2024-04-24T01:16:46.360 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T01:16:46.361 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --name teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi --verbose --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} --archive /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589 -- /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/orig.config.yaml 2024-04-24T01:16:46.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T01:16:46.479 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7670589' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 9360 sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKmHKZqzMaAgEnwkniG11fGFN3dZsarTy3AinwC2g+0grC//8S6sQ29ji6FBNKJn4Y4VrPUoGVbOR5wUC5CqRI= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExoVtdYFlpOaruRpHdKJsC+XPHSFA1jKOnqKCAVNQl4VpLjl/Il5+rKyMQbCUo5QXVmCQ/0dv+RtYPh2OyH0iE= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T01:16:46.479 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa; will attempt to use it 2024-04-24T01:16:46.480 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa/tasks 2024-04-24T01:16:46.480 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T01:16:46.482 INFO:teuthology.task.internal:Checking packages... 2024-04-24T01:16:46.506 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b98aab6c00f483888c049d0d8e7bc507e115dd86' 2024-04-24T01:16:46.506 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T01:16:46.506 INFO:teuthology.packaging:ref: None 2024-04-24T01:16:46.506 INFO:teuthology.packaging:tag: None 2024-04-24T01:16:46.506 INFO:teuthology.packaging:branch: squid 2024-04-24T01:16:46.506 INFO:teuthology.packaging:sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:16:46.507 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-24T01:16:46.847 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2424.gb98aab6c 2024-04-24T01:16:46.848 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T01:16:46.855 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T01:16:46.855 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T01:16:46.874 INFO:teuthology.task.internal:Saving configuration 2024-04-24T01:16:46.886 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T01:16:46.893 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T01:16:46.915 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:11:32.134568', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKmHKZqzMaAgEnwkniG11fGFN3dZsarTy3AinwC2g+0grC//8S6sQ29ji6FBNKJn4Y4VrPUoGVbOR5wUC5CqRI='} 2024-04-24T01:16:46.934 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:11:32.133037', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExoVtdYFlpOaruRpHdKJsC+XPHSFA1jKOnqKCAVNQl4VpLjl/Il5+rKyMQbCUo5QXVmCQ/0dv+RtYPh2OyH0iE='} 2024-04-24T01:16:46.935 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T01:16:46.941 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-04-24T01:16:46.941 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-24T01:16:46.941 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T01:16:47.013 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7febf1891e50>, signals=[15]) 2024-04-24T01:16:47.013 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T01:16:47.076 INFO:teuthology.task.internal:Opening connections... 2024-04-24T01:16:47.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T01:16:47.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:16:47.183 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:16:47.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:16:47.274 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T01:16:47.627 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2024-04-24T01:16:47.647 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2024-04-24T01:16:47.647 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="9" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="9" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:16:47.665 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:16:47.666 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:16:47.666 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2024-04-24T01:16:47.698 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-24T01:16:47.717 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-24T01:16:47.717 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:16:47.774 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:16:47.775 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:16:47.775 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:16:47.775 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:16:47.775 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-24T01:16:47.797 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T01:16:47.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T01:16:47.812 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T01:16:47.812 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:16:47.815 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:16:47.830 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T01:16:47.836 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T01:16:47.836 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:16:47.872 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:16:47.987 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T01:16:48.038 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T01:16:48.054 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-24T01:16:48.054 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-24T01:16:48.054 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:16:48.055 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:16:48.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:16:48.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:16:48.075 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-24T01:16:48.075 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2024-04-24T01:16:48.131 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:16:48.131 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.14.0-437.el9.x86_64 2024-04-24T01:16:48.132 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum install -y kernel 2024-04-24T01:16:48.133 INFO:teuthology.orchestra.run.smithi142.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:16:48.133 INFO:teuthology.task.kernel:Running kernel on smithi142: 5.14.0-437.el9.x86_64 2024-04-24T01:16:48.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2024-04-24T01:16:50.480 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-24T01:16:51.919 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.0 MB 00:02 2024-04-24T01:16:52.831 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-24T01:16:54.361 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 14 MB/s | 19 MB 00:01 2024-04-24T01:16:57.123 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-24T01:16:58.784 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 16 kB 00:00 2024-04-24T01:16:59.395 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 4.4 MB/s | 6.2 MB 00:01 2024-04-24T01:17:00.528 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-24T01:17:02.815 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 7.8 kB/s | 16 kB 00:02 2024-04-24T01:17:04.567 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-24T01:17:05.541 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-24T01:17:07.431 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:17:07.431 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:17:07.528 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:17:07.529 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:17:07.529 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:17:07.648 DEBUG:teuthology.orchestra.run.smithi142:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:17:08.147 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:17:05 AM UTC. 2024-04-24T01:17:08.268 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalling: 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:17:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 255 k 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 0 2024-04-24T01:17:08.278 INFO:teuthology.orchestra.run.smithi142.stderr:Operation aborted. 2024-04-24T01:17:08.332 INFO:teuthology.orchestra.run.smithi142.stdout:Is this ok [y/N]: 2024-04-24T01:17:08.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum reinstall -y kernel || true 2024-04-24T01:17:08.831 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:17:05 AM UTC. 2024-04-24T01:17:08.947 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:17:08.948 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.948 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-24T01:17:08.948 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.948 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalling: 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 255 k 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 0 2024-04-24T01:17:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:17:09.630 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-24T01:17:10.143 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-437.el9.x86_64.rpm 238 kB/s | 255 kB 00:01 2024-04-24T01:17:10.143 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:17:10.143 INFO:teuthology.orchestra.run.smithi142.stdout:Total 213 kB/s | 255 kB 00:01 2024-04-24T01:17:10.165 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:17:10.384 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:17:10.384 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:17:10.389 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:17:10.389 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:17:10.517 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:17:10.594 INFO:teuthology.orchestra.run.smithi142.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:17:10.595 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:11.217 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:17:11.479 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:17:11.479 INFO:teuthology.orchestra.run.smithi169.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:17:11.569 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:17:11.570 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:17:11.570 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:17:11.670 DEBUG:teuthology.orchestra.run.smithi169:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:17:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:11.926 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:11.926 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalled: 2024-04-24T01:17:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:17:11.927 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:17:11.927 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:17:12.099 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:17:12.146 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:17:12.146 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:17:12.146 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:17:12.147 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T01:17:12.147 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:17:12.176 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2024-04-24T01:17:12.205 DEBUG:teuthology.parallel:result is None 2024-04-24T01:17:12.212 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:17:09 AM UTC. 2024-04-24T01:17:12.342 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalling: 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:12.350 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:12.351 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 255 k 2024-04-24T01:17:12.351 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 0 2024-04-24T01:17:12.351 INFO:teuthology.orchestra.run.smithi169.stderr:Operation aborted. 2024-04-24T01:17:12.410 INFO:teuthology.orchestra.run.smithi169.stdout:Is this ok [y/N]: 2024-04-24T01:17:12.411 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum reinstall -y kernel || true 2024-04-24T01:17:12.905 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:17:09 AM UTC. 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalling: 2024-04-24T01:17:13.020 INFO:teuthology.orchestra.run.smithi169.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 255 k 2024-04-24T01:17:13.021 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 0 2024-04-24T01:17:13.022 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:17:13.325 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2024-04-24T01:17:13.325 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:17:13.325 INFO:teuthology.orchestra.run.smithi169.stdout:Total 840 kB/s | 255 kB 00:00 2024-04-24T01:17:13.344 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:17:13.505 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:17:13.505 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:17:13.510 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:17:13.510 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:17:13.649 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:17:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:17:13.734 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:14.475 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:14.475 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:17:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:17:15.161 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:15.162 INFO:teuthology.orchestra.run.smithi169.stdout:Reinstalled: 2024-04-24T01:17:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:17:15.162 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:17:15.162 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:17:15.320 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:17:15.367 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:17:15.367 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:17:15.367 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:17:15.367 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-24T01:17:15.368 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:17:15.408 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-04-24T01:17:15.421 DEBUG:teuthology.parallel:result is None 2024-04-24T01:17:15.422 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T01:17:15.433 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T01:17:15.433 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:17:15.436 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:17:15.476 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T01:17:15.485 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T01:17:15.492 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T01:17:15.492 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:17:15.495 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:17:15.780 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T01:17:15.788 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T01:17:15.789 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:17:15.791 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:17:15.825 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:17:15.826 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:17:15.834 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:17:15.837 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:17:15.839 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T01:17:15.847 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T01:17:15.847 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:17:15.882 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:17:15.907 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T01:17:15.916 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T01:17:15.916 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:17:15.949 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:17:15.964 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:17:16.054 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:17:16.144 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:17:16.187 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:17:16.229 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:17:16.229 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:17:16.294 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:17:16.336 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:17:16.381 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:17:16.462 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:17:16.502 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:17:16.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:17:16.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2024-04-24T01:17:16.569 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-04-24T01:17:16.611 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:17:16.642 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:17:17.126 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T01:17:17.134 INFO:teuthology.task.internal:Starting timer... 2024-04-24T01:17:17.134 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T01:17:17.148 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T01:17:17.158 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T01:17:17.159 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2024-04-24T01:17:17.209 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2024-04-24T01:17:17.211 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-04-24T01:17:17.272 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-04-24T01:17:17.274 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T01:17:17.274 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2024-04-24T01:17:17.299 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2024-04-24T01:17:17.299 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-04-24T01:17:17.321 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-04-24T01:17:17.321 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-04-24T01:17:17.322 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:17:17.365 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:17:17.365 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:17:17.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:17:17.390 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T01:17:17.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:17:17.430 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:17:17.458 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T01:17:17.468 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T01:17:17.485 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T01:17:17.486 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T01:20:44.998 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-04-24T01:20:44.999 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T01:20:45.000 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:20:45.077 DEBUG:teuthology.orchestra.run.smithi142:> true 2024-04-24T01:20:45.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2024-04-24T01:20:45.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-24T01:20:45.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:20:45.227 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-24T01:20:45.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-24T01:20:45.265 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T01:20:45.275 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T01:20:45.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:20:45.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:20:45.278 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:20:45.278 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:20:45.301 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:20:45.314 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:20:45.333 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:20:45.337 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2024-04-24T01:20:45.346 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:20:45.347 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2024-04-24T01:20:45.360 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:20:45.369 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-04-24T01:20:45.372 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:20:45.379 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-04-24T01:20:45.392 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:20:45.405 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:20:45.424 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.427 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.458 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:20:45.461 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:20:45.462 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-04-24T01:20:45.462 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.462 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.462 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.462 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:20:45.463 INFO:teuthology.run_tasks:Running task install... 2024-04-24T01:20:45.471 DEBUG:teuthology.task.install:project ceph 2024-04-24T01:20:45.472 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}} 2024-04-24T01:20:45.472 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'} 2024-04-24T01:20:45.472 INFO:teuthology.task.install:Using flavor: default 2024-04-24T01:20:45.477 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T01:20:45.478 INFO:teuthology.task.install:extra packages: [] 2024-04-24T01:20:45.478 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T01:20:45.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:20:45.480 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-24T01:20:45.481 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:20:45.629 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T01:20:45.629 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T01:20:45.737 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:20:45.738 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:20:45.738 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:20:45.762 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:20:45.762 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:20:45.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:20:45.849 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-24T01:20:45.850 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-24T01:20:45.899 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:20:45.955 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:20:45.955 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:20:45.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:20:45.963 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-04-24T01:20:45.964 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-04-24T01:20:45.979 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:20:45.980 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:20:46.045 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:20:46.118 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:20:46.181 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2024-04-24T01:20:46.182 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2024-04-24T01:20:46.191 INFO:teuthology.orchestra.run.smithi169.stdout:48 files removed 2024-04-24T01:20:46.218 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw 2024-04-24T01:20:46.405 INFO:teuthology.orchestra.run.smithi142.stdout:48 files removed 2024-04-24T01:20:46.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2024-04-24T01:20:46.821 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 241 kB/s | 83 kB 00:00 2024-04-24T01:20:47.167 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 174 kB/s | 83 kB 00:00 2024-04-24T01:20:47.263 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 29 kB/s | 11 kB 00:00 2024-04-24T01:20:47.617 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-24T01:20:47.706 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-24T01:20:48.026 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-04-24T01:20:49.276 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-04-24T01:20:49.881 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 3.8 MB/s | 8.0 MB 00:02 2024-04-24T01:20:53.344 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:02 2024-04-24T01:20:54.724 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 5.0 MB/s | 19 MB 00:03 2024-04-24T01:20:59.961 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 6.2 MB 00:03 2024-04-24T01:21:00.716 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-04-24T01:21:02.014 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 16 kB 00:00 2024-04-24T01:21:02.935 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 16 kB 00:01 2024-04-24T01:21:04.705 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 21 MB 00:02 2024-04-24T01:21:05.543 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 21 MB 00:02 2024-04-24T01:21:09.688 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-04-24T01:21:10.568 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-24T01:21:11.838 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:21:11.840 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:11.840 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:21:11.840 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:11.840 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:21:11.841 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T01:21:11.842 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout:Installing weak dependencies: 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:11.843 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout:Install 30 Packages 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 60 M 2024-04-24T01:21:11.844 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:21:12.718 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-24T01:21:12.721 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:21:12.722 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:21:12.723 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:12.724 INFO:teuthology.orchestra.run.smithi169.stdout:Install 30 Packages 2024-04-24T01:21:12.724 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 2 Packages 2024-04-24T01:21:12.724 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:12.724 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 60 M 2024-04-24T01:21:12.724 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:21:13.547 INFO:teuthology.orchestra.run.smithi142.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 4.2 MB/s | 5.4 MB 00:01 2024-04-24T01:21:13.630 INFO:teuthology.orchestra.run.smithi142.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 302 kB/s | 25 kB 00:00 2024-04-24T01:21:13.906 INFO:teuthology.orchestra.run.smithi142.stdout:(3/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 2.6 MB/s | 745 kB 00:00 2024-04-24T01:21:14.140 INFO:teuthology.orchestra.run.smithi142.stdout:(4/32): libradosstriper1-19.0.0-2424.gb98aab6c. 2.1 MB/s | 501 kB 00:00 2024-04-24T01:21:15.756 INFO:teuthology.orchestra.run.smithi142.stdout:(5/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 3.3 MB/s | 5.3 MB 00:01 2024-04-24T01:21:15.831 INFO:teuthology.orchestra.run.smithi142.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 602 kB/s | 45 kB 00:00 2024-04-24T01:21:15.915 INFO:teuthology.orchestra.run.smithi142.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 1.6 MB/s | 133 kB 00:00 2024-04-24T01:21:15.998 INFO:teuthology.orchestra.run.smithi142.stdout:(8/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 1.9 MB/s | 162 kB 00:00 2024-04-24T01:21:16.274 INFO:teuthology.orchestra.run.smithi142.stdout:(9/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 5.2 MB/s | 21 MB 00:04 2024-04-24T01:21:16.299 INFO:teuthology.orchestra.run.smithi142.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 1.0 MB/s | 321 kB 00:00 2024-04-24T01:21:16.382 INFO:teuthology.orchestra.run.smithi142.stdout:(11/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.2 MB/s | 99 kB 00:00 2024-04-24T01:21:16.491 INFO:teuthology.orchestra.run.smithi142.stdout:(12/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 1.3 MB/s | 299 kB 00:00 2024-04-24T01:21:17.019 INFO:teuthology.orchestra.run.smithi169.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 1.3 MB/s | 5.4 MB 00:04 2024-04-24T01:21:17.211 INFO:teuthology.orchestra.run.smithi169.stdout:(2/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 5.0 MB/s | 21 MB 00:04 2024-04-24T01:21:17.236 INFO:teuthology.orchestra.run.smithi169.stdout:(3/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 116 kB/s | 25 kB 00:00 2024-04-24T01:21:17.308 INFO:teuthology.orchestra.run.smithi142.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 115 kB/s | 107 kB 00:00 2024-04-24T01:21:17.361 INFO:teuthology.orchestra.run.smithi169.stdout:(4/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 4.9 MB/s | 745 kB 00:00 2024-04-24T01:21:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 172 kB/s | 160 kB 00:00 2024-04-24T01:21:17.612 INFO:teuthology.orchestra.run.smithi169.stdout:(5/32): libradosstriper1-19.0.0-2424.gb98aab6c. 1.3 MB/s | 501 kB 00:00 2024-04-24T01:21:17.704 INFO:teuthology.orchestra.run.smithi169.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 493 kB/s | 45 kB 00:00 2024-04-24T01:21:17.837 INFO:teuthology.orchestra.run.smithi169.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 998 kB/s | 133 kB 00:00 2024-04-24T01:21:17.954 INFO:teuthology.orchestra.run.smithi169.stdout:(8/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 9.0 MB/s | 5.3 MB 00:00 2024-04-24T01:21:18.004 INFO:teuthology.orchestra.run.smithi169.stdout:(9/32): python3-rados-19.0.0-2424.gb98aab6c.el9 6.3 MB/s | 321 kB 00:00 2024-04-24T01:21:18.021 INFO:teuthology.orchestra.run.smithi169.stdout:(10/32): python3-cephfs-19.0.0-2424.gb98aab6c.e 882 kB/s | 162 kB 00:00 2024-04-24T01:21:18.071 INFO:teuthology.orchestra.run.smithi169.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 4.4 MB/s | 299 kB 00:00 2024-04-24T01:21:18.091 INFO:teuthology.orchestra.run.smithi142.stdout:(15/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9 1.8 MB/s | 10 MB 00:05 2024-04-24T01:21:18.096 INFO:teuthology.orchestra.run.smithi169.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.3 MB/s | 99 kB 00:00 2024-04-24T01:21:18.117 INFO:teuthology.orchestra.run.smithi142.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 56 kB/s | 45 kB 00:00 2024-04-24T01:21:18.238 INFO:teuthology.orchestra.run.smithi169.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 641 kB/s | 107 kB 00:00 2024-04-24T01:21:18.272 INFO:teuthology.orchestra.run.smithi169.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 914 kB/s | 160 kB 00:00 2024-04-24T01:21:18.289 INFO:teuthology.orchestra.run.smithi169.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-04-24T01:21:18.422 INFO:teuthology.orchestra.run.smithi169.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-24T01:21:18.474 INFO:teuthology.orchestra.run.smithi169.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 846 kB/s | 42 kB 00:00 2024-04-24T01:21:18.590 INFO:teuthology.orchestra.run.smithi169.stdout:(18/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9 1.8 MB/s | 10 MB 00:05 2024-04-24T01:21:18.624 INFO:teuthology.orchestra.run.smithi169.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.8 MB/s | 662 kB 00:00 2024-04-24T01:21:18.650 INFO:teuthology.orchestra.run.smithi169.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-04-24T01:21:18.674 INFO:teuthology.orchestra.run.smithi169.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-04-24T01:21:18.758 INFO:teuthology.orchestra.run.smithi169.stdout:(22/32): qatlib-service-24.02.0-1.el9.x86_64.rp 215 kB/s | 36 kB 00:00 2024-04-24T01:21:18.767 INFO:teuthology.orchestra.run.smithi142.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 65 kB/s | 42 kB 00:00 2024-04-24T01:21:18.949 INFO:teuthology.orchestra.run.smithi169.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 136 kB/s | 26 kB 00:00 2024-04-24T01:21:18.974 INFO:teuthology.orchestra.run.smithi169.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 948 kB/s | 309 kB 00:00 2024-04-24T01:21:18.992 INFO:teuthology.orchestra.run.smithi142.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 423 kB/s | 662 kB 00:01 2024-04-24T01:21:19.033 INFO:teuthology.orchestra.run.smithi169.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-24T01:21:19.051 INFO:teuthology.orchestra.run.smithi142.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 305 kB/s | 292 kB 00:00 2024-04-24T01:21:19.058 INFO:teuthology.orchestra.run.smithi169.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 446 kB/s | 49 kB 00:00 2024-04-24T01:21:19.159 INFO:teuthology.orchestra.run.smithi169.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-24T01:21:19.226 INFO:teuthology.orchestra.run.smithi169.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-04-24T01:21:19.497 INFO:teuthology.orchestra.run.smithi169.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 4.7 MB/s | 1.6 MB 00:00 2024-04-24T01:21:19.578 INFO:teuthology.orchestra.run.smithi169.stdout:(30/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-04-24T01:21:19.634 INFO:teuthology.orchestra.run.smithi142.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 56 kB/s | 36 kB 00:00 2024-04-24T01:21:19.651 INFO:teuthology.orchestra.run.smithi142.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 250 kB/s | 221 kB 00:00 2024-04-24T01:21:19.718 INFO:teuthology.orchestra.run.smithi142.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 71 kB/s | 47 kB 00:00 2024-04-24T01:21:19.963 INFO:teuthology.orchestra.run.smithi169.stdout:(31/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 6.7 MB/s | 3.1 MB 00:00 2024-04-24T01:21:19.976 INFO:teuthology.orchestra.run.smithi142.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 101 kB/s | 26 kB 00:00 2024-04-24T01:21:20.194 INFO:teuthology.orchestra.run.smithi142.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 224 kB/s | 49 kB 00:00 2024-04-24T01:21:20.219 INFO:teuthology.orchestra.run.smithi142.stdout:(25/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 529 kB/s | 309 kB 00:00 2024-04-24T01:21:20.386 INFO:teuthology.orchestra.run.smithi142.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 351 kB/s | 67 kB 00:00 2024-04-24T01:21:20.511 INFO:teuthology.orchestra.run.smithi142.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-04-24T01:21:20.611 INFO:teuthology.orchestra.run.smithi142.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 4.6 MB/s | 4.4 MB 00:00 2024-04-24T01:21:20.637 INFO:teuthology.orchestra.run.smithi142.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 764 kB/s | 192 kB 00:00 2024-04-24T01:21:20.762 INFO:teuthology.orchestra.run.smithi142.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-04-24T01:21:20.796 INFO:teuthology.orchestra.run.smithi169.stdout:(32/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 2.2 MB/s | 3.4 MB 00:01 2024-04-24T01:21:20.801 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:21:20.801 INFO:teuthology.orchestra.run.smithi169.stdout:Total 7.4 MB/s | 60 MB 00:08 2024-04-24T01:21:20.905 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:21:20.941 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:21:20.941 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:21:21.045 INFO:teuthology.orchestra.run.smithi142.stdout:(31/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 7.8 MB/s | 3.4 MB 00:00 2024-04-24T01:21:21.304 INFO:teuthology.orchestra.run.smithi142.stdout:(32/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 4.7 MB/s | 3.1 MB 00:00 2024-04-24T01:21:21.307 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:21:21.307 INFO:teuthology.orchestra.run.smithi142.stdout:Total 6.3 MB/s | 60 MB 00:09 2024-04-24T01:21:21.403 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:21:21.403 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:21:21.412 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:21:21.449 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:21:21.449 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:21:21.911 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:21:21.912 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:21:22.881 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:21:22.971 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:21:23.061 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T01:21:23.093 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T01:21:23.116 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:21:23.138 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:21:23.333 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:21:23.388 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:21:23.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:21:23.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:21:23.501 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-24T01:21:23.526 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-24T01:21:23.549 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:21:23.573 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-24T01:21:23.765 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:21:23.770 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T01:21:23.820 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-24T01:21:23.828 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:23.920 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:24.006 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T01:21:24.046 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:21:24.113 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:21:24.137 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-24T01:21:24.146 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T01:21:24.189 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T01:21:24.244 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:24.257 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:21:24.282 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:21:24.336 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:21:24.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T01:21:24.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-24T01:21:24.445 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:21:24.478 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T01:21:24.491 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-24T01:21:24.514 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T01:21:24.520 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-24T01:21:24.554 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T01:21:24.563 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-24T01:21:24.579 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T01:21:24.608 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T01:21:24.642 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:21:24.642 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T01:21:24.667 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:21:24.728 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-24T01:21:24.762 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-24T01:21:24.869 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-24T01:21:24.896 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-24T01:21:24.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-24T01:21:24.953 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T01:21:24.962 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-24T01:21:24.991 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-24T01:21:24.996 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:21:25.023 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-24T01:21:25.086 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:21:25.117 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T01:21:25.153 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:21:25.335 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-24T01:21:25.377 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:21:25.467 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-24T01:21:25.498 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-24T01:21:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:21:25.625 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:21:25.657 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:21:25.728 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:21:25.806 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T01:21:25.842 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T01:21:26.010 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:21:26.030 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:21:26.084 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-24T01:21:26.162 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-24T01:21:26.190 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-24T01:21:28.096 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:28.197 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:28.484 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:28.521 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:28.739 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:28.776 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:21:28.866 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:21:28.912 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:21:28.912 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:21:28.912 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:28.913 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:29.060 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-24T01:21:29.098 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:21:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-24T01:21:29.189 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:21:29.189 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:21:29.189 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:29.215 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:38.387 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-04-24T01:21:38.388 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /root 2024-04-24T01:21:38.579 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2024-04-24T01:21:38.580 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:39.344 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:21:39.369 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:39.371 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:21:39.455 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:21:39.455 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:39.591 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:21:39.616 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:39.618 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:21:39.701 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:21:39.701 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T01:21:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T01:21:40.698 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:21:40.699 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:21:40.700 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:21:40.701 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-24T01:21:40.887 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:21:40.888 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:21:40.889 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-24T01:21:41.565 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:41.565 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:41.565 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.566 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.567 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.568 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.569 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:21:41.570 INFO:teuthology.orchestra.run.smithi169.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:21:41.571 INFO:teuthology.orchestra.run.smithi169.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:21:41.571 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:21:41.571 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:41.571 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:21:41.631 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:21:41.631 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:41.631 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2024-04-24T01:21:41.631 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.631 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:21:41.632 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:21:41.633 INFO:teuthology.orchestra.run.smithi142.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:21:41.634 INFO:teuthology.orchestra.run.smithi142.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:21:41.634 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:21:41.634 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:41.634 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:21:41.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-test 2024-04-24T01:21:41.904 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2024-04-24T01:21:42.402 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:32 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:21:42.440 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:33 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:21:42.524 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T01:21:42.525 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout:Install 4 Packages 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:42.526 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 49 M 2024-04-24T01:21:42.527 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 207 M 2024-04-24T01:21:42.527 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:21:42.566 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:21:42.566 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:42.566 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout:Install 4 Packages 2024-04-24T01:21:42.567 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:42.568 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 49 M 2024-04-24T01:21:42.568 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 207 M 2024-04-24T01:21:42.568 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:21:42.923 INFO:teuthology.orchestra.run.smithi169.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 691 kB/s | 163 kB 00:00 2024-04-24T01:21:42.965 INFO:teuthology.orchestra.run.smithi169.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 305 kB 00:00 2024-04-24T01:21:43.142 INFO:teuthology.orchestra.run.smithi169.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 291 kB/s | 64 kB 00:00 2024-04-24T01:21:43.144 INFO:teuthology.orchestra.run.smithi142.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 704 kB/s | 163 kB 00:00 2024-04-24T01:21:43.371 INFO:teuthology.orchestra.run.smithi142.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 282 kB/s | 64 kB 00:00 2024-04-24T01:21:43.405 INFO:teuthology.orchestra.run.smithi142.stdout:(3/4): socat-1.7.4.1-5.el9.x86_64.rpm 618 kB/s | 305 kB 00:00 2024-04-24T01:21:46.819 INFO:teuthology.orchestra.run.smithi142.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 12 MB/s | 48 MB 00:03 2024-04-24T01:21:46.821 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:21:46.821 INFO:teuthology.orchestra.run.smithi142.stdout:Total 11 MB/s | 49 MB 00:04 2024-04-24T01:21:46.844 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:21:46.862 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:21:46.862 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:21:47.227 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:21:47.227 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:21:47.754 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:21:47.835 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T01:21:47.876 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T01:21:47.904 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:21:48.400 INFO:teuthology.orchestra.run.smithi169.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 8.5 MB/s | 48 MB 00:05 2024-04-24T01:21:48.403 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:21:48.403 INFO:teuthology.orchestra.run.smithi169.stdout:Total 8.3 MB/s | 49 MB 00:05 2024-04-24T01:21:48.430 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:21:48.450 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:21:48.451 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:21:48.818 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:21:48.819 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:21:49.340 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:21:49.426 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-24T01:21:49.465 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-24T01:21:49.493 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:21:52.438 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:21:52.517 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:21:54.012 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-24T01:21:54.149 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:21:54.783 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:21:54.783 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T01:21:54.783 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T01:21:54.783 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T01:21:55.029 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:55.030 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:21:55.314 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2024-04-24T01:21:55.836 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:46 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:21:55.965 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T01:21:55.969 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:21:55.970 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:21:55.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout:Install 36 Packages 2024-04-24T01:21:55.972 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:21:55.973 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 M 2024-04-24T01:21:55.973 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 107 M 2024-04-24T01:21:55.973 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:21:56.458 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-24T01:21:56.458 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-24T01:21:56.458 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-24T01:21:56.458 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-24T01:21:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-24T01:21:56.724 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:56.724 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:56.725 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:21:56.927 INFO:teuthology.orchestra.run.smithi142.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 30 kB/s | 6.6 kB 00:00 2024-04-24T01:21:56.998 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph 2024-04-24T01:21:57.127 INFO:teuthology.orchestra.run.smithi142.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 3.6 MB/s | 1.5 MB 00:00 2024-04-24T01:21:57.508 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:00:47 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:21:57.511 INFO:teuthology.orchestra.run.smithi142.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 3.0 MB/s | 2.4 MB 00:00 2024-04-24T01:21:57.586 INFO:teuthology.orchestra.run.smithi142.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 3.3 MB/s | 249 kB 00:00 2024-04-24T01:21:57.634 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-24T01:21:57.637 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:21:57.638 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:21:57.639 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout:Install 36 Packages 2024-04-24T01:21:57.640 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:21:57.641 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 30 M 2024-04-24T01:21:57.641 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 107 M 2024-04-24T01:21:57.641 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:21:57.878 INFO:teuthology.orchestra.run.smithi142.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 868 kB/s | 253 kB 00:00 2024-04-24T01:21:57.953 INFO:teuthology.orchestra.run.smithi142.stdout:(6/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 4.6 MB/s | 4.7 MB 00:01 2024-04-24T01:21:58.195 INFO:teuthology.orchestra.run.smithi142.stdout:(7/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86_ 16 MB/s | 17 MB 00:01 2024-04-24T01:21:58.237 INFO:teuthology.orchestra.run.smithi142.stdout:(8/36): python3-cryptography-36.0.1-4.el9.x86_6 3.4 MB/s | 1.2 MB 00:00 2024-04-24T01:21:58.288 INFO:teuthology.orchestra.run.smithi142.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 319 kB/s | 106 kB 00:00 2024-04-24T01:21:58.312 INFO:teuthology.orchestra.run.smithi142.stdout:(10/36): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-04-24T01:21:58.318 INFO:teuthology.orchestra.run.smithi169.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-04-24T01:21:58.421 INFO:teuthology.orchestra.run.smithi142.stdout:(11/36): python3-pycparser-2.20-6.el9.noarch.rp 600 kB/s | 135 kB 00:00 2024-04-24T01:21:58.446 INFO:teuthology.orchestra.run.smithi142.stdout:(12/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.3 MB/s | 215 kB 00:00 2024-04-24T01:21:58.471 INFO:teuthology.orchestra.run.smithi142.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-04-24T01:21:58.494 INFO:teuthology.orchestra.run.smithi169.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 3.7 MB/s | 1.5 MB 00:00 2024-04-24T01:21:58.505 INFO:teuthology.orchestra.run.smithi142.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 593 kB/s | 35 kB 00:00 2024-04-24T01:21:58.547 INFO:teuthology.orchestra.run.smithi142.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 999 kB/s | 42 kB 00:00 2024-04-24T01:21:58.572 INFO:teuthology.orchestra.run.smithi142.stdout:(16/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-24T01:21:58.586 INFO:teuthology.orchestra.run.smithi169.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 4.7 MB/s | 2.4 MB 00:00 2024-04-24T01:21:58.612 INFO:teuthology.orchestra.run.smithi142.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 363 kB/s | 51 kB 00:00 2024-04-24T01:21:58.636 INFO:teuthology.orchestra.run.smithi169.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 4.9 MB/s | 249 kB 00:00 2024-04-24T01:21:58.714 INFO:teuthology.orchestra.run.smithi142.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-04-24T01:21:58.774 INFO:teuthology.orchestra.run.smithi142.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 270 kB/s | 43 kB 00:00 2024-04-24T01:21:58.815 INFO:teuthology.orchestra.run.smithi142.stdout:(20/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-04-24T01:21:58.882 INFO:teuthology.orchestra.run.smithi142.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-04-24T01:21:58.907 INFO:teuthology.orchestra.run.smithi142.stdout:(22/36): luarocks-3.9.2-1.el9.noarch.rpm 452 kB/s | 151 kB 00:00 2024-04-24T01:21:58.919 INFO:teuthology.orchestra.run.smithi169.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 894 kB/s | 253 kB 00:00 2024-04-24T01:21:58.932 INFO:teuthology.orchestra.run.smithi142.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 91 kB/s | 11 kB 00:00 2024-04-24T01:21:58.957 INFO:teuthology.orchestra.run.smithi142.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 235 kB/s | 18 kB 00:00 2024-04-24T01:21:58.983 INFO:teuthology.orchestra.run.smithi142.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 463 kB/s | 23 kB 00:00 2024-04-24T01:21:59.000 INFO:teuthology.orchestra.run.smithi142.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 291 kB/s | 19 kB 00:00 2024-04-24T01:21:59.024 INFO:teuthology.orchestra.run.smithi142.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 294 kB/s | 20 kB 00:00 2024-04-24T01:21:59.050 INFO:teuthology.orchestra.run.smithi142.stdout:(28/36): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-04-24T01:21:59.075 INFO:teuthology.orchestra.run.smithi142.stdout:(29/36): python3-logutils-0.3.5-21.el9.noarch.r 616 kB/s | 46 kB 00:00 2024-04-24T01:21:59.109 INFO:teuthology.orchestra.run.smithi142.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-24T01:21:59.126 INFO:teuthology.orchestra.run.smithi142.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 219 kB/s | 16 kB 00:00 2024-04-24T01:21:59.151 INFO:teuthology.orchestra.run.smithi142.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-04-24T01:21:59.168 INFO:teuthology.orchestra.run.smithi142.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 614 kB/s | 36 kB 00:00 2024-04-24T01:21:59.235 INFO:teuthology.orchestra.run.smithi142.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-04-24T01:21:59.260 INFO:teuthology.orchestra.run.smithi142.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-04-24T01:21:59.261 INFO:teuthology.orchestra.run.smithi169.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 3.6 MB/s | 1.2 MB 00:00 2024-04-24T01:21:59.277 INFO:teuthology.orchestra.run.smithi142.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-04-24T01:21:59.281 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:21:59.281 INFO:teuthology.orchestra.run.smithi142.stdout:Total 9.1 MB/s | 30 MB 00:03 2024-04-24T01:21:59.337 INFO:teuthology.orchestra.run.smithi169.stdout:(7/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 4.6 MB/s | 4.7 MB 00:01 2024-04-24T01:21:59.362 INFO:teuthology.orchestra.run.smithi169.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-24T01:21:59.420 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:21:59.420 INFO:teuthology.orchestra.run.smithi169.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-04-24T01:21:59.460 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:21:59.460 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:21:59.521 INFO:teuthology.orchestra.run.smithi169.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.1 MB/s | 215 kB 00:00 2024-04-24T01:21:59.580 INFO:teuthology.orchestra.run.smithi169.stdout:(11/36): python3-pycparser-2.20-6.el9.noarch.rp 558 kB/s | 135 kB 00:00 2024-04-24T01:21:59.696 INFO:teuthology.orchestra.run.smithi169.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-04-24T01:21:59.722 INFO:teuthology.orchestra.run.smithi169.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 940 kB/s | 188 kB 00:00 2024-04-24T01:21:59.755 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:21:59.755 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:21:59.789 INFO:teuthology.orchestra.run.smithi169.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 378 kB/s | 35 kB 00:00 2024-04-24T01:21:59.814 INFO:teuthology.orchestra.run.smithi169.stdout:(15/36): python3-pytz-2021.1-5.el9.noarch.rpm 555 kB/s | 51 kB 00:00 2024-04-24T01:21:59.867 INFO:teuthology.orchestra.run.smithi169.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 529 kB/s | 42 kB 00:00 2024-04-24T01:21:59.906 INFO:teuthology.orchestra.run.smithi169.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-04-24T01:22:00.240 INFO:teuthology.orchestra.run.smithi169.stdout:(18/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86 9.6 MB/s | 17 MB 00:01 2024-04-24T01:22:00.265 INFO:teuthology.orchestra.run.smithi169.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 121 kB/s | 43 kB 00:00 2024-04-24T01:22:00.374 INFO:teuthology.orchestra.run.smithi169.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 299 kB/s | 151 kB 00:00 2024-04-24T01:22:00.557 INFO:teuthology.orchestra.run.smithi169.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 58 kB/s | 11 kB 00:00 2024-04-24T01:22:00.674 INFO:teuthology.orchestra.run.smithi169.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 396 kB/s | 172 kB 00:00 2024-04-24T01:22:00.816 INFO:teuthology.orchestra.run.smithi169.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 68 kB/s | 18 kB 00:00 2024-04-24T01:22:00.850 INFO:teuthology.orchestra.run.smithi169.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 613 kB/s | 358 kB 00:00 2024-04-24T01:22:00.950 INFO:teuthology.orchestra.run.smithi169.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 84 kB/s | 23 kB 00:00 2024-04-24T01:22:01.003 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:01.054 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:22:01.084 INFO:teuthology.orchestra.run.smithi169.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 73 kB/s | 19 kB 00:00 2024-04-24T01:22:01.104 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:22:01.126 INFO:teuthology.orchestra.run.smithi169.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 71 kB/s | 20 kB 00:00 2024-04-24T01:22:01.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:22:01.212 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:22:01.273 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:22:01.284 INFO:teuthology.orchestra.run.smithi169.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 139 kB/s | 46 kB 00:00 2024-04-24T01:22:01.305 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:22:01.398 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:22:01.476 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:22:01.509 INFO:teuthology.orchestra.run.smithi169.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 185 kB/s | 79 kB 00:00 2024-04-24T01:22:01.516 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:22:01.535 INFO:teuthology.orchestra.run.smithi169.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 66 kB/s | 16 kB 00:00 2024-04-24T01:22:01.551 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:22:01.580 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:22:01.614 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:22:01.626 INFO:teuthology.orchestra.run.smithi169.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 544 kB/s | 272 kB 00:00 2024-04-24T01:22:01.648 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:22:01.706 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:22:01.749 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:22:01.775 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:22:01.813 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:22:01.818 INFO:teuthology.orchestra.run.smithi169.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 126 kB/s | 36 kB 00:00 2024-04-24T01:22:01.852 INFO:teuthology.orchestra.run.smithi169.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 263 kB/s | 90 kB 00:00 2024-04-24T01:22:01.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:22:02.025 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:22:02.105 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:22:02.119 INFO:teuthology.orchestra.run.smithi169.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 75 kB/s | 20 kB 00:00 2024-04-24T01:22:02.144 INFO:teuthology.orchestra.run.smithi169.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 444 kB/s | 230 kB 00:00 2024-04-24T01:22:02.157 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:22:02.195 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:22:02.244 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:22:02.300 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:22:02.403 INFO:teuthology.orchestra.run.smithi169.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 732 kB/s | 427 kB 00:00 2024-04-24T01:22:02.406 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:02.406 INFO:teuthology.orchestra.run.smithi169.stdout:Total 6.3 MB/s | 30 MB 00:04 2024-04-24T01:22:02.486 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:22:02.545 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:02.549 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:22:02.584 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:02.584 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:02.628 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:22:02.716 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:22:02.765 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:22:02.879 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:02.881 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:02.886 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:22:03.046 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T01:22:03.075 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:22:03.101 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:04.127 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:04.197 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:22:04.230 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:22:04.257 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:22:04.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:22:04.365 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:22:04.398 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:22:04.490 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:22:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:22:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:22:04.561 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:04.561 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:22:04.561 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:22:04.561 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:22:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:04.569 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:22:04.618 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:22:04.652 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:22:04.682 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:22:04.717 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:22:04.750 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:22:04.790 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:22:04.842 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:22:04.877 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:22:04.906 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:22:04.983 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:22:05.001 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:22:05.024 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:22:05.025 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:05.025 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:22:05.025 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:22:05.025 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:22:05.025 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:05.130 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:22:05.216 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:22:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:22:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:22:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:22:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:22:05.267 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:22:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:05.293 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:22:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:22:05.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:22:05.389 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:22:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:22:05.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:22:05.711 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:22:05.790 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:22:05.887 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:22:05.926 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:22:06.046 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:22:06.207 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-24T01:22:06.236 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:22:06.262 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-24T01:22:06.262 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:06.262 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:22:06.262 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:22:06.262 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:22:06.263 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:22:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:22:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:22:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:22:07.696 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:22:07.722 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-24T01:22:07.722 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:07.722 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:22:07.723 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:22:07.723 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:22:07.723 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:22:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:07.961 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:22:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:22:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:22:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:22:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:22:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:22:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:07.965 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:08.171 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:22:08.194 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-24T01:22:08.195 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:08.195 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:22:08.195 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:22:08.195 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:22:08.195 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:08.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2024-04-24T01:22:08.422 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:22:08.445 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:08.509 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:22:08.829 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:59 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:08.907 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:08.948 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:08.949 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:09.038 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2024-04-24T01:22:09.540 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:00 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:09.659 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 762 k 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 768 k 2024-04-24T01:22:09.660 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:09.958 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 2.5 MB/s | 762 kB 00:00 2024-04-24T01:22:09.959 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:09.959 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 762 kB 00:00 2024-04-24T01:22:09.959 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:09.964 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:09.964 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:09.970 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:09.970 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:10.042 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:22:10.197 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:22:10.198 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:22:10.199 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:22:10.200 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:22:10.200 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:22:10.200 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:22:10.200 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:22:10.200 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:22:10.526 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:10.610 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:10.982 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:11.081 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:22:11.082 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:22:11.083 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:11.084 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:11.214 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:11.215 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:11.215 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:11.215 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:11.215 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:11.215 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:11.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:22:11.424 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-base 2024-04-24T01:22:11.928 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:02 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:11.934 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:01 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:12.013 INFO:teuthology.orchestra.run.smithi169.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:12.049 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:12.050 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:22:12.051 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:12.051 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 145 k 2024-04-24T01:22:12.051 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 435 k 2024-04-24T01:22:12.051 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:12.054 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:12.055 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:22:12.056 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:12.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install cephadm 2024-04-24T01:22:12.355 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 475 kB/s | 145 kB 00:00 2024-04-24T01:22:12.356 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:12.356 INFO:teuthology.orchestra.run.smithi142.stdout:Total 472 kB/s | 145 kB 00:00 2024-04-24T01:22:12.356 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:12.364 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:12.364 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:12.420 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:12.421 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:12.569 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:12.624 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:02 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:12.656 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:12.681 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:12.681 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:12.681 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:22:12.681 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:12.743 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:12.744 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:12.744 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:12.744 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:12.744 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:12.744 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 762 k 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 768 k 2024-04-24T01:22:12.745 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:13.179 INFO:teuthology.orchestra.run.smithi169.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-24T01:22:13.180 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:13.180 INFO:teuthology.orchestra.run.smithi169.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-24T01:22:13.180 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:13.185 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:13.185 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:13.191 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:13.191 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:13.259 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:13.582 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:13.583 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:13.583 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:13.583 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:13.755 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:13.822 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2024-04-24T01:22:13.856 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:14.185 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:14.335 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:05 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:14.414 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-24T01:22:14.414 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:14.414 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:14.414 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:14.414 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:14.415 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:14.415 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:14.458 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:14.460 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:14.460 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:14.535 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:22:14.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:22:15.039 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:06 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:15.157 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:05 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:15.160 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:15.161 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T01:22:15.162 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T01:22:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:22:15.165 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-04-24T01:22:15.166 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 8.6 M 2024-04-24T01:22:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 103 M 2024-04-24T01:22:15.167 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:15.280 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 145 k 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 435 k 2024-04-24T01:22:15.281 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:15.636 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 409 kB/s | 145 kB 00:00 2024-04-24T01:22:15.636 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:15.637 INFO:teuthology.orchestra.run.smithi169.stdout:Total 407 kB/s | 145 kB 00:00 2024-04-24T01:22:15.637 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:15.644 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:15.645 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:15.701 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:15.701 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:15.767 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 172 kB/s | 32 kB 00:00 2024-04-24T01:22:15.853 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:15.858 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 55 kB/s | 15 kB 00:00 2024-04-24T01:22:15.945 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:15.967 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.0 MB/s | 1.0 MB 00:00 2024-04-24T01:22:15.969 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:15.970 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:15.970 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:22:15.970 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:16.009 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.8 MB/s | 269 kB 00:00 2024-04-24T01:22:16.068 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 8.4 MB/s | 863 kB 00:00 2024-04-24T01:22:16.318 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 4.8 MB/s | 3.5 MB 00:00 2024-04-24T01:22:16.343 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-04-24T01:22:16.627 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 888 kB/s | 548 kB 00:00 2024-04-24T01:22:16.744 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 263 kB/s | 31 kB 00:00 2024-04-24T01:22:16.778 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 333 kB/s | 144 kB 00:00 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:16.830 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:16.878 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2024-04-24T01:22:16.936 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.3 MB/s | 2.0 MB 00:00 2024-04-24T01:22:16.939 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:16.939 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.9 MB/s | 8.6 MB 00:01 2024-04-24T01:22:16.991 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:17.010 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:17.010 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:17.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-mgr 2024-04-24T01:22:17.164 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:17.165 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:17.569 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:07 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:17.648 INFO:teuthology.orchestra.run.smithi169.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:17.687 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:17.691 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:17.693 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:22:17.693 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:17.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:22:17.770 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T01:22:17.805 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T01:22:17.852 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T01:22:17.890 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T01:22:17.967 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T01:22:18.091 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T01:22:18.176 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T01:22:18.220 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T01:22:18.249 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:22:18.258 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:08 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:18.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T01:22:18.379 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-24T01:22:18.380 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:18.381 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:18.382 INFO:teuthology.orchestra.run.smithi169.stdout:Install 12 Packages 2024-04-24T01:22:18.382 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:18.382 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 8.6 M 2024-04-24T01:22:18.382 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 103 M 2024-04-24T01:22:18.382 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:19.322 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T01:22:19.331 INFO:teuthology.orchestra.run.smithi169.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 164 kB/s | 32 kB 00:00 2024-04-24T01:22:19.356 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:22:19.431 INFO:teuthology.orchestra.run.smithi169.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 52 kB/s | 15 kB 00:00 2024-04-24T01:22:19.623 INFO:teuthology.orchestra.run.smithi169.stdout:(3/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 7.2 MB/s | 3.5 MB 00:00 2024-04-24T01:22:19.807 INFO:teuthology.orchestra.run.smithi169.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.6 MB/s | 863 kB 00:00 2024-04-24T01:22:20.032 INFO:teuthology.orchestra.run.smithi169.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 448 kB/s | 269 kB 00:00 2024-04-24T01:22:20.207 INFO:teuthology.orchestra.run.smithi169.stdout:(6/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-04-24T01:22:20.407 INFO:teuthology.orchestra.run.smithi169.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 52 kB/s | 19 kB 00:00 2024-04-24T01:22:20.582 INFO:teuthology.orchestra.run.smithi169.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 706 kB/s | 548 kB 00:00 2024-04-24T01:22:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:22:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T01:22:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T01:22:20.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T01:22:20.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T01:22:20.694 INFO:teuthology.orchestra.run.smithi169.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 283 kB/s | 31 kB 00:00 2024-04-24T01:22:20.725 INFO:teuthology.orchestra.run.smithi169.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 456 kB/s | 144 kB 00:00 2024-04-24T01:22:20.817 INFO:teuthology.orchestra.run.smithi169.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-04-24T01:22:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T01:22:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:20.970 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:20.970 INFO:teuthology.orchestra.run.smithi142.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:20.971 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:21.150 INFO:teuthology.orchestra.run.smithi169.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-04-24T01:22:21.154 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:21.154 INFO:teuthology.orchestra.run.smithi169.stdout:Total 3.1 MB/s | 8.6 MB 00:02 2024-04-24T01:22:21.201 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:21.218 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:21.237 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:22:21.372 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:21.374 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:21.737 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:12 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:21.859 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:21.860 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:22:21.861 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================= 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout:Install 12 Packages 2024-04-24T01:22:21.862 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:21.863 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 38 M 2024-04-24T01:22:21.863 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 209 M 2024-04-24T01:22:21.863 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:21.894 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:21.984 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-24T01:22:22.028 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-24T01:22:22.074 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-24T01:22:22.104 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-24T01:22:22.182 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-24T01:22:22.307 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-24T01:22:22.400 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-24T01:22:22.444 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-24T01:22:22.471 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:22:22.503 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-24T01:22:22.610 INFO:teuthology.orchestra.run.smithi142.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 485 kB/s | 195 kB 00:00 2024-04-24T01:22:22.701 INFO:teuthology.orchestra.run.smithi142.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-04-24T01:22:22.877 INFO:teuthology.orchestra.run.smithi142.stdout:(3/12): ceph-mgr-diskprediction-local-19.0.0-24 11 MB/s | 7.4 MB 00:00 2024-04-24T01:22:22.969 INFO:teuthology.orchestra.run.smithi142.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 198 kB/s | 18 kB 00:00 2024-04-24T01:22:23.027 INFO:teuthology.orchestra.run.smithi142.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.2 MB/s | 3.0 MB 00:00 2024-04-24T01:22:23.052 INFO:teuthology.orchestra.run.smithi142.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 422 kB/s | 35 kB 00:00 2024-04-24T01:22:23.078 INFO:teuthology.orchestra.run.smithi142.stdout:(7/12): libgfortran-11.4.1-3.el9.x86_64.rpm 922 kB/s | 803 kB 00:00 2024-04-24T01:22:23.178 INFO:teuthology.orchestra.run.smithi142.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.9 MB/s | 244 kB 00:00 2024-04-24T01:22:23.228 INFO:teuthology.orchestra.run.smithi142.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.9 MB/s | 250 kB 00:00 2024-04-24T01:22:23.504 INFO:teuthology.orchestra.run.smithi142.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-04-24T01:22:23.563 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-24T01:22:23.595 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:22:24.029 INFO:teuthology.orchestra.run.smithi142.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-04-24T01:22:24.087 INFO:teuthology.orchestra.run.smithi142.stdout:(12/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.5 MB/s | 4.7 MB 00:01 2024-04-24T01:22:24.088 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:24.088 INFO:teuthology.orchestra.run.smithi142.stdout:Total 17 MB/s | 38 MB 00:02 2024-04-24T01:22:24.432 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:24.457 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:24.457 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:24.863 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:24.863 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-24T01:22:25.028 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-24T01:22:25.029 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-24T01:22:25.029 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-24T01:22:25.029 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:22:25.328 INFO:teuthology.orchestra.run.smithi169.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:22:25.329 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:22:25.329 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:22:25.329 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:25.329 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:25.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:22:25.683 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:25.750 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:22:25.793 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:22:25.893 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:22:25.936 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:22:26.087 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:16 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:26.113 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:22:26.144 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:22:26.208 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:22:26.209 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout:Install 12 Packages 2024-04-24T01:22:26.210 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:26.211 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 38 M 2024-04-24T01:22:26.211 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 209 M 2024-04-24T01:22:26.211 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:26.219 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:22:26.526 INFO:teuthology.orchestra.run.smithi169.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-04-24T01:22:26.568 INFO:teuthology.orchestra.run.smithi169.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-04-24T01:22:26.801 INFO:teuthology.orchestra.run.smithi169.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 119 kB/s | 33 kB 00:00 2024-04-24T01:22:26.876 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:22:26.910 INFO:teuthology.orchestra.run.smithi169.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 168 kB/s | 18 kB 00:00 2024-04-24T01:22:26.981 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:22:27.027 INFO:teuthology.orchestra.run.smithi169.stdout:(5/12): ceph-mgr-diskprediction-local-19.0.0-24 11 MB/s | 7.4 MB 00:00 2024-04-24T01:22:27.052 INFO:teuthology.orchestra.run.smithi169.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 248 kB/s | 35 kB 00:00 2024-04-24T01:22:27.327 INFO:teuthology.orchestra.run.smithi169.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 888 kB/s | 244 kB 00:00 2024-04-24T01:22:27.594 INFO:teuthology.orchestra.run.smithi169.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.9 MB/s | 3.0 MB 00:01 2024-04-24T01:22:27.711 INFO:teuthology.orchestra.run.smithi169.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-04-24T01:22:28.128 INFO:teuthology.orchestra.run.smithi169.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 4.3 MB/s | 4.7 MB 00:01 2024-04-24T01:22:28.228 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:22:28.678 INFO:teuthology.orchestra.run.smithi169.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.8 MB/s | 5.1 MB 00:01 2024-04-24T01:22:29.264 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:22:29.291 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:22:31.237 INFO:teuthology.orchestra.run.smithi169.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.6 MB/s | 16 MB 00:03 2024-04-24T01:22:31.238 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:31.238 INFO:teuthology.orchestra.run.smithi169.stdout:Total 7.6 MB/s | 38 MB 00:05 2024-04-24T01:22:31.586 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:31.612 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:31.613 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:31.723 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:22:31.723 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T01:22:31.723 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:22:31.724 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:22:32.021 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:32.021 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:22:32.073 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:32.444 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:22:32.850 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:32.899 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:22:32.943 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:22:32.962 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:23 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:33.050 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:22:33.085 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:33.086 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:33.086 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:33.086 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:22:33.087 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2024-04-24T01:22:33.088 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:33.089 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 2.2 M 2024-04-24T01:22:33.089 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2024-04-24T01:22:33.089 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:33.102 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:22:33.273 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:22:33.302 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:22:33.378 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:22:33.683 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 278 kB/s | 49 kB 00:00 2024-04-24T01:22:33.725 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 87 kB/s | 19 kB 00:00 2024-04-24T01:22:33.750 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 105 kB/s | 26 kB 00:00 2024-04-24T01:22:33.918 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 828 kB/s | 159 kB 00:00 2024-04-24T01:22:33.993 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-04-24T01:22:34.016 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:22:34.018 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 534 kB/s | 54 kB 00:00 2024-04-24T01:22:34.052 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 603 kB/s | 222 kB 00:00 2024-04-24T01:22:34.140 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:22:34.385 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 82 kB/s | 32 kB 00:00 2024-04-24T01:22:34.410 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 38 kB/s | 15 kB 00:00 2024-04-24T01:22:34.735 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 182 kB/s | 59 kB 00:00 2024-04-24T01:22:34.777 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 283 kB/s | 206 kB 00:00 2024-04-24T01:22:35.069 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 269 kB/s | 90 kB 00:00 2024-04-24T01:22:35.372 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:22:35.845 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 716 kB/s | 1.0 MB 00:01 2024-04-24T01:22:35.845 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:35.846 INFO:teuthology.orchestra.run.smithi142.stdout:Total 817 kB/s | 2.2 MB 00:02 2024-04-24T01:22:35.915 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:35.930 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:35.930 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:36.014 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:36.016 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:36.425 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:22:36.460 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:22:36.521 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:36.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:22:36.753 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:22:36.808 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:22:36.838 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:22:36.879 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:22:36.972 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:22:37.097 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:22:37.147 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:22:37.858 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:22:37.911 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:22:37.945 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:22:37.992 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:22:38.014 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:22:38.739 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:22:38.740 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:22:39.031 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:22:39.032 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:22:39.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:39.053 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:39.315 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:22:39.449 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:22:39.450 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:22:39.451 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:22:39.451 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:22:39.451 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:22:39.451 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:39.451 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:39.816 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:22:39.828 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:30 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:39.949 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:22:39.950 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2024-04-24T01:22:39.951 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:39.952 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 7.0 M 2024-04-24T01:22:39.952 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 33 M 2024-04-24T01:22:39.952 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:40.336 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:30 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:40.456 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:40.457 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:40.457 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:40.457 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:22:40.458 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout:Install 13 Packages 2024-04-24T01:22:40.459 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:40.460 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 2.2 M 2024-04-24T01:22:40.460 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 26 M 2024-04-24T01:22:40.460 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:40.495 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 449 kB/s | 141 kB 00:00 2024-04-24T01:22:40.778 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 415 kB/s | 248 kB 00:00 2024-04-24T01:22:40.812 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.7 MB/s | 548 kB 00:00 2024-04-24T01:22:40.879 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 768 kB/s | 51 kB 00:00 2024-04-24T01:22:40.954 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 329 kB/s | 58 kB 00:00 2024-04-24T01:22:41.085 INFO:teuthology.orchestra.run.smithi169.stdout:(1/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 255 kB/s | 49 kB 00:00 2024-04-24T01:22:41.485 INFO:teuthology.orchestra.run.smithi169.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 43 kB/s | 26 kB 00:00 2024-04-24T01:22:41.502 INFO:teuthology.orchestra.run.smithi169.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 31 kB/s | 19 kB 00:00 2024-04-24T01:22:41.521 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 4.4 MB/s | 6.0 MB 00:01 2024-04-24T01:22:41.521 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:41.521 INFO:teuthology.orchestra.run.smithi142.stdout:Total 4.4 MB/s | 7.0 MB 00:01 2024-04-24T01:22:41.591 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:41.602 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:41.602 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:41.698 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:41.699 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:42.009 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:42.172 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:22:42.185 INFO:teuthology.orchestra.run.smithi169.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 202 kB/s | 222 kB 00:01 2024-04-24T01:22:42.222 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:22:42.494 INFO:teuthology.orchestra.run.smithi169.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 157 kB/s | 159 kB 00:01 2024-04-24T01:22:42.678 INFO:teuthology.orchestra.run.smithi169.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 237 kB/s | 279 kB 00:01 2024-04-24T01:22:42.738 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:22:42.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:22:42.828 INFO:teuthology.orchestra.run.smithi169.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 105 kB/s | 32 kB 00:00 2024-04-24T01:22:42.888 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:22:42.917 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:22:43.011 INFO:teuthology.orchestra.run.smithi169.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 65 kB/s | 54 kB 00:00 2024-04-24T01:22:43.137 INFO:teuthology.orchestra.run.smithi169.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 666 kB/s | 206 kB 00:00 2024-04-24T01:22:43.245 INFO:teuthology.orchestra.run.smithi169.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2024-04-24T01:22:43.337 INFO:teuthology.orchestra.run.smithi169.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 979 kB/s | 90 kB 00:00 2024-04-24T01:22:43.362 INFO:teuthology.orchestra.run.smithi169.stdout:(12/13): python3-certifi-2021.10.8-2.el9.noarch 22 kB/s | 15 kB 00:00 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:22:43.615 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:22:43.621 INFO:teuthology.orchestra.run.smithi169.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.7 MB/s | 1.0 MB 00:00 2024-04-24T01:22:43.625 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:43.625 INFO:teuthology.orchestra.run.smithi169.stdout:Total 712 kB/s | 2.2 MB 00:03 2024-04-24T01:22:43.694 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:43.711 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:43.711 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:43.797 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:43.798 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:22:43.858 INFO:teuthology.orchestra.run.smithi142.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:22:43.859 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:43.859 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:44.108 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2024-04-24T01:22:44.303 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:44.475 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:22:44.550 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:22:44.605 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:22:44.617 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:35 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:44.642 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:22:44.684 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:22:44.738 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-04-24T01:22:44.739 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:44.740 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 969 k 2024-04-24T01:22:44.740 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.8 M 2024-04-24T01:22:44.740 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:44.778 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:22:44.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:22:44.934 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:22:45.372 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 224 kB/s | 80 kB 00:00 2024-04-24T01:22:45.447 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-04-24T01:22:45.447 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:45.448 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.3 MB/s | 969 kB 00:00 2024-04-24T01:22:45.459 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:45.482 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:45.482 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:45.560 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:45.560 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:45.654 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:22:45.708 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:22:45.742 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:22:45.744 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:45.789 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:22:45.811 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:22:45.889 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:22:45.953 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:22:46.522 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-24T01:22:46.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-24T01:22:46.522 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:22:46.523 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:22:46.569 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:22:46.569 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T01:22:46.829 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:22:46.829 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:46.829 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:46.829 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:22:46.830 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:46.830 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:46.839 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:22:46.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:46.839 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:22:46.840 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:46.841 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:47.063 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:22:47.116 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2024-04-24T01:22:47.580 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:37 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:47.637 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:38 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:47.701 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:47.702 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:47.702 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:47.702 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:47.702 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout:Install 6 Packages 2024-04-24T01:22:47.703 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:47.704 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 7.0 M 2024-04-24T01:22:47.704 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 33 M 2024-04-24T01:22:47.704 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:47.759 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:47.759 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:47.759 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2024-04-24T01:22:47.760 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:47.761 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 341 k 2024-04-24T01:22:47.761 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.5 M 2024-04-24T01:22:47.761 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:47.951 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 659 kB/s | 77 kB 00:00 2024-04-24T01:22:48.101 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 986 kB/s | 264 kB 00:00 2024-04-24T01:22:48.102 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:48.102 INFO:teuthology.orchestra.run.smithi142.stdout:Total 999 kB/s | 341 kB 00:00 2024-04-24T01:22:48.113 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:48.123 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:48.123 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:48.149 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:48.149 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:48.284 INFO:teuthology.orchestra.run.smithi169.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-04-24T01:22:48.296 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:48.459 INFO:teuthology.orchestra.run.smithi169.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-24T01:22:48.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:22:48.503 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:22:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:22:48.518 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:48.518 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:22:48.518 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:48.559 INFO:teuthology.orchestra.run.smithi169.stdout:(3/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 325 kB/s | 141 kB 00:00 2024-04-24T01:22:48.693 INFO:teuthology.orchestra.run.smithi169.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 249 kB/s | 58 kB 00:00 2024-04-24T01:22:48.718 INFO:teuthology.orchestra.run.smithi169.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2024-04-24T01:22:48.777 INFO:teuthology.orchestra.run.smithi169.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 236 kB/s | 51 kB 00:00 2024-04-24T01:22:48.780 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:48.780 INFO:teuthology.orchestra.run.smithi169.stdout:Total 6.5 MB/s | 7.0 MB 00:01 2024-04-24T01:22:48.850 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:48.861 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:48.862 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:48.959 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:48.960 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:49.220 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T01:22:49.257 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:49.416 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:22:49.470 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:49.501 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:49.816 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2024-04-24T01:22:49.984 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:22:50.064 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:22:50.135 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:22:50.166 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:22:50.340 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:41 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:50.466 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:50.466 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 127 k 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 456 k 2024-04-24T01:22:50.467 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:50.780 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 405 kB/s | 127 kB 00:00 2024-04-24T01:22:50.781 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:50.781 INFO:teuthology.orchestra.run.smithi142.stdout:Total 403 kB/s | 127 kB 00:00 2024-04-24T01:22:50.781 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:50.787 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:50.851 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:50.851 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:22:50.881 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:22:51.003 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:51.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:22:51.130 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:22:51.131 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:22:51.131 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:51.131 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:51.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-fuse 2024-04-24T01:22:51.504 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:51.744 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:51.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:51.745 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:51.745 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:51.745 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:51.745 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:51.845 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:41 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:51.965 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:51.970 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout:Install 2 Packages 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 969 k 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 2.8 M 2024-04-24T01:22:51.971 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:52.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2024-04-24T01:22:52.195 INFO:teuthology.orchestra.run.smithi169.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 532 kB/s | 80 kB 00:00 2024-04-24T01:22:52.487 INFO:teuthology.orchestra.run.smithi169.stdout:(2/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-04-24T01:22:52.488 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:52.488 INFO:teuthology.orchestra.run.smithi169.stdout:Total 1.8 MB/s | 969 kB 00:00 2024-04-24T01:22:52.499 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:52.522 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:52.522 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:52.528 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:43 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:52.601 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:52.601 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:52.608 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:52.649 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:52.650 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:52.650 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:52.732 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2024-04-24T01:22:52.794 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:52.932 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:22:53.002 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:22:53.253 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:44 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:53.372 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T01:22:53.373 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 32 k 2024-04-24T01:22:53.374 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 142 k 2024-04-24T01:22:53.375 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:53.552 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 178 kB/s | 32 kB 00:00 2024-04-24T01:22:53.553 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:53.553 INFO:teuthology.orchestra.run.smithi142.stdout:Total 177 kB/s | 32 kB 00:00 2024-04-24T01:22:53.553 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:53.557 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:53.557 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:53.559 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:53.559 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:53.659 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:53.665 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-24T01:22:53.666 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-24T01:22:53.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:53.892 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:22:53.892 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:53.892 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:53.893 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:22:53.893 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:53.893 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:54.113 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:54.133 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-volume 2024-04-24T01:22:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:54.331 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:54.332 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:22:54.332 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:54.332 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:54.332 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:54.508 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2024-04-24T01:22:54.649 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:44 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:54.772 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:54.772 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:54.772 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-04-24T01:22:54.772 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout:Install 2 Packages 2024-04-24T01:22:54.773 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:54.774 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 341 k 2024-04-24T01:22:54.774 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 1.5 M 2024-04-24T01:22:54.774 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:55.014 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:46 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:55.035 INFO:teuthology.orchestra.run.smithi169.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 595 kB/s | 77 kB 00:00 2024-04-24T01:22:55.093 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:55.135 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:55.135 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:55.135 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:55.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2024-04-24T01:22:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 638 kB/s | 264 kB 00:00 2024-04-24T01:22:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:55.319 INFO:teuthology.orchestra.run.smithi169.stdout:Total 624 kB/s | 341 kB 00:00 2024-04-24T01:22:55.331 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:55.340 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:55.365 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:55.366 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:55.501 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:55.700 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:22:55.712 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:46 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:55.738 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:22:55.754 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-24T01:22:55.754 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:22:55.754 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:22:55.754 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:55.791 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:55.832 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:55.832 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:55.833 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:55.902 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2024-04-24T01:22:56.413 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:56.475 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-24T01:22:56.492 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:56.533 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:56.534 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:56.534 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:56.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2024-04-24T01:22:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:22:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:56.749 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:56.749 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-24T01:22:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:22:56.750 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:56.750 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:57.085 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install librados-devel 2024-04-24T01:22:57.106 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:48 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:57.185 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:57.225 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:57.226 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:57.226 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:57.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2024-04-24T01:22:57.610 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:47 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:57.735 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:57.735 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:22:57.736 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:57.737 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 127 k 2024-04-24T01:22:57.737 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 456 k 2024-04-24T01:22:57.737 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:22:57.809 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:48 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:57.890 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:57.930 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:57.931 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:57.931 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:58.003 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2024-04-24T01:22:58.076 INFO:teuthology.orchestra.run.smithi169.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 373 kB/s | 127 kB 00:00 2024-04-24T01:22:58.077 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:58.077 INFO:teuthology.orchestra.run.smithi169.stdout:Total 372 kB/s | 127 kB 00:00 2024-04-24T01:22:58.077 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:22:58.083 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:22:58.083 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:22:58.146 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:22:58.146 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:22:58.295 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:22:58.389 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:58.506 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:58.585 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:58.626 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:58.628 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2024-04-24T01:22:58.628 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:22:58.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2024-04-24T01:22:58.836 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:59.097 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:59.097 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:22:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:22:59.098 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:22:59.098 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:22:59.206 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:22:59.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install libcephfs2 2024-04-24T01:22:59.325 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:22:59.326 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:22:59.327 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:22:59.327 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 86 k 2024-04-24T01:22:59.327 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 231 k 2024-04-24T01:22:59.327 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:22:59.530 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 423 kB/s | 86 kB 00:00 2024-04-24T01:22:59.531 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:22:59.531 INFO:teuthology.orchestra.run.smithi142.stdout:Total 420 kB/s | 86 kB 00:00 2024-04-24T01:22:59.531 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:22:59.538 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:22:59.538 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:22:59.600 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:22:59.601 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:22:59.739 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:22:59.824 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:49 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:22:59.842 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:22:59.905 INFO:teuthology.orchestra.run.smithi169.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:22:59.947 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:22:59.948 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:22:59.948 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:00.023 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install libcephfs-devel 2024-04-24T01:23:00.287 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:00.538 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:23:00.542 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:50 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:00.663 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:23:00.664 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:00.665 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 32 k 2024-04-24T01:23:00.665 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 142 k 2024-04-24T01:23:00.665 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:23:00.792 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2024-04-24T01:23:00.847 INFO:teuthology.orchestra.run.smithi169.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 174 kB/s | 32 kB 00:00 2024-04-24T01:23:00.847 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:00.848 INFO:teuthology.orchestra.run.smithi169.stdout:Total 173 kB/s | 32 kB 00:00 2024-04-24T01:23:00.848 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:23:00.851 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:23:00.851 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:23:00.853 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:23:00.854 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:23:00.941 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:23:01.060 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:01.323 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:23:01.425 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:01.446 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:23:01.452 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:01.453 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:23:01.453 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:01.453 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.1 M 2024-04-24T01:23:01.453 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 13 M 2024-04-24T01:23:01.453 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:01.636 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:01.797 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install librados2 2024-04-24T01:23:01.834 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 8.0 MB/s | 3.1 MB 00:00 2024-04-24T01:23:01.835 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:01.836 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.0 MB/s | 3.1 MB 00:00 2024-04-24T01:23:01.836 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:23:01.848 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:23:01.848 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:23:01.925 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:23:01.926 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:23:02.316 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:52 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:02.354 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:23:02.398 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:02.418 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:02.436 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:02.437 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:02.437 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:23:02.443 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:02.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install librbd1 2024-04-24T01:23:03.018 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:53 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:03.098 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:03.139 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:03.140 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:03.140 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:03.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install python3-rados 2024-04-24T01:23:03.482 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:03.482 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:03.482 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:23:03.482 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:03.483 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:03.483 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:23:03.716 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:53 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:03.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2024-04-24T01:23:03.794 INFO:teuthology.orchestra.run.smithi169.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:03.835 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:03.836 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:03.836 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:03.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install python3-rgw 2024-04-24T01:23:04.261 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Apr 2024 01:21:09 AM UTC. 2024-04-24T01:23:04.382 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 170 k 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 494 k 2024-04-24T01:23:04.383 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2024-04-24T01:23:04.417 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:54 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:04.497 INFO:teuthology.orchestra.run.smithi169.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:04.539 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:04.540 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:04.540 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:04.605 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install python3-cephfs 2024-04-24T01:23:04.612 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 746 kB/s | 170 kB 00:00 2024-04-24T01:23:04.612 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:04.612 INFO:teuthology.orchestra.run.smithi142.stdout:Total 742 kB/s | 170 kB 00:00 2024-04-24T01:23:04.613 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2024-04-24T01:23:04.621 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2024-04-24T01:23:04.621 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2024-04-24T01:23:04.683 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2024-04-24T01:23:04.683 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2024-04-24T01:23:04.838 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2024-04-24T01:23:04.932 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:05.118 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:05.197 INFO:teuthology.orchestra.run.smithi169.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:05.238 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:05.239 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:05.239 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:05.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install python3-rbd 2024-04-24T01:23:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:05.588 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2024-04-24T01:23:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:05.588 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2024-04-24T01:23:05.823 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:55 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:05.849 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:05.903 INFO:teuthology.orchestra.run.smithi169.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-24T01:23:05.943 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:05.944 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-04-24T01:23:05.944 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:06.019 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install rbd-fuse 2024-04-24T01:23:06.530 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:56 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:06.655 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:06.655 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:06.655 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:23:06.656 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:06.657 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 86 k 2024-04-24T01:23:06.657 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 231 k 2024-04-24T01:23:06.657 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:23:06.967 INFO:teuthology.orchestra.run.smithi169.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 276 kB/s | 86 kB 00:00 2024-04-24T01:23:06.968 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:06.968 INFO:teuthology.orchestra.run.smithi169.stdout:Total 275 kB/s | 86 kB 00:00 2024-04-24T01:23:06.968 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:23:06.975 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:23:06.975 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:23:07.037 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:23:07.038 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:23:07.183 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:23:07.296 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:07.643 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:07.912 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:23:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:07.912 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:07.913 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:08.171 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install rbd-mirror 2024-04-24T01:23:08.686 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:58 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:08.808 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repo Size 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:23:08.809 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:08.810 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:23:08.810 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:08.810 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 3.1 M 2024-04-24T01:23:08.810 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 13 M 2024-04-24T01:23:08.810 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:23:09.238 INFO:teuthology.orchestra.run.smithi169.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 7.2 MB/s | 3.1 MB 00:00 2024-04-24T01:23:09.238 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:09.239 INFO:teuthology.orchestra.run.smithi169.stdout:Total 7.2 MB/s | 3.1 MB 00:00 2024-04-24T01:23:09.239 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:23:09.248 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:23:09.248 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:23:09.327 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:23:09.328 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:23:09.753 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:23:09.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:09.838 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:09.838 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:23:09.838 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:23:09.838 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:23:09.839 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:23:09.839 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:10.854 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:11.082 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install rbd-nbd 2024-04-24T01:23:11.600 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:02:01 ago on Wed 24 Apr 2024 01:21:10 AM UTC. 2024-04-24T01:23:11.725 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-04-24T01:23:11.725 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Install 1 Package 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 170 k 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Installed size: 494 k 2024-04-24T01:23:11.726 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-04-24T01:23:12.318 INFO:teuthology.orchestra.run.smithi169.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 288 kB/s | 170 kB 00:00 2024-04-24T01:23:12.318 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:23:12.319 INFO:teuthology.orchestra.run.smithi169.stdout:Total 287 kB/s | 170 kB 00:00 2024-04-24T01:23:12.319 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-04-24T01:23:12.326 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-04-24T01:23:12.327 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-04-24T01:23:12.390 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-04-24T01:23:12.390 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-04-24T01:23:12.537 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-04-24T01:23:12.655 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:13.025 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:13.265 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-24T01:23:13.265 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:13.266 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-04-24T01:23:13.266 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-24T01:23:13.266 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:13.266 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-04-24T01:23:13.537 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:13.538 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:23:13.764 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:23:13.789 INFO:teuthology.orchestra.run.smithi142.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T01:23:13.789 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T01:23:13.790 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T01:23:13.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-24T01:23:13.930 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:23:13.951 INFO:teuthology.orchestra.run.smithi169.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-24T01:23:13.951 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-24T01:23:13.951 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-24T01:23:13.953 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T01:23:13.953 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:13.953 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:23:13.981 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:13.981 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:23:14.019 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T01:23:14.019 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:14.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:23:14.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:23:14.115 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:14.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:23:14.138 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:23:14.202 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T01:23:14.202 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:14.203 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:23:14.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:23:14.297 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:14.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:23:14.321 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:23:14.384 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T01:23:14.384 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:14.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:23:14.410 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:23:14.476 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:14.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:23:14.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:23:14.562 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T01:23:14.650 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T01:23:14.650 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2024-04-24T01:23:14.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-04-24T01:23:14.676 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T01:23:14.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:23:14.719 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:23:14.742 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T01:23:14.742 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:23:14.784 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:23:14.814 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T01:23:14.815 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T01:23:14.815 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7670589', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 9360, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'targets': {'smithi142.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKmHKZqzMaAgEnwkniG11fGFN3dZsarTy3AinwC2g+0grC//8S6sQ29ji6FBNKJn4Y4VrPUoGVbOR5wUC5CqRI=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBExoVtdYFlpOaruRpHdKJsC+XPHSFA1jKOnqKCAVNQl4VpLjl/Il5+rKyMQbCUo5QXVmCQ/0dv+RtYPh2OyH0iE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T01:23:14.815 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:23:14.849 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:23:14.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:23:14.903 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:23:14.926 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:14.927 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:23:14.981 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:23:14.981 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 01:23:02.684080164 +0000 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 01:20:25.936791800 +0000 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 01:20:25.936791800 +0000 2024-04-24T01:23:15.036 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 01:20:25.936791800 +0000 2024-04-24T01:23:15.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:23:15.099 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T01:23:15.099 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T01:23:15.099 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000263767 s, 1.9 MB/s 2024-04-24T01:23:15.100 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:23:15.156 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 01:23:02.684080164 +0000 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 01:20:26.273785187 +0000 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 01:20:26.273785187 +0000 2024-04-24T01:23:15.211 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 01:20:26.273785187 +0000 2024-04-24T01:23:15.212 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:23:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T01:23:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T01:23:15.273 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000187057 s, 2.7 MB/s 2024-04-24T01:23:15.274 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:23:15.330 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 01:23:02.684080164 +0000 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 01:20:26.606778652 +0000 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 01:20:26.606778652 +0000 2024-04-24T01:23:15.384 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 01:20:26.606778652 +0000 2024-04-24T01:23:15.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:23:15.446 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T01:23:15.446 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T01:23:15.446 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000191521 s, 2.7 MB/s 2024-04-24T01:23:15.447 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:23:15.503 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2024-04-24 01:23:02.685080145 +0000 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2024-04-24 01:20:27.103768900 +0000 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2024-04-24 01:20:27.103768900 +0000 2024-04-24T01:23:15.558 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2024-04-24 01:20:27.103768900 +0000 2024-04-24T01:23:15.559 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:23:15.620 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2024-04-24T01:23:15.620 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2024-04-24T01:23:15.620 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000165013 s, 3.1 MB/s 2024-04-24T01:23:15.621 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:23:15.676 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T01:23:15.677 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:15.677 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:23:15.693 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:23:15.694 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-04-24T01:23:15.750 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:23:15.750 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.750 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-24T01:23:15.750 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.750 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.751 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-24 01:23:10.111336254 +0000 2024-04-24T01:23:15.751 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-24 01:20:25.938016341 +0000 2024-04-24T01:23:15.751 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-24 01:20:25.938016341 +0000 2024-04-24T01:23:15.751 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-24 01:20:25.938016341 +0000 2024-04-24T01:23:15.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:23:15.813 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-24T01:23:15.814 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-24T01:23:15.814 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000267818 s, 1.9 MB/s 2024-04-24T01:23:15.815 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:23:15.871 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-24 01:23:10.111336254 +0000 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-24 01:20:26.286008890 +0000 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-24 01:20:26.286008890 +0000 2024-04-24T01:23:15.928 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-24 01:20:26.286008890 +0000 2024-04-24T01:23:15.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:23:15.991 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-24T01:23:15.991 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-24T01:23:15.991 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000198721 s, 2.6 MB/s 2024-04-24T01:23:15.992 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:23:16.050 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-24 01:23:10.111336254 +0000 2024-04-24T01:23:16.105 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-24 01:20:26.630001524 +0000 2024-04-24T01:23:16.106 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-24 01:20:26.630001524 +0000 2024-04-24T01:23:16.106 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-24 01:20:26.630001524 +0000 2024-04-24T01:23:16.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:23:16.168 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-24T01:23:16.168 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-24T01:23:16.168 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000189361 s, 2.7 MB/s 2024-04-24T01:23:16.169 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:23:16.225 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-04-24T01:23:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:23:16.280 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:23:16.280 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-24T01:23:16.280 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:23:16.281 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:23:16.281 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-24 01:23:10.112336234 +0000 2024-04-24T01:23:16.281 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-24 01:20:26.968994266 +0000 2024-04-24T01:23:16.281 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-24 01:20:26.968994266 +0000 2024-04-24T01:23:16.281 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-04-24 01:20:26.968994266 +0000 2024-04-24T01:23:16.281 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:23:16.342 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-24T01:23:16.342 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-24T01:23:16.342 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000198994 s, 2.6 MB/s 2024-04-24T01:23:16.343 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:23:16.398 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:23:16.398 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T01:23:16.399 INFO:tasks.ceph:Generating config... 2024-04-24T01:23:16.400 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T01:23:16.401 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-04-24T01:23:16.401 INFO:tasks.ceph:[client] debug rgw = 20 2024-04-24T01:23:16.401 INFO:tasks.ceph:[client] setgroup = ceph 2024-04-24T01:23:16.401 INFO:tasks.ceph:[client] setuser = ceph 2024-04-24T01:23:16.401 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T01:23:16.401 INFO:tasks.ceph:[osd] debug objclass = 20 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T01:23:16.402 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T01:23:16.403 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T01:23:16.404 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T01:23:16.404 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T01:23:16.404 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T01:23:16.404 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T01:23:16.404 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T01:23:16.404 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T01:23:16.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T01:23:16.452 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T01:23:16.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T01:23:16.497 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:23:16.563 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142')] 2024-04-24T01:23:16.564 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.142'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-04-24T01:23:16.564 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:16.564 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:23:16.619 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.142 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:16.696 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:23:16.696 INFO:teuthology.orchestra.run.smithi142.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:23:16.696 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid aa5c51fd-2ac5-45d6-b08d-87c82c45b459 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = quincy 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:fsid aa5c51fd-2ac5-45d6-b08d-87c82c45b459 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2024-04-24T01:23:16.697113+0000 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:created 2024-04-24T01:23:16.697113+0000 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 17 (quincy) 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:election_strategy: 1 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2024-04-24T01:23:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-24T01:23:16.699 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:23:16.753 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aa5c51fd-2ac5-45d6-b08d-87c82c45b459... 2024-04-24T01:23:16.754 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:23:16.796 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2024-04-24T01:23:16.833 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2024-04-24T01:23:16.834 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.835 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = 172.21.15.142 2024-04-24T01:23:16.836 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = aa5c51fd-2ac5-45d6-b08d-87c82c45b459 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2024-04-24T01:23:16.837 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug trim objects = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:23:16.838 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: debug objclass = 20 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bdev async discard = True 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bdev enable discard = True 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore allocator = bitmap 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 1/20 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 1/20 2024-04-24T01:23:16.839 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 4/10 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:23:16.840 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2024-04-24T01:23:16.841 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.842 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: rgw gc obj min wait = 15 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: debug rgw = 20 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: setgroup = ceph 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout: setuser = ceph 2024-04-24T01:23:16.843 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.844 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.845 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-04-24T01:23:16.846 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = 172.21.15.142 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = aa5c51fd-2ac5-45d6-b08d-87c82c45b459 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-04-24T01:23:16.847 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-04-24T01:23:16.848 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: debug objclass = 20 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-04-24T01:23:16.849 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-24T01:23:16.850 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-04-24T01:23:16.851 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:23:16.852 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: rgw gc obj min wait = 15 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: debug rgw = 20 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: setgroup = ceph 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout: setuser = ceph 2024-04-24T01:23:16.853 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-04-24T01:23:16.855 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T01:23:16.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T01:23:16.949 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T01:23:16.950 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:16.950 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T01:23:16.964 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:16.965 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T01:23:17.019 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T01:23:17.019 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:17.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:23:17.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:23:17.091 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:17.091 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:17.146 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:23:17.146 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:17.146 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:23:17.146 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:23:17.179 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:17.179 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:17.234 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T01:23:17.234 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T01:23:17.234 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:23:17.335 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:23:17.337 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T01:23:17.338 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T01:23:17.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T01:23:17.376 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T01:23:17.388 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T01:23:17.388 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-04-24T01:23:17.388 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T01:23:17.412 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-24T01:23:17.412 INFO:tasks.ceph:role: osd.0 2024-04-24T01:23:17.412 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T01:23:17.413 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:23:17.483 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:23:17.483 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:23:17.484 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:23:17.974 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2024-04-24T01:23:17.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2024-04-24T01:23:17.976 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T01:23:18.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T01:23:18.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:18.247 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.247+0000 7f1e02625640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T01:23:18.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.251+0000 7f1e02625640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T01:23:18.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.251+0000 7f1e02625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:23:18.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.251+0000 7f1e02625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:23:18.252 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.251+0000 7f1e02625640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T01:23:18.256 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:18.256+0000 7f1e02625640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T01:23:21.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T01:23:21.148 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T01:23:21.177 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:23:21.177 INFO:tasks.ceph:role: osd.1 2024-04-24T01:23:21.177 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:23:21.177 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:23:21.252 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:23:21.253 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:23:21.253 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:23:21.253 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:23:21.253 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:23:21.758 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-24T01:23:21.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-24T01:23:21.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-24T01:23:21.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T01:23:21.922 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T01:23:21.988 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:23:21.988 INFO:tasks.ceph:role: osd.2 2024-04-24T01:23:21.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:23:21.989 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T01:23:22.063 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:23:22.745 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:23:22.745 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:23:22.746 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:23:22.747 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-24T01:23:22.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-24T01:23:22.748 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-04-24T01:23:22.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T01:23:22.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T01:23:22.939 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-04-24T01:23:22.940 INFO:tasks.ceph:role: osd.3 2024-04-24T01:23:22.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:23:22.940 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:23:23.011 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:23:23.532 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-24T01:23:23.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-24T01:23:23.534 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-04-24T01:23:23.688 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T01:23:23.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:23.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.806+0000 7fcaf621b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T01:23:23.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.806+0000 7fcaf621b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T01:23:23.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.806+0000 7fcaf621b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:23:23.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.806+0000 7fcaf621b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:23:23.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.806+0000 7fcaf621b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T01:23:23.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:23.814+0000 7fcaf621b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T01:23:26.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T01:23:26.691 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:26.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.777+0000 7f715ba13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T01:23:26.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.778+0000 7f715ba13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T01:23:26.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.778+0000 7f715ba13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:23:26.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.778+0000 7f715ba13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:23:26.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.778+0000 7f715ba13640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T01:23:26.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:26.778+0000 7f715ba13640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T01:23:29.625 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T01:23:29.653 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:29.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.739+0000 7f712ac12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T01:23:29.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.739+0000 7f712ac12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T01:23:29.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.739+0000 7f712ac12640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:23:29.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.739+0000 7f712ac12640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:23:29.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.739+0000 7f712ac12640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T01:23:29.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:29.740+0000 7f712ac12640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T01:23:32.606 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T01:23:32.634 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T01:23:32.634 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:32.635 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T01:23:32.663 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:32.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T01:23:32.700 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:32.700 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T01:23:32.765 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:32.765 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T01:23:32.829 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:32.830 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T01:23:32.894 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:32.894 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T01:23:32.949 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T01:23:32.949 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T01:23:32.975 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAGXyhmTTHLDhAASvzqo+cv1QzpIbkvjUeVHQ== 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAFXyhmRgwGFBAAY/aWmS8wx3FNV0cREINfsw== 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQALXyhmEVgZMBAAJw80a84MSBfLohU2Vb0mrw== 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAOXyhmegJ3LhAA2fIZil+iI81IIdPNv1OkDw== 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQARXyhmcbgnLBAAdJouM1VxmcISgFQx9fI09Q== 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2024-04-24T01:23:32.976 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQAFXyhmuG1+FhAAAmePo3S+yyKutmnFT4uTFg== 2024-04-24T01:23:32.977 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:23:33.071 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T01:23:33.121 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:23:33.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:23:33.219 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:23:33.268 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T01:23:33.319 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T01:23:33.319 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T01:23:33.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T01:23:33.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T01:23:33.463 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:23:33.518 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T01:23:33.518 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T01:23:33.519 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T01:23:33.561 INFO:tasks.ceph.mon.a:Started 2024-04-24T01:23:33.561 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T01:23:33.561 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T01:23:33.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T01:23:33.564 INFO:tasks.ceph.mgr.x:Started 2024-04-24T01:23:33.564 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T01:23:33.564 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T01:23:33.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.662+0000 7fbc0338b640 1 Processor -- start 2024-04-24T01:23:33.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc0338b640 1 -- start start 2024-04-24T01:23:33.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc0338b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbfc129160 0x7fbbfc129540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:33.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc0338b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbfc0724c0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.664 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc0338b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fbbfc0721b0 con 0x7fbbfc129160 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc01127640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbfc129160 0x7fbbfc129540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc01127640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fbbfc129160 0x7fbbfc129540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51362/0 (socket says 172.21.15.142:51362) 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc00926640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fbbfc06fff0 0x7fbbfc0704a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33466/0 (socket says 172.21.15.142:33466) 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc01127640 1 -- 172.21.15.142:0/2139212464 learned_addr learned my addr 172.21.15.142:0/2139212464 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc01127640 1 -- 172.21.15.142:0/2139212464 >> v1:172.21.15.142:6789/0 conn(0x7fbbfc06fff0 legacy=0x7fbbfc0704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:33.665 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.663+0000 7fbc01127640 1 -- 172.21.15.142:0/2139212464 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc072c90 con 0x7fbbfc129160 2024-04-24T01:23:33.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.665+0000 7fbc01127640 1 --2- 172.21.15.142:0/2139212464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc129160 0x7fbbfc129540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097f0 tx=0x7fbbec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aa8ba8dec64e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:33.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.665+0000 7fbbf3fff640 1 -- 172.21.15.142:0/2139212464 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec035020 con 0x7fbbfc129160 2024-04-24T01:23:33.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.665+0000 7fbbf3fff640 1 -- 172.21.15.142:0/2139212464 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0317a0 con 0x7fbbfc129160 2024-04-24T01:23:33.666 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.665+0000 7fbbf3fff640 1 -- 172.21.15.142:0/2139212464 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec031aa0 con 0x7fbbfc129160 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 -- 172.21.15.142:0/2139212464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc129160 msgr2=0x7fbbfc129540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 --2- 172.21.15.142:0/2139212464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc129160 0x7fbbfc129540 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097f0 tx=0x7fbbec02b910 comp rx=0 tx=0).stop 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 -- 172.21.15.142:0/2139212464 shutdown_connections 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 --2- 172.21.15.142:0/2139212464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc129160 0x7fbbfc129540 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 -- 172.21.15.142:0/2139212464 >> 172.21.15.142:0/2139212464 conn(0x7fbbfc09b5a0 msgr2=0x7fbbfc09b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 -- 172.21.15.142:0/2139212464 shutdown_connections 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.666+0000 7fbc0338b640 1 -- 172.21.15.142:0/2139212464 wait complete. 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc0338b640 1 Processor -- start 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc0338b640 1 -- start start 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc0338b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:33.668 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc0338b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fbbfc071210 con 0x7fbbfc06fff0 2024-04-24T01:23:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc01127640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc01127640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51370/0 (socket says 172.21.15.142:51370) 2024-04-24T01:23:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc01127640 1 -- 172.21.15.142:0/1177460342 learned_addr learned my addr 172.21.15.142:0/1177460342 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:33.669 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.667+0000 7fbc01127640 1 -- 172.21.15.142:0/1177460342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbfc120a00 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbc01127640 1 --2- 172.21.15.142:0/1177460342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097f0 tx=0x7fbbec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec03ad00 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbec0443f0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbfc121690 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbbec0446d0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbfc1c16e0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbbec04b060 con 0x7fbbfc06fff0 2024-04-24T01:23:33.670 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.668+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbbec04d940 con 0x7fbbfc06fff0 2024-04-24T01:23:33.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.669+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbfc120560 con 0x7fbbfc06fff0 2024-04-24T01:23:33.671 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.671+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbbec063dd0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.735 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.734+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbbfc062da0 con 0x7fbbfc06fff0 2024-04-24T01:23:33.736 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.735+0000 7fbbf1ffb640 1 -- 172.21.15.142:0/1177460342 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbbec052070 con 0x7fbbfc06fff0 2024-04-24T01:23:33.738 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2024-04-24T01:23:33.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.735+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 msgr2=0x7fbbfc1c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:33.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.735+0000 7fbc0338b640 1 --2- 172.21.15.142:0/1177460342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fbbec0097f0 tx=0x7fbbec0046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:33.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.736+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 shutdown_connections 2024-04-24T01:23:33.738 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.736+0000 7fbc0338b640 1 --2- 172.21.15.142:0/1177460342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbbfc06fff0 0x7fbbfc1c11a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:33.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.736+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 >> 172.21.15.142:0/1177460342 conn(0x7fbbfc09b5a0 msgr2=0x7fbbfc117f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:33.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.736+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 shutdown_connections 2024-04-24T01:23:33.739 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:33.736+0000 7fbc0338b640 1 -- 172.21.15.142:0/1177460342 wait complete. 2024-04-24T01:23:33.746 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T01:23:33.746 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T01:23:33.747 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2024-04-24T01:23:33.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T01:23:33.769 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:33.769 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T01:23:33.794 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:33.794 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T01:23:33.858 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-24T01:23:33.858 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T01:23:33.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 46ae04bc-ac49-4710-9769-9890b8964b2a 0 2024-04-24T01:23:33.950 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:33.948+0000 7fcb0c01a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T01:23:34.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f2aeb640 1 Processor -- start 2024-04-24T01:23:34.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f2aeb640 1 -- start start 2024-04-24T01:23:34.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f2aeb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52ec1149a0 0x7f52ec114d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f2aeb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52ec1153e0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f2aeb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f52ec110490 con 0x7f52ec1149a0 2024-04-24T01:23:34.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f0887640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52ec1149a0 0x7f52ec114d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f0887640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f52ec1149a0 0x7f52ec114d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33242/0 (socket says 172.21.15.169:33242) 2024-04-24T01:23:34.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f0887640 1 -- 172.21.15.169:0/2358940310 learned_addr learned my addr 172.21.15.169:0/2358940310 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:34.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f0887640 1 -- 172.21.15.169:0/2358940310 >> v1:172.21.15.142:6789/0 conn(0x7f52ec10f8f0 legacy=0x7f52ec10fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.046+0000 7f52f0887640 1 -- 172.21.15.169:0/2358940310 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec110640 con 0x7f52ec1149a0 2024-04-24T01:23:34.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.047+0000 7f52f0887640 1 --2- 172.21.15.169:0/2358940310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec1149a0 0x7f52ec114d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097f0 tx=0x7f52e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10f96a12898b059 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.047+0000 7f52eb7fe640 1 -- 172.21.15.169:0/2358940310 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e0035020 con 0x7f52ec1149a0 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.047+0000 7f52eb7fe640 1 -- 172.21.15.169:0/2358940310 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e00317a0 con 0x7f52ec1149a0 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.047+0000 7f52eb7fe640 1 -- 172.21.15.169:0/2358940310 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e0031aa0 con 0x7f52ec1149a0 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 -- 172.21.15.169:0/2358940310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec1149a0 msgr2=0x7f52ec114d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 --2- 172.21.15.169:0/2358940310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec1149a0 0x7f52ec114d80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097f0 tx=0x7f52e002b910 comp rx=0 tx=0).stop 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 -- 172.21.15.169:0/2358940310 shutdown_connections 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 --2- 172.21.15.169:0/2358940310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec1149a0 0x7f52ec114d80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 -- 172.21.15.169:0/2358940310 >> 172.21.15.169:0/2358940310 conn(0x7f52ec070e80 msgr2=0x7f52ec0732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 -- 172.21.15.169:0/2358940310 shutdown_connections 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.048+0000 7f52f2aeb640 1 -- 172.21.15.169:0/2358940310 wait complete. 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f2aeb640 1 Processor -- start 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f2aeb640 1 -- start start 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f2aeb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f2aeb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec11bd20 con 0x7f52ec10f8f0 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f0887640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f0887640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33254/0 (socket says 172.21.15.169:33254) 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.049+0000 7f52f0887640 1 -- 172.21.15.169:0/1523823471 learned_addr learned my addr 172.21.15.169:0/1523823471 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52f0887640 1 -- 172.21.15.169:0/1523823471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec06d110 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52f0887640 1 --2- 172.21.15.169:0/1523823471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097f0 tx=0x7f52e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e003ad00 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52e00443f0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec06d340 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52e00446d0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec06d7d0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f52e004b060 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.050+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f52e004d940 con 0x7f52ec10f8f0 2024-04-24T01:23:34.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.051+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec062da0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.053+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f52e0063dd0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.103 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:34.101+0000 7fcb0c01a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:23:34.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.126+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46ae04bc-ac49-4710-9769-9890b8964b2a", "id": 0} v 0) -- 0x7f52ec118fb0 con 0x7f52ec10f8f0 2024-04-24T01:23:34.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.127+0000 7f52e97fa640 1 -- 172.21.15.169:0/1523823471 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46ae04bc-ac49-4710-9769-9890b8964b2a", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f52e0052030 con 0x7f52ec10f8f0 2024-04-24T01:23:34.128 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-04-24T01:23:34.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 msgr2=0x7f52ec06cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 --2- 172.21.15.169:0/1523823471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097f0 tx=0x7f52e00046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 shutdown_connections 2024-04-24T01:23:34.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 --2- 172.21.15.169:0/1523823471 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52ec10f8f0 0x7f52ec06cbd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 >> 172.21.15.169:0/1523823471 conn(0x7f52ec070e80 msgr2=0x7f52ec1136e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 shutdown_connections 2024-04-24T01:23:34.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.128+0000 7f52f2aeb640 1 -- 172.21.15.169:0/1523823471 wait complete. 2024-04-24T01:23:34.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 23cde981-9d17-4c9a-9dee-3c1d6092bce7 1 2024-04-24T01:23:34.159 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:34.157+0000 7fcb0c01a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T01:23:34.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.237+0000 7f29cb359640 1 Processor -- start 2024-04-24T01:23:34.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.237+0000 7f29cb359640 1 -- start start 2024-04-24T01:23:34.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.237+0000 7f29cb359640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29c411aaf0 0x7f29c411cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.237+0000 7f29cb359640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29c411d420 con 0x7f29c4116c40 2024-04-24T01:23:34.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.237+0000 7f29cb359640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f29c411e600 con 0x7f29c411aaf0 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29c88f4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29c411aaf0 0x7f29c411cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29c90f5640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f29c4116c40 0x7f29c4117020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:55504/0 (socket says 172.21.15.169:55504) 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29c90f5640 1 -- 172.21.15.169:0/2648517229 learned_addr learned my addr 172.21.15.169:0/2648517229 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29c88f4640 1 -- 172.21.15.169:0/2648517229 >> v1:172.21.15.142:6789/0 conn(0x7f29c4116c40 legacy=0x7f29c4117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29bbfff640 1 -- 172.21.15.169:0/2648517229 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211895914 0 0) 0x7f29c411d420 con 0x7f29c4116c40 2024-04-24T01:23:34.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.238+0000 7f29c88f4640 1 -- 172.21.15.169:0/2648517229 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c411e7b0 con 0x7f29c411aaf0 2024-04-24T01:23:34.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.239+0000 7f29c88f4640 1 --2- 172.21.15.169:0/2648517229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c411aaf0 0x7f29c411cee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009720 tx=0x7f29c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96868ec6ddf78078 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.239+0000 7f29bbfff640 1 -- 172.21.15.169:0/2648517229 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c00316d0 con 0x7f29c411aaf0 2024-04-24T01:23:34.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.239+0000 7f29bbfff640 1 -- 172.21.15.169:0/2648517229 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29c0037070 con 0x7f29c411aaf0 2024-04-24T01:23:34.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.239+0000 7f29bbfff640 1 -- 172.21.15.169:0/2648517229 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29c00319c0 con 0x7f29c411aaf0 2024-04-24T01:23:34.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 -- 172.21.15.169:0/2648517229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c411aaf0 msgr2=0x7f29c411cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 --2- 172.21.15.169:0/2648517229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c411aaf0 0x7f29c411cee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f29c0009720 tx=0x7f29c002b840 comp rx=0 tx=0).stop 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 -- 172.21.15.169:0/2648517229 shutdown_connections 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 --2- 172.21.15.169:0/2648517229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c411aaf0 0x7f29c411cee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 -- 172.21.15.169:0/2648517229 >> 172.21.15.169:0/2648517229 conn(0x7f29c406e700 msgr2=0x7f29c410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 -- 172.21.15.169:0/2648517229 shutdown_connections 2024-04-24T01:23:34.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 -- 172.21.15.169:0/2648517229 wait complete. 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.240+0000 7f29cb359640 1 Processor -- start 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29cb359640 1 -- start start 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29cb359640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29cb359640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f29c411dad0 con 0x7f29c4116c40 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29c90f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29c90f5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33268/0 (socket says 172.21.15.169:33268) 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29c90f5640 1 -- 172.21.15.169:0/1340050558 learned_addr learned my addr 172.21.15.169:0/1340050558 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29c90f5640 1 -- 172.21.15.169:0/1340050558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29c41ac980 con 0x7f29c4116c40 2024-04-24T01:23:34.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29c90f5640 1 --2- 172.21.15.169:0/1340050558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c420 tx=0x7f29b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b4018070 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29b40074d0 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29c41acc10 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.241+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29b4004950 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.242+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29c41a6620 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.242+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29b401b070 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.242+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f29b401cd90 con 0x7f29c4116c40 2024-04-24T01:23:34.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.243+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29c4062da0 con 0x7f29c4116c40 2024-04-24T01:23:34.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.245+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f29b401c3b0 con 0x7f29c4116c40 2024-04-24T01:23:34.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.317+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "23cde981-9d17-4c9a-9dee-3c1d6092bce7", "id": 1} v 0) -- 0x7f29c41ace40 con 0x7f29c4116c40 2024-04-24T01:23:34.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.318+0000 7f29b9ffb640 1 -- 172.21.15.169:0/1340050558 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23cde981-9d17-4c9a-9dee-3c1d6092bce7", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f29b401c590 con 0x7f29c4116c40 2024-04-24T01:23:34.320 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 msgr2=0x7f29c41ac3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 --2- 172.21.15.169:0/1340050558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f29b400c420 tx=0x7f29b400c8e0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 shutdown_connections 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 --2- 172.21.15.169:0/1340050558 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29c4116c40 0x7f29c41ac3b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 >> 172.21.15.169:0/1340050558 conn(0x7f29c406e700 msgr2=0x7f29c41157a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 shutdown_connections 2024-04-24T01:23:34.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.319+0000 7f29cb359640 1 -- 172.21.15.169:0/1340050558 wait complete. 2024-04-24T01:23:34.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new c0d6289e-bcf6-4dc4-827d-955915326bc6 2 2024-04-24T01:23:34.432 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:34.431+0000 7fcb0c01a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.466+0000 7fc0fbe7b640 1 Processor -- start 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0fbe7b640 1 -- start start 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0fbe7b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0f4116c40 0x7fc0f4117020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0fbe7b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0f4117680 con 0x7fc0f4111b00 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0fbe7b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc0f41126a0 con 0x7fc0f4116c40 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9c17640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0f4116c40 0x7fc0f4117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9416640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc0f4111b00 0x7fc0f4111f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:38834/0 (socket says 172.21.15.169:38834) 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9416640 1 -- 172.21.15.169:0/2738280753 learned_addr learned my addr 172.21.15.169:0/2738280753 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9c17640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc0f4116c40 0x7fc0f4117020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:38552/0 (socket says 172.21.15.169:38552) 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9c17640 1 -- 172.21.15.169:0/2738280753 >> v1:172.21.15.142:6789/0 conn(0x7fc0f4111b00 legacy=0x7fc0f4111f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.467+0000 7fc0f9c17640 1 -- 172.21.15.169:0/2738280753 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4112850 con 0x7fc0f4116c40 2024-04-24T01:23:34.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.468+0000 7fc0f9c17640 1 --2- 172.21.15.169:0/2738280753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4116c40 0x7fc0f4117020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009720 tx=0x7fc0e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da398cd787b86d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.468+0000 7fc0f8c15640 1 -- 172.21.15.169:0/2738280753 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40316d0 con 0x7fc0f4116c40 2024-04-24T01:23:34.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.468+0000 7fc0f8c15640 1 -- 172.21.15.169:0/2738280753 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e4037070 con 0x7fc0f4116c40 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.468+0000 7fc0f8c15640 1 -- 172.21.15.169:0/2738280753 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e40319c0 con 0x7fc0f4116c40 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/2738280753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4116c40 msgr2=0x7fc0f4117020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 --2- 172.21.15.169:0/2738280753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4116c40 0x7fc0f4117020 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009720 tx=0x7fc0e402b840 comp rx=0 tx=0).stop 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/2738280753 shutdown_connections 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 --2- 172.21.15.169:0/2738280753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4116c40 0x7fc0f4117020 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/2738280753 >> 172.21.15.169:0/2738280753 conn(0x7fc0f406e700 msgr2=0x7fc0f410fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/2738280753 shutdown_connections 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.469+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/2738280753 wait complete. 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0fbe7b640 1 Processor -- start 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0fbe7b640 1 -- start start 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0fbe7b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0fbe7b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f411df30 con 0x7fc0f4111b00 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0f9c17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0f9c17640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:38556/0 (socket says 172.21.15.169:38556) 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0f9c17640 1 -- 172.21.15.169:0/3084694464 learned_addr learned my addr 172.21.15.169:0/3084694464 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.470+0000 7fc0f9c17640 1 -- 172.21.15.169:0/3084694464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f41a6ef0 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0f9c17640 1 --2- 172.21.15.169:0/3084694464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4034040 tx=0x7fc0e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4032770 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f41a7180 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e4032910 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0e4032c30 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f41ab130 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0e404c060 con 0x7fc0f4111b00 2024-04-24T01:23:34.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.471+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fc0e402f050 con 0x7fc0f4111b00 2024-04-24T01:23:34.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.472+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f4062da0 con 0x7fc0f4111b00 2024-04-24T01:23:34.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.474+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc0e4040070 con 0x7fc0f4111b00 2024-04-24T01:23:34.480 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:34.479+0000 7fcb0c01a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T01:23:34.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.546+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0d6289e-bcf6-4dc4-827d-955915326bc6", "id": 2} v 0) -- 0x7fc0f4116c40 con 0x7fc0f4111b00 2024-04-24T01:23:34.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.547+0000 7fc0ea7fc640 1 -- 172.21.15.169:0/3084694464 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0d6289e-bcf6-4dc4-827d-955915326bc6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fc0e404e7e0 con 0x7fc0f4111b00 2024-04-24T01:23:34.548 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-04-24T01:23:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 msgr2=0x7fc0f41a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 --2- 172.21.15.169:0/3084694464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4034040 tx=0x7fc0e40046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 shutdown_connections 2024-04-24T01:23:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 --2- 172.21.15.169:0/3084694464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc0f4111b00 0x7fc0f41a69b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 >> 172.21.15.169:0/3084694464 conn(0x7fc0f406e700 msgr2=0x7fc0f411cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 shutdown_connections 2024-04-24T01:23:34.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.548+0000 7fc0fbe7b640 1 -- 172.21.15.169:0/3084694464 wait complete. 2024-04-24T01:23:34.560 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 90c61569-11b6-46fd-b46f-dbb52c88ac8e 3 2024-04-24T01:23:34.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccf15ad640 1 Processor -- start 2024-04-24T01:23:34.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccf15ad640 1 -- start start 2024-04-24T01:23:34.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccf15ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccec1175f0 0x7fccec1199e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccf15ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccec119fb0 con 0x7fccec1147e0 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccf15ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fccec11b190 con 0x7fccec1175f0 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccea7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccec1175f0 0x7fccec1199e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fcceaffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fccec1147e0 0x7fccec114bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:38842/0 (socket says 172.21.15.169:38842) 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fcceaffd640 1 -- 172.21.15.169:0/3186398428 learned_addr learned my addr 172.21.15.169:0/3186398428 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.655+0000 7fccea7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fccec1175f0 0x7fccec1199e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:38572/0 (socket says 172.21.15.169:38572) 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.656+0000 7fccea7fc640 1 -- 172.21.15.169:0/3186398428 >> v1:172.21.15.142:6789/0 conn(0x7fccec1147e0 legacy=0x7fccec114bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.656+0000 7fccea7fc640 1 -- 172.21.15.169:0/3186398428 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec11b310 con 0x7fccec1175f0 2024-04-24T01:23:34.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.656+0000 7fccea7fc640 1 --2- 172.21.15.169:0/3186398428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1175f0 0x7fccec1199e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009720 tx=0x7fccdc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c7455b261a61e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fcce9ffb640 1 -- 172.21.15.169:0/3186398428 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccdc0316d0 con 0x7fccec1175f0 2024-04-24T01:23:34.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fcce9ffb640 1 -- 172.21.15.169:0/3186398428 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccdc037070 con 0x7fccec1175f0 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fcce9ffb640 1 -- 172.21.15.169:0/3186398428 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccdc0319c0 con 0x7fccec1175f0 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 -- 172.21.15.169:0/3186398428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1175f0 msgr2=0x7fccec1199e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 --2- 172.21.15.169:0/3186398428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1175f0 0x7fccec1199e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009720 tx=0x7fccdc02b840 comp rx=0 tx=0).stop 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 -- 172.21.15.169:0/3186398428 shutdown_connections 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 --2- 172.21.15.169:0/3186398428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1175f0 0x7fccec1199e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 -- 172.21.15.169:0/3186398428 >> 172.21.15.169:0/3186398428 conn(0x7fccec070090 msgr2=0x7fccec0724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 -- 172.21.15.169:0/3186398428 shutdown_connections 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.657+0000 7fccf15ad640 1 -- 172.21.15.169:0/3186398428 wait complete. 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fccf15ad640 1 Processor -- start 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fccf15ad640 1 -- start start 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fccf15ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fccf15ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fccec11a6a0 con 0x7fccec1147e0 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fcceaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fcceaffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:38584/0 (socket says 172.21.15.169:38584) 2024-04-24T01:23:34.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.658+0000 7fcceaffd640 1 -- 172.21.15.169:0/2689106675 learned_addr learned my addr 172.21.15.169:0/2689106675 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:34.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.659+0000 7fcceaffd640 1 -- 172.21.15.169:0/2689106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec1a6f40 con 0x7fccec1147e0 2024-04-24T01:23:34.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.659+0000 7fcceaffd640 1 --2- 172.21.15.169:0/2689106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c480 tx=0x7fcce000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce0017070 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0005c10 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccec1a7230 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce00070d0 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccec1ab200 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcce001a070 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.660+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fcce001cbb0 con 0x7fccec1147e0 2024-04-24T01:23:34.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.661+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccec062da0 con 0x7fccec1147e0 2024-04-24T01:23:34.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.663+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcce001c440 con 0x7fccec1147e0 2024-04-24T01:23:34.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.734+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd new", "uuid": "90c61569-11b6-46fd-b46f-dbb52c88ac8e", "id": 3} v 0) -- 0x7fccec1175f0 con 0x7fccec1147e0 2024-04-24T01:23:34.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.738+0000 7fccd37fe640 1 -- 172.21.15.169:0/2689106675 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "90c61569-11b6-46fd-b46f-dbb52c88ac8e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fcce001c700 con 0x7fccec1147e0 2024-04-24T01:23:34.740 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 msgr2=0x7fccec1a6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 --2- 172.21.15.169:0/2689106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c480 tx=0x7fcce000c940 comp rx=0 tx=0).stop 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 shutdown_connections 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 --2- 172.21.15.169:0/2689106675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccec1147e0 0x7fccec1a6970 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 >> 172.21.15.169:0/2689106675 conn(0x7fccec070090 msgr2=0x7fccec115900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 shutdown_connections 2024-04-24T01:23:34.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:34.739+0000 7fccf15ad640 1 -- 172.21.15.169:0/2689106675 wait complete. 2024-04-24T01:23:34.751 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T01:23:34.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T01:23:34.754 INFO:tasks.ceph.osd.0:Started 2024-04-24T01:23:34.754 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T01:23:34.754 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T01:23:34.756 INFO:tasks.ceph.osd.1:Started 2024-04-24T01:23:34.756 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T01:23:34.756 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T01:23:34.758 INFO:tasks.ceph.osd.2:Started 2024-04-24T01:23:34.758 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T01:23:34.758 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T01:23:34.760 INFO:tasks.ceph.osd.3:Started 2024-04-24T01:23:34.761 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:34.863 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.863+0000 7f31ab6e6640 1 Processor -- start 2024-04-24T01:23:34.864 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.863+0000 7f31ab6e6640 1 -- start start 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.863+0000 7f31ab6e6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31a406f260 0x7f31a406f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.863+0000 7f31ab6e6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a406fff0 con 0x7f31a406fb80 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.863+0000 7f31ab6e6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f31a4070bc0 con 0x7f31a406f260 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f31a9482640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f31a406f260 0x7f31a406f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f31a8c81640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f31a406fb80 0x7f31a412e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33492/0 (socket says 172.21.15.142:33492) 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f31a8c81640 1 -- 172.21.15.142:0/3885767903 learned_addr learned my addr 172.21.15.142:0/3885767903 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f31a9482640 1 -- 172.21.15.142:0/3885767903 >> v1:172.21.15.142:6789/0 conn(0x7f31a406fb80 legacy=0x7f31a412e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f31a9482640 1 -- 172.21.15.142:0/3885767903 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a412ec50 con 0x7f31a406f260 2024-04-24T01:23:34.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.864+0000 7f319bfff640 1 -- 172.21.15.142:0/3885767903 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314028253 0 0) 0x7f31a406fff0 con 0x7f31a406fb80 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31a9482640 1 --2- 172.21.15.142:0/3885767903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a406f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928c418e2218fee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f319bfff640 1 -- 172.21.15.142:0/3885767903 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a00316d0 con 0x7f31a406f260 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f319bfff640 1 -- 172.21.15.142:0/3885767903 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a0037070 con 0x7f31a406f260 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f319bfff640 1 -- 172.21.15.142:0/3885767903 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a00319c0 con 0x7f31a406f260 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 -- 172.21.15.142:0/3885767903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 msgr2=0x7f31a406f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.868 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 --2- 172.21.15.142:0/3885767903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a406f640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009720 tx=0x7f31a002b840 comp rx=0 tx=0).stop 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 -- 172.21.15.142:0/3885767903 shutdown_connections 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 --2- 172.21.15.142:0/3885767903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a406f640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 -- 172.21.15.142:0/3885767903 >> 172.21.15.142:0/3885767903 conn(0x7f31a409e170 msgr2=0x7f31a406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 -- 172.21.15.142:0/3885767903 shutdown_connections 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.865+0000 7f31ab6e6640 1 -- 172.21.15.142:0/3885767903 wait complete. 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.866+0000 7f31ab6e6640 1 Processor -- start 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.866+0000 7f31ab6e6640 1 -- start start 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31ab6e6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31ab6e6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f31a412f400 con 0x7f31a406f260 2024-04-24T01:23:34.869 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31a9482640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31a9482640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51398/0 (socket says 172.21.15.142:51398) 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31a9482640 1 -- 172.21.15.142:0/2216624829 learned_addr learned my addr 172.21.15.142:0/2216624829 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31a9482640 1 -- 172.21.15.142:0/2216624829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a411a280 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31a9482640 1 --2- 172.21.15.142:0/2216624829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31a0034040 tx=0x7f31a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0032640 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00327e0 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a4072cd0 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31a0032ac0 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a4118a60 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.867+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f31a004c060 con 0x7f31a406f260 2024-04-24T01:23:34.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.868+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f31a002f050 con 0x7f31a406f260 2024-04-24T01:23:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.868+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a40a18a0 con 0x7f31a406f260 2024-04-24T01:23:34.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.870+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f31a40a18a0 con 0x7f31a406f260 2024-04-24T01:23:34.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.929+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31a4119de0 con 0x7f31a406f260 2024-04-24T01:23:34.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.929+0000 7f3199ffb640 1 -- 172.21.15.142:0/2216624829 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f31a0040070 con 0x7f31a406f260 2024-04-24T01:23:34.930 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:34.931 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":6,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:34.737349+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:34.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 msgr2=0x7f31a4118520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:34.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 --2- 172.21.15.142:0/2216624829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f31a0034040 tx=0x7f31a00046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 shutdown_connections 2024-04-24T01:23:34.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 --2- 172.21.15.142:0/2216624829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31a406f260 0x7f31a4118520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:34.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 >> 172.21.15.142:0/2216624829 conn(0x7f31a409e170 msgr2=0x7f31a409e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:34.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 shutdown_connections 2024-04-24T01:23:34.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:34.930+0000 7f31ab6e6640 1 -- 172.21.15.142:0/2216624829 wait complete. 2024-04-24T01:23:34.941 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T01:23:34.941 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T01:23:35.205 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.203+0000 7fcb0c01a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T01:23:35.289 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.288+0000 7fcb0c01a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T01:23:35.331 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.329+0000 7fcb0c01a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T01:23:35.343 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:35.344 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-24T01:23:35.343+0000 7fc86c80c640 -1 Falling back to public interface 2024-04-24T01:23:35.364 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-24T01:23:35.363+0000 7f445891e640 -1 Falling back to public interface 2024-04-24T01:23:35.368 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-24T01:23:35.367+0000 7f1fb6896640 -1 Falling back to public interface 2024-04-24T01:23:35.373 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-24T01:23:35.371+0000 7fd346815640 -1 Falling back to public interface 2024-04-24T01:23:35.433 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95edbed640 1 Processor -- start 2024-04-24T01:23:35.433 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95edbed640 1 -- start start 2024-04-24T01:23:35.433 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95edbed640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95e806f1c0 0x7f95e806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95edbed640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95e809c5e0 con 0x7f95e806fae0 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95edbed640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f95e8070b50 con 0x7f95e806f1c0 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95e77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f95e806f1c0 0x7f95e806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95dffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f95e806fae0 0x7f95e8096020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33496/0 (socket says 172.21.15.142:33496) 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95dffff640 1 -- 172.21.15.142:0/1845982809 learned_addr learned my addr 172.21.15.142:0/1845982809 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.432+0000 7f95e77fe640 1 -- 172.21.15.142:0/1845982809 >> v1:172.21.15.142:6789/0 conn(0x7f95e806fae0 legacy=0x7f95e8096020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e6ffd640 1 -- 172.21.15.142:0/1845982809 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076568195 0 0) 0x7f95e809c5e0 con 0x7f95e806fae0 2024-04-24T01:23:35.434 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e77fe640 1 -- 172.21.15.142:0/1845982809 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e80727e0 con 0x7f95e806f1c0 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e77fe640 1 --2- 172.21.15.142:0/1845982809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e806f5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009720 tx=0x7f95d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a78138b18b665a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e6ffd640 1 -- 172.21.15.142:0/1845982809 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d80316d0 con 0x7f95e806f1c0 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e6ffd640 1 -- 172.21.15.142:0/1845982809 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8037070 con 0x7f95e806f1c0 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.433+0000 7f95e6ffd640 1 -- 172.21.15.142:0/1845982809 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d80319c0 con 0x7f95e806f1c0 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 -- 172.21.15.142:0/1845982809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 msgr2=0x7f95e806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 --2- 172.21.15.142:0/1845982809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e806f5a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009720 tx=0x7f95d802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:35.437 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 -- 172.21.15.142:0/1845982809 shutdown_connections 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 --2- 172.21.15.142:0/1845982809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e806f5a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 -- 172.21.15.142:0/1845982809 >> 172.21.15.142:0/1845982809 conn(0x7f95e809a840 msgr2=0x7f95e809ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 -- 172.21.15.142:0/1845982809 shutdown_connections 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.434+0000 7f95edbed640 1 -- 172.21.15.142:0/1845982809 wait complete. 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95edbed640 1 Processor -- start 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95edbed640 1 -- start start 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95edbed640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95edbed640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f95e8096730 con 0x7f95e806f1c0 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95e77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95e77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51424/0 (socket says 172.21.15.142:51424) 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95e77fe640 1 -- 172.21.15.142:0/1250829721 learned_addr learned my addr 172.21.15.142:0/1250829721 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.435+0000 7f95e77fe640 1 -- 172.21.15.142:0/1250829721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e808d540 con 0x7f95e806f1c0 2024-04-24T01:23:35.438 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e77fe640 1 --2- 172.21.15.142:0/1250829721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009840 tx=0x7f95d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d8032770 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95d8032910 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95d8032c30 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e8095e30 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e808bf80 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95d8045780 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.436+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f95d802f050 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.437+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e80737f0 con 0x7f95e806f1c0 2024-04-24T01:23:35.439 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.439+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f95d8063dd0 con 0x7f95e806f1c0 2024-04-24T01:23:35.498 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.497+0000 7fcb0c01a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T01:23:35.498 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.498+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95e808ec00 con 0x7f95e806f1c0 2024-04-24T01:23:35.499 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.498+0000 7f95e4ff9640 1 -- 172.21.15.142:0/1250829721 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f95d8052030 con 0x7f95e806f1c0 2024-04-24T01:23:35.499 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-24T01:23:35.499 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":6,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:34.737349+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 msgr2=0x7f95e808b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 --2- 172.21.15.142:0/1250829721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009840 tx=0x7f95d80046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 shutdown_connections 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 --2- 172.21.15.142:0/1250829721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95e806f1c0 0x7f95e808b860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 >> 172.21.15.142:0/1250829721 conn(0x7f95e809a840 msgr2=0x7f95e8128010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 shutdown_connections 2024-04-24T01:23:35.500 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:35.499+0000 7f95edbed640 1 -- 172.21.15.142:0/1250829721 wait complete. 2024-04-24T01:23:35.509 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-24T01:23:35.561 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.559+0000 7fcb0c01a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T01:23:35.612 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.611+0000 7fcb0c01a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T01:23:35.726 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:35.725+0000 7fcb0c01a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:23:36.105 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.104+0000 7fcb0c01a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T01:23:36.361 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.360+0000 7fcb0c01a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T01:23:36.412 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.410+0000 7fcb0c01a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T01:23:36.528 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.527+0000 7fcb0c01a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T01:23:36.803 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.802+0000 7fcb0c01a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T01:23:36.850 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:36.849+0000 7fcb0c01a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T01:23:37.003 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.002+0000 7fcb0c01a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T01:23:37.141 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.140+0000 7fcb0c01a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T01:23:37.191 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.189+0000 7fcb0c01a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T01:23:37.260 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.258+0000 7fcb0c01a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T01:23:37.304 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.303+0000 7fcb0c01a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T01:23:37.775 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.775+0000 7fcb0c01a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T01:23:37.889 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:37.889+0000 7fcb0c01a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T01:23:38.774 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-24T01:23:38.773+0000 7fc86c80c640 -1 osd.0 0 log_to_monitors true 2024-04-24T01:23:38.897 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-24T01:23:38.897+0000 7fcaac9c1640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-24T01:23:38.962 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-24T01:23:38.962+0000 7f1fb6896640 -1 osd.2 0 log_to_monitors true 2024-04-24T01:23:38.964 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-24T01:23:38.964+0000 7f445891e640 -1 osd.1 0 log_to_monitors true 2024-04-24T01:23:38.967 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-24T01:23:38.967+0000 7fd346815640 -1 osd.3 0 log_to_monitors true 2024-04-24T01:23:40.786 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-24T01:23:40.785+0000 7fc867f7f640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T01:23:40.799 INFO:tasks.ceph.osd.0.smithi142.stderr:2024-04-24T01:23:40.799+0000 7fc8605b1640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:23:41.913 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:42.012 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7ee152640 1 Processor -- start 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7ee152640 1 -- start start 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7ee152640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e8096350 0x7fd7e8096730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7ee152640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e8071e10 con 0x7fd7e8071570 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7ee152640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e806ecf0 con 0x7fd7e8096350 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7e77fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e8096350 0x7fd7e8096730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7e6ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd7e8071570 0x7fd7e812c050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:33498/0 (socket says 172.21.15.142:33498) 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.011+0000 7fd7e6ffd640 1 -- 172.21.15.142:0/2416721520 learned_addr learned my addr 172.21.15.142:0/2416721520 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.012+0000 7fd7e77fe640 1 -- 172.21.15.142:0/2416721520 >> v1:172.21.15.142:6789/0 conn(0x7fd7e8071570 legacy=0x7fd7e812c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:42.013 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.012+0000 7fd7e77fe640 1 -- 172.21.15.142:0/2416721520 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e809c5e0 con 0x7fd7e8096350 2024-04-24T01:23:42.017 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.012+0000 7fd7e77fe640 1 --2- 172.21.15.142:0/2416721520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8096350 0x7fd7e8096730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009720 tx=0x7fd7d802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9c8a3469f9932c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:42.017 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.012+0000 7fd7e67fc640 1 -- 172.21.15.142:0/2416721520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d80316d0 con 0x7fd7e8096350 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7e67fc640 1 -- 172.21.15.142:0/2416721520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d8037070 con 0x7fd7e8096350 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7e67fc640 1 -- 172.21.15.142:0/2416721520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d80319c0 con 0x7fd7e8096350 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 -- 172.21.15.142:0/2416721520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8096350 msgr2=0x7fd7e8096730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 --2- 172.21.15.142:0/2416721520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8096350 0x7fd7e8096730 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009720 tx=0x7fd7d802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 -- 172.21.15.142:0/2416721520 shutdown_connections 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 --2- 172.21.15.142:0/2416721520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8096350 0x7fd7e8096730 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 -- 172.21.15.142:0/2416721520 >> 172.21.15.142:0/2416721520 conn(0x7fd7e809a840 msgr2=0x7fd7e809ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 -- 172.21.15.142:0/2416721520 shutdown_connections 2024-04-24T01:23:42.018 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.013+0000 7fd7ee152640 1 -- 172.21.15.142:0/2416721520 wait complete. 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.014+0000 7fd7ee152640 1 Processor -- start 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.014+0000 7fd7ee152640 1 -- start start 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.014+0000 7fd7ee152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7ee152640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e812c760 con 0x7fd7e8071570 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7e77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7e77fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51442/0 (socket says 172.21.15.142:51442) 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7e77fe640 1 -- 172.21.15.142:0/947449614 learned_addr learned my addr 172.21.15.142:0/947449614 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7e77fe640 1 -- 172.21.15.142:0/947449614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e8070620 con 0x7fd7e8071570 2024-04-24T01:23:42.019 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7e77fe640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009720 tx=0x7fd7d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d8032770 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d8032910 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e81291d0 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d8032bf0 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.015+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e812bbc0 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.016+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fd7d804c060 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.016+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e80737f0 con 0x7fd7e8071570 2024-04-24T01:23:42.020 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.016+0000 7fd7cffff640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 0x7fd7d403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:42.021 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.016+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1903+0+0 (secure 0 0 0) 0x7fd7d802f050 con 0x7fd7e8071570 2024-04-24T01:23:42.021 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.017+0000 7fd7e6ffd640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 0x7fd7d403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:42.021 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.017+0000 7fd7e6ffd640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 0x7fd7d403a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc007fd0 tx=0x7fd7dc007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:42.022 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.021+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd7d8040070 con 0x7fd7e8071570 2024-04-24T01:23:42.195 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.194+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7e8062da0 con 0x7fd7e8071570 2024-04-24T01:23:42.195 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.195+0000 7fd7cffff640 1 -- 172.21.15.142:0/947449614 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+4685 (secure 0 0 0) 0x7fd7d8032d90 con 0x7fd7e8071570 2024-04-24T01:23:42.195 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-24T01:23:42.196 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":10,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:41.962611+0000","last_up_change":"2024-04-24T01:23:40.951063+0000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6801","nonce":3255114084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6803","nonce":3255114084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6807","nonce":3255114084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6805","nonce":3255114084}]},"public_addr":"172.21.15.142:6801/3255114084","cluster_addr":"172.21.15.142:6803/3255114084","heartbeat_back_addr":"172.21.15.142:6807/3255114084","heartbeat_front_addr":"172.21.15.142:6805/3255114084","state":["exists","up"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.781825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:42.197 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.196+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 msgr2=0x7fd7d403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.196+0000 7fd7ee152640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 0x7fd7d403a490 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc007fd0 tx=0x7fd7dc007ac0 comp rx=0 tx=0).stop 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.196+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 msgr2=0x7fd7e81c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.196+0000 7fd7ee152640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009720 tx=0x7fd7d80046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 shutdown_connections 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7d4037fd0 0x7fd7d403a490 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 --2- 172.21.15.142:0/947449614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e8071570 0x7fd7e81c2fb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 >> 172.21.15.142:0/947449614 conn(0x7fd7e809a840 msgr2=0x7fd7e812a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 shutdown_connections 2024-04-24T01:23:42.198 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:42.197+0000 7fd7ee152640 1 -- 172.21.15.142:0/947449614 wait complete. 2024-04-24T01:23:42.207 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-04-24T01:23:42.653 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-24T01:23:42.653+0000 7f1fb2009640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T01:23:42.668 INFO:tasks.ceph.osd.2.smithi169.stderr:2024-04-24T01:23:42.668+0000 7f1faa63b640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:23:42.677 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-24T01:23:42.677+0000 7fd34198f640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T01:23:42.686 INFO:tasks.ceph.osd.3.smithi169.stderr:2024-04-24T01:23:42.686+0000 7fd339fc1640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:23:42.712 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-24T01:23:42.711+0000 7f4454091640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T01:23:42.725 INFO:tasks.ceph.osd.1.smithi169.stderr:2024-04-24T01:23:42.725+0000 7f444c6c3640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T01:23:48.612 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:48.715 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.714+0000 7fee087ad640 1 Processor -- start 2024-04-24T01:23:48.715 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.714+0000 7fee087ad640 1 -- start start 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee087ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee0012e9b0 0x7fee0012ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee087ad640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0009a730 con 0x7fee0006dde0 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee087ad640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fee0006f290 con 0x7fee0012e9b0 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee06549640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fee0012e9b0 0x7fee0012ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee05d48640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fee0006dde0 0x7fee0006e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56080/0 (socket says 172.21.15.142:56080) 2024-04-24T01:23:48.716 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee05d48640 1 -- 172.21.15.142:0/3736043425 learned_addr learned my addr 172.21.15.142:0/3736043425 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:48.717 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee06549640 1 -- 172.21.15.142:0/3736043425 >> v1:172.21.15.142:6789/0 conn(0x7fee0006dde0 legacy=0x7fee0006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:48.717 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.715+0000 7fee06549640 1 -- 172.21.15.142:0/3736043425 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0006fad0 con 0x7fee0012e9b0 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.716+0000 7fee06549640 1 --2- 172.21.15.142:0/3736043425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0012e9b0 0x7fee0012ed90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009720 tx=0x7fedfc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b13e6b802d592b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.716+0000 7fee05547640 1 -- 172.21.15.142:0/3736043425 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedfc0316d0 con 0x7fee0012e9b0 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.716+0000 7fee05547640 1 -- 172.21.15.142:0/3736043425 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc037070 con 0x7fee0012e9b0 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.716+0000 7fee05547640 1 -- 172.21.15.142:0/3736043425 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedfc0319c0 con 0x7fee0012e9b0 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 -- 172.21.15.142:0/3736043425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0012e9b0 msgr2=0x7fee0012ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 --2- 172.21.15.142:0/3736043425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0012e9b0 0x7fee0012ed90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009720 tx=0x7fedfc02b840 comp rx=0 tx=0).stop 2024-04-24T01:23:48.718 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 -- 172.21.15.142:0/3736043425 shutdown_connections 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 --2- 172.21.15.142:0/3736043425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0012e9b0 0x7fee0012ed90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 -- 172.21.15.142:0/3736043425 >> 172.21.15.142:0/3736043425 conn(0x7fee0009b790 msgr2=0x7fee0009bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 -- 172.21.15.142:0/3736043425 shutdown_connections 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.717+0000 7fee087ad640 1 -- 172.21.15.142:0/3736043425 wait complete. 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee087ad640 1 Processor -- start 2024-04-24T01:23:48.719 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee087ad640 1 -- start start 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee087ad640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee087ad640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fee0012f450 con 0x7fee0006dde0 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee06549640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee06549640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33668/0 (socket says 172.21.15.142:33668) 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee06549640 1 -- 172.21.15.142:0/1272433887 learned_addr learned my addr 172.21.15.142:0/1272433887 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.718+0000 7fee06549640 1 -- 172.21.15.142:0/1272433887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee00120a40 con 0x7fee0006dde0 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fee06549640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedfc034040 tx=0x7fedfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedfc032770 con 0x7fee0006dde0 2024-04-24T01:23:48.721 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc032930 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee00071210 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedfc032c50 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.719+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee001218b0 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.720+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fedfc04c060 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.720+0000 7fedf6ffd640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 0x7fede403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.720+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee000737f0 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.720+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fedfc02f050 con 0x7fee0006dde0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.720+0000 7fee05d48640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 0x7fede403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:48.722 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.721+0000 7fee05d48640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 0x7fede403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007fd0 tx=0x7fedf0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:48.725 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.725+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fedfc040070 con 0x7fee0006dde0 2024-04-24T01:23:48.903 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.902+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee000708c0 con 0x7fee0006dde0 2024-04-24T01:23:48.903 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.903+0000 7fedf6ffd640 1 -- 172.21.15.142:0/1272433887 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7990 (secure 0 0 0) 0x7fee000708c0 con 0x7fee0006dde0 2024-04-24T01:23:48.904 INFO:teuthology.misc.health.smithi142.stdout: 2024-04-24T01:23:48.904 INFO:teuthology.misc.health.smithi142.stdout:{"epoch":14,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:46.662700+0000","last_up_change":"2024-04-24T01:23:43.655336+0000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:23:43.925915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6801","nonce":3255114084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6803","nonce":3255114084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6807","nonce":3255114084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6805","nonce":3255114084}]},"public_addr":"172.21.15.142:6801/3255114084","cluster_addr":"172.21.15.142:6803/3255114084","heartbeat_back_addr":"172.21.15.142:6807/3255114084","heartbeat_front_addr":"172.21.15.142:6805/3255114084","state":["exists","up"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6801","nonce":461208471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6803","nonce":461208471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6807","nonce":461208471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6805","nonce":461208471}]},"public_addr":"172.21.15.169:6801/461208471","cluster_addr":"172.21.15.169:6803/461208471","heartbeat_back_addr":"172.21.15.169:6807/461208471","heartbeat_front_addr":"172.21.15.169:6805/461208471","state":["exists","up"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6809","nonce":1447817104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6811","nonce":1447817104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6815","nonce":1447817104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6813","nonce":1447817104}]},"public_addr":"172.21.15.169:6809/1447817104","cluster_addr":"172.21.15.169:6811/1447817104","heartbeat_back_addr":"172.21.15.169:6815/1447817104","heartbeat_front_addr":"172.21.15.169:6813/1447817104","state":["exists","up"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6817","nonce":1313458488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6819","nonce":1313458488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6823","nonce":1313458488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6821","nonce":1313458488}]},"public_addr":"172.21.15.169:6817/1313458488","cluster_addr":"172.21.15.169:6819/1313458488","heartbeat_back_addr":"172.21.15.169:6823/1313458488","heartbeat_front_addr":"172.21.15.169:6821/1313458488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.781825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.956820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:40.009270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.954872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:48.906 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 msgr2=0x7fede403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:48.906 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 0x7fede403a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007fd0 tx=0x7fedf0007ac0 comp rx=0 tx=0).stop 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 msgr2=0x7fee0011ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedfc034040 tx=0x7fedfc0046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 shutdown_connections 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fede4038060 0x7fede403a520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 --2- 172.21.15.142:0/1272433887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee0006dde0 0x7fee0011ec90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 >> 172.21.15.142:0/1272433887 conn(0x7fee0009b790 msgr2=0x7fee0009d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 shutdown_connections 2024-04-24T01:23:48.907 INFO:teuthology.misc.health.smithi142.stderr:2024-04-24T01:23:48.905+0000 7fee087ad640 1 -- 172.21.15.142:0/1272433887 wait complete. 2024-04-24T01:23:48.916 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-24T01:23:48.916 INFO:tasks.ceph:Creating RBD pool 2024-04-24T01:23:48.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-24T01:23:49.017 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.012+0000 7fd08354b640 1 Processor -- start 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.012+0000 7fd08354b640 1 -- start start 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.012+0000 7fd08354b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd07c127cb0 0x7fd07c128090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd08354b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd07c128a00 con 0x7fd07c1285d0 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd08354b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd07c127b00 con 0x7fd07c127cb0 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd0812e7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd07c127cb0 0x7fd07c128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd080ae6640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd07c1285d0 0x7fd07c06e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56086/0 (socket says 172.21.15.142:56086) 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd080ae6640 1 -- 172.21.15.142:0/147809900 learned_addr learned my addr 172.21.15.142:0/147809900 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd0812e7640 1 -- 172.21.15.142:0/147809900 >> v1:172.21.15.142:6789/0 conn(0x7fd07c1285d0 legacy=0x7fd07c06e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd0812e7640 1 -- 172.21.15.142:0/147809900 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c098800 con 0x7fd07c127cb0 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.013+0000 7fd073fff640 1 -- 172.21.15.142:0/147809900 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 428257097 0 0) 0x7fd07c128a00 con 0x7fd07c1285d0 2024-04-24T01:23:49.018 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd0812e7640 1 --2- 172.21.15.142:0/147809900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c128090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd078009750 tx=0x7fd07802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66a1334ca7daab21 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd073fff640 1 -- 172.21.15.142:0/147809900 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0780316d0 con 0x7fd07c127cb0 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd073fff640 1 -- 172.21.15.142:0/147809900 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078037070 con 0x7fd07c127cb0 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd073fff640 1 -- 172.21.15.142:0/147809900 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0780319c0 con 0x7fd07c127cb0 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 -- 172.21.15.142:0/147809900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 msgr2=0x7fd07c128090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 --2- 172.21.15.142:0/147809900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c128090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd078009750 tx=0x7fd07802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 -- 172.21.15.142:0/147809900 shutdown_connections 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 --2- 172.21.15.142:0/147809900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c128090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 -- 172.21.15.142:0/147809900 >> 172.21.15.142:0/147809900 conn(0x7fd07c099680 msgr2=0x7fd07c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 -- 172.21.15.142:0/147809900 shutdown_connections 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.014+0000 7fd08354b640 1 -- 172.21.15.142:0/147809900 wait complete. 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.015+0000 7fd08354b640 1 Processor -- start 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.015+0000 7fd08354b640 1 -- start start 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd08354b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd08354b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd07c0701f0 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd0812e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd0812e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33696/0 (socket says 172.21.15.142:33696) 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd0812e7640 1 -- 172.21.15.142:0/623299514 learned_addr learned my addr 172.21.15.142:0/623299514 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd0812e7640 1 -- 172.21.15.142:0/623299514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07c08c6d0 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd0812e7640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd078034040 tx=0x7fd0780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078032770 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd078032910 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07c08d0e0 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd078032c30 con 0x7fd07c127cb0 2024-04-24T01:23:49.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.016+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd07c08d780 con 0x7fd07c127cb0 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.017+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd07804c060 con 0x7fd07c127cb0 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.017+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd07c062da0 con 0x7fd07c127cb0 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.017+0000 7fd071ffb640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 0x7fd06003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.017+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7fd07802f050 con 0x7fd07c127cb0 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.018+0000 7fd080ae6640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 0x7fd06003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.018+0000 7fd080ae6640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 0x7fd06003a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd06c000c00 tx=0x7fd06c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.022+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd07c08d780 con 0x7fd07c127cb0 2024-04-24T01:23:49.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.195+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fd07c071f80 con 0x7fd07c127cb0 2024-04-24T01:23:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.675+0000 7fd071ffb640 1 -- 172.21.15.142:0/623299514 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7fd078040070 con 0x7fd07c127cb0 2024-04-24T01:23:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'rbd' created 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 msgr2=0x7fd06003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 0x7fd06003a520 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd06c000c00 tx=0x7fd06c007910 comp rx=0 tx=0).stop 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 msgr2=0x7fd07c1c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd078034040 tx=0x7fd0780046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 shutdown_connections 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd060038060 0x7fd06003a520 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 --2- 172.21.15.142:0/623299514 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd07c127cb0 0x7fd07c1c11d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 >> 172.21.15.142:0/623299514 conn(0x7fd07c099680 msgr2=0x7fd07c12b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 shutdown_connections 2024-04-24T01:23:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.678+0000 7fd08354b640 1 -- 172.21.15.142:0/623299514 wait complete. 2024-04-24T01:23:49.691 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-24T01:23:49.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c9952b640 1 Processor -- start 2024-04-24T01:23:49.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c9952b640 1 -- start start 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c9952b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c9412b760 0x7f0c9412bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c9952b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c9412c080 con 0x7f0c9409f1a0 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c9952b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0c94070210 con 0x7f0c9412b760 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c92ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f0c9412b760 0x7f0c9412bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c927fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f0c9409f1a0 0x7f0c9406dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56092/0 (socket says 172.21.15.142:56092) 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.791+0000 7f0c927fc640 1 -- 172.21.15.142:0/1863650576 learned_addr learned my addr 172.21.15.142:0/1863650576 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.792+0000 7f0c92ffd640 1 -- 172.21.15.142:0/1863650576 >> v1:172.21.15.142:6789/0 conn(0x7f0c9409f1a0 legacy=0x7f0c9406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.792+0000 7f0c92ffd640 1 -- 172.21.15.142:0/1863650576 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9406f580 con 0x7f0c9412b760 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.792+0000 7f0c92ffd640 1 --2- 172.21.15.142:0/1863650576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9412b760 0x7f0c9412bb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009720 tx=0x7f0c8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38c3fed8b43b81a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.792+0000 7f0c91ffb640 1 -- 172.21.15.142:0/1863650576 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c880316d0 con 0x7f0c9412b760 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c91ffb640 1 -- 172.21.15.142:0/1863650576 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88037070 con 0x7f0c9412b760 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c91ffb640 1 -- 172.21.15.142:0/1863650576 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c880319c0 con 0x7f0c9412b760 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 -- 172.21.15.142:0/1863650576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9412b760 msgr2=0x7f0c9412bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1863650576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9412b760 0x7f0c9412bb40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009720 tx=0x7f0c8802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 -- 172.21.15.142:0/1863650576 shutdown_connections 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1863650576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9412b760 0x7f0c9412bb40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 -- 172.21.15.142:0/1863650576 >> 172.21.15.142:0/1863650576 conn(0x7f0c9409cd50 msgr2=0x7f0c9409e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 -- 172.21.15.142:0/1863650576 shutdown_connections 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.793+0000 7f0c9952b640 1 -- 172.21.15.142:0/1863650576 wait complete. 2024-04-24T01:23:49.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.794+0000 7f0c9952b640 1 Processor -- start 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.794+0000 7f0c9952b640 1 -- start start 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.794+0000 7f0c9952b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.794+0000 7f0c9952b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f0c9406e8c0 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.794+0000 7f0c92ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c92ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33724/0 (socket says 172.21.15.142:33724) 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c92ffd640 1 -- 172.21.15.142:0/1392003216 learned_addr learned my addr 172.21.15.142:0/1392003216 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c92ffd640 1 -- 172.21.15.142:0/1392003216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c94124550 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c92ffd640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c88034040 tx=0x7f0c880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c88032770 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c88032910 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c941255c0 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c88032bf0 con 0x7f0c9409f1a0 2024-04-24T01:23:49.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.795+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c941c3830 con 0x7f0c9409f1a0 2024-04-24T01:23:49.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.796+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0c8804c060 con 0x7f0c9409f1a0 2024-04-24T01:23:49.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.796+0000 7f0c7b7fe640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 0x7f0c8003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:49.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.796+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f0c8802f050 con 0x7f0c9409f1a0 2024-04-24T01:23:49.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.796+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c94062da0 con 0x7f0c9409f1a0 2024-04-24T01:23:49.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.796+0000 7f0c927fc640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 0x7f0c8003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:49.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.797+0000 7f0c927fc640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 0x7f0c8003a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:49.801 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.801+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f0c88040070 con 0x7f0c9409f1a0 2024-04-24T01:23:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:49.975+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f0c941253a0 con 0x7f0c9409f1a0 2024-04-24T01:23:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.681+0000 7f0c7b7fe640 1 -- 172.21.15.142:0/1392003216 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 173+0+0 (secure 0 0 0) 0x7f0c8803a540 con 0x7f0c9409f1a0 2024-04-24T01:23:50.682 INFO:teuthology.orchestra.run.smithi142.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-24T01:23:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 msgr2=0x7f0c8003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 0x7f0c8003a520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0c84000f60 tx=0x7f0c84007a80 comp rx=0 tx=0).stop 2024-04-24T01:23:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 msgr2=0x7f0c941c32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0c88034040 tx=0x7f0c880046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 shutdown_connections 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0c80038060 0x7f0c8003a520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 --2- 172.21.15.142:0/1392003216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0c9409f1a0 0x7f0c941c32f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 >> 172.21.15.142:0/1392003216 conn(0x7f0c9409cd50 msgr2=0x7f0c9411b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.684+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 shutdown_connections 2024-04-24T01:23:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.685+0000 7f0c9952b640 1 -- 172.21.15.142:0/1392003216 wait complete. 2024-04-24T01:23:50.700 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T01:23:50.700 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T01:23:50.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T01:23:50.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T01:23:50.701 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T01:23:50.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.801+0000 7ff077fbe640 1 Processor -- start 2024-04-24T01:23:50.802 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff077fbe640 1 -- start start 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff077fbe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff070127ce0 0x7ff0701280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff077fbe640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff070127b00 con 0x7ff070070100 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff077fbe640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff0700708e0 con 0x7ff070127ce0 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff075d5a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff070127ce0 0x7ff0701280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff075559640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7ff070070100 0x7ff07012b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56106/0 (socket says 172.21.15.142:56106) 2024-04-24T01:23:50.803 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.802+0000 7ff075559640 1 -- 172.21.15.142:0/2599521622 learned_addr learned my addr 172.21.15.142:0/2599521622 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:50.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff075d5a640 1 -- 172.21.15.142:0/2599521622 >> v1:172.21.15.142:6789/0 conn(0x7ff070070100 legacy=0x7ff07012b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:50.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff075d5a640 1 -- 172.21.15.142:0/2599521622 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070098800 con 0x7ff070127ce0 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff075d5a640 1 --2- 172.21.15.142:0/2599521622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070127ce0 0x7ff0701280c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff068009720 tx=0x7ff06802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d85384634704fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff074d58640 1 -- 172.21.15.142:0/2599521622 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0680316d0 con 0x7ff070127ce0 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff074d58640 1 -- 172.21.15.142:0/2599521622 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff068037070 con 0x7ff070127ce0 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.803+0000 7ff074d58640 1 -- 172.21.15.142:0/2599521622 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0680319c0 con 0x7ff070127ce0 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 -- 172.21.15.142:0/2599521622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070127ce0 msgr2=0x7ff0701280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:50.805 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 --2- 172.21.15.142:0/2599521622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070127ce0 0x7ff0701280c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff068009720 tx=0x7ff06802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 -- 172.21.15.142:0/2599521622 shutdown_connections 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 --2- 172.21.15.142:0/2599521622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070127ce0 0x7ff0701280c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 -- 172.21.15.142:0/2599521622 >> 172.21.15.142:0/2599521622 conn(0x7ff070099680 msgr2=0x7ff070099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 -- 172.21.15.142:0/2599521622 shutdown_connections 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.804+0000 7ff077fbe640 1 -- 172.21.15.142:0/2599521622 wait complete. 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff077fbe640 1 Processor -- start 2024-04-24T01:23:50.806 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff077fbe640 1 -- start start 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff077fbe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff077fbe640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff070128780 con 0x7ff070070100 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff075d5a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff075d5a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33752/0 (socket says 172.21.15.142:33752) 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.805+0000 7ff075d5a640 1 -- 172.21.15.142:0/356033172 learned_addr learned my addr 172.21.15.142:0/356033172 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff075d5a640 1 -- 172.21.15.142:0/356033172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff070125420 con 0x7ff070070100 2024-04-24T01:23:50.808 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff075d5a640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff068009720 tx=0x7ff0680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff068032770 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff068032910 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07012d960 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff068032bf0 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.806+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07012e590 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.807+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff06804d3f0 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.807+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07012d2a0 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.807+0000 7ff06e7fc640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 0x7ff05c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.807+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7ff06802f050 con 0x7ff070070100 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.807+0000 7ff075559640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 0x7ff05c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:50.809 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.808+0000 7ff075559640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 0x7ff05c03a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff064007fd0 tx=0x7ff064007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:50.812 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:50.812+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7ff068040070 con 0x7ff070070100 2024-04-24T01:23:51.030 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.030+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff070062da0 con 0x7ff070070100 2024-04-24T01:23:51.032 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.031+0000 7ff06e7fc640 1 -- 172.21.15.142:0/356033172 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87207 (secure 0 0 0) 0x7ff06803a540 con 0x7ff070070100 2024-04-24T01:23:51.034 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 msgr2=0x7ff05c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 0x7ff05c03a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff064007fd0 tx=0x7ff064007ac0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 msgr2=0x7ff07012c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff068009720 tx=0x7ff0680046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 shutdown_connections 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff05c038060 0x7ff05c03a520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 --2- 172.21.15.142:0/356033172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff070070100 0x7ff07012c0f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 >> 172.21.15.142:0/356033172 conn(0x7ff070099680 msgr2=0x7ff07009ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.035 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 shutdown_connections 2024-04-24T01:23:51.036 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.034+0000 7ff077fbe640 1 -- 172.21.15.142:0/356033172 wait complete. 2024-04-24T01:23:51.045 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":3871964860},{"type":"v1","addr":"172.21.15.169:6825","nonce":3871964860}]},"active_addr":"172.21.15.169:6825/3871964860","active_change":"2024-04-24T01:23:37.891395+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1299886277}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1244854835}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3860223177}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":3161535830}]}]} 2024-04-24T01:23:51.047 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T01:23:51.047 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T01:23:51.047 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:51.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc249d1c640 1 Processor -- start 2024-04-24T01:23:51.144 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc249d1c640 1 -- start start 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc249d1c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc244096430 0x7fc244096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc249d1c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc244098800 con 0x7fc244071090 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc249d1c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fc244071930 con 0x7fc244096430 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc2437fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fc244096430 0x7fc244096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc242ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fc244071090 0x7fc24406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56120/0 (socket says 172.21.15.142:56120) 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.143+0000 7fc242ffd640 1 -- 172.21.15.142:0/2630861012 learned_addr learned my addr 172.21.15.142:0/2630861012 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2437fe640 1 -- 172.21.15.142:0/2630861012 >> v1:172.21.15.142:6789/0 conn(0x7fc244071090 legacy=0x7fc24406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.145 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2437fe640 1 -- 172.21.15.142:0/2630861012 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc244071f50 con 0x7fc244096430 2024-04-24T01:23:51.148 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2437fe640 1 --2- 172.21.15.142:0/2630861012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244096430 0x7fc244096810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc234009720 tx=0x7fc23402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27a4b3d6bdda0aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2427fc640 1 -- 172.21.15.142:0/2630861012 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2340316d0 con 0x7fc244096430 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2427fc640 1 -- 172.21.15.142:0/2630861012 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234037070 con 0x7fc244096430 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.144+0000 7fc2427fc640 1 -- 172.21.15.142:0/2630861012 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2340319c0 con 0x7fc244096430 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 -- 172.21.15.142:0/2630861012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244096430 msgr2=0x7fc244096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 --2- 172.21.15.142:0/2630861012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244096430 0x7fc244096810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc234009720 tx=0x7fc23402b840 comp rx=0 tx=0).stop 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 -- 172.21.15.142:0/2630861012 shutdown_connections 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 --2- 172.21.15.142:0/2630861012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244096430 0x7fc244096810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 -- 172.21.15.142:0/2630861012 >> 172.21.15.142:0/2630861012 conn(0x7fc244099680 msgr2=0x7fc244099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 -- 172.21.15.142:0/2630861012 shutdown_connections 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.145+0000 7fc249d1c640 1 -- 172.21.15.142:0/2630861012 wait complete. 2024-04-24T01:23:51.149 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc249d1c640 1 Processor -- start 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc249d1c640 1 -- start start 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc249d1c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc249d1c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fc244096d50 con 0x7fc244071090 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc2437fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc2437fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33772/0 (socket says 172.21.15.142:33772) 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.146+0000 7fc2437fe640 1 -- 172.21.15.142:0/715915051 learned_addr learned my addr 172.21.15.142:0/715915051 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc2437fe640 1 -- 172.21.15.142:0/715915051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24408b990 con 0x7fc244071090 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc2437fe640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc234034040 tx=0x7fc2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234032770 con 0x7fc244071090 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc234032930 con 0x7fc244071090 2024-04-24T01:23:51.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc244126530 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc234032c50 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.147+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc24408c620 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.148+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc23404c060 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.148+0000 7fc22bfff640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 0x7fc23003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.148+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc244062da0 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.148+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7fc23402f050 con 0x7fc244071090 2024-04-24T01:23:51.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.148+0000 7fc242ffd640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 0x7fc23003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.149+0000 7fc242ffd640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 0x7fc23003a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc238007fd0 tx=0x7fc238007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.152+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fc234040070 con 0x7fc244071090 2024-04-24T01:23:51.327 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.327+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc24406c170 con 0x7fc244071090 2024-04-24T01:23:51.328 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.327+0000 7fc22bfff640 1 -- 172.21.15.142:0/715915051 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7fc234039310 con 0x7fc244071090 2024-04-24T01:23:51.328 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:51.328 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":16,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:50.679518+0000","last_up_change":"2024-04-24T01:23:43.655336+0000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:23:43.925915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:23:49.213537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6801","nonce":3255114084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6803","nonce":3255114084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6807","nonce":3255114084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6805","nonce":3255114084}]},"public_addr":"172.21.15.142:6801/3255114084","cluster_addr":"172.21.15.142:6803/3255114084","heartbeat_back_addr":"172.21.15.142:6807/3255114084","heartbeat_front_addr":"172.21.15.142:6805/3255114084","state":["exists","up"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6801","nonce":461208471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6803","nonce":461208471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6807","nonce":461208471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6805","nonce":461208471}]},"public_addr":"172.21.15.169:6801/461208471","cluster_addr":"172.21.15.169:6803/461208471","heartbeat_back_addr":"172.21.15.169:6807/461208471","heartbeat_front_addr":"172.21.15.169:6805/461208471","state":["exists","up"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6809","nonce":1447817104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6811","nonce":1447817104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6815","nonce":1447817104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6813","nonce":1447817104}]},"public_addr":"172.21.15.169:6809/1447817104","cluster_addr":"172.21.15.169:6811/1447817104","heartbeat_back_addr":"172.21.15.169:6815/1447817104","heartbeat_front_addr":"172.21.15.169:6813/1447817104","state":["exists","up"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6817","nonce":1313458488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6819","nonce":1313458488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6823","nonce":1313458488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6821","nonce":1313458488}]},"public_addr":"172.21.15.169:6817/1313458488","cluster_addr":"172.21.15.169:6819/1313458488","heartbeat_back_addr":"172.21.15.169:6823/1313458488","heartbeat_front_addr":"172.21.15.169:6821/1313458488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.781825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.956820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:40.009270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.954872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 msgr2=0x7fc23003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 0x7fc23003a520 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc238007fd0 tx=0x7fc238007ac0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 msgr2=0x7fc244089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc234034040 tx=0x7fc2340046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 shutdown_connections 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc230038060 0x7fc23003a520 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 --2- 172.21.15.142:0/715915051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc244071090 0x7fc244089f90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 >> 172.21.15.142:0/715915051 conn(0x7fc244099680 msgr2=0x7fc24409b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 shutdown_connections 2024-04-24T01:23:51.331 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.330+0000 7fc249d1c640 1 -- 172.21.15.142:0/715915051 wait complete. 2024-04-24T01:23:51.342 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T01:23:51.342 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:23:51.441 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.440+0000 7f8d3df21640 1 Processor -- start 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.440+0000 7f8d3df21640 1 -- start start 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.440+0000 7f8d3df21640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d38127ce0 0x7f8d381280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.440+0000 7f8d3df21640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d38127b00 con 0x7f8d38070100 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.440+0000 7f8d3df21640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8d380708e0 con 0x7f8d38127ce0 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d377fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8d38127ce0 0x7f8d381280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d36ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8d38070100 0x7f8d3812b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56124/0 (socket says 172.21.15.142:56124) 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d36ffd640 1 -- 172.21.15.142:0/914364510 learned_addr learned my addr 172.21.15.142:0/914364510 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:51.442 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d377fe640 1 -- 172.21.15.142:0/914364510 >> v1:172.21.15.142:6789/0 conn(0x7f8d38070100 legacy=0x7f8d3812b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d377fe640 1 -- 172.21.15.142:0/914364510 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d38098800 con 0x7f8d38127ce0 2024-04-24T01:23:51.443 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.441+0000 7f8d367fc640 1 -- 172.21.15.142:0/914364510 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933940201 0 0) 0x7f8d2c001110 con 0x7f8d38070100 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d377fe640 1 --2- 172.21.15.142:0/914364510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38127ce0 0x7f8d381280c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009720 tx=0x7f8d2802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565c8fce54599c60 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d367fc640 1 -- 172.21.15.142:0/914364510 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d280316d0 con 0x7f8d38127ce0 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d367fc640 1 -- 172.21.15.142:0/914364510 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d28037070 con 0x7f8d38127ce0 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d367fc640 1 -- 172.21.15.142:0/914364510 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d280319c0 con 0x7f8d38127ce0 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 -- 172.21.15.142:0/914364510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38127ce0 msgr2=0x7f8d381280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 --2- 172.21.15.142:0/914364510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38127ce0 0x7f8d381280c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009720 tx=0x7f8d2802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 -- 172.21.15.142:0/914364510 shutdown_connections 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 --2- 172.21.15.142:0/914364510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38127ce0 0x7f8d381280c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.446 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 -- 172.21.15.142:0/914364510 >> 172.21.15.142:0/914364510 conn(0x7f8d38099680 msgr2=0x7f8d38099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 -- 172.21.15.142:0/914364510 shutdown_connections 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.442+0000 7f8d3df21640 1 -- 172.21.15.142:0/914364510 wait complete. 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.443+0000 7f8d3df21640 1 Processor -- start 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.443+0000 7f8d3df21640 1 -- start start 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d3df21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d3df21640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8d38128780 con 0x7f8d38070100 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d377fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d377fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33786/0 (socket says 172.21.15.142:33786) 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d377fe640 1 -- 172.21.15.142:0/868071029 learned_addr learned my addr 172.21.15.142:0/868071029 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d377fe640 1 -- 172.21.15.142:0/868071029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d38123610 con 0x7f8d38070100 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d377fe640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009840 tx=0x7f8d280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d28032770 con 0x7f8d38070100 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d28032910 con 0x7f8d38070100 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d381241c0 con 0x7f8d38070100 2024-04-24T01:23:51.447 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8d28032c30 con 0x7f8d38070100 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.444+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d38096d60 con 0x7f8d38070100 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.445+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8d2804d3f0 con 0x7f8d38070100 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.445+0000 7f8d1ffff640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 0x7f8d2403a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.445+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3482+0+0 (secure 0 0 0) 0x7f8d2802f050 con 0x7f8d38070100 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.445+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d38123fc0 con 0x7f8d38070100 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.446+0000 7f8d36ffd640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 0x7f8d2403a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.448 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.446+0000 7f8d36ffd640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 0x7f8d2403a550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000c00 tx=0x7f8d2c001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.450 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.450+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f8d28040070 con 0x7f8d38070100 2024-04-24T01:23:51.626 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.625+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d38062da0 con 0x7f8d38070100 2024-04-24T01:23:51.627 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.626+0000 7f8d1ffff640 1 -- 172.21.15.142:0/868071029 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9771 (secure 0 0 0) 0x7f8d28052030 con 0x7f8d38070100 2024-04-24T01:23:51.627 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:51.627 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":16,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:23:50.679518+0000","last_up_change":"2024-04-24T01:23:43.655336+0000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:23:43.925915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:23:49.213537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6801","nonce":3255114084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6803","nonce":3255114084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6807","nonce":3255114084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6805","nonce":3255114084}]},"public_addr":"172.21.15.142:6801/3255114084","cluster_addr":"172.21.15.142:6803/3255114084","heartbeat_back_addr":"172.21.15.142:6807/3255114084","heartbeat_front_addr":"172.21.15.142:6805/3255114084","state":["exists","up"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6801","nonce":461208471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6803","nonce":461208471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6807","nonce":461208471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6805","nonce":461208471}]},"public_addr":"172.21.15.169:6801/461208471","cluster_addr":"172.21.15.169:6803/461208471","heartbeat_back_addr":"172.21.15.169:6807/461208471","heartbeat_front_addr":"172.21.15.169:6805/461208471","state":["exists","up"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6809","nonce":1447817104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6811","nonce":1447817104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6815","nonce":1447817104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6813","nonce":1447817104}]},"public_addr":"172.21.15.169:6809/1447817104","cluster_addr":"172.21.15.169:6811/1447817104","heartbeat_back_addr":"172.21.15.169:6815/1447817104","heartbeat_front_addr":"172.21.15.169:6813/1447817104","state":["exists","up"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6817","nonce":1313458488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6819","nonce":1313458488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6823","nonce":1313458488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6821","nonce":1313458488}]},"public_addr":"172.21.15.169:6817/1313458488","cluster_addr":"172.21.15.169:6819/1313458488","heartbeat_back_addr":"172.21.15.169:6823/1313458488","heartbeat_front_addr":"172.21.15.169:6821/1313458488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.781825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.956820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:40.009270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.954872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 msgr2=0x7f8d2403a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 0x7f8d2403a550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000c00 tx=0x7f8d2c001310 comp rx=0 tx=0).stop 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 msgr2=0x7f8d381244d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009840 tx=0x7f8d280046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 shutdown_connections 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8d24038090 0x7f8d2403a550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 --2- 172.21.15.142:0/868071029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d38070100 0x7f8d381244d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 >> 172.21.15.142:0/868071029 conn(0x7f8d38099680 msgr2=0x7f8d38070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 shutdown_connections 2024-04-24T01:23:51.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.628+0000 7f8d3df21640 1 -- 172.21.15.142:0/868071029 wait complete. 2024-04-24T01:23:51.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T01:23:51.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T01:23:51.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T01:23:51.642 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T01:23:51.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7ff6a9ef8640 1 Processor -- start 2024-04-24T01:23:51.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7f40c2227640 1 Processor -- start 2024-04-24T01:23:51.745 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7ff6a9ef8640 1 -- start start 2024-04-24T01:23:51.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fae96831640 1 Processor -- start 2024-04-24T01:23:51.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fae96831640 1 -- start start 2024-04-24T01:23:51.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7f40c2227640 1 -- start start 2024-04-24T01:23:51.746 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fd7e6463640 1 Processor -- start 2024-04-24T01:23:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fd7e6463640 1 -- start start 2024-04-24T01:23:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7ff6a9ef8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6a412bae0 0x7ff6a4130580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7ff6a9ef8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a406fac0 con 0x7ff6a412aff0 2024-04-24T01:23:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7ff6a9ef8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7ff6a4098800 con 0x7ff6a412bae0 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7f40c2227640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40bc098910 0x7f40bc137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fae96831640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae901281e0 0x7fae901285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fae96831640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae90072960 con 0x7fae9012c410 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7fae96831640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fae90072f00 con 0x7fae901281e0 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7f40c2227640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40bc08beb0 con 0x7f40bc132d80 2024-04-24T01:23:51.748 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.744+0000 7f40c2227640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f40bc096e20 con 0x7f40bc098910 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6a412bae0 0x7ff6a4130580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a2ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7ff6a412bae0 0x7ff6a4130580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33798/0 (socket says 172.21.15.142:33798) 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a2ffd640 1 -- 172.21.15.142:0/2585979769 learned_addr learned my addr 172.21.15.142:0/2585979769 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40baffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40bc098910 0x7f40bc137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40bb7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f40bc132d80 0x7f40bc133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56128/0 (socket says 172.21.15.142:56128) 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40baffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f40bc098910 0x7f40bc137b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33812/0 (socket says 172.21.15.142:33812) 2024-04-24T01:23:51.749 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40baffd640 1 -- 172.21.15.142:0/2327366790 learned_addr learned my addr 172.21.15.142:0/2327366790 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fae901281e0 0x7fae901285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8f7fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fae9012c410 0x7fae9012c870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56140/0 (socket says 172.21.15.142:56140) 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8f7fe640 1 -- 172.21.15.142:0/981944180 learned_addr learned my addr 172.21.15.142:0/981944180 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40baffd640 1 -- 172.21.15.142:0/2327366790 >> v1:172.21.15.142:6789/0 conn(0x7f40bc132d80 legacy=0x7f40bc133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7f40baffd640 1 -- 172.21.15.142:0/2327366790 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc08c150 con 0x7f40bc098910 2024-04-24T01:23:51.750 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a2ffd640 1 -- 172.21.15.142:0/2585979769 >> v1:172.21.15.142:6789/0 conn(0x7ff6a412aff0 legacy=0x7ff6a412b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7e6463640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e006d420 0x7fd7e006d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a2ffd640 1 -- 172.21.15.142:0/2585979769 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a4070b60 con 0x7ff6a412bae0 2024-04-24T01:23:51.751 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7ff6a27fc640 1 -- 172.21.15.142:0/2585979769 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239951268 0 0) 0x7ff6a406fac0 con 0x7ff6a412aff0 2024-04-24T01:23:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8effd640 1 -- 172.21.15.142:0/981944180 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400632804 0 0) 0x7fae90072960 con 0x7fae9012c410 2024-04-24T01:23:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8ffff640 1 -- 172.21.15.142:0/981944180 >> v1:172.21.15.142:6789/0 conn(0x7fae9012c410 legacy=0x7fae9012c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7e6463640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e0072290 con 0x7fd7e006dd40 2024-04-24T01:23:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7e6463640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e006e940 con 0x7fd7e006d420 2024-04-24T01:23:51.752 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fae8ffff640 1 -- 172.21.15.142:0/981944180 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae90071990 con 0x7fae901281e0 2024-04-24T01:23:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7dffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e006d420 0x7fd7e006d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7dffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd7e006d420 0x7fd7e006d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33828/0 (socket says 172.21.15.142:33828) 2024-04-24T01:23:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7dffff640 1 -- 172.21.15.142:0/805745108 learned_addr learned my addr 172.21.15.142:0/805745108 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.745+0000 7fd7dffff640 1 -- 172.21.15.142:0/805745108 >> v1:172.21.15.142:6789/0 conn(0x7fd7e006dd40 legacy=0x7fd7e012e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T01:23:51.753 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7fd7dffff640 1 -- 172.21.15.142:0/805745108 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0098800 con 0x7fd7e006d420 2024-04-24T01:23:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7ff6a2ffd640 1 --2- 172.21.15.142:0/2585979769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412bae0 0x7ff6a4130580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff69800ba90 tx=0x7ff69802e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d1136b3962b433 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7f40baffd640 1 --2- 172.21.15.142:0/2327366790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc137b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40b00097f0 tx=0x7f40b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cae05989750983 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.754 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7ff6a27fc640 1 -- 172.21.15.142:0/2585979769 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff69803b070 con 0x7ff6a412bae0 2024-04-24T01:23:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7ff6a27fc640 1 -- 172.21.15.142:0/2585979769 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69802edd0 con 0x7ff6a412bae0 2024-04-24T01:23:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7ff6a27fc640 1 -- 172.21.15.142:0/2585979769 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff698036590 con 0x7ff6a412bae0 2024-04-24T01:23:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7fd7dffff640 1 --2- 172.21.15.142:0/805745108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e006d800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097f0 tx=0x7fd7d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76e93101b3b8290 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7f40ba7fc640 1 -- 172.21.15.142:0/2327366790 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b0035020 con 0x7f40bc098910 2024-04-24T01:23:51.755 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7f40ba7fc640 1 -- 172.21.15.142:0/2327366790 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b00317a0 con 0x7f40bc098910 2024-04-24T01:23:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7fae8ffff640 1 --2- 172.21.15.142:0/981944180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae901281e0 0x7fae901285c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae80009720 tx=0x7fae8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8583b0a8fb7babf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.756 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7f40ba7fc640 1 -- 172.21.15.142:0/2327366790 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b0035020 con 0x7f40bc098910 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.746+0000 7fd7df7fe640 1 -- 172.21.15.142:0/805745108 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d002e070 con 0x7fd7e006d420 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7df7fe640 1 -- 172.21.15.142:0/805745108 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d0037070 con 0x7fd7e006d420 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7df7fe640 1 -- 172.21.15.142:0/805745108 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d0031730 con 0x7fd7e006d420 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 -- 172.21.15.142:0/805745108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 msgr2=0x7fd7e006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 --2- 172.21.15.142:0/805745108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e006d800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097f0 tx=0x7fd7d002b880 comp rx=0 tx=0).stop 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fae8effd640 1 -- 172.21.15.142:0/981944180 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae800316d0 con 0x7fae901281e0 2024-04-24T01:23:51.757 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/2585979769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412bae0 msgr2=0x7ff6a4130580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 --2- 172.21.15.142:0/2585979769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412bae0 0x7ff6a4130580 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff69800ba90 tx=0x7ff69802e0f0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fae8effd640 1 -- 172.21.15.142:0/981944180 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae80037070 con 0x7fae901281e0 2024-04-24T01:23:51.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fae8effd640 1 -- 172.21.15.142:0/981944180 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae800319c0 con 0x7fae901281e0 2024-04-24T01:23:51.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7f40c2227640 1 -- 172.21.15.142:0/2327366790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 msgr2=0x7f40bc137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.758 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7f40c2227640 1 --2- 172.21.15.142:0/2327366790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc137b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f40b00097f0 tx=0x7f40b002b910 comp rx=0 tx=0).stop 2024-04-24T01:23:51.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 -- 172.21.15.142:0/805745108 shutdown_connections 2024-04-24T01:23:51.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 --2- 172.21.15.142:0/805745108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e006d800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/2585979769 shutdown_connections 2024-04-24T01:23:51.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 --2- 172.21.15.142:0/2585979769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412bae0 0x7ff6a4130580 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.759 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/2585979769 >> 172.21.15.142:0/2585979769 conn(0x7ff6a4099680 msgr2=0x7ff6a4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 -- 172.21.15.142:0/805745108 >> 172.21.15.142:0/805745108 conn(0x7fd7e0099680 msgr2=0x7fd7e0099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7f40c2227640 1 -- 172.21.15.142:0/2327366790 shutdown_connections 2024-04-24T01:23:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7fd7e6463640 1 -- 172.21.15.142:0/805745108 shutdown_connections 2024-04-24T01:23:51.760 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fd7e6463640 1 -- 172.21.15.142:0/805745108 wait complete. 2024-04-24T01:23:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/2585979769 shutdown_connections 2024-04-24T01:23:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/2585979769 wait complete. 2024-04-24T01:23:51.761 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7f40c2227640 1 --2- 172.21.15.142:0/2327366790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc137b70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.747+0000 7f40c2227640 1 -- 172.21.15.142:0/2327366790 >> 172.21.15.142:0/2327366790 conn(0x7f40bc099680 msgr2=0x7f40bc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7f40c2227640 1 -- 172.21.15.142:0/2327366790 shutdown_connections 2024-04-24T01:23:51.762 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7f40c2227640 1 -- 172.21.15.142:0/2327366790 wait complete. 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 -- 172.21.15.142:0/981944180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae901281e0 msgr2=0x7fae901285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 --2- 172.21.15.142:0/981944180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae901281e0 0x7fae901285c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae80009720 tx=0x7fae8002b840 comp rx=0 tx=0).stop 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 -- 172.21.15.142:0/981944180 shutdown_connections 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 --2- 172.21.15.142:0/981944180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae901281e0 0x7fae901285c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 -- 172.21.15.142:0/981944180 >> 172.21.15.142:0/981944180 conn(0x7fae9009c7f0 msgr2=0x7fae9009cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 -- 172.21.15.142:0/981944180 shutdown_connections 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.748+0000 7fae96831640 1 -- 172.21.15.142:0/981944180 wait complete. 2024-04-24T01:23:51.763 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7e6463640 1 Processor -- start 2024-04-24T01:23:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7ff6a9ef8640 1 Processor -- start 2024-04-24T01:23:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7e6463640 1 -- start start 2024-04-24T01:23:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7f40c2227640 1 Processor -- start 2024-04-24T01:23:51.765 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7ff6a9ef8640 1 -- start start 2024-04-24T01:23:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7e6463640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7e6463640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e006e160 con 0x7fd7e006d420 2024-04-24T01:23:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.766 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7dffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33840/0 (socket says 172.21.15.142:33840) 2024-04-24T01:23:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7dffff640 1 -- 172.21.15.142:0/2537910196 learned_addr learned my addr 172.21.15.142:0/2537910196 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7f40c2227640 1 -- start start 2024-04-24T01:23:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fae96831640 1 Processor -- start 2024-04-24T01:23:51.767 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.749+0000 7fd7dffff640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0125790 con 0x7fd7e006d420 2024-04-24T01:23:51.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae96831640 1 -- start start 2024-04-24T01:23:51.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a9ef8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a9ef8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a40708a0 con 0x7ff6a412aff0 2024-04-24T01:23:51.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40c2227640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.768 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40c2227640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc138440 con 0x7f40bc098910 2024-04-24T01:23:51.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7dffff640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097f0 tx=0x7fd7d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40bb7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40bb7fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33854/0 (socket says 172.21.15.142:33854) 2024-04-24T01:23:51.769 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40bb7fe640 1 -- 172.21.15.142:0/2194855503 learned_addr learned my addr 172.21.15.142:0/2194855503 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a37fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33846/0 (socket says 172.21.15.142:33846) 2024-04-24T01:23:51.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a37fe640 1 -- 172.21.15.142:0/501274351 learned_addr learned my addr 172.21.15.142:0/501274351 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d00327b0 con 0x7fd7e006d420 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d0032950 con 0x7fd7e006d420 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7d0032c70 con 0x7fd7e006d420 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e0125160 con 0x7fd7e006d420 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e0124950 con 0x7fd7e006d420 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae96831640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae96831640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fae90072280 con 0x7fae9012c410 2024-04-24T01:23:51.771 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40bb7fe640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc123210 con 0x7f40bc098910 2024-04-24T01:23:51.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae8ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae8ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33856/0 (socket says 172.21.15.142:33856) 2024-04-24T01:23:51.772 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a37fe640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a4124ce0 con 0x7ff6a412aff0 2024-04-24T01:23:51.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7fae8ffff640 1 -- 172.21.15.142:0/1564250910 learned_addr learned my addr 172.21.15.142:0/1564250910 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7ff6a37fe640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c3e0 tx=0x7ff69400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.750+0000 7f40bb7fe640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c380 tx=0x7f40ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.773 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ac007410 con 0x7f40bc098910 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff694017070 con 0x7ff6a412aff0 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a41248f0 con 0x7ff6a412aff0 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40ac0075b0 con 0x7f40bc098910 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc122d90 con 0x7f40bc098910 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd7d004e430 con 0x7fd7e006d420 2024-04-24T01:23:51.774 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd7e012eca0 con 0x7fd7e006d420 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 0x7fd7c003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fd7d006cf00 con 0x7fd7e006d420 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 0x7fd7c003fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fae8ffff640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae90127f60 con 0x7fae9012c410 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fae8ffff640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae80034040 tx=0x7fae800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7ff6a9ef8640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a41c7b40 con 0x7ff6a412aff0 2024-04-24T01:23:51.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff694005410 con 0x7ff6a412aff0 2024-04-24T01:23:51.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae80032640 con 0x7fae9012c410 2024-04-24T01:23:51.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae800327e0 con 0x7fae9012c410 2024-04-24T01:23:51.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae80032b00 con 0x7fae9012c410 2024-04-24T01:23:51.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff694003720 con 0x7ff6a412aff0 2024-04-24T01:23:51.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff67c000f80 con 0x7ff6a412aff0 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc072150 con 0x7f40bc098910 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40ac0047e0 con 0x7f40bc098910 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7c00402f0 con 0x7fd7c003d7e0 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.751+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fd7d0032e10 con 0x7fd7e006d420 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fd7d7fff640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 0x7fd7c003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.777 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fd7e4a00640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 0x7fd7c003fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff69401a070 con 0x7ff6a412aff0 2024-04-24T01:23:51.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae90127b20 con 0x7fae9012c410 2024-04-24T01:23:51.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae901c4090 con 0x7fae9012c410 2024-04-24T01:23:51.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.752+0000 7fd7d7fff640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 0x7fd7c003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8001590 tx=0x7fd7c8007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff68bfff640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 0x7ff69003a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f40ac01a020 con 0x7f40bc098910 2024-04-24T01:23:51.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7ff69404a300 con 0x7ff6a412aff0 2024-04-24T01:23:51.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7fd7e4a00640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 0x7fd7c003fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff6a2ffd640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 0x7ff69003a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff68bfff640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 0x7ff69003fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f40bc062da0 con 0x7f40bc098910 2024-04-24T01:23:51.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff690040340 con 0x7ff69003d830 2024-04-24T01:23:51.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 0x7f40a803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7ff694051050 con 0x7ff6a412aff0 2024-04-24T01:23:51.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f40ac04a6c0 con 0x7f40bc098910 2024-04-24T01:23:51.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff6a3fff640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 0x7ff69003fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 0x7f40a803fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae90132930 con 0x7fae9012c410 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40baffd640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 0x7f40a803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f40a80402f0 con 0x7f40a803d7e0 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f40ac051050 con 0x7f40bc098910 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7f40bbfff640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 0x7f40a803fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7ff6a3fff640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 0x7ff69003fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.783 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.753+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fae80032ca0 con 0x7fae9012c410 2024-04-24T01:23:51.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7ff6a2ffd640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 0x7ff69003a570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff698038000 tx=0x7ff698008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8cff9640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 0x7fae7c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.784 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7f40baffd640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 0x7f40a803a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f40b0036000 tx=0x7f40b0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fae8002f050 con 0x7fae9012c410 2024-04-24T01:23:51.785 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7c00402f0 con 0x7fd7c003d7e0 2024-04-24T01:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8cff9640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 0x7fae7c03fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae8004cec0 con 0x7fae7c03d7e0 2024-04-24T01:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fae800712a0 con 0x7fae9012c410 2024-04-24T01:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8f7fe640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 0x7fae7c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae94dce640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 0x7fae7c03fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff690040340 con 0x7ff69003d830 2024-04-24T01:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7f40bbfff640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 0x7f40a803fc20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.787 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae8f7fe640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 0x7fae7c03a520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.754+0000 7fae94dce640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 0x7fae7c03fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.755+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f40a80402f0 con 0x7f40a803d7e0 2024-04-24T01:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.755+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae8004cec0 con 0x7fae7c03d7e0 2024-04-24T01:23:51.788 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.768+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd7e006df90 con 0x7fd7c003d7e0 2024-04-24T01:23:51.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.768+0000 7fd7dd7fa640 1 -- 172.21.15.142:0/2537910196 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd7e006df90 con 0x7fd7c003d7e0 2024-04-24T01:23:51.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff67c002c70 con 0x7ff69003d830 2024-04-24T01:23:51.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 msgr2=0x7fd7c003fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.789 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 0x7fd7c003fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 msgr2=0x7fd7c003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 0x7fd7c003a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8001590 tx=0x7fd7c8007a30 comp rx=0 tx=0).stop 2024-04-24T01:23:51.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff68bfff640 1 -- 172.21.15.142:0/501274351 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff67c002c70 con 0x7ff69003d830 2024-04-24T01:23:51.790 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 msgr2=0x7fd7e01c30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.791 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00097f0 tx=0x7fd7d00046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 shutdown_connections 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd7c003d7e0 0x7fd7c003fc20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd7c0038060 0x7fd7c003a520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 --2- 172.21.15.142:0/2537910196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7e006d420 0x7fd7e01c30a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 >> 172.21.15.142:0/2537910196 conn(0x7fd7e0099680 msgr2=0x7fd7e00903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 shutdown_connections 2024-04-24T01:23:51.792 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7fd7e6463640 1 -- 172.21.15.142:0/2537910196 wait complete. 2024-04-24T01:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 msgr2=0x7ff69003fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 0x7ff69003fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 msgr2=0x7ff69003a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 0x7ff69003a570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff698038000 tx=0x7ff698008040 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 msgr2=0x7ff6a41c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff69400c3e0 tx=0x7ff69400c8a0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 shutdown_connections 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.769+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7ff69003d830 0x7ff69003fc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff6900380b0 0x7ff69003a570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7ff689ffb640 1 --2- 172.21.15.142:0/501274351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6a412aff0 0x7ff6a41c7420 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 >> 172.21.15.142:0/501274351 conn(0x7ff6a4099680 msgr2=0x7ff6a406d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 shutdown_connections 2024-04-24T01:23:51.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7ff689ffb640 1 -- 172.21.15.142:0/501274351 wait complete. 2024-04-24T01:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae901262f0 con 0x7fae7c03d7e0 2024-04-24T01:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f40bc072470 con 0x7f40a803d7e0 2024-04-24T01:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7fae8cff9640 1 -- 172.21.15.142:0/1564250910 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fae901262f0 con 0x7fae7c03d7e0 2024-04-24T01:23:51.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.770+0000 7f40a3fff640 1 -- 172.21.15.142:0/2194855503 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f40bc072470 con 0x7f40a803d7e0 2024-04-24T01:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 msgr2=0x7fae7c03fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 0x7fae7c03fc20 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 msgr2=0x7f40a803fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 0x7f40a803fc20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 msgr2=0x7fae7c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 0x7fae7c03a520 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84007910 comp rx=0 tx=0).stop 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 msgr2=0x7fae901c3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fae80034040 tx=0x7fae800046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 msgr2=0x7f40a803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 0x7f40a803a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f40b0036000 tx=0x7f40b0008030 comp rx=0 tx=0).stop 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 msgr2=0x7f40bc121820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.797 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c380 tx=0x7f40ac00c840 comp rx=0 tx=0).stop 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 shutdown_connections 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7fae7c03d7e0 0x7fae7c03fc20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fae7c038060 0x7fae7c03a520 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 --2- 172.21.15.142:0/1564250910 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae9012c410 0x7fae901c3b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 >> 172.21.15.142:0/1564250910 conn(0x7fae9009c7f0 msgr2=0x7fae9012b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 shutdown_connections 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 shutdown_connections 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f40a803d7e0 0x7f40a803fc20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f40a8038060 0x7f40a803a520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 --2- 172.21.15.142:0/2194855503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40bc098910 0x7f40bc121820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 >> 172.21.15.142:0/2194855503 conn(0x7f40bc099680 msgr2=0x7f40bc135910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.799 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7fae96831640 1 -- 172.21.15.142:0/1564250910 wait complete. 2024-04-24T01:23:51.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 shutdown_connections 2024-04-24T01:23:51.800 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.771+0000 7f40c2227640 1 -- 172.21.15.142:0/2194855503 wait complete. 2024-04-24T01:23:51.801 INFO:teuthology.orchestra.run.smithi142.stdout:38654705669 2024-04-24T01:23:51.801 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T01:23:51.802 INFO:teuthology.orchestra.run.smithi142.stdout:47244640260 2024-04-24T01:23:51.802 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T01:23:51.803 INFO:teuthology.orchestra.run.smithi142.stdout:47244640262 2024-04-24T01:23:51.803 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T01:23:51.804 INFO:teuthology.orchestra.run.smithi142.stdout:47244640262 2024-04-24T01:23:51.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T01:23:51.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f4fc44c8640 1 Processor -- start 2024-04-24T01:23:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f4fc44c8640 1 -- start start 2024-04-24T01:23:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f6ec646a640 1 Processor -- start 2024-04-24T01:23:51.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7faf4a9a4640 1 Processor -- start 2024-04-24T01:23:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7eff549db640 1 Processor -- start 2024-04-24T01:23:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f6ec646a640 1 -- start start 2024-04-24T01:23:51.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7faf4a9a4640 1 -- start start 2024-04-24T01:23:51.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7eff549db640 1 -- start start 2024-04-24T01:23:51.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f6ec646a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ec006d7d0 0x7f6ec006dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7faf4a9a4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf44127ce0 0x7faf441280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.947 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f6ec646a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec00a08a0 con 0x7f6ec006e0f0 2024-04-24T01:23:51.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc44c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fbc098910 0x7f4fbc137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf4a9a4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf44127b00 con 0x7faf44070100 2024-04-24T01:23:51.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf4a9a4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf440708e0 con 0x7faf44127ce0 2024-04-24T01:23:51.948 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff549db640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff50098970 0x7eff5006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff549db640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff5006f0f0 con 0x7eff50098590 2024-04-24T01:23:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff549db640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7eff50071a60 con 0x7eff50098970 2024-04-24T01:23:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.944+0000 7f6ec646a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec006e560 con 0x7f6ec006d7d0 2024-04-24T01:23:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf44127ce0 0x7faf441280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.949 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf44127ce0 0x7faf441280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33876/0 (socket says 172.21.15.142:33876) 2024-04-24T01:23:51.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc44c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fbc08beb0 con 0x7f4fbc132d80 2024-04-24T01:23:51.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf43fff640 1 -- 172.21.15.142:0/3517894377 learned_addr learned my addr 172.21.15.142:0/3517894377 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.950 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc44c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4fbc096e20 con 0x7f4fbc098910 2024-04-24T01:23:51.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff47fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff50098970 0x7eff5006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff47fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7eff50098970 0x7eff5006dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33894/0 (socket says 172.21.15.142:33894) 2024-04-24T01:23:51.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc1a63640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fbc098910 0x7f4fbc137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc2264640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4fbc132d80 0x7f4fbc133160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:56192/0 (socket says 172.21.15.142:56192) 2024-04-24T01:23:51.951 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc2264640 1 -- 172.21.15.142:0/376216785 learned_addr learned my addr 172.21.15.142:0/376216785 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:51.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f6ebffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ec006d7d0 0x7f6ec006dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f6ebffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6ec006d7d0 0x7f6ec006dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33860/0 (socket says 172.21.15.142:33860) 2024-04-24T01:23:51.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff47fff640 1 -- 172.21.15.142:0/3097371509 learned_addr learned my addr 172.21.15.142:0/3097371509 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.952 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f6ebffff640 1 -- 172.21.15.142:0/1026995153 learned_addr learned my addr 172.21.15.142:0/1026995153 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf43fff640 1 -- 172.21.15.142:0/3517894377 >> v1:172.21.15.142:6789/0 conn(0x7faf44070100 legacy=0x7faf4412b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7faf43fff640 1 -- 172.21.15.142:0/3517894377 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf44098800 con 0x7faf44127ce0 2024-04-24T01:23:51.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff47fff640 1 -- 172.21.15.142:0/3097371509 >> v1:172.21.15.142:6789/0 conn(0x7eff50098590 legacy=0x7eff5006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.953 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7eff47fff640 1 -- 172.21.15.142:0/3097371509 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff5006f8b0 con 0x7eff50098970 2024-04-24T01:23:51.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f6ebffff640 1 -- 172.21.15.142:0/1026995153 >> v1:172.21.15.142:6789/0 conn(0x7f6ec006e0f0 legacy=0x7f6ec012e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f6ebffff640 1 -- 172.21.15.142:0/1026995153 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec006f6d0 con 0x7f6ec006d7d0 2024-04-24T01:23:51.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc1a63640 1 -- 172.21.15.142:0/376216785 >> v1:172.21.15.142:6789/0 conn(0x7f4fbc132d80 legacy=0x7f4fbc133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.954 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7f4fc1a63640 1 -- 172.21.15.142:0/376216785 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc08c150 con 0x7f4fbc098910 2024-04-24T01:23:51.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.945+0000 7f4fc1262640 1 -- 172.21.15.142:0/376216785 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560664638 0 0) 0x7f4fbc08beb0 con 0x7f4fbc132d80 2024-04-24T01:23:51.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7faf43fff640 1 --2- 172.21.15.142:0/3517894377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44127ce0 0x7faf441280c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf340097f0 tx=0x7faf3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1ddeb41d992ea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7eff47fff640 1 --2- 172.21.15.142:0/3097371509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098970 0x7eff5006dda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff380097f0 tx=0x7eff3802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbae3ad6e884ce9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.955 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7faf42ffd640 1 -- 172.21.15.142:0/3517894377 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34035020 con 0x7faf44127ce0 2024-04-24T01:23:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7f4fc1a63640 1 --2- 172.21.15.142:0/376216785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc137b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009720 tx=0x7f4fac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45709530aee43f58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7faf42ffd640 1 -- 172.21.15.142:0/3517894377 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf340317a0 con 0x7faf44127ce0 2024-04-24T01:23:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7f6ebffff640 1 --2- 172.21.15.142:0/1026995153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006d7d0 0x7f6ec006dbb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009820 tx=0x7f6eb002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccae56e860e17b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.956 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7faf42ffd640 1 -- 172.21.15.142:0/3517894377 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34031aa0 con 0x7faf44127ce0 2024-04-24T01:23:51.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7eff4dd9b640 1 -- 172.21.15.142:0/3097371509 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff38035020 con 0x7eff50098970 2024-04-24T01:23:51.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7f4fc1262640 1 -- 172.21.15.142:0/376216785 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac0316d0 con 0x7f4fbc098910 2024-04-24T01:23:51.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.946+0000 7f6ebeffd640 1 -- 172.21.15.142:0/1026995153 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb0034070 con 0x7f6ec006d7d0 2024-04-24T01:23:51.957 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7eff4dd9b640 1 -- 172.21.15.142:0/3097371509 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380317a0 con 0x7eff50098970 2024-04-24T01:23:51.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f4fc1262640 1 -- 172.21.15.142:0/376216785 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fac037070 con 0x7f4fbc098910 2024-04-24T01:23:51.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f4fc1262640 1 -- 172.21.15.142:0/376216785 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fac0319c0 con 0x7f4fbc098910 2024-04-24T01:23:51.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f6ebeffd640 1 -- 172.21.15.142:0/1026995153 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb0030790 con 0x7f6ec006d7d0 2024-04-24T01:23:51.958 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7eff4dd9b640 1 -- 172.21.15.142:0/3097371509 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff38031aa0 con 0x7eff50098970 2024-04-24T01:23:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f6ebeffd640 1 -- 172.21.15.142:0/1026995153 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb0030a90 con 0x7f6ec006d7d0 2024-04-24T01:23:51.959 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 -- 172.21.15.142:0/3517894377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44127ce0 msgr2=0x7faf441280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/3517894377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44127ce0 0x7faf441280c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf340097f0 tx=0x7faf3402b910 comp rx=0 tx=0).stop 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 -- 172.21.15.142:0/3517894377 shutdown_connections 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/3517894377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44127ce0 0x7faf441280c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 -- 172.21.15.142:0/3517894377 >> 172.21.15.142:0/3517894377 conn(0x7faf44099680 msgr2=0x7faf44099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 -- 172.21.15.142:0/3517894377 shutdown_connections 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7faf4a9a4640 1 -- 172.21.15.142:0/3517894377 wait complete. 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f4fc44c8640 1 -- 172.21.15.142:0/376216785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 msgr2=0x7f4fbc137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.960 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/376216785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc137b70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fac009720 tx=0x7f4fac02b840 comp rx=0 tx=0).stop 2024-04-24T01:23:51.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7eff549db640 1 -- 172.21.15.142:0/3097371509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098970 msgr2=0x7eff5006dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.947+0000 7eff549db640 1 --2- 172.21.15.142:0/3097371509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098970 0x7eff5006dda0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7eff380097f0 tx=0x7eff3802b910 comp rx=0 tx=0).stop 2024-04-24T01:23:51.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f4fc44c8640 1 -- 172.21.15.142:0/376216785 shutdown_connections 2024-04-24T01:23:51.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/376216785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc137b70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.961 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f4fc44c8640 1 -- 172.21.15.142:0/376216785 >> 172.21.15.142:0/376216785 conn(0x7f4fbc099680 msgr2=0x7f4fbc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7eff549db640 1 -- 172.21.15.142:0/3097371509 shutdown_connections 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7eff549db640 1 --2- 172.21.15.142:0/3097371509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098970 0x7eff5006dda0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7eff549db640 1 -- 172.21.15.142:0/3097371509 >> 172.21.15.142:0/3097371509 conn(0x7eff50099680 msgr2=0x7eff50099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 -- 172.21.15.142:0/1026995153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006d7d0 msgr2=0x7f6ec006dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1026995153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006d7d0 0x7f6ec006dbb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009820 tx=0x7f6eb002b9a0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.962 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f4fc44c8640 1 -- 172.21.15.142:0/376216785 shutdown_connections 2024-04-24T01:23:51.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7eff549db640 1 -- 172.21.15.142:0/3097371509 shutdown_connections 2024-04-24T01:23:51.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 -- 172.21.15.142:0/1026995153 shutdown_connections 2024-04-24T01:23:51.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1026995153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006d7d0 0x7f6ec006dbb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:51.963 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7eff549db640 1 -- 172.21.15.142:0/3097371509 wait complete. 2024-04-24T01:23:51.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f4fc44c8640 1 -- 172.21.15.142:0/376216785 wait complete. 2024-04-24T01:23:51.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 -- 172.21.15.142:0/1026995153 >> 172.21.15.142:0/1026995153 conn(0x7f6ec009ea70 msgr2=0x7f6ec009ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:51.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 -- 172.21.15.142:0/1026995153 shutdown_connections 2024-04-24T01:23:51.964 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7f6ec646a640 1 -- 172.21.15.142:0/1026995153 wait complete. 2024-04-24T01:23:51.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.948+0000 7faf4a9a4640 1 Processor -- start 2024-04-24T01:23:51.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc44c8640 1 Processor -- start 2024-04-24T01:23:51.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc44c8640 1 -- start start 2024-04-24T01:23:51.965 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf4a9a4640 1 -- start start 2024-04-24T01:23:51.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc44c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc44c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fbc138440 con 0x7f4fbc098910 2024-04-24T01:23:51.966 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f6ec646a640 1 Processor -- start 2024-04-24T01:23:51.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf4a9a4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf4a9a4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf44128780 con 0x7faf44070100 2024-04-24T01:23:51.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc2264640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.967 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7eff549db640 1 Processor -- start 2024-04-24T01:23:51.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc2264640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33898/0 (socket says 172.21.15.142:33898) 2024-04-24T01:23:51.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf43fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf43fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33906/0 (socket says 172.21.15.142:33906) 2024-04-24T01:23:51.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7faf43fff640 1 -- 172.21.15.142:0/1963583292 learned_addr learned my addr 172.21.15.142:0/1963583292 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.968 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7eff549db640 1 -- start start 2024-04-24T01:23:51.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f6ec646a640 1 -- start start 2024-04-24T01:23:51.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc2264640 1 -- 172.21.15.142:0/573545494 learned_addr learned my addr 172.21.15.142:0/573545494 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.949+0000 7f4fc2264640 1 -- 172.21.15.142:0/573545494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fbc071fb0 con 0x7f4fbc098910 2024-04-24T01:23:51.969 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7faf43fff640 1 -- 172.21.15.142:0/1963583292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf44125810 con 0x7faf44070100 2024-04-24T01:23:51.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ec646a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ec646a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec012ebb0 con 0x7f6ec006e0f0 2024-04-24T01:23:51.970 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff549db640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fc2264640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c430 tx=0x7f4fb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff549db640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7eff50070050 con 0x7eff50098590 2024-04-24T01:23:51.971 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ebffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff4e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ebffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33914/0 (socket says 172.21.15.142:33914) 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ebffff640 1 -- 172.21.15.142:0/1545537813 learned_addr learned my addr 172.21.15.142:0/1545537813 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff4e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33928/0 (socket says 172.21.15.142:33928) 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff4e59c640 1 -- 172.21.15.142:0/1035150105 learned_addr learned my addr 172.21.15.142:0/1035150105 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:51.972 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7faf43fff640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf3402b950 tx=0x7faf340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb8005cd0 con 0x7f4fbc098910 2024-04-24T01:23:51.973 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ebffff640 1 -- 172.21.15.142:0/1545537813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec0090d30 con 0x7f6ec006e0f0 2024-04-24T01:23:51.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fbc1244c0 con 0x7f4fbc098910 2024-04-24T01:23:51.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fbc1232d0 con 0x7f4fbc098910 2024-04-24T01:23:51.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fb8007070 con 0x7f4fbc098910 2024-04-24T01:23:51.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f6ebffff640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6eb002b9e0 tx=0x7f6eb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.974 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7eff4e59c640 1 -- 172.21.15.142:0/1035150105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff50096b80 con 0x7eff50098590 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf34031aa0 con 0x7faf44070100 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3403b5c0 con 0x7faf44070100 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf3403b790 con 0x7faf44070100 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf4408a6e0 con 0x7faf44070100 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf44123370 con 0x7faf44070100 2024-04-24T01:23:51.975 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7eff4e59c640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c380 tx=0x7eff4000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb0048070 con 0x7f6ec006e0f0 2024-04-24T01:23:51.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff40005200 con 0x7eff50098590 2024-04-24T01:23:51.976 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff50091ff0 con 0x7eff50098590 2024-04-24T01:23:51.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec0092570 con 0x7f6ec006e0f0 2024-04-24T01:23:51.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec01c3850 con 0x7f6ec006e0f0 2024-04-24T01:23:51.977 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff5008f910 con 0x7eff50098590 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.950+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb8007260 con 0x7f4fbc098910 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.951+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fb8007400 con 0x7f4fbc098910 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7f4fb2ffd640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 0x7f4fa003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f4fb804aa50 con 0x7f4fbc098910 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fbc122c20 con 0x7f4fbc098910 2024-04-24T01:23:51.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf44062da0 con 0x7faf44070100 2024-04-24T01:23:51.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb0030720 con 0x7f6ec006e0f0 2024-04-24T01:23:51.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6eb0052060 con 0x7f6ec006e0f0 2024-04-24T01:23:51.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff400053a0 con 0x7eff50098590 2024-04-24T01:23:51.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff40020060 con 0x7eff50098590 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf3404d060 con 0x7faf44070100 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.952+0000 7faf40ff9640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 0x7faf3003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7faf3404ecb0 con 0x7faf44070100 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7faf437fe640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 0x7faf3003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6eb004b070 con 0x7f6ec006e0f0 2024-04-24T01:23:51.980 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7f4fc1a63640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 0x7f4fa003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff34005080 con 0x7eff50098590 2024-04-24T01:23:51.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea0005080 con 0x7f6ec006e0f0 2024-04-24T01:23:51.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7f6ebcff9640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 0x7f6eac03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.981 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7faf437fe640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 0x7faf3003a4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf38001560 tx=0x7faf38007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff40006900 con 0x7eff50098590 2024-04-24T01:23:51.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7f6ebf7fe640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 0x7f6eac03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.953+0000 7eff46ffd640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 0x7eff3003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:51.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.954+0000 7f4fc1a63640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 0x7f4fa003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fac036000 tx=0x7f4fac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.954+0000 7eff47fff640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 0x7eff3003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:51.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.954+0000 7f6ebf7fe640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 0x7f6eac03a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40015e0 tx=0x7f6eb40079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.954+0000 7eff47fff640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 0x7eff3003a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff38036000 tx=0x7eff38008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:51.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.958+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f6eb0040050 con 0x7f6ec006e0f0 2024-04-24T01:23:51.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.958+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7eff40049320 con 0x7eff50098590 2024-04-24T01:23:51.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.958+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f4fb80076f0 con 0x7f4fbc098910 2024-04-24T01:23:51.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.962+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7faf34041070 con 0x7faf44070100 2024-04-24T01:23:51.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.966+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f6eb006c260 con 0x7f6ec006e0f0 2024-04-24T01:23:51.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:51.971+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7eff40012820 con 0x7eff50098590 2024-04-24T01:23:52.146 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.145+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4fbc062da0 con 0x7f4fbc098910 2024-04-24T01:23:52.147 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.146+0000 7f4fb2ffd640 1 -- 172.21.15.142:0/573545494 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4fb8011df0 con 0x7f4fbc098910 2024-04-24T01:23:52.147 INFO:teuthology.orchestra.run.smithi142.stdout:38654705668 2024-04-24T01:23:52.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 msgr2=0x7f4fa003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 0x7f4fa003a520 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4fac036000 tx=0x7f4fac008030 comp rx=0 tx=0).stop 2024-04-24T01:23:52.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 msgr2=0x7f4fbc121820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.150 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4fb800c430 tx=0x7f4fb800c8f0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 shutdown_connections 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fa0038060 0x7f4fa003a520 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 --2- 172.21.15.142:0/573545494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fbc098910 0x7f4fbc121820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 >> 172.21.15.142:0/573545494 conn(0x7f4fbc099680 msgr2=0x7f4fbc135910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 shutdown_connections 2024-04-24T01:23:52.151 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.149+0000 7f4fc44c8640 1 -- 172.21.15.142:0/573545494 wait complete. 2024-04-24T01:23:52.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.150+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6ea0005370 con 0x7f6ec006e0f0 2024-04-24T01:23:52.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.151+0000 7f6ebcff9640 1 -- 172.21.15.142:0/1545537813 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6eb004d960 con 0x7f6ec006e0f0 2024-04-24T01:23:52.152 INFO:teuthology.orchestra.run.smithi142.stdout:47244640259 2024-04-24T01:23:52.155 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 msgr2=0x7f6eac03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 0x7f6eac03a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40015e0 tx=0x7f6eb40079d0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 msgr2=0x7f6ec01c3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6eb002b9e0 tx=0x7f6eb0004730 comp rx=0 tx=0).stop 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 shutdown_connections 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6eac038060 0x7f6eac03a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 --2- 172.21.15.142:0/1545537813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6ec006e0f0 0x7f6ec01c3310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.154+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 >> 172.21.15.142:0/1545537813 conn(0x7f6ec009ea70 msgr2=0x7f6ec009c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.155+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 shutdown_connections 2024-04-24T01:23:52.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.155+0000 7f6ec646a640 1 -- 172.21.15.142:0/1545537813 wait complete. 2024-04-24T01:23:52.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-24T01:23:52.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.166+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7faf44124650 con 0x7faf44070100 2024-04-24T01:23:52.167 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.167+0000 7faf40ff9640 1 -- 172.21.15.142:0/1963583292 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf3404dc20 con 0x7faf44070100 2024-04-24T01:23:52.167 INFO:teuthology.orchestra.run.smithi142.stdout:47244640261 2024-04-24T01:23:52.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2024-04-24T01:23:52.170 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 msgr2=0x7faf3003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 0x7faf3003a4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7faf38001560 tx=0x7faf38007a50 comp rx=0 tx=0).stop 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 msgr2=0x7faf44122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf3402b950 tx=0x7faf340046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 shutdown_connections 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf30038010 0x7faf3003a4d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 --2- 172.21.15.142:0/1963583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf44070100 0x7faf44122e30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 >> 172.21.15.142:0/1963583292 conn(0x7faf44099680 msgr2=0x7faf4406e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 shutdown_connections 2024-04-24T01:23:52.171 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.170+0000 7faf4a9a4640 1 -- 172.21.15.142:0/1963583292 wait complete. 2024-04-24T01:23:52.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.176+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7eff34005370 con 0x7eff50098590 2024-04-24T01:23:52.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.177+0000 7eff46ffd640 1 -- 172.21.15.142:0/1035150105 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff4001bd10 con 0x7eff50098590 2024-04-24T01:23:52.177 INFO:teuthology.orchestra.run.smithi142.stdout:47244640261 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 msgr2=0x7eff3003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 0x7eff3003a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7eff38036000 tx=0x7eff38008030 comp rx=0 tx=0).stop 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 msgr2=0x7eff5008f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7eff4000c380 tx=0x7eff4000c840 comp rx=0 tx=0).stop 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 shutdown_connections 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7eff30038060 0x7eff3003a520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 --2- 172.21.15.142:0/1035150105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff50098590 0x7eff5008f3d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 >> 172.21.15.142:0/1035150105 conn(0x7eff50099680 msgr2=0x7eff50130b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 shutdown_connections 2024-04-24T01:23:52.180 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:52.179+0000 7eff549db640 1 -- 172.21.15.142:0/1035150105 wait complete. 2024-04-24T01:23:52.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.3 2024-04-24T01:23:52.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-04-24T01:23:53.165 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T01:23:53.169 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T01:23:53.184 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T01:23:53.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T01:23:53.282 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8d06d640 1 Processor -- start 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8d06d640 1 -- start start 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8d06d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d8806f260 0x7f1d8806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8d06d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8806fff0 con 0x7f1d8806fb80 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8d06d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1d88070bc0 con 0x7f1d8806f260 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d86d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d8806f260 0x7f1d8806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8659c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1d8806fb80 0x7f1d8812e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52558/0 (socket says 172.21.15.142:52558) 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.273+0000 7f1d8659c640 1 -- 172.21.15.142:0/3673217572 learned_addr learned my addr 172.21.15.142:0/3673217572 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.274+0000 7f1d86d9d640 1 -- 172.21.15.142:0/3673217572 >> v1:172.21.15.142:6789/0 conn(0x7f1d8806fb80 legacy=0x7f1d8812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.274+0000 7f1d85d9b640 1 -- 172.21.15.142:0/3673217572 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557773283 0 0) 0x7f1d8806fff0 con 0x7f1d8806fb80 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.274+0000 7f1d86d9d640 1 -- 172.21.15.142:0/3673217572 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8812ec50 con 0x7f1d8806f260 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.274+0000 7f1d86d9d640 1 --2- 172.21.15.142:0/3673217572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d8806f640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009720 tx=0x7f1d7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e5b8a195e3b600 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.275+0000 7f1d85d9b640 1 -- 172.21.15.142:0/3673217572 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d780316d0 con 0x7f1d8806f260 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.275+0000 7f1d85d9b640 1 -- 172.21.15.142:0/3673217572 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d78037070 con 0x7f1d8806f260 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.275+0000 7f1d85d9b640 1 -- 172.21.15.142:0/3673217572 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d780319c0 con 0x7f1d8806f260 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.275+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3673217572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 msgr2=0x7f1d8806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.275+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3673217572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d8806f640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009720 tx=0x7f1d7802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.276+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3673217572 shutdown_connections 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.276+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3673217572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d8806f640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.276+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3673217572 >> 172.21.15.142:0/3673217572 conn(0x7f1d8809e170 msgr2=0x7f1d8806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.276+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3673217572 shutdown_connections 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.276+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3673217572 wait complete. 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.277+0000 7f1d8d06d640 1 Processor -- start 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.277+0000 7f1d8d06d640 1 -- start start 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d8d06d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d8d06d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8812f400 con 0x7f1d8806f260 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d86d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d86d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45818/0 (socket says 172.21.15.142:45818) 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d86d9d640 1 -- 172.21.15.142:0/3065456556 learned_addr learned my addr 172.21.15.142:0/3065456556 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.278+0000 7f1d86d9d640 1 -- 172.21.15.142:0/3065456556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8811a280 con 0x7f1d8806f260 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d86d9d640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d78034040 tx=0x7f1d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d78032640 con 0x7f1d8806f260 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d780327e0 con 0x7f1d8806f260 2024-04-24T01:23:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d78032ac0 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d88072cd0 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.279+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d88118a60 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.280+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d7804c060 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.280+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d880a18a0 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.280+0000 7f1d6f7fe640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 0x7f1d7403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.280+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f1d7802f050 con 0x7f1d8806f260 2024-04-24T01:23:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.281+0000 7f1d8659c640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 0x7f1d7403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.281+0000 7f1d8659c640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 0x7f1d7403a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c000c00 tx=0x7f1d7c007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.289+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f1d880a18a0 con 0x7f1d8806f260 2024-04-24T01:23:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f0241184640 1 Processor -- start 2024-04-24T01:23:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f0241184640 1 -- start start 2024-04-24T01:23:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7fa082ff4640 1 Processor -- start 2024-04-24T01:23:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7fa082ff4640 1 -- start start 2024-04-24T01:23:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f0241184640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f023c1287d0 0x7f023c130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f0241184640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c127b00 con 0x7f023c127ce0 2024-04-24T01:23:53.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f0241184640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f023c0708e0 con 0x7f023c1287d0 2024-04-24T01:23:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7fa082ff4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa07c06d7d0 0x7fa07c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f023a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f023c1287d0 0x7f023c130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.313+0000 7f023ad9d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f023c127ce0 0x7f023c1280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52564/0 (socket says 172.21.15.142:52564) 2024-04-24T01:23:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa082ff4640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07c0a08a0 con 0x7fa07c06e0f0 2024-04-24T01:23:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa082ff4640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa07c06e560 con 0x7fa07c06d7d0 2024-04-24T01:23:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f023a59c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f023c1287d0 0x7f023c130360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45820/0 (socket says 172.21.15.142:45820) 2024-04-24T01:23:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f023ad9d640 1 -- 172.21.15.142:0/456940307 learned_addr learned my addr 172.21.15.142:0/456940307 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa07bfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa07c06e0f0 0x7fa07c12e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52576/0 (socket says 172.21.15.142:52576) 2024-04-24T01:23:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa07bfff640 1 -- 172.21.15.142:0/356174789 learned_addr learned my addr 172.21.15.142:0/356174789 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa080d90640 1 --2- 172.21.15.142:0/356174789 >> v2:172.21.15.142:3300/0 conn(0x7fa07c06d7d0 0x7fa07c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f0239d9b640 1 -- 172.21.15.142:0/456940307 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565055868 0 0) 0x7f022c001110 con 0x7f023c127ce0 2024-04-24T01:23:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f0239d9b640 1 -- 172.21.15.142:0/456940307 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0224003520 con 0x7f023c127ce0 2024-04-24T01:23:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa080d90640 1 -- 172.21.15.142:0/356174789 >> v1:172.21.15.142:6789/0 conn(0x7fa07c06e0f0 legacy=0x7fa07c12e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f023a59c640 1 -- 172.21.15.142:0/456940307 >> v1:172.21.15.142:6789/0 conn(0x7f023c127ce0 legacy=0x7f023c1280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7f023a59c640 1 -- 172.21.15.142:0/456940307 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c098800 con 0x7f023c1287d0 2024-04-24T01:23:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.314+0000 7fa080d90640 1 -- 172.21.15.142:0/356174789 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c06f6d0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7fa080d90640 1 --2- 172.21.15.142:0/356174789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c06dbb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa070009750 tx=0x7fa07002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431a3937d0f8291 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f023a59c640 1 --2- 172.21.15.142:0/456940307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c1287d0 0x7f023c130360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0230009750 tx=0x7f023002da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d1e9c997531fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7fa07b7fe640 1 -- 172.21.15.142:0/356174789 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070037070 con 0x7fa07c06d7d0 2024-04-24T01:23:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7fa07b7fe640 1 -- 172.21.15.142:0/356174789 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa070030640 con 0x7fa07c06d7d0 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7fa07b7fe640 1 -- 172.21.15.142:0/356174789 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070030940 con 0x7fa07c06d7d0 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f0239d9b640 1 -- 172.21.15.142:0/456940307 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02300317a0 con 0x7f023c1287d0 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f0239d9b640 1 -- 172.21.15.142:0/456940307 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0230031940 con 0x7f023c1287d0 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f0239d9b640 1 -- 172.21.15.142:0/456940307 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0230031c40 con 0x7f023c1287d0 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f097e1e6640 1 Processor -- start 2024-04-24T01:23:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.315+0000 7f097e1e6640 1 -- start start 2024-04-24T01:23:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 -- 172.21.15.142:0/356174789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 msgr2=0x7fa07c06dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 --2- 172.21.15.142:0/356174789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c06dbb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa070009750 tx=0x7fa07002b710 comp rx=0 tx=0).stop 2024-04-24T01:23:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f097e1e6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f097806f260 0x7f097806f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 -- 172.21.15.142:0/356174789 shutdown_connections 2024-04-24T01:23:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 --2- 172.21.15.142:0/356174789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c06dbb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 -- 172.21.15.142:0/356174789 >> 172.21.15.142:0/356174789 conn(0x7fa07c09ea70 msgr2=0x7fa07c09ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f097e1e6640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f097806fff0 con 0x7f097806fb80 2024-04-24T01:23:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 -- 172.21.15.142:0/356174789 shutdown_connections 2024-04-24T01:23:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7fa082ff4640 1 -- 172.21.15.142:0/356174789 wait complete. 2024-04-24T01:23:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 -- 172.21.15.142:0/456940307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c1287d0 msgr2=0x7f023c130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 --2- 172.21.15.142:0/456940307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c1287d0 0x7f023c130360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0230009750 tx=0x7f023002da50 comp rx=0 tx=0).stop 2024-04-24T01:23:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f097e1e6640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f0978070bc0 con 0x7f097806f260 2024-04-24T01:23:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f09777fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f097806f260 0x7f097806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f09777fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f097806f260 0x7f097806f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45838/0 (socket says 172.21.15.142:45838) 2024-04-24T01:23:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f09777fe640 1 -- 172.21.15.142:0/1700374676 learned_addr learned my addr 172.21.15.142:0/1700374676 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 -- 172.21.15.142:0/456940307 shutdown_connections 2024-04-24T01:23:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 --2- 172.21.15.142:0/456940307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c1287d0 0x7f023c130360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 -- 172.21.15.142:0/456940307 >> 172.21.15.142:0/456940307 conn(0x7f023c099680 msgr2=0x7f023c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.367 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f09777fe640 1 -- 172.21.15.142:0/1700374676 >> v1:172.21.15.142:6789/0 conn(0x7f097806fb80 legacy=0x7f097812e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-24T01:23:53.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f09777fe640 1 -- 172.21.15.142:0/1700374676 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f097812ec50 con 0x7f097806f260 2024-04-24T01:23:53.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 -- 172.21.15.142:0/456940307 shutdown_connections 2024-04-24T01:23:53.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.316+0000 7f0241184640 1 -- 172.21.15.142:0/456940307 wait complete. 2024-04-24T01:23:53.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.317+0000 7fa082ff4640 1 Processor -- start 2024-04-24T01:23:53.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.317+0000 7fa082ff4640 1 -- start start 2024-04-24T01:23:53.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f09777fe640 1 --2- 172.21.15.142:0/1700374676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806f260 0x7f097806f640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09680097f0 tx=0x7f096802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38ab29f1f826870 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f09767fc640 1 -- 172.21.15.142:0/1700374676 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f096802e070 con 0x7f097806f260 2024-04-24T01:23:53.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f09767fc640 1 -- 172.21.15.142:0/1700374676 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0968037070 con 0x7f097806f260 2024-04-24T01:23:53.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f09767fc640 1 -- 172.21.15.142:0/1700374676 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0968031730 con 0x7f097806f260 2024-04-24T01:23:53.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f0241184640 1 Processor -- start 2024-04-24T01:23:53.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7fa082ff4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7fa082ff4640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa07c12ebb0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f0241184640 1 -- start start 2024-04-24T01:23:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7fa080d90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7fa080d90640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45846/0 (socket says 172.21.15.142:45846) 2024-04-24T01:23:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7fa080d90640 1 -- 172.21.15.142:0/906380625 learned_addr learned my addr 172.21.15.142:0/906380625 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f0241184640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.318+0000 7f0241184640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f023c06faa0 con 0x7f023c127ce0 2024-04-24T01:23:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa080d90640 1 -- 172.21.15.142:0/906380625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07c125f50 con 0x7fa07c06d7d0 2024-04-24T01:23:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f023ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f023ad9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45860/0 (socket says 172.21.15.142:45860) 2024-04-24T01:23:53.372 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f023ad9d640 1 -- 172.21.15.142:0/298558383 learned_addr learned my addr 172.21.15.142:0/298558383 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 -- 172.21.15.142:0/1700374676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806f260 msgr2=0x7f097806f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 --2- 172.21.15.142:0/1700374676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806f260 0x7f097806f640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f09680097f0 tx=0x7f096802b880 comp rx=0 tx=0).stop 2024-04-24T01:23:53.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa080d90640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa070035040 tx=0x7fa0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 -- 172.21.15.142:0/1700374676 shutdown_connections 2024-04-24T01:23:53.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 --2- 172.21.15.142:0/1700374676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806f260 0x7f097806f640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 -- 172.21.15.142:0/1700374676 >> 172.21.15.142:0/1700374676 conn(0x7f097809e170 msgr2=0x7f097806d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f023ad9d640 1 -- 172.21.15.142:0/298558383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c1b1f90 con 0x7f023c127ce0 2024-04-24T01:23:53.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 -- 172.21.15.142:0/1700374676 shutdown_connections 2024-04-24T01:23:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070042070 con 0x7fa07c06d7d0 2024-04-24T01:23:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0700328c0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f023ad9d640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c6b0 tx=0x7f022c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.375 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa07c1262e0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022c017070 con 0x7f023c127ce0 2024-04-24T01:23:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f022c0058b0 con 0x7f023c127ce0 2024-04-24T01:23:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023c124600 con 0x7f023c127ce0 2024-04-24T01:23:53.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07c126f10 con 0x7fa07c06d7d0 2024-04-24T01:23:53.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f022c005bd0 con 0x7f023c127ce0 2024-04-24T01:23:53.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023c08a5e0 con 0x7f023c127ce0 2024-04-24T01:23:53.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.319+0000 7f097e1e6640 1 -- 172.21.15.142:0/1700374676 wait complete. 2024-04-24T01:23:53.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.320+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa070037040 con 0x7fa07c06d7d0 2024-04-24T01:23:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.320+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa07c062da0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023c062da0 con 0x7f023c127ce0 2024-04-24T01:23:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f097e1e6640 1 Processor -- start 2024-04-24T01:23:53.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f022c01a070 con 0x7f023c127ce0 2024-04-24T01:23:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa070045070 con 0x7fa07c06d7d0 2024-04-24T01:23:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f097e1e6640 1 -- start start 2024-04-24T01:23:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f02237fe640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 0x7f022803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.379 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f022c04a210 con 0x7f023c127ce0 2024-04-24T01:23:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7fa0797fa640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 0x7fa06003a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fa07006cca0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f023a59c640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 0x7f022803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.380 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7fa07bfff640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 0x7fa06003a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f097e1e6640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f097e1e6640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f097812f400 con 0x7f097806fb80 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.321+0000 7f09777fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7f09777fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45866/0 (socket says 172.21.15.142:45866) 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7f09777fe640 1 -- 172.21.15.142:0/859089224 learned_addr learned my addr 172.21.15.142:0/859089224 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.381 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7fa07bfff640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 0x7fa06003a6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa068007fd0 tx=0x7fa068007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7f09777fe640 1 -- 172.21.15.142:0/859089224 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0978119730 con 0x7f097806fb80 2024-04-24T01:23:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7f023a59c640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 0x7f022803a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0230038000 tx=0x7f023003b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.382 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.322+0000 7f09777fe640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f096802be10 tx=0x7f09680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.330+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f023c1b1f90 con 0x7f023c127ce0 2024-04-24T01:23:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0968032680 con 0x7f097806fb80 2024-04-24T01:23:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0968032840 con 0x7f097806fb80 2024-04-24T01:23:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0968032b60 con 0x7f097806fb80 2024-04-24T01:23:53.383 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f097811a6a0 con 0x7f097806fb80 2024-04-24T01:23:53.384 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fa07003e460 con 0x7fa07c06d7d0 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.338+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09781c3f50 con 0x7f097806fb80 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.339+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0978119290 con 0x7f097806fb80 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.340+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0968032d00 con 0x7f097806fb80 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.340+0000 7f095ffff640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 0x7f096403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.340+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f096806cdf0 con 0x7f097806fb80 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.340+0000 7f0976ffd640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 0x7f096403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.341+0000 7f0976ffd640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 0x7f096403a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f096c001610 tx=0x7f096c007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.385 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.349+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f0968040070 con 0x7f097806fb80 2024-04-24T01:23:53.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.486+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1d88119de0 con 0x7f1d8806f260 2024-04-24T01:23:53.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.487+0000 7f1d6f7fe640 1 -- 172.21.15.142:0/3065456556 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d78040070 con 0x7f1d8806f260 2024-04-24T01:23:53.488 INFO:teuthology.orchestra.run.smithi142.stdout:38654705669 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 msgr2=0x7f1d7403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 0x7f1d7403a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c000c00 tx=0x7f1d7c007910 comp rx=0 tx=0).stop 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 msgr2=0x7f1d88118520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1d78034040 tx=0x7f1d780046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 shutdown_connections 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d74038060 0x7f1d7403a520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 --2- 172.21.15.142:0/3065456556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d8806f260 0x7f1d88118520 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 >> 172.21.15.142:0/3065456556 conn(0x7f1d8809e170 msgr2=0x7f1d8809e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 shutdown_connections 2024-04-24T01:23:53.490 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.489+0000 7f1d8d06d640 1 -- 172.21.15.142:0/3065456556 wait complete. 2024-04-24T01:23:53.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-24T01:23:53.503 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.516+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f023c06c170 con 0x7f023c127ce0 2024-04-24T01:23:53.516 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.516+0000 7f02237fe640 1 -- 172.21.15.142:0/298558383 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f023c127b00 con 0x7f023c127ce0 2024-04-24T01:23:53.517 INFO:teuthology.orchestra.run.smithi142.stdout:47244640260 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 msgr2=0x7f022803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 0x7f022803a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0230038000 tx=0x7f023003b040 comp rx=0 tx=0).stop 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 msgr2=0x7f023c122cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c6b0 tx=0x7f022c00cb70 comp rx=0 tx=0).stop 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 shutdown_connections 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0228038060 0x7f022803a520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 --2- 172.21.15.142:0/298558383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f023c127ce0 0x7f023c122cb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 >> 172.21.15.142:0/298558383 conn(0x7f023c099680 msgr2=0x7f023c06d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 shutdown_connections 2024-04-24T01:23:53.519 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.518+0000 7f0241184640 1 -- 172.21.15.142:0/298558383 wait complete. 2024-04-24T01:23:53.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.522+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa07c06c170 con 0x7fa07c06d7d0 2024-04-24T01:23:53.522 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.522+0000 7fa0797fa640 1 -- 172.21.15.142:0/906380625 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa070031ca0 con 0x7fa07c06d7d0 2024-04-24T01:23:53.523 INFO:teuthology.orchestra.run.smithi142.stdout:47244640262 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 msgr2=0x7fa06003a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 0x7fa06003a6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa068007fd0 tx=0x7fa068007aa0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 msgr2=0x7fa07c08bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa070035040 tx=0x7fa0700046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 shutdown_connections 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa0600381f0 0x7fa06003a6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 --2- 172.21.15.142:0/906380625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa07c06d7d0 0x7fa07c08bf60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 >> 172.21.15.142:0/906380625 conn(0x7fa07c09ea70 msgr2=0x7fa07c12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 shutdown_connections 2024-04-24T01:23:53.525 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.524+0000 7fa082ff4640 1 -- 172.21.15.142:0/906380625 wait complete. 2024-04-24T01:23:53.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.1 2024-04-24T01:23:53.530 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:53.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.3 2024-04-24T01:23:53.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.535+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f09780a18a0 con 0x7f097806fb80 2024-04-24T01:23:53.536 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.536+0000 7f095ffff640 1 -- 172.21.15.142:0/859089224 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f09780a18a0 con 0x7f097806fb80 2024-04-24T01:23:53.537 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:53.537 INFO:teuthology.orchestra.run.smithi142.stdout:47244640262 2024-04-24T01:23:53.538 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 msgr2=0x7f096403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 0x7f096403a570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f096c001610 tx=0x7f096c007a50 comp rx=0 tx=0).stop 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 msgr2=0x7f09781c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f096802be10 tx=0x7f09680046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 shutdown_connections 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09640380b0 0x7f096403a570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 --2- 172.21.15.142:0/859089224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f097806fb80 0x7f09781c3a10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 >> 172.21.15.142:0/859089224 conn(0x7f097809e170 msgr2=0x7f097812b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 shutdown_connections 2024-04-24T01:23:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.538+0000 7f097e1e6640 1 -- 172.21.15.142:0/859089224 wait complete. 2024-04-24T01:23:53.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.2 2024-04-24T01:23:53.549 DEBUG:teuthology.parallel:result is None 2024-04-24T01:23:53.549 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T01:23:53.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:23:53.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c8d04640 1 Processor -- start 2024-04-24T01:23:53.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c8d04640 1 -- start start 2024-04-24T01:23:53.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c8d04640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3c406d690 0x7fd3c406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.687 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c8d04640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3c406f0f0 con 0x7fd3c406dfb0 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c8d04640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd3c4071a60 con 0x7fd3c406d690 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd3c406d690 0x7fd3c406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c1d9b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd3c406dfb0 0x7fd3c4070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52598/0 (socket says 172.21.15.142:52598) 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c1d9b640 1 -- 172.21.15.142:0/871212669 learned_addr learned my addr 172.21.15.142:0/871212669 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.686+0000 7fd3c259c640 1 --2- 172.21.15.142:0/871212669 >> v2:172.21.15.142:3300/0 conn(0x7fd3c406d690 0x7fd3c406da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45874/0 (socket says 172.21.15.142:45874) 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.687+0000 7fd3c259c640 1 -- 172.21.15.142:0/871212669 >> v1:172.21.15.142:6789/0 conn(0x7fd3c406dfb0 legacy=0x7fd3c4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.687+0000 7fd3c259c640 1 -- 172.21.15.142:0/871212669 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c406f8b0 con 0x7fd3c406d690 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.687+0000 7fd3c159a640 1 -- 172.21.15.142:0/871212669 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882276003 0 0) 0x7fd3c406f0f0 con 0x7fd3c406dfb0 2024-04-24T01:23:53.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.687+0000 7fd3c259c640 1 --2- 172.21.15.142:0/871212669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c406da70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800a8c0 tx=0x7fd3b802cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6355e206a97e5784 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.689+0000 7fd3c159a640 1 -- 172.21.15.142:0/871212669 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b803a070 con 0x7fd3c406d690 2024-04-24T01:23:53.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.689+0000 7fd3c159a640 1 -- 172.21.15.142:0/871212669 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b802da00 con 0x7fd3c406d690 2024-04-24T01:23:53.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.689+0000 7fd3c159a640 1 -- 172.21.15.142:0/871212669 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b800b040 con 0x7fd3c406d690 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 -- 172.21.15.142:0/871212669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 msgr2=0x7fd3c406da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/871212669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c406da70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800a8c0 tx=0x7fd3b802cd20 comp rx=0 tx=0).stop 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 -- 172.21.15.142:0/871212669 shutdown_connections 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/871212669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c406da70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 -- 172.21.15.142:0/871212669 >> 172.21.15.142:0/871212669 conn(0x7fd3c4099680 msgr2=0x7fd3c4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 -- 172.21.15.142:0/871212669 shutdown_connections 2024-04-24T01:23:53.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.690+0000 7fd3c8d04640 1 -- 172.21.15.142:0/871212669 wait complete. 2024-04-24T01:23:53.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c8d04640 1 Processor -- start 2024-04-24T01:23:53.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c8d04640 1 -- start start 2024-04-24T01:23:53.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c8d04640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c8d04640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c4070050 con 0x7fd3c406d690 2024-04-24T01:23:53.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45882/0 (socket says 172.21.15.142:45882) 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c259c640 1 -- 172.21.15.142:0/4040845523 learned_addr learned my addr 172.21.15.142:0/4040845523 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.691+0000 7fd3c259c640 1 -- 172.21.15.142:0/4040845523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c41a65d0 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3c259c640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800a8c0 tx=0x7fd3b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b8042020 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3b8035bf0 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3b803a040 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c40958e0 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.692+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c41a8910 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.693+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd3b8045020 con 0x7fd3c406d690 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.693+0000 7fd3b2ffd640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 0x7fd3a403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.694 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.693+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7fd3b806cbd0 con 0x7fd3c406d690 2024-04-24T01:23:53.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.693+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3c41a8c40 con 0x7fd3c406d690 2024-04-24T01:23:53.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.693+0000 7fd3c1d9b640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 0x7fd3a403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.695 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.694+0000 7fd3c1d9b640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 0x7fd3a403a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000c00 tx=0x7fd3b4007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.698 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.698+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd3b804c030 con 0x7fd3c406d690 2024-04-24T01:23:53.866 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.865+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3c41a7a00 con 0x7fd3a4038060 2024-04-24T01:23:53.867 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.868+0000 7fd3b2ffd640 1 -- 172.21.15.142:0/4040845523 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31874 (secure 0 0 0) 0x7fd3b40058d0 con 0x7fd3a4038060 2024-04-24T01:23:53.868 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:53.868 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:23:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 msgr2=0x7fd3a403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 0x7fd3a403a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4000c00 tx=0x7fd3b4007970 comp rx=0 tx=0).stop 2024-04-24T01:23:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 msgr2=0x7fd3c41c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.870 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800a8c0 tx=0x7fd3b80046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 shutdown_connections 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd3a4038060 0x7fd3a403a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 --2- 172.21.15.142:0/4040845523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3c406d690 0x7fd3c41c0a60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 >> 172.21.15.142:0/4040845523 conn(0x7fd3c4099680 msgr2=0x7fd3c408c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 shutdown_connections 2024-04-24T01:23:53.871 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.869+0000 7fd3c8d04640 1 -- 172.21.15.142:0/4040845523 wait complete. 2024-04-24T01:23:53.881 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-24T01:23:51.897827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109800,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377560,"statfs":{"total":386547056640,"available":386434621440,"internally_reserved":0,"allocated":1753088,"data_stored":1351076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.220951"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.779828+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:23:50.779828+0000","last_peered":"2024-04-24T01:23:50.779828+0000","last_clean":"2024-04-24T01:23:50.779828+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:23:50.779828+0000","last_undegraded":"2024-04-24T01:23:50.779828+0000","last_fullsized":"2024-04-24T01:23:50.779828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:53.952804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.693540+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:23:50.693540+0000","last_peered":"2024-04-24T01:23:50.693540+0000","last_clean":"2024-04-24T01:23:50.693540+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:23:50.693540+0000","last_undegraded":"2024-04-24T01:23:50.693540+0000","last_fullsized":"2024-04-24T01:23:50.693540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:24.844791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694900+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:23:50.694900+0000","last_peered":"2024-04-24T01:23:50.694900+0000","last_clean":"2024-04-24T01:23:50.694900+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:23:50.694900+0000","last_undegraded":"2024-04-24T01:23:50.694900+0000","last_fullsized":"2024-04-24T01:23:50.694900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:14.459436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.693547+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:23:50.693547+0000","last_peered":"2024-04-24T01:23:50.693547+0000","last_clean":"2024-04-24T01:23:50.693547+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:23:50.693547+0000","last_undegraded":"2024-04-24T01:23:50.693547+0000","last_fullsized":"2024-04-24T01:23:50.693547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:49.572859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694970+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:23:50.694970+0000","last_peered":"2024-04-24T01:23:50.694970+0000","last_clean":"2024-04-24T01:23:50.694970+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:23:50.694970+0000","last_undegraded":"2024-04-24T01:23:50.694970+0000","last_fullsized":"2024-04-24T01:23:50.694970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:32.500402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.692283+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:23:50.692283+0000","last_peered":"2024-04-24T01:23:50.692283+0000","last_clean":"2024-04-24T01:23:50.692283+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:23:50.692283+0000","last_undegraded":"2024-04-24T01:23:50.692283+0000","last_fullsized":"2024-04-24T01:23:50.692283+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:31.899106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694874+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:23:50.694874+0000","last_peered":"2024-04-24T01:23:50.694874+0000","last_clean":"2024-04-24T01:23:50.694874+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:23:50.694874+0000","last_undegraded":"2024-04-24T01:23:50.694874+0000","last_fullsized":"2024-04-24T01:23:50.694874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:10.687292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.695210+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:23:50.695210+0000","last_peered":"2024-04-24T01:23:50.695210+0000","last_clean":"2024-04-24T01:23:50.695210+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:23:50.695210+0000","last_undegraded":"2024-04-24T01:23:50.695210+0000","last_fullsized":"2024-04-24T01:23:50.695210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:31.899106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:23:51.684660+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:23:51.684660+0000","last_peered":"2024-04-24T01:23:51.684660+0000","last_clean":"2024-04-24T01:23:51.684660+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:23:51.684660+0000","last_undegraded":"2024-04-24T01:23:51.684660+0000","last_fullsized":"2024-04-24T01:23:51.684660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":635968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:23:53.882 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:23:53.978 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.977+0000 7f387d245640 1 Processor -- start 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.977+0000 7f387d245640 1 -- start start 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.977+0000 7f387d245640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3878096430 0x7f3878096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.977+0000 7f387d245640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3878098800 con 0x7f3878071090 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.977+0000 7f387d245640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3878071930 con 0x7f3878096430 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f3876d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3878096430 0x7f3878096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f386ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3878071090 0x7f387806d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52608/0 (socket says 172.21.15.142:52608) 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f386ffff640 1 -- 172.21.15.142:0/734631847 learned_addr learned my addr 172.21.15.142:0/734631847 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f3876d9d640 1 -- 172.21.15.142:0/734631847 >> v1:172.21.15.142:6789/0 conn(0x7f3878071090 legacy=0x7f387806d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.979 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f3876d9d640 1 -- 172.21.15.142:0/734631847 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3878071f50 con 0x7f3878096430 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.978+0000 7f3876d9d640 1 --2- 172.21.15.142:0/734631847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878096430 0x7f3878096810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3868009720 tx=0x7f386802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a709bf7045ca5ee7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387659c640 1 -- 172.21.15.142:0/734631847 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38680316d0 con 0x7f3878096430 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387659c640 1 -- 172.21.15.142:0/734631847 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868037070 con 0x7f3878096430 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387659c640 1 -- 172.21.15.142:0/734631847 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38680319c0 con 0x7f3878096430 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 -- 172.21.15.142:0/734631847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878096430 msgr2=0x7f3878096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 --2- 172.21.15.142:0/734631847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878096430 0x7f3878096810 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3868009720 tx=0x7f386802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 -- 172.21.15.142:0/734631847 shutdown_connections 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 --2- 172.21.15.142:0/734631847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878096430 0x7f3878096810 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 -- 172.21.15.142:0/734631847 >> 172.21.15.142:0/734631847 conn(0x7f3878099680 msgr2=0x7f3878099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 -- 172.21.15.142:0/734631847 shutdown_connections 2024-04-24T01:23:53.982 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.979+0000 7f387d245640 1 -- 172.21.15.142:0/734631847 wait complete. 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.980+0000 7f387d245640 1 Processor -- start 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.980+0000 7f387d245640 1 -- start start 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.980+0000 7f387d245640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.980+0000 7f387d245640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3878096d50 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f3876d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f3876d9d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45904/0 (socket says 172.21.15.142:45904) 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f3876d9d640 1 -- 172.21.15.142:0/3488153752 learned_addr learned my addr 172.21.15.142:0/3488153752 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f3876d9d640 1 -- 172.21.15.142:0/3488153752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387808b950 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f3876d9d640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3868034040 tx=0x7f38680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868032770 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3868032930 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3868032c50 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3878126530 con 0x7f3878071090 2024-04-24T01:23:53.983 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.981+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387808c5e0 con 0x7f3878071090 2024-04-24T01:23:53.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.982+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f386804c060 con 0x7f3878071090 2024-04-24T01:23:53.984 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.982+0000 7f386f7fe640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 0x7f385803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:53.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.982+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3878062da0 con 0x7f3878071090 2024-04-24T01:23:53.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.982+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f386802f050 con 0x7f3878071090 2024-04-24T01:23:53.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.982+0000 7f386ffff640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 0x7f385803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:53.985 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.983+0000 7f386ffff640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 0x7f385803a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3860007fd0 tx=0x7f3860007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:53.987 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:53.987+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f3868040070 con 0x7f3878071090 2024-04-24T01:23:54.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.155+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38781291a0 con 0x7f3858038060 2024-04-24T01:23:54.158 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.157+0000 7f386f7fe640 1 -- 172.21.15.142:0/3488153752 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31862 (secure 0 0 0) 0x7f38600058b0 con 0x7f3858038060 2024-04-24T01:23:54.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 msgr2=0x7f385803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 0x7f385803a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3860007fd0 tx=0x7f3860007ac0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 msgr2=0x7f3878089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3868034040 tx=0x7f38680046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 shutdown_connections 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3858038060 0x7f385803a520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.160 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 --2- 172.21.15.142:0/3488153752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3878071090 0x7f3878089f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 >> 172.21.15.142:0/3488153752 conn(0x7f3878099680 msgr2=0x7f387809b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:54.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 shutdown_connections 2024-04-24T01:23:54.161 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.159+0000 7f387d245640 1 -- 172.21.15.142:0/3488153752 wait complete. 2024-04-24T01:23:54.171 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-24T01:23:53.898298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109800,"kb_used_data":1712,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377560,"statfs":{"total":386547056640,"available":386434621440,"internally_reserved":0,"allocated":1753088,"data_stored":1351076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.221422"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.779828+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:23:50.779828+0000","last_peered":"2024-04-24T01:23:50.779828+0000","last_clean":"2024-04-24T01:23:50.779828+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:23:50.779828+0000","last_undegraded":"2024-04-24T01:23:50.779828+0000","last_fullsized":"2024-04-24T01:23:50.779828+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:53.952804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.693540+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:23:50.693540+0000","last_peered":"2024-04-24T01:23:50.693540+0000","last_clean":"2024-04-24T01:23:50.693540+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:23:50.693540+0000","last_undegraded":"2024-04-24T01:23:50.693540+0000","last_fullsized":"2024-04-24T01:23:50.693540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:02:24.844791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694900+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:23:50.694900+0000","last_peered":"2024-04-24T01:23:50.694900+0000","last_clean":"2024-04-24T01:23:50.694900+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:23:50.694900+0000","last_undegraded":"2024-04-24T01:23:50.694900+0000","last_fullsized":"2024-04-24T01:23:50.694900+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:14.459436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.693547+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:23:50.693547+0000","last_peered":"2024-04-24T01:23:50.693547+0000","last_clean":"2024-04-24T01:23:50.693547+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:23:50.693547+0000","last_undegraded":"2024-04-24T01:23:50.693547+0000","last_fullsized":"2024-04-24T01:23:50.693547+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:49.572859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694970+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:23:50.694970+0000","last_peered":"2024-04-24T01:23:50.694970+0000","last_clean":"2024-04-24T01:23:50.694970+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:23:50.694970+0000","last_undegraded":"2024-04-24T01:23:50.694970+0000","last_fullsized":"2024-04-24T01:23:50.694970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:32.500402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.692283+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:23:50.692283+0000","last_peered":"2024-04-24T01:23:50.692283+0000","last_clean":"2024-04-24T01:23:50.692283+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:23:50.692283+0000","last_undegraded":"2024-04-24T01:23:50.692283+0000","last_fullsized":"2024-04-24T01:23:50.692283+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:31.899106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.694874+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:23:50.694874+0000","last_peered":"2024-04-24T01:23:50.694874+0000","last_clean":"2024-04-24T01:23:50.694874+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:23:50.694874+0000","last_undegraded":"2024-04-24T01:23:50.694874+0000","last_fullsized":"2024-04-24T01:23:50.694874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:10.687292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-24T01:23:50.695210+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:23:50.695210+0000","last_peered":"2024-04-24T01:23:50.695210+0000","last_clean":"2024-04-24T01:23:50.695210+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:23:50.695210+0000","last_undegraded":"2024-04-24T01:23:50.695210+0000","last_fullsized":"2024-04-24T01:23:50.695210+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:31.899106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":168,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-24T01:23:51.684660+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:23:51.684660+0000","last_peered":"2024-04-24T01:23:51.684660+0000","last_clean":"2024-04-24T01:23:51.684660+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:23:51.684660+0000","last_undegraded":"2024-04-24T01:23:51.684660+0000","last_fullsized":"2024-04-24T01:23:51.684660+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":733184,"data_stored":631948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":635968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27156,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344684,"statfs":{"total":96636764160,"available":96608956416,"internally_reserved":0,"allocated":139264,"data_stored":41580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:23:54.172 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T01:23:54.172 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T01:23:54.172 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T01:23:54.172 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T01:23:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69ce440640 1 Processor -- start 2024-04-24T01:23:54.268 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69ce440640 1 -- start start 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69ce440640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69c8127ce0 0x7f69c81280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69ce440640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c8127b00 con 0x7f69c8070100 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69ce440640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f69c80708e0 con 0x7f69c8127ce0 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c7fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f69c8127ce0 0x7f69c81280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c77fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f69c8070100 0x7f69c812b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:52610/0 (socket says 172.21.15.142:52610) 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c77fe640 1 -- 172.21.15.142:0/3484717269 learned_addr learned my addr 172.21.15.142:0/3484717269 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c7fff640 1 -- 172.21.15.142:0/3484717269 >> v1:172.21.15.142:6789/0 conn(0x7f69c8070100 legacy=0x7f69c812b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c6ffd640 1 -- 172.21.15.142:0/3484717269 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836750881 0 0) 0x7f69b8001110 con 0x7f69c8070100 2024-04-24T01:23:54.269 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.267+0000 7f69c7fff640 1 -- 172.21.15.142:0/3484717269 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c8098800 con 0x7f69c8127ce0 2024-04-24T01:23:54.272 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.268+0000 7f69c7fff640 1 --2- 172.21.15.142:0/3484717269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8127ce0 0x7f69c81280c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009720 tx=0x7f69b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c64b388fd30123 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.268+0000 7f69c6ffd640 1 -- 172.21.15.142:0/3484717269 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b00316d0 con 0x7f69c8127ce0 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.268+0000 7f69c6ffd640 1 -- 172.21.15.142:0/3484717269 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b0037070 con 0x7f69c8127ce0 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.268+0000 7f69c6ffd640 1 -- 172.21.15.142:0/3484717269 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b00319c0 con 0x7f69c8127ce0 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 -- 172.21.15.142:0/3484717269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8127ce0 msgr2=0x7f69c81280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 --2- 172.21.15.142:0/3484717269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8127ce0 0x7f69c81280c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009720 tx=0x7f69b002b840 comp rx=0 tx=0).stop 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 -- 172.21.15.142:0/3484717269 shutdown_connections 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 --2- 172.21.15.142:0/3484717269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8127ce0 0x7f69c81280c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 -- 172.21.15.142:0/3484717269 >> 172.21.15.142:0/3484717269 conn(0x7f69c8099680 msgr2=0x7f69c8099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 -- 172.21.15.142:0/3484717269 shutdown_connections 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.269+0000 7f69ce440640 1 -- 172.21.15.142:0/3484717269 wait complete. 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69ce440640 1 Processor -- start 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69ce440640 1 -- start start 2024-04-24T01:23:54.273 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69ce440640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69ce440640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f69c8128780 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69c7fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45918/0 (socket says 172.21.15.142:45918) 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.270+0000 7f69c7fff640 1 -- 172.21.15.142:0/1528269889 learned_addr learned my addr 172.21.15.142:0/1528269889 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69c7fff640 1 -- 172.21.15.142:0/1528269889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c809b990 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69c7fff640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009720 tx=0x7f69b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0004160 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b0004320 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69b0032640 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c81252d0 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.271+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c808a4a0 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.272+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f69b00327e0 con 0x7f69c8070100 2024-04-24T01:23:54.274 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.272+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c8099dd0 con 0x7f69c8070100 2024-04-24T01:23:54.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.272+0000 7f69c4ff9640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 0x7f69a803a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.272+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f69b002f050 con 0x7f69c8070100 2024-04-24T01:23:54.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.272+0000 7f69c77fe640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 0x7f69a803a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.275 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.273+0000 7f69c77fe640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 0x7f69a803a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.277 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.276+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f69c8099dd0 con 0x7f69c8070100 2024-04-24T01:23:54.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.483+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f69c8124b80 con 0x7f69c8070100 2024-04-24T01:23:54.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.483+0000 7f69c4ff9640 1 -- 172.21.15.142:0/1528269889 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f69c808a4a0 con 0x7f69c8070100 2024-04-24T01:23:54.484 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:23:54.484 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T01:23:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 msgr2=0x7f69a803a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 0x7f69a803a550 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000c00 tx=0x7f69b8001310 comp rx=0 tx=0).stop 2024-04-24T01:23:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 msgr2=0x7f69c81232a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009720 tx=0x7f69b00046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 shutdown_connections 2024-04-24T01:23:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f69a8038090 0x7f69a803a550 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 --2- 172.21.15.142:0/1528269889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69c8070100 0x7f69c81232a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 >> 172.21.15.142:0/1528269889 conn(0x7f69c8099680 msgr2=0x7f69c8070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 shutdown_connections 2024-04-24T01:23:54.487 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:23:54.485+0000 7f69ce440640 1 -- 172.21.15.142:0/1528269889 wait complete. 2024-04-24T01:23:54.497 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T01:23:54.497 INFO:teuthology.run_tasks:Running task rgw... 2024-04-24T01:23:54.513 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-24T01:23:54.514 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-24T01:23:54.514 INFO:tasks.rgw:Creating data pools 2024-04-24T01:23:54.514 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-24T01:23:54.514 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-04-24T01:23:54.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.625+0000 7f968e8c8640 1 Processor -- start 2024-04-24T01:23:54.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.625+0000 7f968e8c8640 1 -- start start 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.625+0000 7f968e8c8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f968810dde0 0x7f968810e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.625+0000 7f968e8c8640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f968811b080 con 0x7f968810e7f0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.625+0000 7f968e8c8640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f968811c260 con 0x7f968810dde0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f9687fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f968810dde0 0x7f968810e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f96877fe640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f968810e7f0 0x7f9688119960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:56208/0 (socket says 172.21.15.169:56208) 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f96877fe640 1 -- 172.21.15.169:0/1497280332 learned_addr learned my addr 172.21.15.169:0/1497280332 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f9687fff640 1 -- 172.21.15.169:0/1497280332 >> v1:172.21.15.142:6789/0 conn(0x7f968810e7f0 legacy=0x7f9688119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f9686ffd640 1 -- 172.21.15.169:0/1497280332 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549573800 0 0) 0x7f968811b080 con 0x7f968810e7f0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.626+0000 7f9687fff640 1 -- 172.21.15.169:0/1497280332 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968811c3e0 con 0x7f968810dde0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.627+0000 7f9687fff640 1 --2- 172.21.15.169:0/1497280332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810e1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9678009720 tx=0x7f967802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d867dea3b52870 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.627+0000 7f9686ffd640 1 -- 172.21.15.169:0/1497280332 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96780316d0 con 0x7f968810dde0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.627+0000 7f9686ffd640 1 -- 172.21.15.169:0/1497280332 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9678037070 con 0x7f968810dde0 2024-04-24T01:23:54.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.627+0000 7f9686ffd640 1 -- 172.21.15.169:0/1497280332 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96780319c0 con 0x7f968810dde0 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 -- 172.21.15.169:0/1497280332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 msgr2=0x7f968810e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 --2- 172.21.15.169:0/1497280332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810e1c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9678009720 tx=0x7f967802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 -- 172.21.15.169:0/1497280332 shutdown_connections 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 --2- 172.21.15.169:0/1497280332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810e1c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 -- 172.21.15.169:0/1497280332 >> 172.21.15.169:0/1497280332 conn(0x7f968806f2a0 msgr2=0x7f96880716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 -- 172.21.15.169:0/1497280332 shutdown_connections 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 -- 172.21.15.169:0/1497280332 wait complete. 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.628+0000 7f968e8c8640 1 Processor -- start 2024-04-24T01:23:54.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f968e8c8640 1 -- start start 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f968e8c8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f968e8c8640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f968811b770 con 0x7f968810dde0 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f9687fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f9687fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53822/0 (socket says 172.21.15.169:53822) 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f9687fff640 1 -- 172.21.15.169:0/211896109 learned_addr learned my addr 172.21.15.169:0/211896109 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:54.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f9687fff640 1 -- 172.21.15.169:0/211896109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968810fd00 con 0x7f968810dde0 2024-04-24T01:23:54.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.629+0000 7f9687fff640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f967802b880 tx=0x7f96780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678004030 con 0x7f968810dde0 2024-04-24T01:23:54.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96780041d0 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968810ff30 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9678032640 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9688110400 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.630+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f96780327e0 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.631+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9688062da0 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.631+0000 7f9684ff9640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 0x7f967403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.631+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 3482+0+0 (secure 0 0 0) 0x7f967802f050 con 0x7f968810dde0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.631+0000 7f96877fe640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 0x7f967403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:54.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.631+0000 7f96877fe640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 0x7f967403a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:54.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.635+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9678041070 con 0x7f968810dde0 2024-04-24T01:23:54.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:54.818+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7f9688113510 con 0x7f968810dde0 2024-04-24T01:23:55.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.697+0000 7f9684ff9640 1 -- 172.21.15.169:0/211896109 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v18) ==== 171+0+0 (secure 0 0 0) 0x7f967804e3a0 con 0x7f968810dde0 2024-04-24T01:23:55.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 msgr2=0x7f967403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:55.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 0x7f967403a520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f967c000c00 tx=0x7f967c007970 comp rx=0 tx=0).stop 2024-04-24T01:23:55.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 msgr2=0x7f968810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:55.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f967802b880 tx=0x7f96780046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 shutdown_connections 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9674038060 0x7f967403a520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 --2- 172.21.15.169:0/211896109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f968810dde0 0x7f968810f7c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 >> 172.21.15.169:0/211896109 conn(0x7f968806f2a0 msgr2=0x7f9688116ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 shutdown_connections 2024-04-24T01:23:55.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.701+0000 7f968e8c8640 1 -- 172.21.15.169:0/211896109 wait complete. 2024-04-24T01:23:55.714 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-04-24T01:23:55.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.818+0000 7fd56f838640 1 Processor -- start 2024-04-24T01:23:55.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.818+0000 7fd56f838640 1 -- start start 2024-04-24T01:23:55.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56f838640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd56810dfc0 0x7fd56810e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:55.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56f838640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56811b110 con 0x7fd56810e8e0 2024-04-24T01:23:55.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56f838640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd56811c2f0 con 0x7fd56810dfc0 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56d5d4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd56810dfc0 0x7fd56810e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56d5d4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd56810dfc0 0x7fd56810e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53828/0 (socket says 172.21.15.169:53828) 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56d5d4640 1 -- 172.21.15.169:0/3578866878 learned_addr learned my addr 172.21.15.169:0/3578866878 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56d5d4640 1 -- 172.21.15.169:0/3578866878 >> v1:172.21.15.142:6789/0 conn(0x7fd56810e8e0 legacy=0x7fd568119960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.819+0000 7fd56d5d4640 1 -- 172.21.15.169:0/3578866878 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd56811c470 con 0x7fd56810dfc0 2024-04-24T01:23:55.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.820+0000 7fd56d5d4640 1 --2- 172.21.15.169:0/3578866878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd56810e3a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097f0 tx=0x7fd55802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2618e60340e6b03e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:55.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.820+0000 7fd55ffff640 1 -- 172.21.15.169:0/3578866878 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd558035020 con 0x7fd56810dfc0 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.820+0000 7fd55ffff640 1 -- 172.21.15.169:0/3578866878 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5580317a0 con 0x7fd56810dfc0 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.820+0000 7fd55ffff640 1 -- 172.21.15.169:0/3578866878 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd558031aa0 con 0x7fd56810dfc0 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 -- 172.21.15.169:0/3578866878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 msgr2=0x7fd56810e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 --2- 172.21.15.169:0/3578866878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd56810e3a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097f0 tx=0x7fd55802b910 comp rx=0 tx=0).stop 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 -- 172.21.15.169:0/3578866878 shutdown_connections 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 --2- 172.21.15.169:0/3578866878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd56810e3a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 -- 172.21.15.169:0/3578866878 >> 172.21.15.169:0/3578866878 conn(0x7fd56806f2b0 msgr2=0x7fd5680716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 -- 172.21.15.169:0/3578866878 shutdown_connections 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 -- 172.21.15.169:0/3578866878 wait complete. 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.821+0000 7fd56f838640 1 Processor -- start 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56f838640 1 -- start start 2024-04-24T01:23:55.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56f838640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56f838640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd56811b800 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56d5d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56d5d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53836/0 (socket says 172.21.15.169:53836) 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56d5d4640 1 -- 172.21.15.169:0/381192759 learned_addr learned my addr 172.21.15.169:0/381192759 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56d5d4640 1 -- 172.21.15.169:0/381192759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5681aa740 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.822+0000 7fd56d5d4640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097f0 tx=0x7fd5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.823+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd55803ad00 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.823+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5580443f0 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.823+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5681aa970 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.823+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5580446d0 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.823+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5681a4280 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd55804b060 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd568062da0 con 0x7fd56810dfc0 2024-04-24T01:23:55.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd55dffb640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 0x7fd54c03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:55.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3797+0+0 (secure 0 0 0) 0x7fd55806d240 con 0x7fd56810dfc0 2024-04-24T01:23:55.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd56cdd3640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 0x7fd54c03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:55.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.824+0000 7fd56cdd3640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 0x7fd54c03a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd56810ed30 tx=0x7fd5640079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:55.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:55.829+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd55803f070 con 0x7fd56810dfc0 2024-04-24T01:23:56.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:56.004+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fd56810e8e0 con 0x7fd56810dfc0 2024-04-24T01:23:57.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.705+0000 7fd55dffb640 1 -- 172.21.15.169:0/381192759 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v20) ==== 227+0+0 (secure 0 0 0) 0x7fd55804dca0 con 0x7fd56810dfc0 2024-04-24T01:23:57.706 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.data' created 2024-04-24T01:23:57.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 msgr2=0x7fd54c03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:57.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 0x7fd54c03a4d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd56810ed30 tx=0x7fd5640079d0 comp rx=0 tx=0).stop 2024-04-24T01:23:57.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 msgr2=0x7fd5681aa170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd5580097f0 tx=0x7fd5580046c0 comp rx=0 tx=0).stop 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 shutdown_connections 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c038010 0x7fd54c03a4d0 secure :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd56810ed30 tx=0x7fd5640079d0 comp rx=0 tx=0).stop 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 --2- 172.21.15.169:0/381192759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd56810dfc0 0x7fd5681aa170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.709+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 >> 172.21.15.169:0/381192759 conn(0x7fd56806f2b0 msgr2=0x7fd56811a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.710+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 shutdown_connections 2024-04-24T01:23:57.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.710+0000 7fd56f838640 1 -- 172.21.15.169:0/381192759 wait complete. 2024-04-24T01:23:57.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-24T01:23:57.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.827+0000 7fe80f639640 1 Processor -- start 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.827+0000 7fe80f639640 1 -- start start 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80f639640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe80811a990 0x7fe80811cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80f639640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80811d2c0 con 0x7fe808111d10 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80f639640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe80811e4c0 con 0x7fe80811a990 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80cbd4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe80811a990 0x7fe80811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80cbd4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe80811a990 0x7fe80811cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53852/0 (socket says 172.21.15.169:53852) 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80d3d5640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe808111d10 0x7fe8081120f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:56226/0 (socket says 172.21.15.169:56226) 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80cbd4640 1 -- 172.21.15.169:0/2184133229 learned_addr learned my addr 172.21.15.169:0/2184133229 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80cbd4640 1 -- 172.21.15.169:0/2184133229 >> v1:172.21.15.142:6789/0 conn(0x7fe808111d10 legacy=0x7fe8081120f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:57.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.828+0000 7fe80cbd4640 1 -- 172.21.15.169:0/2184133229 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80811e670 con 0x7fe80811a990 2024-04-24T01:23:57.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.829+0000 7fe80cbd4640 1 --2- 172.21.15.169:0/2184133229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80811a990 0x7fe80811cd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097f0 tx=0x7fe7f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f2bd9bed31fe56 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:57.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.829+0000 7fe7fffff640 1 -- 172.21.15.169:0/2184133229 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8035020 con 0x7fe80811a990 2024-04-24T01:23:57.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.829+0000 7fe7fffff640 1 -- 172.21.15.169:0/2184133229 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f80317a0 con 0x7fe80811a990 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.829+0000 7fe7fffff640 1 -- 172.21.15.169:0/2184133229 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7f8031aa0 con 0x7fe80811a990 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 -- 172.21.15.169:0/2184133229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80811a990 msgr2=0x7fe80811cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 --2- 172.21.15.169:0/2184133229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80811a990 0x7fe80811cd80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097f0 tx=0x7fe7f802b910 comp rx=0 tx=0).stop 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 -- 172.21.15.169:0/2184133229 shutdown_connections 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 --2- 172.21.15.169:0/2184133229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe80811a990 0x7fe80811cd80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 -- 172.21.15.169:0/2184133229 >> 172.21.15.169:0/2184133229 conn(0x7fe80806e680 msgr2=0x7fe80810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 -- 172.21.15.169:0/2184133229 shutdown_connections 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.830+0000 7fe80f639640 1 -- 172.21.15.169:0/2184133229 wait complete. 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80f639640 1 Processor -- start 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80f639640 1 -- start start 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80f639640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80f639640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe80811d970 con 0x7fe808111d10 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80d3d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:57.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80d3d5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53868/0 (socket says 172.21.15.169:53868) 2024-04-24T01:23:57.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80d3d5640 1 -- 172.21.15.169:0/4088303671 learned_addr learned my addr 172.21.15.169:0/4088303671 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:57.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.831+0000 7fe80d3d5640 1 -- 172.21.15.169:0/4088303671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8081ac9e0 con 0x7fe808111d10 2024-04-24T01:23:57.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe80d3d5640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c710 tx=0x7fe80400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:57.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe804017070 con 0x7fe808111d10 2024-04-24T01:23:57.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe804005da0 con 0x7fe808111d10 2024-04-24T01:23:57.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe80400a790 con 0x7fe808111d10 2024-04-24T01:23:57.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8081acc70 con 0x7fe808111d10 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.832+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8081a6700 con 0x7fe808111d10 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe80401a070 con 0x7fe808111d10 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe808062da0 con 0x7fe808111d10 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe7fdffb640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 0x7fe7ec03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4272+0+0 (secure 0 0 0) 0x7fe80404a770 con 0x7fe808111d10 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe80cbd4640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 0x7fe7ec03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:57.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.833+0000 7fe80cbd4640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 0x7fe7ec03a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8036000 tx=0x7fe7f8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:57.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:57.838+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe80400a930 con 0x7fe808111d10 2024-04-24T01:23:58.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.013+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fe8081acf10 con 0x7fe808111d10 2024-04-24T01:23:58.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.711+0000 7fe7fdffb640 1 -- 172.21.15.169:0/4088303671 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7fe804007070 con 0x7fe808111d10 2024-04-24T01:23:58.711 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-24T01:23:58.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 msgr2=0x7fe7ec03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:58.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 0x7fe7ec03a520 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8036000 tx=0x7fe7f8008030 comp rx=0 tx=0).stop 2024-04-24T01:23:58.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 msgr2=0x7fe8081ac410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:58.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe80400c710 tx=0x7fe80400cbd0 comp rx=0 tx=0).stop 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 shutdown_connections 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe7ec038060 0x7fe7ec03a520 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 --2- 172.21.15.169:0/4088303671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe808111d10 0x7fe8081ac410 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.714+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 >> 172.21.15.169:0/4088303671 conn(0x7fe80806e680 msgr2=0x7fe80810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.715+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 shutdown_connections 2024-04-24T01:23:58.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.715+0000 7fe80f639640 1 -- 172.21.15.169:0/4088303671 wait complete. 2024-04-24T01:23:58.747 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-24T01:23:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.851+0000 7f29a8738640 1 Processor -- start 2024-04-24T01:23:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.851+0000 7f29a8738640 1 -- start start 2024-04-24T01:23:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.851+0000 7f29a8738640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a011aaf0 0x7f29a011cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.851+0000 7f29a8738640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29a011d420 con 0x7f29a0116c40 2024-04-24T01:23:58.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.851+0000 7f29a8738640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f29a011e600 con 0x7f29a011aaf0 2024-04-24T01:23:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a5cd3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a011aaf0 0x7f29a011cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a5cd3640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f29a011aaf0 0x7f29a011cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53870/0 (socket says 172.21.15.169:53870) 2024-04-24T01:23:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a5cd3640 1 -- 172.21.15.169:0/1164532301 learned_addr learned my addr 172.21.15.169:0/1164532301 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a64d4640 1 --1- 172.21.15.169:0/1164532301 >> v1:172.21.15.142:6789/0 conn(0x7f29a0116c40 0x7f29a0117020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:56234/0 (socket says 172.21.15.169:56234) 2024-04-24T01:23:58.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a5cd3640 1 -- 172.21.15.169:0/1164532301 >> v1:172.21.15.142:6789/0 conn(0x7f29a0116c40 legacy=0x7f29a0117020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.852+0000 7f29a5cd3640 1 -- 172.21.15.169:0/1164532301 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a011e7b0 con 0x7f29a011aaf0 2024-04-24T01:23:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.853+0000 7f29a5cd3640 1 --2- 172.21.15.169:0/1164532301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a011aaf0 0x7f29a011cee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06b58dd2d842d28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.853+0000 7f29a54d2640 1 -- 172.21.15.169:0/1164532301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2990035020 con 0x7f29a011aaf0 2024-04-24T01:23:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.853+0000 7f29a54d2640 1 -- 172.21.15.169:0/1164532301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29900317a0 con 0x7f29a011aaf0 2024-04-24T01:23:58.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.853+0000 7f29a54d2640 1 -- 172.21.15.169:0/1164532301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2990031aa0 con 0x7f29a011aaf0 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- 172.21.15.169:0/1164532301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a011aaf0 msgr2=0x7f29a011cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 --2- 172.21.15.169:0/1164532301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a011aaf0 0x7f29a011cee0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299002b910 comp rx=0 tx=0).stop 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- 172.21.15.169:0/1164532301 shutdown_connections 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 --2- 172.21.15.169:0/1164532301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a011aaf0 0x7f29a011cee0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- 172.21.15.169:0/1164532301 >> 172.21.15.169:0/1164532301 conn(0x7f29a006e700 msgr2=0x7f29a010fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:58.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- 172.21.15.169:0/1164532301 shutdown_connections 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- 172.21.15.169:0/1164532301 wait complete. 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 Processor -- start 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- start start 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.854+0000 7f29a8738640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f29a011dad0 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a64d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a64d4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53886/0 (socket says 172.21.15.169:53886) 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a64d4640 1 -- 172.21.15.169:0/1461919313 learned_addr learned my addr 172.21.15.169:0/1461919313 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a64d4640 1 -- 172.21.15.169:0/1461919313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a01a6ec0 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a64d4640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c710 tx=0x7f299c00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c017070 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f299c005da0 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a01a71b0 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299c00a790 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.855+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a01ab2e0 con 0x7f29a0116c40 2024-04-24T01:23:58.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.856+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29a0062da0 con 0x7f29a0116c40 2024-04-24T01:23:58.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.856+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f299c01a070 con 0x7f29a0116c40 2024-04-24T01:23:58.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.856+0000 7f2996ffd640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 0x7f298403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:58.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.856+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 4283+0+0 (secure 0 0 0) 0x7f299c04a870 con 0x7f29a0116c40 2024-04-24T01:23:58.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.856+0000 7f29a5cd3640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 0x7f298403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:58.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.857+0000 7f29a5cd3640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 0x7f298403a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2990036000 tx=0x7f2990008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:58.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:58.861+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f299c00a930 con 0x7f29a0116c40 2024-04-24T01:23:59.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.034+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f29a01a73e0 con 0x7f29a0116c40 2024-04-24T01:23:59.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.715+0000 7f2996ffd640 1 -- 172.21.15.169:0/1461919313 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7f299c0070c0 con 0x7f29a0116c40 2024-04-24T01:23:59.716 INFO:teuthology.orchestra.run.smithi169.stderr:pool 'default.rgw.buckets.index' created 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 msgr2=0x7f298403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 0x7f298403a4d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2990036000 tx=0x7f2990008030 comp rx=0 tx=0).stop 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 msgr2=0x7f29a01a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f299c00c710 tx=0x7f299c00cbd0 comp rx=0 tx=0).stop 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 shutdown_connections 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2984038010 0x7f298403a4d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 --2- 172.21.15.169:0/1461919313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a0116c40 0x7f29a01a6980 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 >> 172.21.15.169:0/1461919313 conn(0x7f29a006e700 msgr2=0x7f29a011b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 shutdown_connections 2024-04-24T01:23:59.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.719+0000 7f29a8738640 1 -- 172.21.15.169:0/1461919313 wait complete. 2024-04-24T01:23:59.738 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-24T01:23:59.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.838+0000 7f9ddea96640 1 Processor -- start 2024-04-24T01:23:59.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.838+0000 7f9ddea96640 1 -- start start 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.838+0000 7f9ddea96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dd8116c40 0x7f9dd8117020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.838+0000 7f9ddea96640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd8117680 con 0x7f9dd8111b00 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.838+0000 7f9ddea96640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd81126a0 con 0x7f9dd8116c40 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9ddc832640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dd8116c40 0x7f9dd8117020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9dd7fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f9dd8111b00 0x7f9dd8111f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:56242/0 (socket says 172.21.15.169:56242) 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9ddc832640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f9dd8116c40 0x7f9dd8117020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53898/0 (socket says 172.21.15.169:53898) 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9dd7fff640 1 -- 172.21.15.169:0/1850106202 learned_addr learned my addr 172.21.15.169:0/1850106202 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9ddc832640 1 -- 172.21.15.169:0/1850106202 >> v1:172.21.15.142:6789/0 conn(0x7f9dd8111b00 legacy=0x7f9dd8111f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:59.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.839+0000 7f9ddc832640 1 -- 172.21.15.169:0/1850106202 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd8112850 con 0x7f9dd8116c40 2024-04-24T01:23:59.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.840+0000 7f9ddc832640 1 --2- 172.21.15.169:0/1850106202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8116c40 0x7f9dd8117020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009720 tx=0x7f9dc802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261e73bb1a06cf74 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.840+0000 7f9dd77fe640 1 -- 172.21.15.169:0/1850106202 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc80316d0 con 0x7f9dd8116c40 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.840+0000 7f9dd77fe640 1 -- 172.21.15.169:0/1850106202 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8037070 con 0x7f9dd8116c40 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.840+0000 7f9dd77fe640 1 -- 172.21.15.169:0/1850106202 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc80319c0 con 0x7f9dd8116c40 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 -- 172.21.15.169:0/1850106202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8116c40 msgr2=0x7f9dd8117020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 --2- 172.21.15.169:0/1850106202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8116c40 0x7f9dd8117020 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009720 tx=0x7f9dc802b840 comp rx=0 tx=0).stop 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 -- 172.21.15.169:0/1850106202 shutdown_connections 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 --2- 172.21.15.169:0/1850106202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8116c40 0x7f9dd8117020 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 -- 172.21.15.169:0/1850106202 >> 172.21.15.169:0/1850106202 conn(0x7f9dd806e700 msgr2=0x7f9dd810fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 -- 172.21.15.169:0/1850106202 shutdown_connections 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 -- 172.21.15.169:0/1850106202 wait complete. 2024-04-24T01:23:59.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.841+0000 7f9ddea96640 1 Processor -- start 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddea96640 1 -- start start 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddea96640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddea96640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd811df30 con 0x7f9dd8111b00 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddc832640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddc832640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:53904/0 (socket says 172.21.15.169:53904) 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddc832640 1 -- 172.21.15.169:0/2890574373 learned_addr learned my addr 172.21.15.169:0/2890574373 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:23:59.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.842+0000 7f9ddc832640 1 -- 172.21.15.169:0/2890574373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd81a6f70 con 0x7f9dd8111b00 2024-04-24T01:23:59.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9ddc832640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8034040 tx=0x7f9dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc8032770 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc8032910 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd81a7200 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc8032c30 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.843+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd81ab0e0 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd8062da0 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9dc804c060 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9dd57fa640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 0x7f9dc403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4647+0+0 (secure 0 0 0) 0x7f9dc802f050 con 0x7f9dd8111b00 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9dd7fff640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 0x7f9dc403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:23:59.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.844+0000 7f9dd7fff640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 0x7f9dc403a4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc007fd0 tx=0x7f9dcc007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:23:59.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:23:59.849+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f9dc8040070 con 0x7f9dd8111b00 2024-04-24T01:24:00.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.022+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f9dd8116c40 con 0x7f9dd8111b00 2024-04-24T01:24:00.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.719+0000 7f9dd57fa640 1 -- 172.21.15.169:0/2890574373 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7f9dc8032dd0 con 0x7f9dd8111b00 2024-04-24T01:24:00.719 INFO:teuthology.orchestra.run.smithi169.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-24T01:24:00.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.722+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 msgr2=0x7f9dc403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:00.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.722+0000 7f9ddea96640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 0x7f9dc403a4d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc007fd0 tx=0x7f9dcc007ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:00.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.722+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 msgr2=0x7f9dd81a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:00.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.722+0000 7f9ddea96640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8034040 tx=0x7f9dc80046c0 comp rx=0 tx=0).stop 2024-04-24T01:24:00.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.726+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 shutdown_connections 2024-04-24T01:24:00.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.726+0000 7f9ddea96640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9dc4038010 0x7f9dc403a4d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:00.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.726+0000 7f9ddea96640 1 --2- 172.21.15.169:0/2890574373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9dd8111b00 0x7f9dd81a6a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:00.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.726+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 >> 172.21.15.169:0/2890574373 conn(0x7f9dd806e700 msgr2=0x7f9dd811cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:00.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.729+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 shutdown_connections 2024-04-24T01:24:00.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:00.730+0000 7f9ddea96640 1 -- 172.21.15.169:0/2890574373 wait complete. 2024-04-24T01:24:00.750 DEBUG:tasks.rgw:Pools created 2024-04-24T01:24:00.750 INFO:tasks.rgw:Starting rgw... 2024-04-24T01:24:00.750 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-24T01:24:00.750 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-24T01:24:00.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo echo -n http://smithi169.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-24T01:24:00.775 INFO:teuthology.orchestra.run.smithi169.stdout:http://smithi169.front.sepia.ceph.com:80 2024-04-24T01:24:00.776 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-24T01:24:00.841 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-24T01:24:00.841 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-24T01:24:00.884 INFO:tasks.rgw.client.0:Started 2024-04-24T01:24:00.884 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:00.885 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:00.908 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:24:00.908 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:24:00.908 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:24:00.908 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:24:00.909 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:24:01.910 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:01.931 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:24:01.931 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:24:01.933 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:24:01.933 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:24:01.933 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:24:03.934 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:03.957 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:24:03.958 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:24:03.958 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:24:03.958 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:24:03.958 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:24:07.959 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:07.983 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:24:07.983 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:24:07.983 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T01:24:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:curl: (7) Failed to connect to smithi169.front.sepia.ceph.com port 80: Connection refused 2024-04-24T01:24:07.984 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T01:24:09.836 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-24T01:24:09.836+0000 7f9cdd611880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-24T01:24:15.985 DEBUG:teuthology.orchestra.run.smithi169:> curl http://smithi169.front.sepia.ceph.com:80/ 2024-04-24T01:24:16.008 INFO:teuthology.orchestra.run.smithi169.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T01:24:16.008 INFO:teuthology.orchestra.run.smithi169.stderr: Dload Upload Total Spent Left Speed 2024-04-24T01:24:16.010 INFO:teuthology.orchestra.run.smithi169.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-04-24T01:24:16.011 INFO:teuthology.orchestra.run.smithi169.stdout:anonymous 2024-04-24T01:24:16.011 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-04-24T01:24:17.527 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-04-24T01:24:17.527 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T01:24:17.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T01:24:17.527 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T01:24:17.575 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:17.575 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:17.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.575+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.575+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.575+0000 7f8a82c30800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55911181b450 0x55911181d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.575+0000 7f8a82c30800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591116d5d40 con 0x559111817940 2024-04-24T01:24:17.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.575+0000 7f8a82c30800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5591116a84d0 con 0x55911181b450 2024-04-24T01:24:17.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a77fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55911181b450 0x55911181d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a7df2e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x559111817940 0x559111819d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34532/0 (socket says 172.21.15.169:34532) 2024-04-24T01:24:17.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a77fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55911181b450 0x55911181d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60770/0 (socket says 172.21.15.169:60770) 2024-04-24T01:24:17.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a7df2e640 1 -- 172.21.15.169:0/2882341333 learned_addr learned my addr 172.21.15.169:0/2882341333 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:17.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a77fff640 1 -- 172.21.15.169:0/2882341333 >> v1:172.21.15.142:6789/0 conn(0x559111817940 legacy=0x559111819d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a77fff640 1 -- 172.21.15.169:0/2882341333 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591116d4590 con 0x55911181b450 2024-04-24T01:24:17.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.576+0000 7f8a7d72d640 1 -- 172.21.15.169:0/2882341333 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209847734 0 0) 0x5591116d5d40 con 0x559111817940 2024-04-24T01:24:17.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.578+0000 7f8a77fff640 1 --2- 172.21.15.169:0/2882341333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911181b450 0x55911181d840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800a470 tx=0x7f8a6801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e869ab414142b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.578+0000 7f8a7d72d640 1 -- 172.21.15.169:0/2882341333 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68057070 con 0x55911181b450 2024-04-24T01:24:17.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.578+0000 7f8a7d72d640 1 -- 172.21.15.169:0/2882341333 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a68052570 con 0x55911181b450 2024-04-24T01:24:17.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.578+0000 7f8a7d72d640 1 -- 172.21.15.169:0/2882341333 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a68052870 con 0x55911181b450 2024-04-24T01:24:17.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 -- 172.21.15.169:0/2882341333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911181b450 msgr2=0x55911181d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 --2- 172.21.15.169:0/2882341333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911181b450 0x55911181d840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800a470 tx=0x7f8a6801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:17.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 -- 172.21.15.169:0/2882341333 shutdown_connections 2024-04-24T01:24:17.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 --2- 172.21.15.169:0/2882341333 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911181b450 0x55911181d840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 -- 172.21.15.169:0/2882341333 >> 172.21.15.169:0/2882341333 conn(0x559111811370 msgr2=0x559111813790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 -- 172.21.15.169:0/2882341333 shutdown_connections 2024-04-24T01:24:17.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.579+0000 7f8a82c30800 1 -- 172.21.15.169:0/2882341333 wait complete. 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a82c30800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a82c30800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591117623b0 con 0x559111817940 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60778/0 (socket says 172.21.15.169:60778) 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.593+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3871006738 learned_addr learned my addr 172.21.15.169:0/3871006738 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.594+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3871006738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591119084d0 con 0x559111817940 2024-04-24T01:24:17.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.594+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/3871006738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b210 tx=0x7f8a7000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c379e569e369c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.594+0000 7f896be07640 1 -- 172.21.15.169:0/3871006738 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70008070 con 0x559111817940 2024-04-24T01:24:17.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.594+0000 7f896be07640 1 -- 172.21.15.169:0/3871006738 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7000d500 con 0x559111817940 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.594+0000 7f896be07640 1 -- 172.21.15.169:0/3871006738 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7000d840 con 0x559111817940 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- 172.21.15.169:0/3871006738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 msgr2=0x559111907f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3871006738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b210 tx=0x7f8a7000b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- 172.21.15.169:0/3871006738 shutdown_connections 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3871006738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111907f00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- 172.21.15.169:0/3871006738 >> 172.21.15.169:0/3871006738 conn(0x559111811370 msgr2=0x559111903820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- 172.21.15.169:0/3871006738 shutdown_connections 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- 172.21.15.169:0/3871006738 wait complete. 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.595+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a82c30800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111817260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a82c30800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559111820090 con 0x559111817940 2024-04-24T01:24:17.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111817260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111817260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60780/0 (socket says 172.21.15.169:60780) 2024-04-24T01:24:17.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3094077255 learned_addr learned my addr 172.21.15.169:0/3094077255 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559111815950 con 0x559111817940 2024-04-24T01:24:17.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111817260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b210 tx=0x7f8a70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.596+0000 7f896a604640 1 -- 172.21.15.169:0/3094077255 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7000f950 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.597+0000 7f896a604640 1 -- 172.21.15.169:0/3094077255 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7000faf0 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.597+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559111815be0 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.597+0000 7f896a604640 1 -- 172.21.15.169:0/3094077255 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7000fdd0 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.597+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559111816100 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.597+0000 7f896a604640 1 -- 172.21.15.169:0/3094077255 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a70017040 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f896a604640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8964036900 0x7f8964038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f896a604640 1 -- 172.21.15.169:0/3094077255 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8a70015020 con 0x559111817940 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8964036900 0x7f8964038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55911181b450 0x559111918e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5591119193d0 con 0x55911181b450 2024-04-24T01:24:17.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55911181b450 0x559111918e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8964036900 0x7f8964038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a68054000 tx=0x7f8a6804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.598+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55911181b450 0x559111918e90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a7e72f640 1 -- 172.21.15.169:0/3094077255 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x55911181b450 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111816490 con 0x55911181b450 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a7e72f640 1 -- 172.21.15.169:0/3094077255 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x55911181b450 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55911191b720 0x55911191db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55911191e1b0 con 0x55911191b720 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.599+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55911191b720 0x55911191db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55911191b720 0x55911191db10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3094077255 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8a7002d070 con 0x55911191b720 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55911191a6d0 con 0x55911181b450 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a7e72f640 1 -- 172.21.15.169:0/3094077255 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x55911181b450 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55911191f660 0x559111921ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.600+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111922210 con 0x55911191f660 2024-04-24T01:24:17.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.601+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55911191f660 0x559111921ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.601+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55911191f660 0x559111921ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.601+0000 7f8a77fff640 1 -- 172.21.15.169:0/3094077255 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8a68052940 con 0x55911191f660 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.601+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a82c30800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a82c30800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591117086b0 con 0x559111930670 2024-04-24T01:24:17.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60796/0 (socket says 172.21.15.169:60796) 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3772714713 learned_addr learned my addr 172.21.15.169:0/3772714713 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a7df2e640 1 -- 172.21.15.169:0/3772714713 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559111930fd0 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.602+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a7004b4b0 tx=0x7f8a7001aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.603+0000 7f89637fe640 1 -- 172.21.15.169:0/3772714713 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70019470 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.603+0000 7f89637fe640 1 -- 172.21.15.169:0/3772714713 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70019610 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.603+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559111931a40 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.603+0000 7f89637fe640 1 -- 172.21.15.169:0/3772714713 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a700198f0 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.603+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559111931f40 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f89637fe640 1 -- 172.21.15.169:0/3772714713 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a7003f1b0 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f89637fe640 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 0x7f8958038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f89637fe640 1 -- 172.21.15.169:0/3772714713 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8a7003cc50 con 0x559111930670 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 0x7f8958038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a77fff640 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 0x7f8958038d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5591118163b0 tx=0x7f8a68005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a82c30800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.604+0000 7f8a82c30800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559111908850 con 0x55911193d9c0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60800/0 (socket says 172.21.15.169:60800) 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f8a7df2e640 1 -- 172.21.15.169:0/2001943281 learned_addr learned my addr 172.21.15.169:0/2001943281 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f8a7df2e640 1 -- 172.21.15.169:0/2001943281 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55911193e3b0 con 0x55911193d9c0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/2001943281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a700274c0 tx=0x7f8a700266d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a9f2f3a276e8c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f89617fa640 1 -- 172.21.15.169:0/2001943281 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7004b530 con 0x55911193d9c0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f89617fa640 1 -- 172.21.15.169:0/2001943281 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70041dd0 con 0x55911193d9c0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.605+0000 7f89617fa640 1 -- 172.21.15.169:0/2001943281 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a70040a30 con 0x55911193d9c0 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- 172.21.15.169:0/2001943281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 msgr2=0x55911193dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 --2- 172.21.15.169:0/2001943281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8a700274c0 tx=0x7f8a700266d0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- 172.21.15.169:0/2001943281 shutdown_connections 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 --2- 172.21.15.169:0/2001943281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x55911193dde0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- 172.21.15.169:0/2001943281 >> 172.21.15.169:0/2001943281 conn(0x559111939c90 msgr2=0x559111937cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- 172.21.15.169:0/2001943281 shutdown_connections 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- 172.21.15.169:0/2001943281 wait complete. 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 Processor -- start 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- start start 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x559111944ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a82c30800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55911193ea10 con 0x55911193d9c0 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x559111944ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.606+0000 7f8a7df2e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x559111944ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60804/0 (socket says 172.21.15.169:60804) 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 learned_addr learned my addr 172.21.15.169:0/1121216483 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559111945220 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x559111944ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a7004d0f0 tx=0x7f8a70027450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f894f7fe640 1 -- 172.21.15.169:0/1121216483 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7004b530 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f894f7fe640 1 -- 172.21.15.169:0/1121216483 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70030d90 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f894f7fe640 1 -- 172.21.15.169:0/1121216483 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a7004b880 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559111945220 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.607+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559111945220 con 0x55911193d9c0 2024-04-24T01:24:17.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f894f7fe640 1 -- 172.21.15.169:0/1121216483 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a7004bb30 con 0x55911193d9c0 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f894f7fe640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8948036900 0x7f8948038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f894f7fe640 1 -- 172.21.15.169:0/1121216483 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8a70071c90 con 0x55911193d9c0 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f8a77fff640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8948036900 0x7f8948038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559111950300 0x5591119527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.608+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111952f10 con 0x559111950300 2024-04-24T01:24:17.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559111950300 0x5591119527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a77fff640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8948036900 0x7f8948038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a68052fd0 tx=0x7f8a6804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559111950300 0x5591119527c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 20 realm 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111953320 con 0x559111950300 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.609+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111953bc0 con 0x559111950300 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111950300 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559111954cc0 0x5591119570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5591119575f0 con 0x559111954cc0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.610+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559111954cc0 0x5591119570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a7df2e640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559111954cc0 0x5591119570b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a82c30800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a82c30800 20 searching for the correct realm 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559111959670 0x55911195bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55911195c200 con 0x559111959670 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a77fff640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559111959670 0x55911195bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.611+0000 7f8a77fff640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559111959670 0x55911195bb30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.612+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.612+0000 7f8a77fff640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8a68076040 0x7f8a68083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.612+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55911195c200 con 0x7f8a68076040 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.612+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8a68076040 0x7f8a68083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.612+0000 7f8a7e72f640 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8a68076040 0x7f8a68083410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111954cc0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111950300 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111950300 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.613+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x7f8a68076040 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.614+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111959670 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111950300 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111950300 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.615+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x7f8a68076040 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111953f60 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.616+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.617+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.618+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.619+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.619+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.619+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.619+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.620+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.621+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111957f70 con 0x559111950300 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111957f70 con 0x559111950300 2024-04-24T01:24:17.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.622+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111957f70 con 0x7f8a68076040 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 zone default found 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 4 Realm: () 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 zonegroup default 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111958360 con 0x559111954cc0 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55911195e060 con 0x559111959670 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55911195e400 con 0x559111959670 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.623+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.624+0000 7f8a82c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.624+0000 7f8a82c30800 20 started sync module instance, tier type = 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.624+0000 7f8a82c30800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:17.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.624+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195d500 con 0x7f8a68076040 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.625+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.625+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94081553649744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195d920 con 0x7f8a68076040 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.625+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195ec50 con 0x559111950300 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.626+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.626+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94081553655712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195f070 con 0x559111950300 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.626+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195fa30 con 0x559111959670 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.627+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94081553655712] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.629+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94081553649744] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.629+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.629+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94081553650800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195f070 con 0x559111959670 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.629+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119602d0 con 0x7f8a68076040 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.630+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94081553650800] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.630+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.630+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94081553661472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119606f0 con 0x7f8a68076040 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.630+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119610b0 con 0x559111950300 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.631+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.631+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94081553665024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119614d0 con 0x559111950300 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.631+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111961fb0 con 0x559111954cc0 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.633+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94081553661472] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.633+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94081553665024] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.633+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.633+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94081553662528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119614d0 con 0x559111954cc0 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.633+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111962850 con 0x559111954cc0 2024-04-24T01:24:17.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.634+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94081553662528] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.634+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.634+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94081553666080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.635+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111963a60 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94081553676176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111964180 con 0x559111954cc0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=0 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=1 2024-04-24T01:24:17.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=2 2024-04-24T01:24:17.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=3 2024-04-24T01:24:17.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=4 2024-04-24T01:24:17.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=5 2024-04-24T01:24:17.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94081553666080] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.637+0000 7f8a82c30800 20 add_watcher() i=6 2024-04-24T01:24:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.638+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94081553676176] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.638+0000 7f8a82c30800 20 add_watcher() i=7 2024-04-24T01:24:17.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.638+0000 7f8a82c30800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.638+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559111962bf0 con 0x559111950300 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.639+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.639+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94081553677360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111962bf0 con 0x559111950300 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94081553677360] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f892f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f8a82c30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f8a82c30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f8a82c30800 5 note: GC not initialized 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f892e7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.640+0000 7f8a82c30800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:17.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a82c30800 20 Filter name: none 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f889ffff640 20 reqs_thread_entry: start 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111999cc0 con 0x559111959670 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111999cc0 con 0x559111959670 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.641+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559111999cc0 con 0x559111950300 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.642+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.643+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111954cc0 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111959670 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.644+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.645+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.646+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.647+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.648+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111954cc0 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111950300 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x559111959670 2024-04-24T01:24:17.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.649+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f8a68090040 con 0x7f8a68076040 2024-04-24T01:24:17.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.650+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.650+0000 7f892f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.650+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94081553677360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111950300 2024-04-24T01:24:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.652+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94081553677360] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.652+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94081553649744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x7f8a68076040 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.653+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94081553649744] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.653+0000 7f8a82c30800 20 remove_watcher() i=0 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.653+0000 7f8a82c30800 2 removed watcher, disabling cache 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.653+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94081553655712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111950300 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.654+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94081553655712] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.654+0000 7f8a82c30800 20 remove_watcher() i=1 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.654+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94081553650800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591119630a0 con 0x559111959670 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.655+0000 7f8a77fff640 1 -- 172.21.15.169:0/1121216483 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94081553650800] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a68081070 con 0x559111959670 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.655+0000 7f8a82c30800 20 remove_watcher() i=2 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.655+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94081553661472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195e7a0 con 0x7f8a68076040 2024-04-24T01:24:17.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.656+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94081553661472] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x7f8a68076040 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.656+0000 7f8a82c30800 20 remove_watcher() i=3 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.656+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94081553665024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195e7a0 con 0x559111950300 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.657+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94081553665024] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7800a4a0 con 0x559111950300 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.657+0000 7f8a82c30800 20 remove_watcher() i=4 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.657+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94081553662528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559111960c00 con 0x559111954cc0 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.659+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94081553662528] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.659+0000 7f8a82c30800 20 remove_watcher() i=5 2024-04-24T01:24:17.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.659+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94081553666080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195e7a0 con 0x559111954cc0 2024-04-24T01:24:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.662+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94081553666080] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.662+0000 7f8a82c30800 20 remove_watcher() i=6 2024-04-24T01:24:17.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.662+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94081553676176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55911195e7a0 con 0x559111954cc0 2024-04-24T01:24:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a7df2e640 1 -- 172.21.15.169:0/1121216483 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94081553676176] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8a7005d020 con 0x559111954cc0 2024-04-24T01:24:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 20 remove_watcher() i=7 2024-04-24T01:24:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559111954cc0 msgr2=0x5591119570b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559111954cc0 0x5591119570b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559111950300 msgr2=0x5591119527c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559111950300 0x5591119527c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8a68076040 msgr2=0x7f8a68083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8a68076040 0x7f8a68083410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559111959670 msgr2=0x55911195bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559111959670 0x55911195bb30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8948036900 msgr2=0x7f8948038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8948036900 0x7f8948038dc0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8a68052fd0 tx=0x7f8a6804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 msgr2=0x559111944ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a82c30800 1 --2- 172.21.15.169:0/1121216483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55911193d9c0 0x559111944ce0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a7004d0f0 tx=0x7f8a70027450 comp rx=0 tx=0).stop 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 reap_dead start 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.663+0000 7f8a7e72f640 1 -- 172.21.15.169:0/1121216483 reap_dead start 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 shutdown_connections 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 >> 172.21.15.169:0/1121216483 conn(0x559111939c90 msgr2=0x5591119372f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 shutdown_connections 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/1121216483 wait complete. 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 msgr2=0x7f8958038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 0x7f8958038d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x5591118163b0 tx=0x7f8a68005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:17.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 msgr2=0x559111930a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8a7004b4b0 tx=0x7f8a7001aaf0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 shutdown_connections 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89580368b0 0x7f8958038d70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3772714713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111930670 0x559111930a90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 >> 172.21.15.169:0/3772714713 conn(0x559111924710 msgr2=0x559111924b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 shutdown_connections 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3772714713 wait complete. 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55911191b720 msgr2=0x55911191db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55911191b720 0x55911191db10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55911181b450 msgr2=0x559111918e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55911181b450 0x559111918e90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55911191f660 msgr2=0x559111921ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55911191f660 0x559111921ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8964036900 msgr2=0x7f8964038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8964036900 0x7f8964038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a68054000 tx=0x7f8a6804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 msgr2=0x559111817260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 --2- 172.21.15.169:0/3094077255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559111817940 0x559111817260 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000b210 tx=0x7f8a70000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a7e72f640 1 -- 172.21.15.169:0/3094077255 reap_dead start 2024-04-24T01:24:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 shutdown_connections 2024-04-24T01:24:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.664+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 >> 172.21.15.169:0/3094077255 conn(0x559111811370 msgr2=0x559111902100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.665+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 shutdown_connections 2024-04-24T01:24:17.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.665+0000 7f8a82c30800 1 -- 172.21.15.169:0/3094077255 wait complete. 2024-04-24T01:24:17.688 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-04-24T01:24:17.688 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:24:17.688 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-04-24T01:24:17.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-04-24T01:24:17.689 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-04-24T01:24:17.732 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:17.732 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.731+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.731+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.731+0000 7fa3a9319800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564b5eba0370 0x564b5eba2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.731+0000 7fa3a9319800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b5ea5ad40 con 0x564b5eb9a100 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.731+0000 7fa3a9319800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x564b5ea2d4d0 con 0x564b5eba0370 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.732+0000 7fa39ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564b5eba0370 0x564b5eba2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.732+0000 7fa39ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564b5eba0370 0x564b5eba2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60820/0 (socket says 172.21.15.169:60820) 2024-04-24T01:24:17.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.732+0000 7fa39ffff640 1 -- 172.21.15.169:0/2661437078 learned_addr learned my addr 172.21.15.169:0/2661437078 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.732+0000 7fa39ffff640 1 -- 172.21.15.169:0/2661437078 >> v1:172.21.15.142:6789/0 conn(0x564b5eb9a100 legacy=0x564b5eb9a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.732+0000 7fa39ffff640 1 -- 172.21.15.169:0/2661437078 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5ea59590 con 0x564b5eba0370 2024-04-24T01:24:17.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa39ffff640 1 --2- 172.21.15.169:0/2661437078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eba0370 0x564b5eba2760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a520 tx=0x7fa39001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0d3156f2111bbb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a6617640 1 -- 172.21.15.169:0/2661437078 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa390057070 con 0x564b5eba0370 2024-04-24T01:24:17.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a6617640 1 -- 172.21.15.169:0/2661437078 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa390052570 con 0x564b5eba0370 2024-04-24T01:24:17.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a6617640 1 -- 172.21.15.169:0/2661437078 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39004ae60 con 0x564b5eba0370 2024-04-24T01:24:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 -- 172.21.15.169:0/2661437078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eba0370 msgr2=0x564b5eba2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 --2- 172.21.15.169:0/2661437078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eba0370 0x564b5eba2760 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa39000a520 tx=0x7fa39001d010 comp rx=0 tx=0).stop 2024-04-24T01:24:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 -- 172.21.15.169:0/2661437078 shutdown_connections 2024-04-24T01:24:17.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 --2- 172.21.15.169:0/2661437078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eba0370 0x564b5eba2760 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 -- 172.21.15.169:0/2661437078 >> 172.21.15.169:0/2661437078 conn(0x564b5eb95b00 msgr2=0x564b5eb97f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.734+0000 7fa3a9319800 1 -- 172.21.15.169:0/2661437078 shutdown_connections 2024-04-24T01:24:17.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.735+0000 7fa3a9319800 1 -- 172.21.15.169:0/2661437078 wait complete. 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.746+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.746+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.746+0000 7fa3a9319800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.746+0000 7fa3a9319800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564b5eae73c0 con 0x564b5eb9a100 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.746+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60826/0 (socket says 172.21.15.169:60826) 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa3a6e18640 1 -- 172.21.15.169:0/3199574439 learned_addr learned my addr 172.21.15.169:0/3199574439 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa3a6e18640 1 -- 172.21.15.169:0/3199574439 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5eb9b040 con 0x564b5eb9a100 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/3199574439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa398001d00 tx=0x7fa39800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6506394d635d6dd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa294e09640 1 -- 172.21.15.169:0/3199574439 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39800f400 con 0x564b5eb9a100 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa294e09640 1 -- 172.21.15.169:0/3199574439 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398001e50 con 0x564b5eb9a100 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.747+0000 7fa294e09640 1 -- 172.21.15.169:0/3199574439 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39800f600 con 0x564b5eb9a100 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- 172.21.15.169:0/3199574439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 msgr2=0x564b5eb9ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 --2- 172.21.15.169:0/3199574439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa398001d00 tx=0x7fa39800b5b0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- 172.21.15.169:0/3199574439 shutdown_connections 2024-04-24T01:24:17.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 --2- 172.21.15.169:0/3199574439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5eb9ca80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- 172.21.15.169:0/3199574439 >> 172.21.15.169:0/3199574439 conn(0x564b5eb95b00 msgr2=0x564b5ec88950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- 172.21.15.169:0/3199574439 shutdown_connections 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- 172.21.15.169:0/3199574439 wait complete. 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5ec96e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.748+0000 7fa3a9319800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564b5eba2fa0 con 0x564b5eb9a100 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5ec96e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5ec96e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60832/0 (socket says 172.21.15.169:60832) 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a6e18640 1 -- 172.21.15.169:0/1670532971 learned_addr learned my addr 172.21.15.169:0/1670532971 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a6e18640 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5ec97360 con 0x564b5eb9a100 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5ec96e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa398002000 tx=0x7fa398000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa293606640 1 -- 172.21.15.169:0/1670532971 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39801a5b0 con 0x564b5eb9a100 2024-04-24T01:24:17.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa293606640 1 -- 172.21.15.169:0/1670532971 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39801a750 con 0x564b5eb9a100 2024-04-24T01:24:17.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5ec975f0 con 0x564b5eb9a100 2024-04-24T01:24:17.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa293606640 1 -- 172.21.15.169:0/1670532971 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39801aa70 con 0x564b5eb9a100 2024-04-24T01:24:17.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.749+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5ec9a2a0 con 0x564b5eb9a100 2024-04-24T01:24:17.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa293606640 1 -- 172.21.15.169:0/1670532971 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa398017070 con 0x564b5eb9a100 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa293606640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa28c036900 0x7fa28c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa293606640 1 -- 172.21.15.169:0/1670532971 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa398015020 con 0x564b5eb9a100 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa39ffff640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa28c036900 0x7fa28c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5eba0370 0x564b5ec9e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.750+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ec9e630 con 0x564b5eba0370 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a7619640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5eba0370 0x564b5ec9e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa39ffff640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa28c036900 0x7fa28c038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa390054000 tx=0x7fa39004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a7619640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5eba0370 0x564b5ec9e060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a7619640 1 -- 172.21.15.169:0/1670532971 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5eba0370 2024-04-24T01:24:17.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ec9b630 con 0x564b5eba0370 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a7619640 1 -- 172.21.15.169:0/1670532971 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5eba0370 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5eca09b0 0x564b5eca2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.751+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5eca3440 con 0x564b5eca09b0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5eca09b0 0x564b5eca2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5eca09b0 0x564b5eca2da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a6e18640 1 -- 172.21.15.169:0/1670532971 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa39802e070 con 0x564b5eca09b0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ec9f930 con 0x564b5eba0370 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a7619640 1 -- 172.21.15.169:0/1670532971 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5eba0370 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564b5eca48a0 0x564b5eca6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.752+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5eca7470 con 0x564b5eca48a0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.753+0000 7fa39ffff640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564b5eca48a0 0x564b5eca6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.753+0000 7fa39ffff640 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564b5eca48a0 0x564b5eca6d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.753+0000 7fa39ffff640 1 -- 172.21.15.169:0/1670532971 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa39005a040 con 0x564b5eca48a0 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.753+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a9319800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a9319800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564b5ea8d6b0 con 0x564b5ecb5800 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60836/0 (socket says 172.21.15.169:60836) 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a6e18640 1 -- 172.21.15.169:0/550290901 learned_addr learned my addr 172.21.15.169:0/550290901 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a6e18640 1 -- 172.21.15.169:0/550290901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5ecb6160 con 0x564b5ecb5800 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa398000fb0 tx=0x7fa398044f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa290e01640 1 -- 172.21.15.169:0/550290901 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39804c1d0 con 0x564b5ecb5800 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa290e01640 1 -- 172.21.15.169:0/550290901 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39804c370 con 0x564b5ecb5800 2024-04-24T01:24:17.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa290e01640 1 -- 172.21.15.169:0/550290901 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39804c650 con 0x564b5ecb5800 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.754+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5ecb6bd0 con 0x564b5ecb5800 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.755+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5ecb6bd0 con 0x564b5ecb5800 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.755+0000 7fa290e01640 1 -- 172.21.15.169:0/550290901 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa398041040 con 0x564b5ecb5800 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.755+0000 7fa290e01640 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 0x7fa280038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.755+0000 7fa290e01640 1 -- 172.21.15.169:0/550290901 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa398038070 con 0x564b5ecb5800 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.755+0000 7fa39ffff640 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 0x7fa280038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa39ffff640 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 0x7fa280038e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x564b5ec9b550 tx=0x7fa390005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a9319800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a9319800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564b5eb9b3c0 con 0x564b5ecc2840 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60838/0 (socket says 172.21.15.169:60838) 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a6e18640 1 -- 172.21.15.169:0/1612013405 learned_addr learned my addr 172.21.15.169:0/1612013405 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a6e18640 1 -- 172.21.15.169:0/1612013405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5ecc3230 con 0x564b5ecc2840 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.756+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/1612013405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa398027fd0 tx=0x7fa39804cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdf17f2ffc0003d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa28a7fc640 1 -- 172.21.15.169:0/1612013405 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa398031440 con 0x564b5ecc2840 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa28a7fc640 1 -- 172.21.15.169:0/1612013405 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398049900 con 0x564b5ecc2840 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa28a7fc640 1 -- 172.21.15.169:0/1612013405 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39800ea60 con 0x564b5ecc2840 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- 172.21.15.169:0/1612013405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 msgr2=0x564b5ecc2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1612013405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa398027fd0 tx=0x7fa39804cf10 comp rx=0 tx=0).stop 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- 172.21.15.169:0/1612013405 shutdown_connections 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1612013405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc2c60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- 172.21.15.169:0/1612013405 >> 172.21.15.169:0/1612013405 conn(0x564b5ecbeb10 msgr2=0x564b5ecbcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- 172.21.15.169:0/1612013405 shutdown_connections 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- 172.21.15.169:0/1612013405 wait complete. 2024-04-24T01:24:17.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 Processor -- start 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.757+0000 7fa3a9319800 1 -- start start 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a9319800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a9319800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564b5ecc3890 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a6e18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60840/0 (socket says 172.21.15.169:60840) 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 learned_addr learned my addr 172.21.15.169:0/4200647764 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b5ecca150 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa398027fd0 tx=0x7fa398017bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa288ff9640 1 -- 172.21.15.169:0/4200647764 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa398073070 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa288ff9640 1 -- 172.21.15.169:0/4200647764 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3980305f0 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa288ff9640 1 -- 172.21.15.169:0/4200647764 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa398031660 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b5ecca150 con 0x564b5ecc2840 2024-04-24T01:24:17.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.758+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b5ecca150 con 0x564b5ecc2840 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.759+0000 7fa288ff9640 1 -- 172.21.15.169:0/4200647764 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa398076070 con 0x564b5ecc2840 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.759+0000 7fa288ff9640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa270036950 0x7fa270038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.759+0000 7fa288ff9640 1 -- 172.21.15.169:0/4200647764 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa398079ca0 con 0x564b5ecc2840 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.759+0000 7fa39ffff640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa270036950 0x7fa270038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5ecd51d0 0x564b5ecd7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd7de0 con 0x564b5ecd51d0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a7619640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5ecd51d0 0x564b5ecd7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa39ffff640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa270036950 0x7fa270038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa390055040 tx=0x7fa39004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a7619640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5ecd51d0 0x564b5ecd7690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 20 realm 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.760+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd81f0 con 0x564b5ecd51d0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8ac0 con 0x564b5ecd51d0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd51d0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5ecd9bc0 0x564b5ecdbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecdc5c0 con 0x564b5ecd9bc0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.761+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5ecd9bc0 0x564b5ecdbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a6e18640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5ecd9bc0 0x564b5ecdbfb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a9319800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a9319800 20 searching for the correct realm 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564b5ecde570 0x564b5ece0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece1100 con 0x564b5ecde570 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa39ffff640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564b5ecde570 0x564b5ece0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.762+0000 7fa39ffff640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564b5ecde570 0x564b5ece0a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa39ffff640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa390074040 0x7fa390081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece1100 con 0x7fa390074040 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa3a7619640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa390074040 0x7fa390081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa3a7619640 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa390074040 0x7fa390081410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.763+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd9bc0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd51d0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd51d0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd9bc0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.764+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd9bc0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x7fa390074040 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecde570 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd51d0 2024-04-24T01:24:17.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.765+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd9bc0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecd51d0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x7fa390074040 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecd8e60 con 0x564b5ecde570 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.766+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd9bc0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.767+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd51d0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd51d0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd9bc0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x7fa390074040 2024-04-24T01:24:17.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.768+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd51d0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.769+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.769+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd9bc0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.769+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.769+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd9bc0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x7fa390074040 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecde570 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.770+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd9bc0 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x564b5ecd51d0 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fa39008e040 con 0x7fa390074040 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecdce80 con 0x564b5ecd51d0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.771+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecdce80 con 0x564b5ecd51d0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecdce80 con 0x7fa390074040 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 zone default found 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 4 Realm: () 2024-04-24T01:24:17.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 zonegroup default 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecdd720 con 0x564b5ecd9bc0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2f60 con 0x564b5ecde570 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.772+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece3300 con 0x564b5ecde570 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.773+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.773+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.773+0000 7fa3a9319800 20 started sync module instance, tier type = 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.773+0000 7fa3a9319800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.773+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2400 con 0x7fa390074040 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.774+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.774+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94881713105232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2400 con 0x7fa390074040 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.774+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece3b90 con 0x564b5ecd51d0 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.775+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.775+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94881713108640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece3b40 con 0x564b5ecd51d0 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.775+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece4b60 con 0x564b5ecde570 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.776+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94881713108640] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.777+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94881713105232] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.779+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.779+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94881713102672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece3f80 con 0x564b5ecde570 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.779+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece5400 con 0x7fa390074040 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.782+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.782+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94881713115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece5be0 con 0x7fa390074040 2024-04-24T01:24:17.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.782+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece66e0 con 0x564b5ecd51d0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.782+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94881713102672] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.783+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.783+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94881713119696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece66a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.784+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece7120 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.784+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94881713115472] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.785+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94881713119696] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.786+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.786+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94881713112656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece5630 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.786+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece79c0 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.788+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.788+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94881713126752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece8630 con 0x564b5ecd9bc0 2024-04-24T01:24:17.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.788+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece9050 con 0x564b5ecd9bc0 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94881713112656] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94881713130304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece9820 con 0x564b5ecd9bc0 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=0 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=1 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=2 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=3 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=4 2024-04-24T01:24:17.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.791+0000 7fa3a9319800 20 add_watcher() i=5 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94881713126752] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a9319800 20 add_watcher() i=6 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94881713130304] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a9319800 20 add_watcher() i=7 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a9319800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece6d30 con 0x564b5ecd51d0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.794+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94881713132240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece6d30 con 0x564b5ecd51d0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.795+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94881713132240] v32'32 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.795+0000 7fa25d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.795+0000 7fa3a9319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.795+0000 7fa3a9319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:17.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.796+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf4c30 con 0x564b5ecd51d0 2024-04-24T01:24:17.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.797+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'42 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.797+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf5280 con 0x564b5ecd9bc0 2024-04-24T01:24:17.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.798+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.798+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf5280 con 0x564b5ecde570 2024-04-24T01:24:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.799+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.800+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf5d60 con 0x564b5ecd51d0 2024-04-24T01:24:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.801+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.801+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf2a20 con 0x7fa390074040 2024-04-24T01:24:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.804+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.804+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf2a20 con 0x564b5ecde570 2024-04-24T01:24:17.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.805+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.805+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf6a90 con 0x564b5ecd51d0 2024-04-24T01:24:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.806+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.806+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf6e50 con 0x564b5ecd9bc0 2024-04-24T01:24:17.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.808+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.808+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf6e50 con 0x7fa390074040 2024-04-24T01:24:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.809+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.809+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf6e50 con 0x564b5ecde570 2024-04-24T01:24:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.810+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.810+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x7fa390074040 2024-04-24T01:24:17.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.811+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.811+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x564b5ecd9bc0 2024-04-24T01:24:17.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.812+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.812+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x7fa390074040 2024-04-24T01:24:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.813+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.813+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x564b5ecd9bc0 2024-04-24T01:24:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.815+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.815+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x564b5ecd51d0 2024-04-24T01:24:17.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.817+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.817+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7300 con 0x564b5ecde570 2024-04-24T01:24:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.819+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.819+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7390 con 0x7fa390074040 2024-04-24T01:24:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.820+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.820+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7390 con 0x564b5ecde570 2024-04-24T01:24:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.821+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.821+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7390 con 0x564b5ecd51d0 2024-04-24T01:24:17.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.822+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.822+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7390 con 0x564b5ecd51d0 2024-04-24T01:24:17.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.823+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'35 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.823+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7390 con 0x564b5ecde570 2024-04-24T01:24:17.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.824+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.824+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7320 con 0x7fa390074040 2024-04-24T01:24:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.825+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.825+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.826+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.826+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.827+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.827+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.828+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.828+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.829+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.829+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecd9bc0 2024-04-24T01:24:17.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.830+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.830+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.831+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.831+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecd9bc0 2024-04-24T01:24:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.833+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.833+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecde570 2024-04-24T01:24:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.834+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.834+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x564b5ecd9bc0 2024-04-24T01:24:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.835+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.835+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf7430 con 0x7fa390074040 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa1d7fff640 20 reqs_thread_entry: start 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a9319800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a9319800 20 Filter name: none 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa1d5ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a9319800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a9319800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b5ed225c0 con 0x7fa390074040 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.837+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.838+0000 7fa3a9319800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.838+0000 7fa3a9319800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-04-24T01:24:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.838+0000 7fa3a9319800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:24:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:24:17.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.838+0000 7fa25d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.838+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94881713132240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ecf1730 con 0x564b5ecd51d0 2024-04-24T01:24:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.839+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94881713132240] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.839+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94881713105232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece9290 con 0x7fa390074040 2024-04-24T01:24:17.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.840+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94881713105232] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.840+0000 7fa3a9319800 20 remove_watcher() i=0 2024-04-24T01:24:17.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.840+0000 7fa3a9319800 2 removed watcher, disabling cache 2024-04-24T01:24:17.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.840+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94881713108640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x564b5ecd51d0 2024-04-24T01:24:17.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.842+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94881713108640] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.842+0000 7fa3a9319800 20 remove_watcher() i=1 2024-04-24T01:24:17.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.842+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94881713102672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x564b5ecde570 2024-04-24T01:24:17.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.843+0000 7fa39ffff640 1 -- 172.21.15.169:0/4200647764 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94881713102672] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa39007f070 con 0x564b5ecde570 2024-04-24T01:24:17.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.843+0000 7fa3a9319800 20 remove_watcher() i=2 2024-04-24T01:24:17.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.843+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94881713115472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x7fa390074040 2024-04-24T01:24:17.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.844+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94881713115472] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x7fa390074040 2024-04-24T01:24:17.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.844+0000 7fa3a9319800 20 remove_watcher() i=3 2024-04-24T01:24:17.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.844+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94881713119696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x564b5ecd51d0 2024-04-24T01:24:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.845+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94881713119696] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa3a000a4a0 con 0x564b5ecd51d0 2024-04-24T01:24:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.845+0000 7fa3a9319800 20 remove_watcher() i=4 2024-04-24T01:24:17.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.845+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94881713112656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x564b5ecd9bc0 2024-04-24T01:24:17.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.846+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94881713112656] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.846+0000 7fa3a9319800 20 remove_watcher() i=5 2024-04-24T01:24:17.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.846+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94881713126752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece4650 con 0x564b5ecd9bc0 2024-04-24T01:24:17.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.847+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94881713126752] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.847+0000 7fa3a9319800 20 remove_watcher() i=6 2024-04-24T01:24:17.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.847+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94881713130304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b5ece2950 con 0x564b5ecd9bc0 2024-04-24T01:24:17.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a6e18640 1 -- 172.21.15.169:0/4200647764 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94881713130304] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa398075030 con 0x564b5ecd9bc0 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 20 remove_watcher() i=7 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5ecd9bc0 msgr2=0x564b5ecdbfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5ecd9bc0 0x564b5ecdbfb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5ecd51d0 msgr2=0x564b5ecd7690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5ecd51d0 0x564b5ecd7690 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa390074040 msgr2=0x7fa390081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa390074040 0x7fa390081410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564b5ecde570 msgr2=0x564b5ece0a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564b5ecde570 0x564b5ece0a30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa270036950 msgr2=0x7fa270038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa270036950 0x7fa270038e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa390055040 tx=0x7fa39004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 msgr2=0x564b5ecc9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa398027fd0 tx=0x7fa398017bf0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a7619640 1 -- 172.21.15.169:0/4200647764 reap_dead start 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 shutdown_connections 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 --2- 172.21.15.169:0/4200647764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecc2840 0x564b5ecc9c10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 >> 172.21.15.169:0/4200647764 conn(0x564b5ecbeb10 msgr2=0x564b5ecbc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 shutdown_connections 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.848+0000 7fa3a9319800 1 -- 172.21.15.169:0/4200647764 wait complete. 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 msgr2=0x7fa280038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 0x7fa280038e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x564b5ec9b550 tx=0x7fa390005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 msgr2=0x564b5ecb5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa398000fb0 tx=0x7fa398044f10 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 shutdown_connections 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa280036950 0x7fa280038e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/550290901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5ecb5800 0x564b5ecb5c20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 >> 172.21.15.169:0/550290901 conn(0x564b5eca98a0 msgr2=0x564b5eca9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 shutdown_connections 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/550290901 wait complete. 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5eca09b0 msgr2=0x564b5eca2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564b5eca09b0 0x564b5eca2da0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5eba0370 msgr2=0x564b5ec9e060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564b5eba0370 0x564b5ec9e060 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564b5eca48a0 msgr2=0x564b5eca6d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564b5eca48a0 0x564b5eca6d10 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa28c036900 msgr2=0x7fa28c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa28c036900 0x7fa28c038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa390054000 tx=0x7fa39004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 msgr2=0x564b5ec96e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 --2- 172.21.15.169:0/1670532971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564b5eb9a100 0x564b5ec96e20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa398002000 tx=0x7fa398000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a7619640 1 -- 172.21.15.169:0/1670532971 reap_dead start 2024-04-24T01:24:17.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 shutdown_connections 2024-04-24T01:24:17.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 >> 172.21.15.169:0/1670532971 conn(0x564b5eb95b00 msgr2=0x564b5eb9b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 shutdown_connections 2024-04-24T01:24:17.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.849+0000 7fa3a9319800 1 -- 172.21.15.169:0/1670532971 wait complete. 2024-04-24T01:24:17.858 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:24:17.859 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-04-24T01:24:17.859 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-04-24T01:24:17.859 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-04-24T01:24:17.942 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:17.943 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.941+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.941+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.941+0000 7fdcd7b33800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b2e13fd7a0 0x55b2e13fdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.941+0000 7fdcd7b33800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b2e12bdd40 con 0x55b2e13fe100 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.941+0000 7fdcd7b33800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b2e12904d0 con 0x55b2e13fd7a0 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd37d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b2e13fd7a0 0x55b2e13fdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd2fd0640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b2e13fe100 0x55b2e13fe5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34550/0 (socket says 172.21.15.169:34550) 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd37d1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b2e13fd7a0 0x55b2e13fdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60848/0 (socket says 172.21.15.169:60848) 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/3519282281 learned_addr learned my addr 172.21.15.169:0/3519282281 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:17.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd37d1640 1 -- 172.21.15.169:0/3519282281 >> v1:172.21.15.142:6789/0 conn(0x55b2e13fe100 legacy=0x55b2e13fe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.942+0000 7fdcd37d1640 1 -- 172.21.15.169:0/3519282281 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e12bc590 con 0x55b2e13fd7a0 2024-04-24T01:24:17.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/3519282281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e13fdbc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400a470 tx=0x7fdcc401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9911ad4e4af8c1b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd27cf640 1 -- 172.21.15.169:0/3519282281 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4057070 con 0x55b2e13fd7a0 2024-04-24T01:24:17.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd27cf640 1 -- 172.21.15.169:0/3519282281 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc404adc0 con 0x55b2e13fd7a0 2024-04-24T01:24:17.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd27cf640 1 -- 172.21.15.169:0/3519282281 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4052590 con 0x55b2e13fd7a0 2024-04-24T01:24:17.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 -- 172.21.15.169:0/3519282281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 msgr2=0x55b2e13fdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/3519282281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e13fdbc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdcc400a470 tx=0x7fdcc401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 -- 172.21.15.169:0/3519282281 shutdown_connections 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/3519282281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e13fdbc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 -- 172.21.15.169:0/3519282281 >> 172.21.15.169:0/3519282281 conn(0x55b2e13f9320 msgr2=0x55b2e13fb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 -- 172.21.15.169:0/3519282281 shutdown_connections 2024-04-24T01:24:17.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.944+0000 7fdcd7b33800 1 -- 172.21.15.169:0/3519282281 wait complete. 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.956+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.956+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.956+0000 7fdcd7b33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.956+0000 7fdcd7b33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b2e134a3c0 con 0x55b2e13fd7a0 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60862/0 (socket says 172.21.15.169:60862) 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdcd37d1640 1 -- 172.21.15.169:0/2832672276 learned_addr learned my addr 172.21.15.169:0/2832672276 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdcd37d1640 1 -- 172.21.15.169:0/2832672276 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e14f2960 con 0x55b2e13fd7a0 2024-04-24T01:24:17.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/2832672276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4055040 tx=0x7fdcc404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff1715da8cffcb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdbc160a640 1 -- 172.21.15.169:0/2832672276 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4057040 con 0x55b2e13fd7a0 2024-04-24T01:24:17.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdbc160a640 1 -- 172.21.15.169:0/2832672276 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4062070 con 0x55b2e13fd7a0 2024-04-24T01:24:17.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.957+0000 7fdbc160a640 1 -- 172.21.15.169:0/2832672276 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc405d470 con 0x55b2e13fd7a0 2024-04-24T01:24:17.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2832672276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 msgr2=0x55b2e14f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2832672276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4055040 tx=0x7fdcc404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2832672276 shutdown_connections 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2832672276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f2390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2832672276 >> 172.21.15.169:0/2832672276 conn(0x55b2e13f9320 msgr2=0x55b2e14edcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2832672276 shutdown_connections 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2832672276 wait complete. 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.958+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd7b33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd7b33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b2e13fef60 con 0x55b2e13fd7a0 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60870/0 (socket says 172.21.15.169:60870) 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd37d1640 1 -- 172.21.15.169:0/2724528503 learned_addr learned my addr 172.21.15.169:0/2724528503 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd37d1640 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e14fa330 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f9df0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcc405f040 tx=0x7fdcc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdbbfe07640 1 -- 172.21.15.169:0/2724528503 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc406b070 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdbbfe07640 1 -- 172.21.15.169:0/2724528503 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc405d960 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e14fa5c0 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdbbfe07640 1 -- 172.21.15.169:0/2724528503 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4057070 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.959+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e14fd220 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.960+0000 7fdbbfe07640 1 -- 172.21.15.169:0/2724528503 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcc405dc80 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.960+0000 7fdbbfe07640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbb8036900 0x7fdbb8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.960+0000 7fdbbfe07640 1 -- 172.21.15.169:0/2724528503 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcc408e330 con 0x55b2e13fd7a0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbb8036900 0x7fdbb8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e13fe100 0x55b2e1500fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1501520 con 0x55b2e13fe100 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e13fe100 0x55b2e1500fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbb8036900 0x7fdbb8038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f60 tx=0x7fdcc80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e13fe100 0x55b2e1500fe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/2724528503 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e13fe100 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.961+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e14fe5b0 con 0x55b2e13fe100 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.962+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/2724528503 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e13fe100 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.962+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e1503810 0x55b2e1505c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.962+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15062f0 con 0x55b2e1503810 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.962+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e1503810 0x55b2e1505c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.962+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e1503810 0x55b2e1505c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd37d1640 1 -- 172.21.15.169:0/2724528503 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcc405a040 con 0x55b2e1503810 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15027c0 con 0x55b2e13fe100 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/2724528503 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e13fe100 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b2e15077a0 0x55b2e1509bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e150a350 con 0x55b2e15077a0 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b2e15077a0 0x55b2e1509bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.963+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b2e15077a0 0x55b2e1509bf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/2724528503 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15077a0 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd7b33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd7b33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b2e12f06b0 con 0x55b2e15187b0 2024-04-24T01:24:17.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60886/0 (socket says 172.21.15.169:60886) 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.964+0000 7fdcd37d1640 1 -- 172.21.15.169:0/535112986 learned_addr learned my addr 172.21.15.169:0/535112986 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdcd37d1640 1 -- 172.21.15.169:0/535112986 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e1519110 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000c00 tx=0x7fdcc408e190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdbbd602640 1 -- 172.21.15.169:0/535112986 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4084070 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdbbd602640 1 -- 172.21.15.169:0/535112986 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc40783a0 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e1519b80 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdbbd602640 1 -- 172.21.15.169:0/535112986 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4009410 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.965+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e151a080 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdbbd602640 1 -- 172.21.15.169:0/535112986 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcc4066bb0 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdbbd602640 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 0x7fdbac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdbbd602640 1 -- 172.21.15.169:0/535112986 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcc4088030 con 0x55b2e15187b0 2024-04-24T01:24:17.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 0x7fdbac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.966+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 0x7fdbac038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800bf50 tx=0x7fdcc800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd7b33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd7b33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b2e14f2c20 con 0x55b2e1525930 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60900/0 (socket says 172.21.15.169:60900) 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd37d1640 1 -- 172.21.15.169:0/1990555024 learned_addr learned my addr 172.21.15.169:0/1990555024 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd37d1640 1 -- 172.21.15.169:0/1990555024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e1526320 con 0x55b2e1525930 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.967+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/1990555024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4078ff0 tx=0x7fdcc40787f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0a09284797211e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdbb6ffd640 1 -- 172.21.15.169:0/1990555024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc40a7070 con 0x55b2e1525930 2024-04-24T01:24:17.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdbb6ffd640 1 -- 172.21.15.169:0/1990555024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4078ab0 con 0x55b2e1525930 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdbb6ffd640 1 -- 172.21.15.169:0/1990555024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc4080b90 con 0x55b2e1525930 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- 172.21.15.169:0/1990555024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 msgr2=0x55b2e1525d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/1990555024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4078ff0 tx=0x7fdcc40787f0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- 172.21.15.169:0/1990555024 shutdown_connections 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/1990555024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e1525d50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- 172.21.15.169:0/1990555024 >> 172.21.15.169:0/1990555024 conn(0x55b2e1521c90 msgr2=0x55b2e151fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- 172.21.15.169:0/1990555024 shutdown_connections 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- 172.21.15.169:0/1990555024 wait complete. 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 Processor -- start 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.968+0000 7fdcd7b33800 1 -- start start 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd7b33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e152cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd7b33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b2e15269d0 con 0x55b2e1525930 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e152cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd37d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e152cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60910/0 (socket says 172.21.15.169:60910) 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 learned_addr learned my addr 172.21.15.169:0/4176433840 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2e152d2a0 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e152cd60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40854c0 tx=0x7fdcc4008140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdbb57fa640 1 -- 172.21.15.169:0/4176433840 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc40b2020 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdbb57fa640 1 -- 172.21.15.169:0/4176433840 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4079760 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b2e152d2a0 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.969+0000 7fdbb57fa640 1 -- 172.21.15.169:0/4176433840 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcc40a7030 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.970+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2e152d2a0 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.970+0000 7fdbb57fa640 1 -- 172.21.15.169:0/4176433840 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdcc40b5020 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.970+0000 7fdbb57fa640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdb9c036900 0x7fdb9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.970+0000 7fdbb57fa640 1 -- 172.21.15.169:0/4176433840 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fdcc40a8070 con 0x55b2e1525930 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.970+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdb9c036900 0x7fdb9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e1538400 0x55b2e153a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdb9c036900 0x7fdb9c038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8001b60 tx=0x7fdcc8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153b010 con 0x55b2e1538400 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e1538400 0x55b2e153a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e1538400 0x55b2e153a8c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.971+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 realm 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153b420 con 0x55b2e1538400 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153bcf0 con 0x55b2e1538400 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e153cdf0 0x55b2e153f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.972+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153f7f0 con 0x55b2e153cdf0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e153cdf0 0x55b2e153f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd37d1640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e153cdf0 0x55b2e153f1e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd7b33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd7b33800 20 searching for the correct realm 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b2e15417a0 0x55b2e1543c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1544330 con 0x55b2e15417a0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.973+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b2e15417a0 0x55b2e1543c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b2e15417a0 0x55b2e1543c60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd2fd0640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fdcc8038040 0x7fdcc801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1544330 con 0x7fdcc8038040 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fdcc8038040 0x7fdcc801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.974+0000 7fdcd3fd2640 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fdcc8038040 0x7fdcc801bab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:17.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.975+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x7fdcc8038040 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.976+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x7fdcc8038040 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.977+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.978+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.979+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x7fdcc8038040 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:17.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.980+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x7fdcc8038040 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.981+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e15417a0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:17.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x55b2e1538400 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b2e153c090 con 0x7fdcc8038040 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.982+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15400b0 con 0x55b2e1538400 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15400b0 con 0x55b2e1538400 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15400b0 con 0x7fdcc8038040 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 zone default found 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 4 Realm: () 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 zonegroup default 2024-04-24T01:24:18.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1540950 con 0x55b2e153cdf0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.983+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1546190 con 0x55b2e15417a0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1546530 con 0x55b2e15417a0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 started sync module instance, tier type = 2024-04-24T01:24:18.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.984+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1545630 con 0x7fdcc8038040 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.985+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.985+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94226772941392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1545630 con 0x7fdcc8038040 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.985+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1546d80 con 0x55b2e1538400 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.986+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94226772941392] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.986+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.986+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94226772945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1545630 con 0x55b2e1538400 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.986+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15477f0 con 0x55b2e15417a0 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.988+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.988+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94226772947680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1548090 con 0x55b2e15417a0 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.988+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1548b80 con 0x7fdcc8038040 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.988+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94226772945584] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.989+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94226772947680] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.989+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.989+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94226772949984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1545180 con 0x7fdcc8038040 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.989+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1549420 con 0x55b2e1538400 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.990+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94226772949984] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.990+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.990+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94226772952656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1549380 con 0x55b2e1538400 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.990+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1549e60 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.991+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.991+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94226772957616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154a6b0 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.991+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154b120 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.991+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94226772952656] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.992+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94226772957616] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.993+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.993+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94226772962288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154b510 con 0x55b2e153cdf0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.993+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154bd60 con 0x55b2e153cdf0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94226772962288] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94226772964544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154c150 con 0x55b2e153cdf0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=0 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=1 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=2 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=3 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=4 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=5 2024-04-24T01:24:18.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.994+0000 7fdcd7b33800 20 add_watcher() i=6 2024-04-24T01:24:18.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.995+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94226772964544] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.995+0000 7fdcd7b33800 20 add_watcher() i=7 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.995+0000 7fdcd7b33800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.995+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154f180 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.996+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.996+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94226772966064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e154c640 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.997+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94226772966064] v32'37 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.997+0000 7fdb89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.997+0000 7fdcd7b33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.997+0000 7fdcd7b33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.998+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1557b00 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.999+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'43 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:17.999+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15581d0 con 0x55b2e153cdf0 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.000+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.000+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15581d0 con 0x55b2e15417a0 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.001+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.001+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1558c70 con 0x55b2e1538400 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.003+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.003+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1555970 con 0x7fdcc8038040 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.004+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.004+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1555940 con 0x55b2e15417a0 2024-04-24T01:24:18.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.007+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.007+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1559e50 con 0x55b2e1538400 2024-04-24T01:24:18.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.008+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.008+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e153cdf0 2024-04-24T01:24:18.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.009+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.010+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x7fdcc8038040 2024-04-24T01:24:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.011+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.011+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e15417a0 2024-04-24T01:24:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.012+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.012+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x7fdcc8038040 2024-04-24T01:24:18.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.014+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.014+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e153cdf0 2024-04-24T01:24:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.016+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.016+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x7fdcc8038040 2024-04-24T01:24:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.017+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.017+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e153cdf0 2024-04-24T01:24:18.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.020+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.020+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e1538400 2024-04-24T01:24:18.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.023+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'39 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.023+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554930 con 0x55b2e15417a0 2024-04-24T01:24:18.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.027+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.027+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x7fdcc8038040 2024-04-24T01:24:18.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.029+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.029+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.032+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.032+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e1538400 2024-04-24T01:24:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.035+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.035+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e1538400 2024-04-24T01:24:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.036+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.036+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.038+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.038+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x7fdcc8038040 2024-04-24T01:24:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.039+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.039+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.041+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.041+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.044+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.044+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.046+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.046+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.049+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.049+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e153cdf0 2024-04-24T01:24:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.051+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.051+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.051+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.051+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e153cdf0 2024-04-24T01:24:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.053+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.053+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e15417a0 2024-04-24T01:24:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.054+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.054+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1554980 con 0x55b2e153cdf0 2024-04-24T01:24:18.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.055+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.055+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15549c0 con 0x7fdcc8038040 2024-04-24T01:24:18.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.056+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.056+0000 7fdb88fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.056+0000 7fdcd7b33800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 20 Filter name: none 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdb027fc640 20 reqs_thread_entry: start 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1585850 con 0x55b2e153cdf0 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.057+0000 7fdcd7b33800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:24:18.059 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:24:18.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.058+0000 7fdb89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.058+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94226772966064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x55b2e1538400 2024-04-24T01:24:18.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.059+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94226772966064] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.059+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94226772941392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x7fdcc8038040 2024-04-24T01:24:18.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.062+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94226772941392] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.062+0000 7fdcd7b33800 20 remove_watcher() i=0 2024-04-24T01:24:18.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.062+0000 7fdcd7b33800 2 removed watcher, disabling cache 2024-04-24T01:24:18.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.062+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94226772945584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x55b2e1538400 2024-04-24T01:24:18.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.063+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94226772945584] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.063+0000 7fdcd7b33800 20 remove_watcher() i=1 2024-04-24T01:24:18.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.063+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94226772947680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x55b2e15417a0 2024-04-24T01:24:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.064+0000 7fdcd2fd0640 1 -- 172.21.15.169:0/4176433840 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94226772947680] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc8009050 con 0x55b2e15417a0 2024-04-24T01:24:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.064+0000 7fdcd7b33800 20 remove_watcher() i=2 2024-04-24T01:24:18.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.064+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94226772949984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x7fdcc8038040 2024-04-24T01:24:18.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.065+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94226772949984] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x7fdcc8038040 2024-04-24T01:24:18.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.065+0000 7fdcd7b33800 20 remove_watcher() i=3 2024-04-24T01:24:18.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.065+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94226772952656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1547be0 con 0x55b2e1538400 2024-04-24T01:24:18.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.067+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94226772952656] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdccc00a4a0 con 0x55b2e1538400 2024-04-24T01:24:18.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.067+0000 7fdcd7b33800 20 remove_watcher() i=4 2024-04-24T01:24:18.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.067+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94226772957616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1553640 con 0x55b2e153cdf0 2024-04-24T01:24:18.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.067+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94226772957616] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.067+0000 7fdcd7b33800 20 remove_watcher() i=5 2024-04-24T01:24:18.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.068+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94226772962288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e1547be0 con 0x55b2e153cdf0 2024-04-24T01:24:18.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.069+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94226772962288] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.069+0000 7fdcd7b33800 20 remove_watcher() i=6 2024-04-24T01:24:18.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.069+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94226772964544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b2e15499b0 con 0x55b2e153cdf0 2024-04-24T01:24:18.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.069+0000 7fdcd37d1640 1 -- 172.21.15.169:0/4176433840 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94226772964544] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcc408b070 con 0x55b2e153cdf0 2024-04-24T01:24:18.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 20 remove_watcher() i=7 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e153cdf0 msgr2=0x55b2e153f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e153cdf0 0x55b2e153f1e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e1538400 msgr2=0x55b2e153a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e1538400 0x55b2e153a8c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fdcc8038040 msgr2=0x7fdcc801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fdcc8038040 0x7fdcc801bab0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b2e15417a0 msgr2=0x55b2e1543c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b2e15417a0 0x55b2e1543c60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdb9c036900 msgr2=0x7fdb9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdb9c036900 0x7fdb9c038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8001b60 tx=0x7fdcc8010000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 msgr2=0x55b2e152cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/4176433840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e1525930 0x55b2e152cd60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40854c0 tx=0x7fdcc4008140 comp rx=0 tx=0).stop 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 reap_dead start 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/4176433840 reap_dead start 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 shutdown_connections 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 >> 172.21.15.169:0/4176433840 conn(0x55b2e1521c90 msgr2=0x55b2e151f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 shutdown_connections 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/4176433840 wait complete. 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 msgr2=0x7fdbac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 0x7fdbac038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800bf50 tx=0x7fdcc800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 msgr2=0x55b2e1518bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4000c00 tx=0x7fdcc408e190 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 shutdown_connections 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbac036900 0x7fdbac038dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/535112986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e15187b0 0x55b2e1518bd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 >> 172.21.15.169:0/535112986 conn(0x55b2e150c850 msgr2=0x55b2e150cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 shutdown_connections 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.070+0000 7fdcd7b33800 1 -- 172.21.15.169:0/535112986 wait complete. 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e1503810 msgr2=0x55b2e1505c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b2e1503810 0x55b2e1505c00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e13fe100 msgr2=0x55b2e1500fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b2e13fe100 0x55b2e1500fe0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b2e15077a0 msgr2=0x55b2e1509bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b2e15077a0 0x55b2e1509bf0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbb8036900 msgr2=0x7fdbb8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdbb8036900 0x7fdbb8038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8000f60 tx=0x7fdcc80012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 msgr2=0x55b2e14f9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 --2- 172.21.15.169:0/2724528503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b2e13fd7a0 0x55b2e14f9df0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdcc405f040 tx=0x7fdcc4002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd3fd2640 1 -- 172.21.15.169:0/2724528503 reap_dead start 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 shutdown_connections 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 >> 172.21.15.169:0/2724528503 conn(0x55b2e13f9320 msgr2=0x55b2e14ec4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 shutdown_connections 2024-04-24T01:24:18.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.071+0000 7fdcd7b33800 1 -- 172.21.15.169:0/2724528503 wait complete. 2024-04-24T01:24:18.080 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:24:18.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:18.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:18.080 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:24:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:18.162 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b6898800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b458078330 0x55b45807a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b6898800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b457f32d40 con 0x55b458073f90 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b6898800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b457f054d0 con 0x55b458078330 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b3b96640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b458078330 0x55b45807a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b4397640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b458073f90 0x55b4580743b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34556/0 (socket says 172.21.15.169:34556) 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b4397640 1 -- 172.21.15.169:0/930911840 learned_addr learned my addr 172.21.15.169:0/930911840 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b3b96640 1 -- 172.21.15.169:0/930911840 >> v1:172.21.15.142:6789/0 conn(0x55b458073f90 legacy=0x55b4580743b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.162+0000 7f72b3b96640 1 -- 172.21.15.169:0/930911840 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b457f31590 con 0x55b458078330 2024-04-24T01:24:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.164+0000 7f72b3b96640 1 --2- 172.21.15.169:0/930911840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458078330 0x55b45807a720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72a800a470 tx=0x7f72a801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43faec930d98e7d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.164+0000 7f72b3395640 1 -- 172.21.15.169:0/930911840 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a8057070 con 0x55b458078330 2024-04-24T01:24:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.164+0000 7f72b3395640 1 -- 172.21.15.169:0/930911840 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a8052570 con 0x55b458078330 2024-04-24T01:24:18.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.164+0000 7f72b3395640 1 -- 172.21.15.169:0/930911840 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a8052870 con 0x55b458078330 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 -- 172.21.15.169:0/930911840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458078330 msgr2=0x55b45807a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 --2- 172.21.15.169:0/930911840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458078330 0x55b45807a720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72a800a470 tx=0x7f72a801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 -- 172.21.15.169:0/930911840 shutdown_connections 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 --2- 172.21.15.169:0/930911840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458078330 0x55b45807a720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 -- 172.21.15.169:0/930911840 >> 172.21.15.169:0/930911840 conn(0x55b45806f530 msgr2=0x55b458071950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 -- 172.21.15.169:0/930911840 shutdown_connections 2024-04-24T01:24:18.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.165+0000 7f72b6898800 1 -- 172.21.15.169:0/930911840 wait complete. 2024-04-24T01:24:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b6898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b6898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b457fbf3c0 con 0x55b458073f90 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60934/0 (socket says 172.21.15.169:60934) 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.177+0000 7f72b4397640 1 -- 172.21.15.169:0/4242358320 learned_addr learned my addr 172.21.15.169:0/4242358320 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.178+0000 7f72b4397640 1 -- 172.21.15.169:0/4242358320 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b457fe7f60 con 0x55b458073f90 2024-04-24T01:24:18.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.178+0000 7f72b4397640 1 --2- 172.21.15.169:0/4242358320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72a4001d80 tx=0x7f72a4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7eebf2a36fa94e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.178+0000 7f71a260c640 1 -- 172.21.15.169:0/4242358320 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4013030 con 0x55b458073f90 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.178+0000 7f71a260c640 1 -- 172.21.15.169:0/4242358320 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a400e470 con 0x55b458073f90 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.178+0000 7f71a260c640 1 -- 172.21.15.169:0/4242358320 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a400e810 con 0x55b458073f90 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- 172.21.15.169:0/4242358320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 msgr2=0x55b457fe99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 --2- 172.21.15.169:0/4242358320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f72a4001d80 tx=0x7f72a4001e70 comp rx=0 tx=0).stop 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- 172.21.15.169:0/4242358320 shutdown_connections 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 --2- 172.21.15.169:0/4242358320 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b457fe99a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- 172.21.15.169:0/4242358320 >> 172.21.15.169:0/4242358320 conn(0x55b45806f530 msgr2=0x55b458160990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- 172.21.15.169:0/4242358320 shutdown_connections 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- 172.21.15.169:0/4242358320 wait complete. 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b45816ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b6898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b45807aff0 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b45816ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b45816ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60948/0 (socket says 172.21.15.169:60948) 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.179+0000 7f72b4397640 1 -- 172.21.15.169:0/2540722290 learned_addr learned my addr 172.21.15.169:0/2540722290 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f72b4397640 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45816f3a0 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f72b4397640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b45816ee60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72a4004000 tx=0x7f72a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f71a0e09640 1 -- 172.21.15.169:0/2540722290 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4027070 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f71a0e09640 1 -- 172.21.15.169:0/2540722290 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4019900 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f71a0e09640 1 -- 172.21.15.169:0/2540722290 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4019c60 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45816f630 con 0x55b458073f90 2024-04-24T01:24:18.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.180+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b458172290 con 0x55b458073f90 2024-04-24T01:24:18.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f71a0e09640 1 -- 172.21.15.169:0/2540722290 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a402a070 con 0x55b458073f90 2024-04-24T01:24:18.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f71a0e09640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f719c036900 0x7f719c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f71a0e09640 1 -- 172.21.15.169:0/2540722290 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72a401f070 con 0x55b458073f90 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b3b96640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f719c036900 0x7f719c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b458078330 0x55b458176050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581765e0 con 0x55b458078330 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b4b98640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b458078330 0x55b458176050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b3b96640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f719c036900 0x7f719c038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72a8054000 tx=0x7f72a804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.181+0000 7f72b4b98640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b458078330 0x55b458176050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b4b98640 1 -- 172.21.15.169:0/2540722290 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b458078330 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b458173620 con 0x55b458078330 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b4b98640 1 -- 172.21.15.169:0/2540722290 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b458078330 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b458178930 0x55b45817ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45817b410 con 0x55b458178930 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.182+0000 7f72b4397640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b458178930 0x55b45817ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b4397640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b458178930 0x55b45817ad20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b4397640 1 -- 172.21.15.169:0/2540722290 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72a4029030 con 0x55b458178930 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581778e0 con 0x55b458078330 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b4b98640 1 -- 172.21.15.169:0/2540722290 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b458078330 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b45817c8c0 0x55b45817ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b45817f470 con 0x55b45817c8c0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.183+0000 7f72b3b96640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b45817c8c0 0x55b45817ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b3b96640 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b45817c8c0 0x55b45817ed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b3b96640 1 -- 172.21.15.169:0/2540722290 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f72a8052980 con 0x55b45817c8c0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b6898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b6898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b457f656b0 con 0x55b45818d8d0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60962/0 (socket says 172.21.15.169:60962) 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.184+0000 7f72b4397640 1 -- 172.21.15.169:0/689922789 learned_addr learned my addr 172.21.15.169:0/689922789 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f72b4397640 1 -- 172.21.15.169:0/689922789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45818e230 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f72b4397640 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72a4016fd0 tx=0x7f72a40167a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f7199ffb640 1 -- 172.21.15.169:0/689922789 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a40448e0 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f7199ffb640 1 -- 172.21.15.169:0/689922789 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a4044a80 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b45818eca0 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f7199ffb640 1 -- 172.21.15.169:0/689922789 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a4044d60 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.185+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b45818f1a0 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f7199ffb640 1 -- 172.21.15.169:0/689922789 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a403b020 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f7199ffb640 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 0x7f718c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f7199ffb640 1 -- 172.21.15.169:0/689922789 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72a4039020 con 0x55b45818d8d0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f72b3b96640 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 0x7f718c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.186+0000 7f72b3b96640 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 0x7f718c038dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55b458176ee0 tx=0x7f72a8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b6898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b6898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b457fe82e0 con 0x55b45819aa30 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60972/0 (socket says 172.21.15.169:60972) 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b4397640 1 -- 172.21.15.169:0/964588971 learned_addr learned my addr 172.21.15.169:0/964588971 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b4397640 1 -- 172.21.15.169:0/964588971 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b45819b420 con 0x55b45819aa30 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f72b4397640 1 --2- 172.21.15.169:0/964588971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72a403dd50 tx=0x7f72a40442a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109dc07787171bbd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f71937fe640 1 -- 172.21.15.169:0/964588971 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a405a070 con 0x55b45819aa30 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f71937fe640 1 -- 172.21.15.169:0/964588971 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a403d410 con 0x55b45819aa30 2024-04-24T01:24:18.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.187+0000 7f71937fe640 1 -- 172.21.15.169:0/964588971 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a403d790 con 0x55b45819aa30 2024-04-24T01:24:18.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- 172.21.15.169:0/964588971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 msgr2=0x55b45819ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 --2- 172.21.15.169:0/964588971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f72a403dd50 tx=0x7f72a40442a0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- 172.21.15.169:0/964588971 shutdown_connections 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 --2- 172.21.15.169:0/964588971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b45819ae50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- 172.21.15.169:0/964588971 >> 172.21.15.169:0/964588971 conn(0x55b458196d50 msgr2=0x55b458194db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- 172.21.15.169:0/964588971 shutdown_connections 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- 172.21.15.169:0/964588971 wait complete. 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 Processor -- start 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- start start 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b6898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b45819bb40 con 0x55b45819aa30 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b4397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60976/0 (socket says 172.21.15.169:60976) 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.188+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 learned_addr learned my addr 172.21.15.169:0/1422015016 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4581a23c0 con 0x55b45819aa30 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f72b4397640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55b458196220 tx=0x7f72a4057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f7191ffb640 1 -- 172.21.15.169:0/1422015016 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a403da90 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f7191ffb640 1 -- 172.21.15.169:0/1422015016 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a401ba50 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4581a23c0 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f7191ffb640 1 -- 172.21.15.169:0/1422015016 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72a401bd70 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.189+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4581a23c0 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f7191ffb640 1 -- 172.21.15.169:0/1422015016 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f72a406c020 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f7191ffb640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7184036950 0x7f7184038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f7191ffb640 1 -- 172.21.15.169:0/1422015016 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f72a4014070 con 0x55b45819aa30 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f72b3b96640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7184036950 0x7f7184038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f72b3b96640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7184036950 0x7f7184038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72a801ced0 tx=0x7f72a804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4581ad540 0x55b4581afa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.190+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b0150 con 0x55b4581ad540 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b4b98640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4581ad540 0x55b4581afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b4b98640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4581ad540 0x55b4581afa00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 realm 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b0560 con 0x55b4581ad540 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b0e30 con 0x55b4581ad540 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.191+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581ad540 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b6898800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4581b1f30 0x55b4581b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b4930 con 0x55b4581b1f30 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b4397640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4581b1f30 0x55b4581b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b4397640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4581b1f30 0x55b4581b4320 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.192+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b6898800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b6898800 20 searching for the correct realm 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4581b68e0 0x55b4581b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b9470 con 0x55b4581b68e0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b3b96640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4581b68e0 0x55b4581b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b3b96640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4581b68e0 0x55b4581b8da0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b3b96640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f72a8076040 0x7f72a8083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b9470 con 0x7f72a8076040 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.193+0000 7f72b4b98640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f72a8076040 0x7f72a8083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4b98640 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f72a8076040 0x7f72a8083410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b1f30 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.194+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b1f30 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b1f30 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x7f72a8076040 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.195+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b68e0 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b1f30 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581ad540 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.196+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x7f72a8076040 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b11d0 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b1f30 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.197+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581ad540 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581ad540 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.198+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b1f30 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x7f72a8076040 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581ad540 2024-04-24T01:24:18.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.199+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x7f72a8076040 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.200+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b68e0 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x55b4581ad540 2024-04-24T01:24:18.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f72a8090040 con 0x7f72a8076040 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.201+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b51f0 con 0x55b4581ad540 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b51f0 con 0x55b4581ad540 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b51f0 con 0x7f72a8076040 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 zone default found 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 4 Realm: () 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:18.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 zonegroup default 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581b5ae0 con 0x55b4581b1f30 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.202+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bb2d0 con 0x55b4581b68e0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bb670 con 0x55b4581b68e0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 20 started sync module instance, tier type = 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.203+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ba770 con 0x7f72a8076040 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.204+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.204+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233060682896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ba770 con 0x7f72a8076040 2024-04-24T01:24:18.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.204+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bc030 con 0x55b4581ad540 2024-04-24T01:24:18.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.207+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.207+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233060686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bc450 con 0x55b4581ad540 2024-04-24T01:24:18.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.207+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bcef0 con 0x55b4581b68e0 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.207+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233060682896] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.210+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233060686720] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.210+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.210+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233060680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bc450 con 0x55b4581b68e0 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.210+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bd790 con 0x7f72a8076040 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.212+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.212+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233060680384] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.212+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233060693184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581be030 con 0x7f72a8076040 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.212+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bbfe0 con 0x55b4581ad540 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.214+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.214+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233060697584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bbfe0 con 0x55b4581ad540 2024-04-24T01:24:18.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.214+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bf4e0 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.216+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233060693184] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.217+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.217+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233060700208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bf900 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.217+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c02c0 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.219+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233060697584] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.219+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.219+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233060698640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c02c0 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.219+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0cf0 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233060700208] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233060694912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0cb0 con 0x55b4581b1f30 2024-04-24T01:24:18.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=0 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=1 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=2 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=3 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=4 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=5 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233060698640] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.220+0000 7f72b6898800 20 add_watcher() i=6 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.223+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233060694912] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.223+0000 7f72b6898800 20 add_watcher() i=7 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.223+0000 7f72b6898800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.223+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bfe10 con 0x55b4581ad540 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.223+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.224+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233060706304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bfe10 con 0x55b4581ad540 2024-04-24T01:24:18.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.225+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233060706304] v32'42 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.226+0000 7f716a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.226+0000 7f72b6898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.226+0000 7f72b6898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.226+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cc620 con 0x55b4581ad540 2024-04-24T01:24:18.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.227+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'44 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.227+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cccf0 con 0x55b4581b1f30 2024-04-24T01:24:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.228+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.228+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cccf0 con 0x55b4581b68e0 2024-04-24T01:24:18.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.231+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.231+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cd7b0 con 0x55b4581ad540 2024-04-24T01:24:18.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.234+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.234+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ca3f0 con 0x7f72a8076040 2024-04-24T01:24:18.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.236+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.238 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.236+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ca3f0 con 0x55b4581b68e0 2024-04-24T01:24:18.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.239+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.239+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ce4e0 con 0x55b4581ad540 2024-04-24T01:24:18.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.240+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.240+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ce4e0 con 0x55b4581b1f30 2024-04-24T01:24:18.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.242+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.242+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ce570 con 0x7f72a8076040 2024-04-24T01:24:18.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.243+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.243+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ce680 con 0x55b4581b68e0 2024-04-24T01:24:18.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.244+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.244+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x7f72a8076040 2024-04-24T01:24:18.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.247+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.247+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x55b4581b1f30 2024-04-24T01:24:18.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.248+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.248+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x7f72a8076040 2024-04-24T01:24:18.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.249+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.249+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x55b4581b1f30 2024-04-24T01:24:18.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.251+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.251+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x55b4581ad540 2024-04-24T01:24:18.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.252+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.252+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ceb60 con 0x55b4581b68e0 2024-04-24T01:24:18.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.253+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.253+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x7f72a8076040 2024-04-24T01:24:18.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.254+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.254+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.255+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.255+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581ad540 2024-04-24T01:24:18.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.256+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.256+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581ad540 2024-04-24T01:24:18.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.257+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'45 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.257+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.258+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.258+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x7f72a8076040 2024-04-24T01:24:18.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.259+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.259+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.260+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.260+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.261+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.261+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.262+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.262+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.263+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.263+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b1f30 2024-04-24T01:24:18.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.265+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.265+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cef50 con 0x55b4581b68e0 2024-04-24T01:24:18.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.266+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.266+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cefe0 con 0x55b4581b1f30 2024-04-24T01:24:18.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.267+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.267+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cefe0 con 0x55b4581b68e0 2024-04-24T01:24:18.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.268+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.268+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cefe0 con 0x55b4581b1f30 2024-04-24T01:24:18.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.270+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.270+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581cefe0 con 0x7f72a8076040 2024-04-24T01:24:18.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.271+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.271+0000 7f71697e2640 20 reqs_thread_entry: start 2024-04-24T01:24:18.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.271+0000 7f72b6898800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.271+0000 7f72b6898800 20 Filter name: none 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f70daffd640 20 reqs_thread_entry: start 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b4581f9c40 con 0x55b4581b1f30 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.272+0000 7f72b6898800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:18.274 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:24:18.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.273+0000 7f716a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.273+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233060706304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b45815c940 con 0x55b4581ad540 2024-04-24T01:24:18.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.274+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94233060706304] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.274+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233060682896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0800 con 0x7f72a8076040 2024-04-24T01:24:18.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.275+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94233060682896] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.275+0000 7f72b6898800 20 remove_watcher() i=0 2024-04-24T01:24:18.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.275+0000 7f72b6898800 2 removed watcher, disabling cache 2024-04-24T01:24:18.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.275+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233060686720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0800 con 0x55b4581ad540 2024-04-24T01:24:18.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.276+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94233060686720] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.276+0000 7f72b6898800 20 remove_watcher() i=1 2024-04-24T01:24:18.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.276+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233060680384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bbb80 con 0x55b4581b68e0 2024-04-24T01:24:18.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.277+0000 7f72b3b96640 1 -- 172.21.15.169:0/1422015016 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94233060680384] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a8081070 con 0x55b4581b68e0 2024-04-24T01:24:18.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.277+0000 7f72b6898800 20 remove_watcher() i=2 2024-04-24T01:24:18.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.277+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233060693184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0800 con 0x7f72a8076040 2024-04-24T01:24:18.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.278+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94233060693184] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x7f72a8076040 2024-04-24T01:24:18.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.278+0000 7f72b6898800 20 remove_watcher() i=3 2024-04-24T01:24:18.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.278+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233060697584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581ba2c0 con 0x55b4581ad540 2024-04-24T01:24:18.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.279+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94233060697584] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72ac00a4a0 con 0x55b4581ad540 2024-04-24T01:24:18.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.279+0000 7f72b6898800 20 remove_watcher() i=4 2024-04-24T01:24:18.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.279+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233060700208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bbb80 con 0x55b4581b1f30 2024-04-24T01:24:18.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.280+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94233060700208] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.280+0000 7f72b6898800 20 remove_watcher() i=5 2024-04-24T01:24:18.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.280+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233060698640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581bd4c0 con 0x55b4581b1f30 2024-04-24T01:24:18.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.281+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94233060698640] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.281+0000 7f72b6898800 20 remove_watcher() i=6 2024-04-24T01:24:18.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.281+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233060694912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b4581c0800 con 0x55b4581b1f30 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.282+0000 7f72b4397640 1 -- 172.21.15.169:0/1422015016 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94233060694912] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f72a4029030 con 0x55b4581b1f30 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.282+0000 7f72b6898800 20 remove_watcher() i=7 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4581b1f30 msgr2=0x55b4581b4320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4581b1f30 0x55b4581b4320 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4581ad540 msgr2=0x55b4581afa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4581ad540 0x55b4581afa00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f72a8076040 msgr2=0x7f72a8083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f72a8076040 0x7f72a8083410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4581b68e0 msgr2=0x55b4581b8da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4581b68e0 0x55b4581b8da0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7184036950 msgr2=0x7f7184038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7184036950 0x7f7184038e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f72a801ced0 tx=0x7f72a804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b4b98640 1 -- 172.21.15.169:0/1422015016 reap_dead start 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 msgr2=0x55b4581a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55b458196220 tx=0x7f72a4057000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 shutdown_connections 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/1422015016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45819aa30 0x55b4581a1e80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 >> 172.21.15.169:0/1422015016 conn(0x55b458196d50 msgr2=0x55b4581943b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 shutdown_connections 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/1422015016 wait complete. 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 msgr2=0x7f718c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 0x7f718c038dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x55b458176ee0 tx=0x7f72a8005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:18.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 msgr2=0x55b45818dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72a4016fd0 tx=0x7f72a40167a0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 shutdown_connections 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f718c036900 0x7f718c038dc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 --2- 172.21.15.169:0/689922789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b45818d8d0 0x55b45818dcf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 >> 172.21.15.169:0/689922789 conn(0x55b458181970 msgr2=0x55b458181d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 shutdown_connections 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.283+0000 7f72b6898800 1 -- 172.21.15.169:0/689922789 wait complete. 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b458178930 msgr2=0x55b45817ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b458178930 0x55b45817ad20 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b458078330 msgr2=0x55b458176050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b458078330 0x55b458176050 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b45817c8c0 msgr2=0x55b45817ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b45817c8c0 0x55b45817ed10 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f719c036900 msgr2=0x7f719c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f719c036900 0x7f719c038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f72a8054000 tx=0x7f72a804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 msgr2=0x55b45816ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 --2- 172.21.15.169:0/2540722290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b458073f90 0x55b45816ee60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f72a4004000 tx=0x7f72a4000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b4b98640 1 -- 172.21.15.169:0/2540722290 reap_dead start 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 shutdown_connections 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 >> 172.21.15.169:0/2540722290 conn(0x55b45806f530 msgr2=0x55b457fe8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 shutdown_connections 2024-04-24T01:24:18.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.284+0000 7f72b6898800 1 -- 172.21.15.169:0/2540722290 wait complete. 2024-04-24T01:24:18.292 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:24:18.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:18.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:18.293 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:24:18.376 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:18.376 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.375+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.375+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.375+0000 7fcbae71f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ff847232a0 0x55ff8472bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.375+0000 7fcbae71f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ff845e1d40 con 0x55ff84721760 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.375+0000 7fcbae71f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55ff845b44d0 con 0x55ff847232a0 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.376+0000 7fcba1bc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ff847232a0 0x55ff8472bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.376+0000 7fcba1bc9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ff847232a0 0x55ff8472bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60980/0 (socket says 172.21.15.169:60980) 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.376+0000 7fcba1bc9640 1 -- 172.21.15.169:0/2995052455 learned_addr learned my addr 172.21.15.169:0/2995052455 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.376+0000 7fcba1bc9640 1 -- 172.21.15.169:0/2995052455 >> v1:172.21.15.142:6789/0 conn(0x55ff84721760 legacy=0x55ff84721b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.376+0000 7fcba1bc9640 1 -- 172.21.15.169:0/2995052455 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff845e0590 con 0x55ff847232a0 2024-04-24T01:24:18.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/2995052455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff847232a0 0x55ff8472bda0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400a520 tx=0x7fcb9401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7556fdd36f377c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcba9bc9640 1 -- 172.21.15.169:0/2995052455 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb94057070 con 0x55ff847232a0 2024-04-24T01:24:18.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcba9bc9640 1 -- 172.21.15.169:0/2995052455 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb94052440 con 0x55ff847232a0 2024-04-24T01:24:18.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcba9bc9640 1 -- 172.21.15.169:0/2995052455 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9404ae60 con 0x55ff847232a0 2024-04-24T01:24:18.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 -- 172.21.15.169:0/2995052455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff847232a0 msgr2=0x55ff8472bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 --2- 172.21.15.169:0/2995052455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff847232a0 0x55ff8472bda0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400a520 tx=0x7fcb9401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 -- 172.21.15.169:0/2995052455 shutdown_connections 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 --2- 172.21.15.169:0/2995052455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff847232a0 0x55ff8472bda0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 -- 172.21.15.169:0/2995052455 >> 172.21.15.169:0/2995052455 conn(0x55ff8471d380 msgr2=0x55ff8471f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 -- 172.21.15.169:0/2995052455 shutdown_connections 2024-04-24T01:24:18.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.378+0000 7fcbae71f800 1 -- 172.21.15.169:0/2995052455 wait complete. 2024-04-24T01:24:18.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.390+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.390+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.390+0000 7fcbae71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.390+0000 7fcbae71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ff8466e3c0 con 0x55ff84721760 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60986/0 (socket says 172.21.15.169:60986) 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/2205922909 learned_addr learned my addr 172.21.15.169:0/2205922909 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/2205922909 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff84816a50 con 0x55ff84721760 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/2205922909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c001cd0 tx=0x7fcb9c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53939d9c32540111 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fca98608640 1 -- 172.21.15.169:0/2205922909 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c00be10 con 0x55ff84721760 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fca98608640 1 -- 172.21.15.169:0/2205922909 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00f400 con 0x55ff84721760 2024-04-24T01:24:18.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.391+0000 7fca98608640 1 -- 172.21.15.169:0/2205922909 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c00f720 con 0x55ff84721760 2024-04-24T01:24:18.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- 172.21.15.169:0/2205922909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 msgr2=0x55ff84816480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 --2- 172.21.15.169:0/2205922909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c001cd0 tx=0x7fcb9c00b5b0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- 172.21.15.169:0/2205922909 shutdown_connections 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 --2- 172.21.15.169:0/2205922909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff84816480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- 172.21.15.169:0/2205922909 >> 172.21.15.169:0/2205922909 conn(0x55ff8471d380 msgr2=0x55ff84811da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- 172.21.15.169:0/2205922909 shutdown_connections 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- 172.21.15.169:0/2205922909 wait complete. 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff8481e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.392+0000 7fcbae71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ff8472e5c0 con 0x55ff84721760 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff8481e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff8481e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:60990/0 (socket says 172.21.15.169:60990) 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/173283501 learned_addr learned my addr 172.21.15.169:0/173283501 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8481e570 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff8481e030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b5f0 tx=0x7fcb9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fca96e05640 1 -- 172.21.15.169:0/173283501 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c01a7c0 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fca96e05640 1 -- 172.21.15.169:0/173283501 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c01a960 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff8481e800 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fca96e05640 1 -- 172.21.15.169:0/173283501 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c01ac60 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.393+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff848214b0 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fca96e05640 1 -- 172.21.15.169:0/173283501 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb9c017070 con 0x55ff84721760 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fca96e05640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca90036950 0x7fca90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fca96e05640 1 -- 172.21.15.169:0/173283501 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c015020 con 0x55ff84721760 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca90036950 0x7fca90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff847232a0 0x55ff84825270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.394+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84825840 con 0x55ff847232a0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff847232a0 0x55ff84825270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca90036950 0x7fca90038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb94054000 tx=0x7fcb9404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff847232a0 0x55ff84825270 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbaabcb640 1 -- 172.21.15.169:0/173283501 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff847232a0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84822840 con 0x55ff847232a0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbaabcb640 1 -- 172.21.15.169:0/173283501 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff847232a0 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84827b70 0x55ff84829f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.395+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8482a650 con 0x55ff84827b70 2024-04-24T01:24:18.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.396+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84827b70 0x55ff84829f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.396+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84827b70 0x55ff84829f60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.396+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/173283501 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84827b70 2024-04-24T01:24:18.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.396+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84826af0 con 0x55ff847232a0 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcbaabcb640 1 -- 172.21.15.169:0/173283501 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff847232a0 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ff8482bab0 0x55ff8482df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8482e680 con 0x55ff8482bab0 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ff8482bab0 0x55ff8482df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ff8482bab0 0x55ff8482df20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.397+0000 7fcba1bc9640 1 -- 172.21.15.169:0/173283501 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb9405a040 con 0x55ff8482bab0 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbae71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbae71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ff846146b0 con 0x55ff8483ca70 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32774/0 (socket says 172.21.15.169:32774) 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/1822318217 learned_addr learned my addr 172.21.15.169:0/1822318217 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/1822318217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8483d3d0 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.398+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c04ae40 tx=0x7fcb9c017e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 -- 172.21.15.169:0/1822318217 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c044200 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 -- 172.21.15.169:0/1822318217 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c01c450 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff8483d3d0 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 -- 172.21.15.169:0/1822318217 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c01c730 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff8483d3d0 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 -- 172.21.15.169:0/1822318217 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb9c00e070 con 0x55ff8483ca70 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 0x7fca84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.399+0000 7fca8ffff640 1 -- 172.21.15.169:0/1822318217 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c043030 con 0x55ff8483ca70 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 0x7fca84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 0x7fca84038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55ff84826120 tx=0x7fcb94005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbae71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbae71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ff84816dd0 con 0x55ff84849860 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32784/0 (socket says 172.21.15.169:32784) 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/352366956 learned_addr learned my addr 172.21.15.169:0/352366956 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.400+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/352366956 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8484a250 con 0x55ff84849860 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/352366956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c017f30 tx=0x7fcb9c028cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a23b74a951ed9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fca8dffb640 1 -- 172.21.15.169:0/352366956 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c057040 con 0x55ff84849860 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fca8dffb640 1 -- 172.21.15.169:0/352366956 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c01c8d0 con 0x55ff84849860 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fca8dffb640 1 -- 172.21.15.169:0/352366956 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c031b40 con 0x55ff84849860 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- 172.21.15.169:0/352366956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 msgr2=0x55ff84849c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 --2- 172.21.15.169:0/352366956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c017f30 tx=0x7fcb9c028cf0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- 172.21.15.169:0/352366956 shutdown_connections 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 --2- 172.21.15.169:0/352366956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84849c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- 172.21.15.169:0/352366956 >> 172.21.15.169:0/352366956 conn(0x55ff84845ae0 msgr2=0x55ff84843b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- 172.21.15.169:0/352366956 shutdown_connections 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- 172.21.15.169:0/352366956 wait complete. 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 Processor -- start 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.401+0000 7fcbae71f800 1 -- start start 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbae71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbae71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ff8484a8c0 con 0x55ff84849860 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbaa3ca640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32794/0 (socket says 172.21.15.169:32794) 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 learned_addr learned my addr 172.21.15.169:0/3738315033 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff84851120 con 0x55ff84849860 2024-04-24T01:24:18.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.402+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00f800 tx=0x7fcb9c047e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fca7bfff640 1 -- 172.21.15.169:0/3738315033 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c056040 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fca7bfff640 1 -- 172.21.15.169:0/3738315033 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb9c019c50 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ff84851120 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fca7bfff640 1 -- 172.21.15.169:0/3738315033 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb9c031450 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff84851120 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.403+0000 7fca7bfff640 1 -- 172.21.15.169:0/3738315033 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb9c063040 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fca7bfff640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca74036860 0x7fca74038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fca7bfff640 1 -- 172.21.15.169:0/3738315033 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fcb9c0361a0 con 0x55ff84849860 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca74036860 0x7fca74038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca74036860 0x7fca74038d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55ff8482ea80 tx=0x7fcb9404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff8485c260 0x55ff8485e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485ee70 con 0x55ff8485c260 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.404+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff8485c260 0x55ff8485e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff8485c260 0x55ff8485e720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 realm 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485f280 con 0x55ff8485c260 2024-04-24T01:24:18.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fb50 con 0x55ff8485c260 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff8485c260 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84860c50 0x55ff84863040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.405+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84863650 con 0x55ff84860c50 2024-04-24T01:24:18.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84860c50 0x55ff84863040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbaa3ca640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84860c50 0x55ff84863040 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbae71f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbae71f800 20 searching for the correct realm 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ff84865600 0x55ff84867ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff84868190 con 0x55ff84865600 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.406+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ff84865600 0x55ff84867ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.407+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ff84865600 0x55ff84867ac0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.407+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.407+0000 7fcba1bc9640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fcb94074040 0x7fcb94081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.407+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff84868190 con 0x7fcb94074040 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.407+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fcb94074040 0x7fcb94081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaabcb640 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fcb94074040 0x7fcb94081410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff8485c260 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.408+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff8485c260 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x7fcb94074040 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.409+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84865600 2024-04-24T01:24:18.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff8485c260 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84860c50 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff8485c260 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.410+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x7fcb94074040 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ff8485fef0 con 0x55ff84865600 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84860c50 2024-04-24T01:24:18.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.411+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff8485c260 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff8485c260 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.412+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84860c50 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x7fcb94074040 2024-04-24T01:24:18.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.413+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff8485c260 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84860c50 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84860c50 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.414+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.415+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x7fcb94074040 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.415+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.415+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84865600 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.415+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.415+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff84860c50 2024-04-24T01:24:18.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x55ff8485c260 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fcb9408e040 con 0x7fcb94074040 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84863f10 con 0x55ff8485c260 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.416+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84863f10 con 0x55ff8485c260 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84863f10 con 0x7fcb94074040 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 zone default found 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 4 Realm: () 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:18.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 zonegroup default 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff848647b0 con 0x55ff84860c50 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.417+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869ff0 con 0x55ff84865600 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486a390 con 0x55ff84865600 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 20 started sync module instance, tier type = 2024-04-24T01:24:18.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.418+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869490 con 0x7fcb94074040 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.419+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.419+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94555928434816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869490 con 0x7fcb94074040 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.419+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486abe0 con 0x55ff8485c260 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.420+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94555928434816] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.420+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.420+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94555928439056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869490 con 0x55ff8485c260 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.420+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486b5f0 con 0x55ff84865600 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.421+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94555928439056] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.421+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.421+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94555928432608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869400 con 0x55ff84865600 2024-04-24T01:24:18.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.421+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486c4e0 con 0x7fcb94074040 2024-04-24T01:24:18.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.422+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94555928432608] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.422+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.422+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94555928444976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486c900 con 0x7fcb94074040 2024-04-24T01:24:18.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.422+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486d2c0 con 0x55ff8485c260 2024-04-24T01:24:18.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.424+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.424+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94555928448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486d6e0 con 0x55ff8485c260 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.424+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486e190 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.424+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94555928444976] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.425+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94555928448528] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.425+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.425+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94555928446032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486d6e0 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.425+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486ea30 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.426+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94555928446032] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.426+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.426+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94555928449584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486f280 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.426+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486fb50 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94555928458784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84870340 con 0x55ff84860c50 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=0 2024-04-24T01:24:18.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=1 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=2 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=3 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=4 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=5 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94555928449584] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.427+0000 7fcbae71f800 20 add_watcher() i=6 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94555928458784] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbae71f800 20 add_watcher() i=7 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbae71f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486edd0 con 0x55ff8485c260 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.428+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94555928460752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486edd0 con 0x55ff8485c260 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.429+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94555928460752] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.429+0000 7fca60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.430+0000 7fcbae71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.430+0000 7fcbae71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.430+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487bce0 con 0x55ff8485c260 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.431+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'45 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.431+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487c3b0 con 0x55ff84860c50 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.432+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.432+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487c7d0 con 0x55ff84865600 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.433+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.433+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487d020 con 0x55ff8485c260 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.434+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.434+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84879b10 con 0x7fcb94074040 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.437+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.437+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84879b10 con 0x55ff84865600 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.438+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.438+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487dd50 con 0x55ff8485c260 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.439+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.439+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e200 con 0x55ff84860c50 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.440+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.440+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e200 con 0x7fcb94074040 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.441+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.441+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e200 con 0x55ff84865600 2024-04-24T01:24:18.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.442+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.442+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e5c0 con 0x7fcb94074040 2024-04-24T01:24:18.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.443+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.443+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84860c50 2024-04-24T01:24:18.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.444+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.444+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x7fcb94074040 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.446+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.446+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84860c50 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.447+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.447+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff8485c260 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.448+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.448+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.449+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.449+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x7fcb94074040 2024-04-24T01:24:18.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.450+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.450+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.451+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.451+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff8485c260 2024-04-24T01:24:18.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.452+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.453+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff8485c260 2024-04-24T01:24:18.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.453+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'50 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.454+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.454+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.454+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x7fcb94074040 2024-04-24T01:24:18.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.455+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.455+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.456+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.456+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.457+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.457+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.458+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.458+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.459+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.459+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84860c50 2024-04-24T01:24:18.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.461+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.461+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.462+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.462+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84860c50 2024-04-24T01:24:18.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.466+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.466+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84865600 2024-04-24T01:24:18.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.467+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.467+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x55ff84860c50 2024-04-24T01:24:18.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.468+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.469+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487e540 con 0x7fcb94074040 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fc9db7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 20 Filter name: none 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fc9d97fa640 20 reqs_thread_entry: start 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ff848a9600 con 0x55ff8485c260 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T01:24:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.470+0000 7fcbae71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, user does not exist 2024-04-24T01:24:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.471+0000 7fca60fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.471+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94555928460752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8487cb70 con 0x55ff8485c260 2024-04-24T01:24:18.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.472+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94555928460752] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.472+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94555928434816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486fd90 con 0x7fcb94074040 2024-04-24T01:24:18.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.473+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94555928434816] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.473+0000 7fcbae71f800 20 remove_watcher() i=0 2024-04-24T01:24:18.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.473+0000 7fcbae71f800 2 removed watcher, disabling cache 2024-04-24T01:24:18.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.473+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94555928439056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869880 con 0x55ff8485c260 2024-04-24T01:24:18.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.474+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94555928439056] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.474+0000 7fcbae71f800 20 remove_watcher() i=1 2024-04-24T01:24:18.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.474+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94555928432608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84869880 con 0x55ff84865600 2024-04-24T01:24:18.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.476+0000 7fcba1bc9640 1 -- 172.21.15.169:0/3738315033 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94555928432608] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9407f070 con 0x55ff84865600 2024-04-24T01:24:18.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.476+0000 7fcbae71f800 20 remove_watcher() i=2 2024-04-24T01:24:18.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.476+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94555928444976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84868fe0 con 0x7fcb94074040 2024-04-24T01:24:18.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.477+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94555928444976] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x7fcb94074040 2024-04-24T01:24:18.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.477+0000 7fcbae71f800 20 remove_watcher() i=3 2024-04-24T01:24:18.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.477+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94555928448528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486c030 con 0x55ff8485c260 2024-04-24T01:24:18.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.480+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94555928448528] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcba400a4a0 con 0x55ff8485c260 2024-04-24T01:24:18.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.480+0000 7fcbae71f800 20 remove_watcher() i=4 2024-04-24T01:24:18.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.480+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94555928446032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84868fe0 con 0x55ff84860c50 2024-04-24T01:24:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.481+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94555928446032] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.481+0000 7fcbae71f800 20 remove_watcher() i=5 2024-04-24T01:24:18.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.481+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94555928449584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff8486ce10 con 0x55ff84860c50 2024-04-24T01:24:18.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.484+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94555928449584] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.484+0000 7fcbae71f800 20 remove_watcher() i=6 2024-04-24T01:24:18.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.484+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94555928458784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ff84868fe0 con 0x55ff84860c50 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbaa3ca640 1 -- 172.21.15.169:0/3738315033 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94555928458784] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb9c02e070 con 0x55ff84860c50 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 20 remove_watcher() i=7 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84860c50 msgr2=0x55ff84863040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84860c50 0x55ff84863040 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff8485c260 msgr2=0x55ff8485e720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff8485c260 0x55ff8485e720 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fcb94074040 msgr2=0x7fcb94081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fcb94074040 0x7fcb94081410 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ff84865600 msgr2=0x55ff84867ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ff84865600 0x55ff84867ac0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca74036860 msgr2=0x7fca74038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca74036860 0x7fca74038d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55ff8482ea80 tx=0x7fcb9404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbaabcb640 1 -- 172.21.15.169:0/3738315033 reap_dead start 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 msgr2=0x55ff84850be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00f800 tx=0x7fcb9c047e80 comp rx=0 tx=0).stop 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 shutdown_connections 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 --2- 172.21.15.169:0/3738315033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84849860 0x55ff84850be0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 >> 172.21.15.169:0/3738315033 conn(0x55ff84845ae0 msgr2=0x55ff84843140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 shutdown_connections 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.485+0000 7fcbae71f800 1 -- 172.21.15.169:0/3738315033 wait complete. 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 msgr2=0x7fca84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 0x7fca84038e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55ff84826120 tx=0x7fcb94005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 msgr2=0x55ff8483ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c04ae40 tx=0x7fcb9c017e60 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 shutdown_connections 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca84036950 0x7fca84038e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/1822318217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff8483ca70 0x55ff8483ce90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 >> 172.21.15.169:0/1822318217 conn(0x55ff84830b10 msgr2=0x55ff84830f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 shutdown_connections 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/1822318217 wait complete. 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84827b70 msgr2=0x55ff84829f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ff84827b70 0x55ff84829f60 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff847232a0 msgr2=0x55ff84825270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ff847232a0 0x55ff84825270 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ff8482bab0 msgr2=0x55ff8482df20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ff8482bab0 0x55ff8482df20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca90036950 msgr2=0x7fca90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fca90036950 0x7fca90038e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcb94054000 tx=0x7fcb9404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 msgr2=0x55ff8481e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 --2- 172.21.15.169:0/173283501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff84721760 0x55ff8481e030 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b5f0 tx=0x7fcb9c000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbaabcb640 1 -- 172.21.15.169:0/173283501 reap_dead start 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 shutdown_connections 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 >> 172.21.15.169:0/173283501 conn(0x55ff8471d380 msgr2=0x55ff84810600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 shutdown_connections 2024-04-24T01:24:18.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.486+0000 7fcbae71f800 1 -- 172.21.15.169:0/173283501 wait complete. 2024-04-24T01:24:18.495 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-24T01:24:18.496 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:24:18.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:24:18.496 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T01:24:18.582 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:18.583 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.582+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.582+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.582+0000 7faacaf31800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ce57e842f0 0x55ce57f13a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.582+0000 7faacaf31800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce57dcfd40 con 0x55ce57f14000 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.582+0000 7faacaf31800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55ce57da24d0 con 0x55ce57e842f0 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac6cf2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ce57e842f0 0x55ce57f13a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac6cf2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ce57e842f0 0x55ce57f13a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32810/0 (socket says 172.21.15.169:32810) 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac6cf2640 1 -- 172.21.15.169:0/2385390781 learned_addr learned my addr 172.21.15.169:0/2385390781 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac64f1640 1 --1- 172.21.15.169:0/2385390781 >> v1:172.21.15.142:6789/0 conn(0x55ce57f14000 0x55ce57f164a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34572/0 (socket says 172.21.15.169:34572) 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac6cf2640 1 -- 172.21.15.169:0/2385390781 >> v1:172.21.15.142:6789/0 conn(0x55ce57f14000 legacy=0x55ce57f164a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac6cf2640 1 -- 172.21.15.169:0/2385390781 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce57dce590 con 0x55ce57e842f0 2024-04-24T01:24:18.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.583+0000 7faac5cf0640 1 -- 172.21.15.169:0/2385390781 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169048935 0 0) 0x55ce57dcfd40 con 0x55ce57f14000 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faac6cf2640 1 --2- 172.21.15.169:0/2385390781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce57f13a60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faab800a520 tx=0x7faab801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684e838a54035720 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faac5cf0640 1 -- 172.21.15.169:0/2385390781 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8057070 con 0x55ce57e842f0 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faac5cf0640 1 -- 172.21.15.169:0/2385390781 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8052570 con 0x55ce57e842f0 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faac5cf0640 1 -- 172.21.15.169:0/2385390781 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab804ae60 con 0x55ce57e842f0 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 -- 172.21.15.169:0/2385390781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 msgr2=0x55ce57f13a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 --2- 172.21.15.169:0/2385390781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce57f13a60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faab800a520 tx=0x7faab801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 -- 172.21.15.169:0/2385390781 shutdown_connections 2024-04-24T01:24:18.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 --2- 172.21.15.169:0/2385390781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce57f13a60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 -- 172.21.15.169:0/2385390781 >> 172.21.15.169:0/2385390781 conn(0x55ce57f0b440 msgr2=0x55ce57f0d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 -- 172.21.15.169:0/2385390781 shutdown_connections 2024-04-24T01:24:18.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.585+0000 7faacaf31800 1 -- 172.21.15.169:0/2385390781 wait complete. 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.597+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.597+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.597+0000 7faacaf31800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.597+0000 7faacaf31800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ce57e5c3e0 con 0x55ce57e842f0 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32814/0 (socket says 172.21.15.169:32814) 2024-04-24T01:24:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7faac6cf2640 1 -- 172.21.15.169:0/2945812799 learned_addr learned my addr 172.21.15.169:0/2945812799 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7faac6cf2640 1 -- 172.21.15.169:0/2945812799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce580025c0 con 0x55ce57e842f0 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7faac6cf2640 1 --2- 172.21.15.169:0/2945812799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faab8055040 tx=0x7faab804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637e2d7ed3c2905d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7fa9b4e09640 1 -- 172.21.15.169:0/2945812799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8057040 con 0x55ce57e842f0 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7fa9b4e09640 1 -- 172.21.15.169:0/2945812799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8052720 con 0x55ce57e842f0 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.598+0000 7fa9b4e09640 1 -- 172.21.15.169:0/2945812799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8052a40 con 0x55ce57e842f0 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- 172.21.15.169:0/2945812799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 msgr2=0x55ce58001ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 --2- 172.21.15.169:0/2945812799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faab8055040 tx=0x7faab804c000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- 172.21.15.169:0/2945812799 shutdown_connections 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 --2- 172.21.15.169:0/2945812799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58001ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- 172.21.15.169:0/2945812799 >> 172.21.15.169:0/2945812799 conn(0x55ce57f0b440 msgr2=0x55ce57ffd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- 172.21.15.169:0/2945812799 shutdown_connections 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- 172.21.15.169:0/2945812799 wait complete. 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.599+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faacaf31800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faacaf31800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ce57f17f70 con 0x55ce57e842f0 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32830/0 (socket says 172.21.15.169:32830) 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faac6cf2640 1 -- 172.21.15.169:0/273308249 learned_addr learned my addr 172.21.15.169:0/273308249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faac6cf2640 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce58009fe0 con 0x55ce57e842f0 2024-04-24T01:24:18.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faac6cf2640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faab8052540 tx=0x7faab8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7fa9b3606640 1 -- 172.21.15.169:0/273308249 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8073070 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7fa9b3606640 1 -- 172.21.15.169:0/273308249 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab805d440 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce5800a270 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.600+0000 7fa9b3606640 1 -- 172.21.15.169:0/273308249 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8057070 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce5800ced0 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7fa9b3606640 1 -- 172.21.15.169:0/273308249 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faab8076070 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faacaf31800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faacaf31800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ce57e026b0 con 0x55ce58017300 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7fa9b3606640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 0x7fa9ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7fa9b3606640 1 -- 172.21.15.169:0/273308249 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faab808db90 con 0x55ce57e842f0 2024-04-24T01:24:18.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faac74f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faac74f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32832/0 (socket says 172.21.15.169:32832) 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.601+0000 7faac74f3640 1 -- 172.21.15.169:0/974989548 learned_addr learned my addr 172.21.15.169:0/974989548 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faac6cf2640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 0x7fa9ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faac74f3640 1 -- 172.21.15.169:0/974989548 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce58017c60 con 0x55ce58017300 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faac6cf2640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 0x7fa9ac038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faab806efd0 tx=0x7faab80529c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faac74f3640 1 --2- 172.21.15.169:0/974989548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faac000a430 tx=0x7faac000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5c292739b37dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7fa9b1602640 1 -- 172.21.15.169:0/974989548 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0015070 con 0x55ce58017300 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7fa9b1602640 1 -- 172.21.15.169:0/974989548 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac0001670 con 0x55ce58017300 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7fa9b1602640 1 -- 172.21.15.169:0/974989548 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0001990 con 0x55ce58017300 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 -- 172.21.15.169:0/974989548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 msgr2=0x55ce58017720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 --2- 172.21.15.169:0/974989548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faac000a430 tx=0x7faac000a8f0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 -- 172.21.15.169:0/974989548 shutdown_connections 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 --2- 172.21.15.169:0/974989548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce58017720 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 -- 172.21.15.169:0/974989548 >> 172.21.15.169:0/974989548 conn(0x55ce57f14000 msgr2=0x55ce58013da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 -- 172.21.15.169:0/974989548 shutdown_connections 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.602+0000 7faacaf31800 1 -- 172.21.15.169:0/974989548 wait complete. 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faacaf31800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faacaf31800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ce580185f0 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faac74f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faac74f3640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32848/0 (socket says 172.21.15.169:32848) 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faac74f3640 1 -- 172.21.15.169:0/615283809 learned_addr learned my addr 172.21.15.169:0/615283809 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faac74f3640 1 -- 172.21.15.169:0/615283809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce5801ed20 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.603+0000 7faac74f3640 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faac000a930 tx=0x7faac0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7fa9ab7fe640 1 -- 172.21.15.169:0/615283809 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0020020 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7fa9ab7fe640 1 -- 172.21.15.169:0/615283809 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac00108b0 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce5801efb0 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7fa9ab7fe640 1 -- 172.21.15.169:0/615283809 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faac0015040 con 0x55ce58017300 2024-04-24T01:24:18.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce58021c60 con 0x55ce58017300 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.604+0000 7fa9ab7fe640 1 -- 172.21.15.169:0/615283809 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faac0023020 con 0x55ce58017300 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7fa9ab7fe640 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 0x7fa9a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7fa9ab7fe640 1 -- 172.21.15.169:0/615283809 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faac004bf40 con 0x55ce58017300 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faac64f1640 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 0x7fa9a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 1 Processor -- start 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 1 -- start start 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faac64f1640 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 0x7fa9a0038e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faabc000c00 tx=0x7faabc001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.605+0000 7faacaf31800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ce58002880 con 0x55ce58038e40 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faac6cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32852/0 (socket says 172.21.15.169:32852) 2024-04-24T01:24:18.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faac6cf2640 1 -- 172.21.15.169:0/2852029819 learned_addr learned my addr 172.21.15.169:0/2852029819 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faac6cf2640 1 -- 172.21.15.169:0/2852029819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce580397a0 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faac6cf2640 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faab80768e0 tx=0x7faab8076490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7fa98bfe7640 1 -- 172.21.15.169:0/2852029819 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab805ce50 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7fa98bfe7640 1 -- 172.21.15.169:0/2852029819 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab8091070 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7fa98bfe7640 1 -- 172.21.15.169:0/2852029819 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faab8064610 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce5803a210 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.606+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce5803a710 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7fa98bfe7640 1 -- 172.21.15.169:0/2852029819 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faab8064a50 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7fa98bfe7640 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 0x7fa904038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7fa98bfe7640 1 -- 172.21.15.169:0/2852029819 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faab8083070 con 0x55ce58038e40 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7faac64f1640 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 0x7fa904038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7fa989fe3640 20 reqs_thread_entry: start 2024-04-24T01:24:18.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 0x55ce58048c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce58049340 con 0x55ce580467e0 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7faac64f1640 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 0x7fa904038fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faabc000f60 tx=0x7faabc006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.607+0000 7faac74f3640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 0x55ce58048c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.608+0000 7faac74f3640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 0x55ce58048c70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.608+0000 7faac74f3640 1 -- 172.21.15.169:0/273308249 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7faac0010d70 con 0x55ce580467e0 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.608+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 0x55ce5804d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.608+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:2 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce5804dc20 con 0x55ce5804b160 2024-04-24T01:24:18.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.608+0000 7faac6cf2640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 0x55ce5804d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.609+0000 7faac6cf2640 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 0x55ce5804d550 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.609+0000 7faac6cf2640 1 -- 172.21.15.169:0/273308249 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(2 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faab8075030 con 0x55ce5804b160 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.609+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce5804a660 con 0x55ce5804b160 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.610+0000 7faac6cf2640 1 -- 172.21.15.169:0/273308249 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7faab8075030 con 0x55ce5804b160 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 msgr2=0x7fa9a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 0x7fa9a0038e10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7faabc000c00 tx=0x7faabc001330 comp rx=0 tx=0).stop 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 msgr2=0x55ce5801e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faac000a930 tx=0x7faac0003370 comp rx=0 tx=0).stop 2024-04-24T01:24:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 shutdown_connections 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9a0036950 0x7fa9a0038e10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/615283809 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58017300 0x55ce5801e7e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 >> 172.21.15.169:0/615283809 conn(0x55ce57f14000 msgr2=0x55ce580113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 shutdown_connections 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/615283809 wait complete. 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 msgr2=0x7fa904038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 0x7fa904038fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faabc000f60 tx=0x7faabc006000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 msgr2=0x55ce58039260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7faab80768e0 tx=0x7faab8076490 comp rx=0 tx=0).stop 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 shutdown_connections 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa904036af0 0x7fa904038fb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.611+0000 7faacaf31800 1 --2- 172.21.15.169:0/2852029819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce58038e40 0x55ce58039260 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 >> 172.21.15.169:0/2852029819 conn(0x55ce5802d950 msgr2=0x55ce5802e370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 shutdown_connections 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/2852029819 wait complete. 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 msgr2=0x55ce5804d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 0x55ce5804d550 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 msgr2=0x55ce58048c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 0x55ce58048c70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 msgr2=0x7fa9ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 0x7fa9ac038e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faab806efd0 tx=0x7faab80529c0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 msgr2=0x55ce58009aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faab8052540 tx=0x7faab8003020 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 shutdown_connections 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ce5804b160 0x55ce5804d550 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ce580467e0 0x55ce58048c70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa9ac036950 0x7fa9ac038e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 --2- 172.21.15.169:0/273308249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ce57e842f0 0x55ce58009aa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 >> 172.21.15.169:0/273308249 conn(0x55ce57f0b440 msgr2=0x55ce57ffc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 shutdown_connections 2024-04-24T01:24:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.612+0000 7faacaf31800 1 -- 172.21.15.169:0/273308249 wait complete. 2024-04-24T01:24:18.622 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:24:18.622 DEBUG:tasks.util.rgw: json result: {'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:24:18.623 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T01:24:18.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T01:24:18.624 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T01:24:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:18.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.663+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.663+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.663+0000 7fb00e62f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559467d4f120 0x559467d515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.663+0000 7fb00e62f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559467c09d40 con 0x559467cbe1b0 2024-04-24T01:24:18.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.663+0000 7fb00e62f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559467bdc4d0 con 0x559467d4f120 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb003fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559467d4f120 0x559467d515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb0099c0640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x559467cbe1b0 0x559467d4d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34586/0 (socket says 172.21.15.169:34586) 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb0099c0640 1 -- 172.21.15.169:0/2121934899 learned_addr learned my addr 172.21.15.169:0/2121934899 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb003fff640 1 -- 172.21.15.169:0/2121934899 >> v1:172.21.15.142:6789/0 conn(0x559467cbe1b0 legacy=0x559467d4d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb0091bf640 1 -- 172.21.15.169:0/2121934899 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231060762 0 0) 0x559467c09d40 con 0x559467cbe1b0 2024-04-24T01:24:18.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.664+0000 7fb003fff640 1 -- 172.21.15.169:0/2121934899 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467c08590 con 0x559467d4f120 2024-04-24T01:24:18.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.666+0000 7fb003fff640 1 --2- 172.21.15.169:0/2121934899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467d4f120 0x559467d515e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faff400a470 tx=0x7faff401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26822ef53fa99c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.666+0000 7fb0091bf640 1 -- 172.21.15.169:0/2121934899 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4057070 con 0x559467d4f120 2024-04-24T01:24:18.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.666+0000 7fb0091bf640 1 -- 172.21.15.169:0/2121934899 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff4052570 con 0x559467d4f120 2024-04-24T01:24:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.666+0000 7fb0091bf640 1 -- 172.21.15.169:0/2121934899 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff4052870 con 0x559467d4f120 2024-04-24T01:24:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 -- 172.21.15.169:0/2121934899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467d4f120 msgr2=0x559467d515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 --2- 172.21.15.169:0/2121934899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467d4f120 0x559467d515e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7faff400a470 tx=0x7faff401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 -- 172.21.15.169:0/2121934899 shutdown_connections 2024-04-24T01:24:18.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 --2- 172.21.15.169:0/2121934899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467d4f120 0x559467d515e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 -- 172.21.15.169:0/2121934899 >> 172.21.15.169:0/2121934899 conn(0x559467d45370 msgr2=0x559467d47790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 -- 172.21.15.169:0/2121934899 shutdown_connections 2024-04-24T01:24:18.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.667+0000 7fb00e62f800 1 -- 172.21.15.169:0/2121934899 wait complete. 2024-04-24T01:24:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.678+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.678+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb00e62f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb00e62f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559467c963b0 con 0x559467cbe1b0 2024-04-24T01:24:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32880/0 (socket says 172.21.15.169:32880) 2024-04-24T01:24:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb0099c0640 1 -- 172.21.15.169:0/3129540336 learned_addr learned my addr 172.21.15.169:0/3129540336 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb0099c0640 1 -- 172.21.15.169:0/3129540336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467e3c4c0 con 0x559467cbe1b0 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.679+0000 7fb0099c0640 1 --2- 172.21.15.169:0/3129540336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faffc00b210 tx=0x7faffc00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97381d0eed1979fe server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7faef7e07640 1 -- 172.21.15.169:0/3129540336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc008070 con 0x559467cbe1b0 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7faef7e07640 1 -- 172.21.15.169:0/3129540336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc00d500 con 0x559467cbe1b0 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7faef7e07640 1 -- 172.21.15.169:0/3129540336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc00d840 con 0x559467cbe1b0 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 -- 172.21.15.169:0/3129540336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 msgr2=0x559467e3bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 --2- 172.21.15.169:0/3129540336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faffc00b210 tx=0x7faffc00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 -- 172.21.15.169:0/3129540336 shutdown_connections 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 --2- 172.21.15.169:0/3129540336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467e3bef0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 -- 172.21.15.169:0/3129540336 >> 172.21.15.169:0/3129540336 conn(0x559467d45370 msgr2=0x559467e37810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 -- 172.21.15.169:0/3129540336 shutdown_connections 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.680+0000 7fb00e62f800 1 -- 172.21.15.169:0/3129540336 wait complete. 2024-04-24T01:24:18.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb00e62f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467d4b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb00e62f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559467d51f90 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467d4b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467d4b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32886/0 (socket says 172.21.15.169:32886) 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb0099c0640 1 -- 172.21.15.169:0/1848532376 learned_addr learned my addr 172.21.15.169:0/1848532376 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.681+0000 7fb0099c0640 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467d499f0 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7fb0099c0640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467d4b300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faffc001e60 tx=0x7faffc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7faef6604640 1 -- 172.21.15.169:0/1848532376 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc019870 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7faef6604640 1 -- 172.21.15.169:0/1848532376 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc019a10 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559467d49c80 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7faef6604640 1 -- 172.21.15.169:0/1848532376 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc019cf0 con 0x559467cbe1b0 2024-04-24T01:24:18.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559467d4a1a0 con 0x559467cbe1b0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.682+0000 7faef6604640 1 -- 172.21.15.169:0/1848532376 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faffc017040 con 0x559467cbe1b0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7faef6604640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faef0036950 0x7faef0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7faef6604640 1 -- 172.21.15.169:0/1848532376 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faffc015020 con 0x559467cbe1b0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb003fff640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faef0036950 0x7faef0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467d4f120 0x559467e4ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e4d440 con 0x559467d4f120 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467d4f120 0x559467e4ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb003fff640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faef0036950 0x7faef0038e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faff4054000 tx=0x7faff404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.683+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467d4f120 0x559467e4ce60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb00a1c1640 1 -- 172.21.15.169:0/1848532376 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467d4f120 2024-04-24T01:24:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e4dd00 con 0x559467d4f120 2024-04-24T01:24:18.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb00a1c1640 1 -- 172.21.15.169:0/1848532376 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467d4f120 2024-04-24T01:24:18.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e4f730 0x559467e51bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e52380 con 0x559467e4f730 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb0099c0640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e4f730 0x559467e51bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.684+0000 7fb0099c0640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e4f730 0x559467e51bf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb0099c0640 1 -- 172.21.15.169:0/1848532376 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faffc02d070 con 0x559467e4f730 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e4e580 con 0x559467d4f120 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb00a1c1640 1 -- 172.21.15.169:0/1848532376 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467d4f120 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559467e53880 0x559467e55cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e56450 con 0x559467e53880 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb003fff640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559467e53880 0x559467e55cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.685+0000 7fb003fff640 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559467e53880 0x559467e55cf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb003fff640 1 -- 172.21.15.169:0/1848532376 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7faff4052940 con 0x559467e53880 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb00e62f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb00e62f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559467d4b840 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32902/0 (socket says 172.21.15.169:32902) 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.686+0000 7fb0099c0640 1 -- 172.21.15.169:0/1717611076 learned_addr learned my addr 172.21.15.169:0/1717611076 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7fb0099c0640 1 -- 172.21.15.169:0/1717611076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467e651c0 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7fb0099c0640 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e8f0 tx=0x7faffc01aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7faeef7fe640 1 -- 172.21.15.169:0/1717611076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc01c900 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7faeef7fe640 1 -- 172.21.15.169:0/1717611076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc034070 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559467e65c30 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7faeef7fe640 1 -- 172.21.15.169:0/1717611076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc044b00 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.687+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559467e66130 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7faeef7fe640 1 -- 172.21.15.169:0/1717611076 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faffc044ca0 con 0x559467e64860 2024-04-24T01:24:18.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7faeef7fe640 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 0x7faee4038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7faeef7fe640 1 -- 172.21.15.169:0/1717611076 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faffc03acc0 con 0x559467e64860 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb003fff640 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 0x7faee4038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb003fff640 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 0x7faee4038e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x559467d4a5c0 tx=0x7faff4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb00e62f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb00e62f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559467c3c6b0 con 0x559467e71bf0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32914/0 (socket says 172.21.15.169:32914) 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.688+0000 7fb0099c0640 1 -- 172.21.15.169:0/3717578486 learned_addr learned my addr 172.21.15.169:0/3717578486 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb0099c0640 1 -- 172.21.15.169:0/3717578486 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467e725e0 con 0x559467e71bf0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb0099c0640 1 --2- 172.21.15.169:0/3717578486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faffc04d050 tx=0x7faffc03f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f3b1c1226978b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7faeed7fa640 1 -- 172.21.15.169:0/3717578486 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc05b070 con 0x559467e71bf0 2024-04-24T01:24:18.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7faeed7fa640 1 -- 172.21.15.169:0/3717578486 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc025bb0 con 0x559467e71bf0 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7faeed7fa640 1 -- 172.21.15.169:0/3717578486 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc030d70 con 0x559467e71bf0 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 -- 172.21.15.169:0/3717578486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 msgr2=0x559467e72010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 --2- 172.21.15.169:0/3717578486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faffc04d050 tx=0x7faffc03f940 comp rx=0 tx=0).stop 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 -- 172.21.15.169:0/3717578486 shutdown_connections 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 --2- 172.21.15.169:0/3717578486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e72010 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 -- 172.21.15.169:0/3717578486 >> 172.21.15.169:0/3717578486 conn(0x559467e6dec0 msgr2=0x559467e6bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.689+0000 7fb00e62f800 1 -- 172.21.15.169:0/3717578486 shutdown_connections 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb00e62f800 1 -- 172.21.15.169:0/3717578486 wait complete. 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb00e62f800 1 Processor -- start 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb00e62f800 1 -- start start 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb00e62f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb00e62f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559467e72ac0 con 0x559467e71bf0 2024-04-24T01:24:18.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb0099c0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32924/0 (socket says 172.21.15.169:32924) 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 learned_addr learned my addr 172.21.15.169:0/880718629 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.690+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559467e79300 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7fb0099c0640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faffc01aaa0 tx=0x7faffc057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7faedb7fe640 1 -- 172.21.15.169:0/880718629 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc070070 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7faedb7fe640 1 -- 172.21.15.169:0/880718629 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc03f250 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559467e79300 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7faedb7fe640 1 -- 172.21.15.169:0/880718629 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faffc00f610 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559467e79860 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.691+0000 7faedb7fe640 1 -- 172.21.15.169:0/880718629 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faffc073070 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7faedb7fe640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faed4036950 0x7faed4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7faedb7fe640 1 -- 172.21.15.169:0/880718629 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7faffc068070 con 0x559467e71bf0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb003fff640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faed4036950 0x7faed4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467e84500 0x559467e869c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e87110 con 0x559467e84500 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467e84500 0x559467e869c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb003fff640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faed4036950 0x7faed4038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faff4052fd0 tx=0x7faff404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467e84500 0x559467e869c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.692+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 realm 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e87520 con 0x559467e84500 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:18.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e87df0 con 0x559467e84500 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e84500 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e88c80 0x559467e8b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e8b7d0 con 0x559467e88c80 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.693+0000 7fb0099c0640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e88c80 0x559467e8b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb0099c0640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e88c80 0x559467e8b070 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb00e62f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb00e62f800 20 searching for the correct realm 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559467e8d880 0x559467e8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e90410 con 0x559467e8d880 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb003fff640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559467e8d880 0x559467e8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.694+0000 7fb003fff640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559467e8d880 0x559467e8fd40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb003fff640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faff4076040 0x7faff4083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e90410 con 0x7faff4076040 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faff4076040 0x7faff4083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb00a1c1640 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faff4076040 0x7faff4083410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.695+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e88c80 2024-04-24T01:24:18.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e84500 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e84500 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e88c80 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.696+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e88c80 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x7faff4076040 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e8d880 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e84500 2024-04-24T01:24:18.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e88c80 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.697+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e84500 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x7faff4076040 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559467e88190 con 0x559467e8d880 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.698+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e88c80 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e84500 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.699+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e84500 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e88c80 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.700+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x7faff4076040 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e84500 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e88c80 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.701+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e88c80 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x7faff4076040 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e8d880 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e88c80 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.702+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x559467e84500 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7faff4090040 con 0x7faff4076040 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:18.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e8c180 con 0x559467e84500 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e8c180 con 0x559467e84500 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.703+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e8c180 con 0x7faff4076040 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 zone default found 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 4 Realm: () 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 zonegroup default 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e8c570 con 0x559467e88c80 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e92270 con 0x559467e8d880 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e92610 con 0x559467e8d880 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.704+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.705+0000 7fb00e62f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.705+0000 7fb00e62f800 20 started sync module instance, tier type = 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.705+0000 7fb00e62f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.705+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e8cde0 con 0x7faff4076040 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.706+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.706+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94095886848880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e91e00 con 0x7faff4076040 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.706+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e93010 con 0x559467e84500 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.707+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.707+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94095886854944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e92fe0 con 0x559467e84500 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.707+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e94000 con 0x559467e8d880 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.710+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94095886854944] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.710+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94095886848880] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.711+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.711+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94095886858960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e91850 con 0x559467e8d880 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.711+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e948a0 con 0x7faff4076040 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.714+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.714+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94095886861808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e95140 con 0x7faff4076040 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.714+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e95b90 con 0x559467e84500 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.715+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94095886858960] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.716+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.716+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94095886866048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e95b50 con 0x559467e84500 2024-04-24T01:24:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.716+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e965d0 con 0x559467e88c80 2024-04-24T01:24:18.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.720+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94095886861808] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.720+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.720+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94095886868768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e96970 con 0x559467e88c80 2024-04-24T01:24:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.720+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e97330 con 0x559467e88c80 2024-04-24T01:24:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.722+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94095886868768] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.725+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94095886866048] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.725+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.725+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94095886857264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e96e80 con 0x559467e88c80 2024-04-24T01:24:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.725+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e97840 con 0x559467e88c80 2024-04-24T01:24:18.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94095886857264] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94095886873488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e977b0 con 0x559467e88c80 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=0 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=1 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=2 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=3 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=4 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=5 2024-04-24T01:24:18.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.726+0000 7fb00e62f800 20 add_watcher() i=6 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94095886873488] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb00e62f800 20 add_watcher() i=7 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb00e62f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467e9ac70 con 0x559467e84500 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.727+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94095886863504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467e981c0 con 0x559467e84500 2024-04-24T01:24:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.728+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94095886863504] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7faebb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 5 note: GC not initialized 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7faeba7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 20 Filter name: none 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fae2bfff640 20 reqs_thread_entry: start 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece550 con 0x559467e84500 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.729+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece550 con 0x7faff4076040 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece510 con 0x559467e84500 2024-04-24T01:24:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece510 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ecea60 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ecea20 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.730+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ecea20 con 0x559467e84500 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ecea20 con 0x559467e84500 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece9b0 con 0x559467e8d880 2024-04-24T01:24:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece9b0 con 0x559467e8d880 2024-04-24T01:24:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.731+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e88c80 2024-04-24T01:24:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e84500 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x7faff4076040 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e8d880 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.732+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e88c80 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e88c80 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece960 con 0x559467e8d880 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.733+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.734+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x7faff4076040 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.735+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.736+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.737+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.737+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.737+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.738+0000 7faebb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.738+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94095886863504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.739+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94095886863504] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.739+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94095886848880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x7faff4076040 2024-04-24T01:24:18.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.740+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94095886848880] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.740+0000 7fb00e62f800 20 remove_watcher() i=0 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.740+0000 7fb00e62f800 2 removed watcher, disabling cache 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.740+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94095886854944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.741+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94095886854944] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.741+0000 7fb00e62f800 20 remove_watcher() i=1 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.741+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94095886858960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e8d880 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.742+0000 7fb003fff640 1 -- 172.21.15.169:0/880718629 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94095886858960] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff4081070 con 0x559467e8d880 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.742+0000 7fb00e62f800 20 remove_watcher() i=2 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.742+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94095886861808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x7faff4076040 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.743+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94095886861808] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x7faff4076040 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.743+0000 7fb00e62f800 20 remove_watcher() i=3 2024-04-24T01:24:18.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.743+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94095886866048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e84500 2024-04-24T01:24:18.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.744+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94095886866048] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb00400a4a0 con 0x559467e84500 2024-04-24T01:24:18.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.744+0000 7fb00e62f800 20 remove_watcher() i=4 2024-04-24T01:24:18.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.744+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94095886868768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.745+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94095886868768] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.745+0000 7fb00e62f800 20 remove_watcher() i=5 2024-04-24T01:24:18.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.745+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94095886857264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.746+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94095886857264] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.746+0000 7fb00e62f800 20 remove_watcher() i=6 2024-04-24T01:24:18.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.746+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94095886873488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559467ece910 con 0x559467e88c80 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb0099c0640 1 -- 172.21.15.169:0/880718629 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94095886873488] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faffc072030 con 0x559467e88c80 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 20 remove_watcher() i=7 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e88c80 msgr2=0x559467e8b070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e88c80 0x559467e8b070 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467e84500 msgr2=0x559467e869c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467e84500 0x559467e869c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faff4076040 msgr2=0x7faff4083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faff4076040 0x7faff4083410 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559467e8d880 msgr2=0x559467e8fd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559467e8d880 0x559467e8fd40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faed4036950 msgr2=0x7faed4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faed4036950 0x7faed4038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faff4052fd0 tx=0x7faff404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 msgr2=0x559467e78dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00a1c1640 1 -- 172.21.15.169:0/880718629 reap_dead start 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7faffc01aaa0 tx=0x7faffc057000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 shutdown_connections 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 --2- 172.21.15.169:0/880718629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e71bf0 0x559467e78dc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.747+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 >> 172.21.15.169:0/880718629 conn(0x559467e6dec0 msgr2=0x559467e6b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 shutdown_connections 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/880718629 wait complete. 2024-04-24T01:24:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 msgr2=0x7faee4038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 0x7faee4038e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x559467d4a5c0 tx=0x7faff4005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 msgr2=0x559467e64c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e8f0 tx=0x7faffc01aa10 comp rx=0 tx=0).stop 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 shutdown_connections 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faee40369c0 0x7faee4038e80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1717611076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467e64860 0x559467e64c80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 >> 172.21.15.169:0/1717611076 conn(0x559467e58900 msgr2=0x559467e58d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 shutdown_connections 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1717611076 wait complete. 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e4f730 msgr2=0x559467e51bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559467e4f730 0x559467e51bf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467d4f120 msgr2=0x559467e4ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559467d4f120 0x559467e4ce60 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559467e53880 msgr2=0x559467e55cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559467e53880 0x559467e55cf0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faef0036950 msgr2=0x7faef0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faef0036950 0x7faef0038e10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faff4054000 tx=0x7faff404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 msgr2=0x559467d4b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 --2- 172.21.15.169:0/1848532376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559467cbe1b0 0x559467d4b300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faffc001e60 tx=0x7faffc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00a1c1640 1 -- 172.21.15.169:0/1848532376 reap_dead start 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 shutdown_connections 2024-04-24T01:24:18.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 >> 172.21.15.169:0/1848532376 conn(0x559467d45370 msgr2=0x559467e360f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.748+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 shutdown_connections 2024-04-24T01:24:18.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.749+0000 7fb00e62f800 1 -- 172.21.15.169:0/1848532376 wait complete. 2024-04-24T01:24:18.758 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[],"summary":[]} 2024-04-24T01:24:18.759 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T01:24:18.759 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:18.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:18.759 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:18.841 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:18.841 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd6b23800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c59c19dd20 0x55c59c19e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd6b23800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c59c05dd40 con 0x55c59c19ef80 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd6b23800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c59c0304d0 con 0x55c59c19dd20 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd28b7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c59c19dd20 0x55c59c19e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd28b7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c59c19dd20 0x55c59c19e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32936/0 (socket says 172.21.15.169:32936) 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd20b6640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c59c19ef80 0x55c59c19f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34602/0 (socket says 172.21.15.169:34602) 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1298139990 learned_addr learned my addr 172.21.15.169:0/1298139990 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1298139990 >> v1:172.21.15.142:6789/0 conn(0x55c59c19ef80 legacy=0x55c59c19f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.841+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1298139990 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c05c590 con 0x55c59c19dd20 2024-04-24T01:24:18.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.843+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/1298139990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19dd20 0x55c59c19e140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400a520 tx=0x7fbdc401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebc0db33d6255c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.843+0000 7fbdd18b5640 1 -- 172.21.15.169:0/1298139990 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4057070 con 0x55c59c19dd20 2024-04-24T01:24:18.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.843+0000 7fbdd18b5640 1 -- 172.21.15.169:0/1298139990 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4052570 con 0x55c59c19dd20 2024-04-24T01:24:18.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.843+0000 7fbdd18b5640 1 -- 172.21.15.169:0/1298139990 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc404ae60 con 0x55c59c19dd20 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1298139990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19dd20 msgr2=0x55c59c19e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1298139990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19dd20 0x55c59c19e140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbdc400a520 tx=0x7fbdc401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1298139990 shutdown_connections 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1298139990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19dd20 0x55c59c19e140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1298139990 >> 172.21.15.169:0/1298139990 conn(0x55c59c199380 msgr2=0x55c59c19b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1298139990 shutdown_connections 2024-04-24T01:24:18.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.844+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1298139990 wait complete. 2024-04-24T01:24:18.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd6b23800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd6b23800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c59c0ea3c0 con 0x55c59c19ef80 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32938/0 (socket says 172.21.15.169:32938) 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1856661287 learned_addr learned my addr 172.21.15.169:0/1856661287 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.856+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1856661287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c28fb70 con 0x55c59c19ef80 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/1856661287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4044940 tx=0x7fbdc404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2d21d6d15f3af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbcc0e09640 1 -- 172.21.15.169:0/1856661287 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4057040 con 0x55c59c19ef80 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbcc0e09640 1 -- 172.21.15.169:0/1856661287 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4052720 con 0x55c59c19ef80 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbcc0e09640 1 -- 172.21.15.169:0/1856661287 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4052a00 con 0x55c59c19ef80 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1856661287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 msgr2=0x55c59c28f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1856661287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4044940 tx=0x7fbdc404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1856661287 shutdown_connections 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1856661287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c19ef80 0x55c59c28f5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1856661287 >> 172.21.15.169:0/1856661287 conn(0x55c59c199380 msgr2=0x55c59c28ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1856661287 shutdown_connections 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.857+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1856661287 wait complete. 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd6b23800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 0x55c59c29aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd6b23800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c59c1a73f0 con 0x55c59c111ff0 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 0x55c59c29aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 0x55c59c29aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32950/0 (socket says 172.21.15.169:32950) 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1489503458 learned_addr learned my addr 172.21.15.169:0/1489503458 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.858+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c29b530 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 0x55c59c29aff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4044940 tx=0x7fbdc4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbcbf606640 1 -- 172.21.15.169:0/1489503458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4057070 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbcbf606640 1 -- 172.21.15.169:0/1489503458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4052b00 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c59c29b700 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbcbf606640 1 -- 172.21.15.169:0/1489503458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4052e00 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59c29bae0 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.859+0000 7fbcbf606640 1 -- 172.21.15.169:0/1489503458 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc405d440 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbcbf606640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcb8036900 0x7fbcb8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbcbf606640 1 -- 172.21.15.169:0/1489503458 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc408da40 con 0x55c59c111ff0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcb8036900 0x7fbcb8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c29d8f0 0x55c59c29fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2a0340 con 0x55c59c29d8f0 2024-04-24T01:24:18.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c29d8f0 0x55c59c29fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcb8036900 0x7fbcb8038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000f60 tx=0x7fbdbc001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c29d8f0 0x55c59c29fd00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.860+0000 7fbdd30b8640 1 -- 172.21.15.169:0/1489503458 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c29d8f0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.861+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c29ceb0 con 0x55c59c29d8f0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.861+0000 7fbdd30b8640 1 -- 172.21.15.169:0/1489503458 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c29d8f0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.861+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2a2640 0x55c59c2a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.861+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2a5120 con 0x55c59c2a2640 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.861+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2a2640 0x55c59c2a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2a2640 0x55c59c2a4a30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd28b7640 1 -- 172.21.15.169:0/1489503458 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbdc406c070 con 0x55c59c2a2640 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2a15f0 con 0x55c59c29d8f0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd30b8640 1 -- 172.21.15.169:0/1489503458 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c29d8f0 2024-04-24T01:24:18.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c59c2a65d0 0x55c59c2a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2a9180 con 0x55c59c2a65d0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c59c2a65d0 0x55c59c2a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.862+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c59c2a65d0 0x55c59c2a8a20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd20b6640 1 -- 172.21.15.169:0/1489503458 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbdbc00f690 con 0x55c59c2a65d0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd6b23800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd6b23800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c59c0906b0 con 0x55c59c2b75e0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32962/0 (socket says 172.21.15.169:32962) 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.863+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3729433757 learned_addr learned my addr 172.21.15.169:0/3729433757 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3729433757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c2b7f40 con 0x55c59c2b75e0 2024-04-24T01:24:18.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4055040 tx=0x7fbdc4002a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbcbce01640 1 -- 172.21.15.169:0/3729433757 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc4092070 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbcbce01640 1 -- 172.21.15.169:0/3729433757 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc405cac0 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbcbce01640 1 -- 172.21.15.169:0/3729433757 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc405cda0 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c59c2b89b0 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.864+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59c2b8eb0 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbcbce01640 1 -- 172.21.15.169:0/3729433757 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc4095070 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbcbce01640 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 0x7fbcac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbcbce01640 1 -- 172.21.15.169:0/3729433757 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc4082070 con 0x55c59c2b75e0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 0x7fbcac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 0x7fbcac038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c59c2a0bf0 tx=0x7fbdbc00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd6b23800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.865+0000 7fbdd6b23800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c59c28fe30 con 0x55c59c2c47d0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32976/0 (socket says 172.21.15.169:32976) 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd28b7640 1 -- 172.21.15.169:0/2162440952 learned_addr learned my addr 172.21.15.169:0/2162440952 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd28b7640 1 -- 172.21.15.169:0/2162440952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c2c51c0 con 0x55c59c2c47d0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/2162440952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbdc408d010 tx=0x7fbdc4088510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ea3f41d4188b67 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbcb67fc640 1 -- 172.21.15.169:0/2162440952 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc40ab070 con 0x55c59c2c47d0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbcb67fc640 1 -- 172.21.15.169:0/2162440952 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4066760 con 0x55c59c2c47d0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbcb67fc640 1 -- 172.21.15.169:0/2162440952 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc40a2040 con 0x55c59c2c47d0 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd6b23800 1 -- 172.21.15.169:0/2162440952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 msgr2=0x55c59c2c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.866+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/2162440952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbdc408d010 tx=0x7fbdc4088510 comp rx=0 tx=0).stop 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- 172.21.15.169:0/2162440952 shutdown_connections 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/2162440952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2c4bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- 172.21.15.169:0/2162440952 >> 172.21.15.169:0/2162440952 conn(0x55c59c2c0aa0 msgr2=0x55c59c2beb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- 172.21.15.169:0/2162440952 shutdown_connections 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- 172.21.15.169:0/2162440952 wait complete. 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 Processor -- start 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- start start 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd6b23800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c59c2c5820 con 0x55c59c2c47d0 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd28b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32986/0 (socket says 172.21.15.169:32986) 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 learned_addr learned my addr 172.21.15.169:0/3667131469 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.867+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c59c2cbff0 con 0x55c59c2c47d0 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4077980 tx=0x7fbdc4093f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbcb4ff9640 1 -- 172.21.15.169:0/3667131469 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc40b5020 con 0x55c59c2c47d0 2024-04-24T01:24:18.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbcb4ff9640 1 -- 172.21.15.169:0/3667131469 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc4077b20 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbcb4ff9640 1 -- 172.21.15.169:0/3667131469 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc40ab040 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c59c2cbff0 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.868+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c59c2cbff0 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbcb4ff9640 1 -- 172.21.15.169:0/3667131469 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbdc40b8020 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbcb4ff9640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbc9c036900 0x7fbc9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbcb4ff9640 1 -- 172.21.15.169:0/3667131469 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbdc40bbc60 con 0x55c59c2c47d0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbc9c036900 0x7fbc9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c2d72a0 0x55c59c2d9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2d9eb0 con 0x55c59c2d72a0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c2d72a0 0x55c59c2d9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbc9c036900 0x7fbc9c038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55c59c2a9580 tx=0x7fbdbc010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.869+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c2d72a0 0x55c59c2d9760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 realm 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2da2c0 con 0x55c59c2d72a0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2dab90 con 0x55c59c2d72a0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2dba20 0x55c59c2dde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.870+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2de570 con 0x55c59c2dba20 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2dba20 0x55c59c2dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd28b7640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2dba20 0x55c59c2dde10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd6b23800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd6b23800 20 searching for the correct realm 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c59c2e0610 0x55c59c2e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e31a0 con 0x55c59c2e0610 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.871+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c59c2e0610 0x55c59c2e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c59c2e0610 0x55c59c2e2ad0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd20b6640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbdbc00f070 0x7fbdbc02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:18.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e31a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbdbc00f070 0x7fbdbc02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:18.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.872+0000 7fbdd30b8640 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbdbc00f070 0x7fbdbc02e910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.873+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x7fbdbc00f070 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.874+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x7fbdbc00f070 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.875+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.876+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.877+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x7fbdbc00f070 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.878+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x7fbdbc00f070 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2e0610 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.879+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x55c59c2d72a0 2024-04-24T01:24:18.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2daf30 con 0x7fbdbc00f070 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2def10 con 0x55c59c2d72a0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2def10 con 0x55c59c2d72a0 2024-04-24T01:24:18.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.880+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2deec0 con 0x7fbdbc00f070 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 zone default found 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 4 Realm: () 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 zonegroup default 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2df300 con 0x55c59c2dba20 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.881+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e5000 con 0x55c59c2e0610 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e53a0 con 0x55c59c2e0610 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 20 started sync module instance, tier type = 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.882+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e44a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.883+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.883+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94307217197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e44a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.883+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e5bf0 con 0x55c59c2d72a0 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.885+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.885+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94307217200960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e6010 con 0x55c59c2d72a0 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.886+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e6b00 con 0x55c59c2e0610 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.886+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94307217197200] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.888+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.888+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94307217204688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e6ef0 con 0x55c59c2e0610 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.888+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e78f0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.888+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94307217200960] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.889+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.889+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94307217202016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e7ce0 con 0x7fbdbc00f070 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.889+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e86e0 con 0x55c59c2d72a0 2024-04-24T01:24:18.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.889+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94307217204688] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.891+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.891+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94307217194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e86a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.891+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e9130 con 0x55c59c2dba20 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.894+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94307217202016] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.894+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.894+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94307217208320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e9520 con 0x55c59c2dba20 2024-04-24T01:24:18.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.894+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e9ee0 con 0x55c59c2dba20 2024-04-24T01:24:18.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.896+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94307217194992] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.896+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94307217208320] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.900+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.900+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94307217218096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2ea2d0 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.900+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2eab20 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94307217220816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2eaf60 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=0 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=1 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=2 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=3 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=4 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=5 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94307217218096] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.902+0000 7fbdd6b23800 20 add_watcher() i=6 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94307217220816] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd6b23800 20 add_watcher() i=7 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd6b23800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:18.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e81f0 con 0x55c59c2d72a0 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.903+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94307217222128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e81f0 con 0x55c59c2d72a0 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94307217222128] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbc897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbdd6b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbdd6b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbdd6b23800 5 note: GC not initialized 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbc03fff640 20 reqs_thread_entry: start 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.904+0000 7fbdd6b23800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbdd6b23800 20 Filter name: none 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbc01ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbdd6b23800 20 rados->read ofs=0 len=0 2024-04-24T01:24:18.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c59c320d20 con 0x55c59c2d72a0 2024-04-24T01:24:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.905+0000 7fbdd6b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:could not fetch user info: no user info saved 2024-04-24T01:24:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.906+0000 7fbc897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:18.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.906+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94307217222128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c320ce0 con 0x55c59c2d72a0 2024-04-24T01:24:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.907+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94307217222128] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.907+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94307217197200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c320ce0 con 0x7fbdbc00f070 2024-04-24T01:24:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.908+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94307217197200] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.908+0000 7fbdd6b23800 20 remove_watcher() i=0 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.908+0000 7fbdd6b23800 2 removed watcher, disabling cache 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.908+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94307217200960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c320ce0 con 0x55c59c2d72a0 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.909+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94307217200960] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.909+0000 7fbdd6b23800 20 remove_watcher() i=1 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.909+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94307217204688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c320ce0 con 0x55c59c2e0610 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.910+0000 7fbdd20b6640 1 -- 172.21.15.169:0/3667131469 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94307217204688] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdbc037040 con 0x55c59c2e0610 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.910+0000 7fbdd6b23800 20 remove_watcher() i=2 2024-04-24T01:24:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.910+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94307217202016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e5740 con 0x7fbdbc00f070 2024-04-24T01:24:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.911+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94307217202016] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x7fbdbc00f070 2024-04-24T01:24:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.911+0000 7fbdd6b23800 20 remove_watcher() i=3 2024-04-24T01:24:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.911+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94307217194992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e4890 con 0x55c59c2d72a0 2024-04-24T01:24:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.912+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94307217194992] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc00a4a0 con 0x55c59c2d72a0 2024-04-24T01:24:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.912+0000 7fbdd6b23800 20 remove_watcher() i=4 2024-04-24T01:24:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.912+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94307217208320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e4890 con 0x55c59c2dba20 2024-04-24T01:24:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.913+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94307217208320] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.913+0000 7fbdd6b23800 20 remove_watcher() i=5 2024-04-24T01:24:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.913+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94307217218096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e4890 con 0x55c59c2dba20 2024-04-24T01:24:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.914+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94307217218096] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.914+0000 7fbdd6b23800 20 remove_watcher() i=6 2024-04-24T01:24:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.914+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94307217220816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c59c2e9a30 con 0x55c59c2dba20 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd28b7640 1 -- 172.21.15.169:0/3667131469 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94307217220816] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc40ae040 con 0x55c59c2dba20 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 20 remove_watcher() i=7 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2dba20 msgr2=0x55c59c2dde10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2dba20 0x55c59c2dde10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c2d72a0 msgr2=0x55c59c2d9760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c2d72a0 0x55c59c2d9760 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbdbc00f070 msgr2=0x7fbdbc02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbdbc00f070 0x7fbdbc02e910 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c59c2e0610 msgr2=0x55c59c2e2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c59c2e0610 0x55c59c2e2ad0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbc9c036900 msgr2=0x7fbc9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbc9c036900 0x7fbc9c038dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x55c59c2a9580 tx=0x7fbdbc010000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 msgr2=0x55c59c2cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4077980 tx=0x7fbdc4093f10 comp rx=0 tx=0).stop 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd30b8640 1 -- 172.21.15.169:0/3667131469 reap_dead start 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 shutdown_connections 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3667131469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2c47d0 0x55c59c2cbab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.915+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 >> 172.21.15.169:0/3667131469 conn(0x55c59c2c0aa0 msgr2=0x55c59c2be100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 shutdown_connections 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3667131469 wait complete. 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 msgr2=0x7fbcac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 0x7fbcac038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x55c59c2a0bf0 tx=0x7fbdbc00f000 comp rx=0 tx=0).stop 2024-04-24T01:24:18.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 msgr2=0x55c59c2b7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4055040 tx=0x7fbdc4002a40 comp rx=0 tx=0).stop 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 shutdown_connections 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcac036950 0x7fbcac038e10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/3729433757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c2b75e0 0x55c59c2b7a00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 >> 172.21.15.169:0/3729433757 conn(0x55c59c2ab680 msgr2=0x55c59c2aba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 shutdown_connections 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/3729433757 wait complete. 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2a2640 msgr2=0x55c59c2a4a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c59c2a2640 0x55c59c2a4a30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c29d8f0 msgr2=0x55c59c29fd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c59c29d8f0 0x55c59c29fd00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c59c2a65d0 msgr2=0x55c59c2a8a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c59c2a65d0 0x55c59c2a8a20 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcb8036900 msgr2=0x7fbcb8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbcb8036900 0x7fbcb8038dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000f60 tx=0x7fbdbc001370 comp rx=0 tx=0).stop 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 msgr2=0x55c59c29aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 --2- 172.21.15.169:0/1489503458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c59c111ff0 0x55c59c29aff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4044940 tx=0x7fbdc4003020 comp rx=0 tx=0).stop 2024-04-24T01:24:18.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd30b8640 1 -- 172.21.15.169:0/1489503458 reap_dead start 2024-04-24T01:24:18.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 shutdown_connections 2024-04-24T01:24:18.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 >> 172.21.15.169:0/1489503458 conn(0x55c59c199380 msgr2=0x55c59c2896a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:18.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 shutdown_connections 2024-04-24T01:24:18.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:18.916+0000 7fbdd6b23800 1 -- 172.21.15.169:0/1489503458 wait complete. 2024-04-24T01:24:18.925 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T01:24:18.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T01:24:18.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-04-24T01:24:18.926 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-04-24T01:24:19.019 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.019 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.018+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.018+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f7726f33800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5646bc3d4760 0x5646bc468d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f7726f33800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646bc31ed40 con 0x5646bc3d5aa0 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f7726f33800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5646bc2f14d0 con 0x5646bc3d4760 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f771a4f1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5646bc3d4760 0x5646bc468d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f771a4f1640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5646bc3d4760 0x5646bc468d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:32988/0 (socket says 172.21.15.169:32988) 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f7722cf2640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5646bc3d5aa0 0x5646bc3d4050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34604/0 (socket says 172.21.15.169:34604) 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f771a4f1640 1 -- 172.21.15.169:0/194504935 learned_addr learned my addr 172.21.15.169:0/194504935 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f771a4f1640 1 -- 172.21.15.169:0/194504935 >> v1:172.21.15.142:6789/0 conn(0x5646bc3d5aa0 legacy=0x5646bc3d4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f77224f1640 1 -- 172.21.15.169:0/194504935 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713799530 0 0) 0x5646bc31ed40 con 0x5646bc3d5aa0 2024-04-24T01:24:19.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.019+0000 7f771a4f1640 1 -- 172.21.15.169:0/194504935 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc31d590 con 0x5646bc3d4760 2024-04-24T01:24:19.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.021+0000 7f771a4f1640 1 --2- 172.21.15.169:0/194504935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc468d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f770c00a520 tx=0x7f770c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33787015825e205 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.021+0000 7f77224f1640 1 -- 172.21.15.169:0/194504935 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f770c057070 con 0x5646bc3d4760 2024-04-24T01:24:19.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.021+0000 7f77224f1640 1 -- 172.21.15.169:0/194504935 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f770c052440 con 0x5646bc3d4760 2024-04-24T01:24:19.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.021+0000 7f77224f1640 1 -- 172.21.15.169:0/194504935 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f770c04ae60 con 0x5646bc3d4760 2024-04-24T01:24:19.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 -- 172.21.15.169:0/194504935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 msgr2=0x5646bc468d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 --2- 172.21.15.169:0/194504935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc468d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f770c00a520 tx=0x7f770c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 -- 172.21.15.169:0/194504935 shutdown_connections 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 --2- 172.21.15.169:0/194504935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc468d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 -- 172.21.15.169:0/194504935 >> 172.21.15.169:0/194504935 conn(0x5646bc45b4d0 msgr2=0x5646bc45d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 -- 172.21.15.169:0/194504935 shutdown_connections 2024-04-24T01:24:19.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.022+0000 7f7726f33800 1 -- 172.21.15.169:0/194504935 wait complete. 2024-04-24T01:24:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.033+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.033+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7726f33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7726f33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5646bc3ab360 con 0x5646bc3d4760 2024-04-24T01:24:19.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33004/0 (socket says 172.21.15.169:33004) 2024-04-24T01:24:19.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7722cf2640 1 -- 172.21.15.169:0/2794246432 learned_addr learned my addr 172.21.15.169:0/2794246432 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7722cf2640 1 -- 172.21.15.169:0/2794246432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc553960 con 0x5646bc3d4760 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.034+0000 7f7722cf2640 1 --2- 172.21.15.169:0/2794246432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f771400b230 tx=0x7f771400b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601f39f643b14df3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7610e09640 1 -- 172.21.15.169:0/2794246432 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771400e5c0 con 0x5646bc3d4760 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7610e09640 1 -- 172.21.15.169:0/2794246432 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714014070 con 0x5646bc3d4760 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7610e09640 1 -- 172.21.15.169:0/2794246432 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771400e910 con 0x5646bc3d4760 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 -- 172.21.15.169:0/2794246432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 msgr2=0x5646bc553390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 --2- 172.21.15.169:0/2794246432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f771400b230 tx=0x7f771400b6f0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 -- 172.21.15.169:0/2794246432 shutdown_connections 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 --2- 172.21.15.169:0/2794246432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc553390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 -- 172.21.15.169:0/2794246432 >> 172.21.15.169:0/2794246432 conn(0x5646bc45b4d0 msgr2=0x5646bc54ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 -- 172.21.15.169:0/2794246432 shutdown_connections 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.035+0000 7f7726f33800 1 -- 172.21.15.169:0/2794246432 wait complete. 2024-04-24T01:24:19.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7726f33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc55af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7726f33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5646bc46b5e0 con 0x5646bc3d4760 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc55af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc55af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33006/0 (socket says 172.21.15.169:33006) 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7722cf2640 1 -- 172.21.15.169:0/2597600888 learned_addr learned my addr 172.21.15.169:0/2597600888 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7722cf2640 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc55b470 con 0x5646bc3d4760 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.036+0000 7f7722cf2640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc55af30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7714000c00 tx=0x7f7714000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f760f606640 1 -- 172.21.15.169:0/2597600888 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771400f9b0 con 0x5646bc3d4760 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f760f606640 1 -- 172.21.15.169:0/2597600888 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714006070 con 0x5646bc3d4760 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f760f606640 1 -- 172.21.15.169:0/2597600888 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771400fcc0 con 0x5646bc3d4760 2024-04-24T01:24:19.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646bc55b700 con 0x5646bc3d4760 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646bc55e3b0 con 0x5646bc3d4760 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.037+0000 7f760f606640 1 -- 172.21.15.169:0/2597600888 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7714019430 con 0x5646bc3d4760 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f760f606640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7608036950 0x7f7608038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f760f606640 1 -- 172.21.15.169:0/2597600888 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f771404c810 con 0x5646bc3d4760 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f771a4f1640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7608036950 0x7f7608038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc3d5aa0 0x5646bc562170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5626b0 con 0x5646bc3d5aa0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f77234f3640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc3d5aa0 0x5646bc562170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f771a4f1640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7608036950 0x7f7608038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f770c054000 tx=0x7f770c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.038+0000 7f77234f3640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc3d5aa0 0x5646bc562170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f77234f3640 1 -- 172.21.15.169:0/2597600888 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc3d5aa0 2024-04-24T01:24:19.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc55f720 con 0x5646bc3d5aa0 2024-04-24T01:24:19.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f77234f3640 1 -- 172.21.15.169:0/2597600888 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc3d5aa0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc564980 0x5646bc566d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc567460 con 0x5646bc564980 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.039+0000 7f7722cf2640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc564980 0x5646bc566d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f7722cf2640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc564980 0x5646bc566d70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f7722cf2640 1 -- 172.21.15.169:0/2597600888 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f771402d070 con 0x5646bc564980 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc563900 con 0x5646bc3d5aa0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f77234f3640 1 -- 172.21.15.169:0/2597600888 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc3d5aa0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5646bc5688c0 0x5646bc56ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc56b4a0 con 0x5646bc5688c0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.040+0000 7f771a4f1640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5646bc5688c0 0x5646bc56ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f771a4f1640 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5646bc5688c0 0x5646bc56ad10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f771a4f1640 1 -- 172.21.15.169:0/2597600888 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f770c05a040 con 0x5646bc5688c0 2024-04-24T01:24:19.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f7726f33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.041+0000 7f7726f33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5646bc3516b0 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33022/0 (socket says 172.21.15.169:33022) 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7722cf2640 1 -- 172.21.15.169:0/1860798539 learned_addr learned my addr 172.21.15.169:0/1860798539 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7722cf2640 1 -- 172.21.15.169:0/1860798539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc57a240 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7722cf2640 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f771404ac60 tx=0x7f7714044dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f760ce01640 1 -- 172.21.15.169:0/1860798539 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7714041040 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f760ce01640 1 -- 172.21.15.169:0/1860798539 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7714018a00 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646bc57acb0 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f760ce01640 1 -- 172.21.15.169:0/1860798539 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77140443c0 con 0x5646bc5798e0 2024-04-24T01:24:19.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.042+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646bc57b1b0 con 0x5646bc5798e0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f760ce01640 1 -- 172.21.15.169:0/1860798539 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7714044560 con 0x5646bc5798e0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f760ce01640 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 0x7f75fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f760ce01640 1 -- 172.21.15.169:0/1860798539 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7714036070 con 0x5646bc5798e0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 0x7f75fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.043+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 0x7f75fc038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5646bc562f30 tx=0x7f770c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7726f33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7726f33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5646bc553ce0 con 0x5646bc586c50 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33032/0 (socket says 172.21.15.169:33032) 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7722cf2640 1 -- 172.21.15.169:0/193126340 learned_addr learned my addr 172.21.15.169:0/193126340 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7722cf2640 1 -- 172.21.15.169:0/193126340 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc587640 con 0x5646bc586c50 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f7722cf2640 1 --2- 172.21.15.169:0/193126340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7714025520 tx=0x7f771404cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533fe2f2c19b4f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f76067fc640 1 -- 172.21.15.169:0/193126340 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77140490e0 con 0x5646bc586c50 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f76067fc640 1 -- 172.21.15.169:0/193126340 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77140474a0 con 0x5646bc586c50 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.044+0000 7f76067fc640 1 -- 172.21.15.169:0/193126340 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7714049280 con 0x5646bc586c50 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- 172.21.15.169:0/193126340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 msgr2=0x5646bc587070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 --2- 172.21.15.169:0/193126340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7714025520 tx=0x7f771404cc60 comp rx=0 tx=0).stop 2024-04-24T01:24:19.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- 172.21.15.169:0/193126340 shutdown_connections 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 --2- 172.21.15.169:0/193126340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc587070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- 172.21.15.169:0/193126340 >> 172.21.15.169:0/193126340 conn(0x5646bc582f20 msgr2=0x5646bc580f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- 172.21.15.169:0/193126340 shutdown_connections 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- 172.21.15.169:0/193126340 wait complete. 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 Processor -- start 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- start start 2024-04-24T01:24:19.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7726f33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5646bc587d10 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7722cf2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33038/0 (socket says 172.21.15.169:33038) 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.045+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 learned_addr learned my addr 172.21.15.169:0/1249880419 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646bc58e5e0 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7722cf2640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7714050ff0 tx=0x7f7714036f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7604ff9640 1 -- 172.21.15.169:0/1249880419 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771404ce20 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7604ff9640 1 -- 172.21.15.169:0/1249880419 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f771402b060 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646bc58e5e0 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7604ff9640 1 -- 172.21.15.169:0/1249880419 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f771402b340 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.046+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646bc58e5e0 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7604ff9640 1 -- 172.21.15.169:0/1249880419 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7714030440 con 0x5646bc586c50 2024-04-24T01:24:19.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7604ff9640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75ec036900 0x7f75ec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7604ff9640 1 -- 172.21.15.169:0/1249880419 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7714066070 con 0x5646bc586c50 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75ec036900 0x7f75ec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75ec036900 0x7f75ec038dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5646bc56b8a0 tx=0x7f770c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc599760 0x5646bc59bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59c370 con 0x5646bc599760 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.047+0000 7f77234f3640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc599760 0x5646bc59bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f77234f3640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc599760 0x5646bc59bc20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 realm 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59c780 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d050 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.048+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc59e150 0x5646bc5a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a0b50 con 0x5646bc59e150 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7722cf2640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc59e150 0x5646bc5a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7722cf2640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc59e150 0x5646bc5a0540 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 20 searching for the correct realm 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.049+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5646bc5a2b00 0x5646bc5a4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a5690 con 0x5646bc5a2b00 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5646bc5a2b00 0x5646bc5a4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5646bc5a2b00 0x5646bc5a4fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f771a4f1640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f770c085040 0x7f770c076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a5690 con 0x7f770c085040 2024-04-24T01:24:19.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.050+0000 7f77234f3640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f770c085040 0x7f770c076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f77234f3640 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f770c085040 0x7f770c076430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.051+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x7f770c085040 2024-04-24T01:24:19.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.052+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.053+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x7f770c085040 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.054+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.055+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x7f770c085040 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.056+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.057+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x7f770c085040 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc59e150 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x5646bc599760 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.058+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5646bc59d3f0 con 0x7f770c085040 2024-04-24T01:24:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a1410 con 0x5646bc599760 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a1410 con 0x5646bc599760 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a1410 con 0x7f770c085040 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 zone default found 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 4 Realm: () 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 zonegroup default 2024-04-24T01:24:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.059+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a1cb0 con 0x5646bc59e150 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a74f0 con 0x5646bc5a2b00 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a7890 con 0x5646bc5a2b00 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 started sync module instance, tier type = 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.060+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a6990 con 0x7f770c085040 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.061+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.062+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94861807742336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a6990 con 0x7f770c085040 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.062+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a8120 con 0x5646bc599760 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.062+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94861807742336] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.063+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.063+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94861807746096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a6990 con 0x5646bc599760 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.063+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a8bb0 con 0x5646bc5a2b00 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.064+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94861807746096] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.064+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.064+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94861807740128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a6900 con 0x5646bc5a2b00 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.064+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a9970 con 0x7f770c085040 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.065+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94861807740128] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.065+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.065+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94861807751072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a9d60 con 0x7f770c085040 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.065+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5aa760 con 0x5646bc599760 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.067+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.068+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94861807755888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5aa690 con 0x5646bc599760 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.068+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab690 con 0x5646bc59e150 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.070+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94861807751072] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.070+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.071+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94861807752128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5abab0 con 0x5646bc59e150 2024-04-24T01:24:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.071+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ac470 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.073+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94861807755888] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.073+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.073+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94861807758160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5accc0 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.073+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ad680 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94861807768016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5adaa0 con 0x5646bc59e150 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 20 add_watcher() i=0 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 20 add_watcher() i=1 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 20 add_watcher() i=2 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 20 add_watcher() i=3 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.074+0000 7f7726f33800 20 add_watcher() i=4 2024-04-24T01:24:19.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.075+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94861807768016] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.076+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(55 notify.5 [watch watch cookie 94861807752128] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.076+0000 7f7726f33800 20 add_watcher() i=5 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94861807758160] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7726f33800 20 add_watcher() i=6 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7726f33800 20 add_watcher() i=7 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7726f33800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ad5f0 con 0x5646bc599760 2024-04-24T01:24:19.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.079+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94861807759776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ad5f0 con 0x5646bc599760 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94861807759776] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f75d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f7726f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f7726f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f7726f33800 5 note: GC not initialized 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.080+0000 7f7553fff640 20 reqs_thread_entry: start 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 Filter name: none 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7551ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:19.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e3850 con 0x5646bc599760 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e1ff0 con 0x5646bc599760 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.081+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e1ff0 con 0x5646bc59e150 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.082+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e2980 con 0x5646bc599760 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f7726f33800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f7726f33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94861807985712 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e7390 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== watch-notify(notify (1) cookie 94861807755888 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x5646bc5e2d20 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f76067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94861807755888 notifier 4290 bl.length()=567 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(66 notify.4 [notify cookie 94861807985712 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f76067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f76067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f76067fc640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f75e8003ea0 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify_complete (2) cookie 94861807985712 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5646bc5e3470 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.083+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e2430 con 0x5646bc599760 2024-04-24T01:24:19.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f7726f33800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f7726f33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94861807985712 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e77c0 con 0x7f770c085040 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== watch-notify(notify (1) cookie 94861807751072 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5646bc5e3470 con 0x7f770c085040 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f76067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94861807751072 notifier 4290 bl.length()=169 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f76067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f76067fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(69 notify.3 [notify cookie 94861807985712 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.085+0000 7f76067fc640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f75e8003ea0 con 0x7f770c085040 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.086+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.086+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== watch-notify(notify_complete (2) cookie 94861807985712 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f771c044710 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.086+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e5430 con 0x5646bc59e150 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7726f33800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7726f33800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7726f33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94861807996448 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e5430 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== watch-notify(notify (1) cookie 94861807751072 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f771c044710 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7605ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94861807751072 notifier 4290 bl.length()=177 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(72 notify.3 [notify cookie 94861807996448 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7605ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7605ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.087+0000 7f7605ffb640 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7558003400 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.088+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== watch-notify(notify_complete (2) cookie 94861807996448 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f771c044bc0 con 0x7f770c085040 2024-04-24T01:24:19.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.088+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.098 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:19.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.088+0000 7f75d97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.088+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94861807759776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5e4980 con 0x5646bc599760 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.089+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94861807759776] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.089+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94861807742336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab1a0 con 0x7f770c085040 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.090+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94861807742336] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.090+0000 7f7726f33800 20 remove_watcher() i=0 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.090+0000 7f7726f33800 2 removed watcher, disabling cache 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.090+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94861807746096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab1a0 con 0x5646bc599760 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.091+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94861807746096] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.091+0000 7f7726f33800 20 remove_watcher() i=1 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.091+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94861807740128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a7c30 con 0x5646bc5a2b00 2024-04-24T01:24:19.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.092+0000 7f771a4f1640 1 -- 172.21.15.169:0/1249880419 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94861807740128] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f770c073070 con 0x5646bc5a2b00 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.092+0000 7f7726f33800 20 remove_watcher() i=2 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.092+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94861807751072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab1a0 con 0x7f770c085040 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.093+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94861807751072] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x7f770c085040 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.093+0000 7f7726f33800 20 remove_watcher() i=3 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.093+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94861807755888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5a8fa0 con 0x5646bc599760 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.094+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94861807755888] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771c00a4a0 con 0x5646bc599760 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.094+0000 7f7726f33800 20 remove_watcher() i=4 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.094+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94861807752128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab1a0 con 0x5646bc59e150 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.095+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94861807752128] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.095+0000 7f7726f33800 20 remove_watcher() i=5 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.095+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94861807758160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5aa270 con 0x5646bc59e150 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.096+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94861807758160] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.096+0000 7f7726f33800 20 remove_watcher() i=6 2024-04-24T01:24:19.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.096+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94861807768016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5646bc5ab1a0 con 0x5646bc59e150 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7722cf2640 1 -- 172.21.15.169:0/1249880419 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94861807768016] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f771406f020 con 0x5646bc59e150 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 20 remove_watcher() i=7 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc59e150 msgr2=0x5646bc5a0540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc59e150 0x5646bc5a0540 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc599760 msgr2=0x5646bc59bc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc599760 0x5646bc59bc20 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f770c085040 msgr2=0x7f770c076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.097+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f770c085040 0x7f770c076430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5646bc5a2b00 msgr2=0x5646bc5a4fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5646bc5a2b00 0x5646bc5a4fc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75ec036900 msgr2=0x7f75ec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75ec036900 0x7f75ec038dc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x5646bc56b8a0 tx=0x7f770c04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 msgr2=0x5646bc58e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f77234f3640 1 -- 172.21.15.169:0/1249880419 reap_dead start 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7714050ff0 tx=0x7f7714036f30 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 shutdown_connections 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1249880419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc586c50 0x5646bc58e0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 >> 172.21.15.169:0/1249880419 conn(0x5646bc582f20 msgr2=0x5646bc580580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 shutdown_connections 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1249880419 wait complete. 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 msgr2=0x7f75fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 0x7f75fc038e10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x5646bc562f30 tx=0x7f770c005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 msgr2=0x5646bc579d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f771404ac60 tx=0x7f7714044dc0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 shutdown_connections 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f75fc036950 0x7f75fc038e10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 --2- 172.21.15.169:0/1860798539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc5798e0 0x5646bc579d00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 >> 172.21.15.169:0/1860798539 conn(0x5646bc56d980 msgr2=0x5646bc56dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 shutdown_connections 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/1860798539 wait complete. 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.098+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc564980 msgr2=0x5646bc566d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5646bc564980 0x5646bc566d70 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc3d5aa0 msgr2=0x5646bc562170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5646bc3d5aa0 0x5646bc562170 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5646bc5688c0 msgr2=0x5646bc56ad10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5646bc5688c0 0x5646bc56ad10 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7608036950 msgr2=0x7f7608038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7608036950 0x7f7608038e10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f770c054000 tx=0x7f770c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 msgr2=0x5646bc55af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 --2- 172.21.15.169:0/2597600888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5646bc3d4760 0x5646bc55af30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7714000c00 tx=0x7f7714000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f77234f3640 1 -- 172.21.15.169:0/2597600888 reap_dead start 2024-04-24T01:24:19.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 shutdown_connections 2024-04-24T01:24:19.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 >> 172.21.15.169:0/2597600888 conn(0x5646bc45b4d0 msgr2=0x5646bc54d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 shutdown_connections 2024-04-24T01:24:19.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.099+0000 7f7726f33800 1 -- 172.21.15.169:0/2597600888 wait complete. 2024-04-24T01:24:19.110 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:19.110 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T01:24:19.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-04-24T01:24:19.110 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-04-24T01:24:19.156 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.157 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.156+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.156+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.156+0000 7fb4a7e06800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619c976d2a0 0x5619c9775da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.156+0000 7fb4a7e06800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5619c962bd40 con 0x5619c976b760 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.156+0000 7fb4a7e06800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5619c95fe4d0 con 0x5619c976d2a0 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb49d104640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619c976d2a0 0x5619c9775da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb4a5905640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5619c976b760 0x5619c976bb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34614/0 (socket says 172.21.15.169:34614) 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb4a5905640 1 -- 172.21.15.169:0/250393991 learned_addr learned my addr 172.21.15.169:0/250393991 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb49d104640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619c976d2a0 0x5619c9775da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33044/0 (socket says 172.21.15.169:33044) 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb49d104640 1 -- 172.21.15.169:0/250393991 >> v1:172.21.15.142:6789/0 conn(0x5619c976b760 legacy=0x5619c976bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.157+0000 7fb49d104640 1 -- 172.21.15.169:0/250393991 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c962a590 con 0x5619c976d2a0 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb49d104640 1 --2- 172.21.15.169:0/250393991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976d2a0 0x5619c9775da0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb49000a470 tx=0x7fb49001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab6507b63e5536 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a5104640 1 -- 172.21.15.169:0/250393991 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb490057070 con 0x5619c976d2a0 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a5104640 1 -- 172.21.15.169:0/250393991 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49004adc0 con 0x5619c976d2a0 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a5104640 1 -- 172.21.15.169:0/250393991 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb490052590 con 0x5619c976d2a0 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a7e06800 1 -- 172.21.15.169:0/250393991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976d2a0 msgr2=0x5619c9775da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/250393991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976d2a0 0x5619c9775da0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb49000a470 tx=0x7fb49001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a7e06800 1 -- 172.21.15.169:0/250393991 shutdown_connections 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/250393991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976d2a0 0x5619c9775da0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.159+0000 7fb4a7e06800 1 -- 172.21.15.169:0/250393991 >> 172.21.15.169:0/250393991 conn(0x5619c97673a0 msgr2=0x5619c97697c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.160+0000 7fb4a7e06800 1 -- 172.21.15.169:0/250393991 shutdown_connections 2024-04-24T01:24:19.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.160+0000 7fb4a7e06800 1 -- 172.21.15.169:0/250393991 wait complete. 2024-04-24T01:24:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.171+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.171+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.171+0000 7fb4a7e06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.171+0000 7fb4a7e06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619c96b83e0 con 0x5619c976b760 2024-04-24T01:24:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33054/0 (socket says 172.21.15.169:33054) 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb4a5905640 1 -- 172.21.15.169:0/3627533738 learned_addr learned my addr 172.21.15.169:0/3627533738 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb4a5905640 1 -- 172.21.15.169:0/3627533738 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c9860bd0 con 0x5619c976b760 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb4a5905640 1 --2- 172.21.15.169:0/3627533738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb498001de0 tx=0x7fb49800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f70bb470687edf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb393e07640 1 -- 172.21.15.169:0/3627533738 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb498012020 con 0x5619c976b760 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb393e07640 1 -- 172.21.15.169:0/3627533738 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49800e5a0 con 0x5619c976b760 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.172+0000 7fb393e07640 1 -- 172.21.15.169:0/3627533738 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49800e8c0 con 0x5619c976b760 2024-04-24T01:24:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 -- 172.21.15.169:0/3627533738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 msgr2=0x5619c9860600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/3627533738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb498001de0 tx=0x7fb49800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 -- 172.21.15.169:0/3627533738 shutdown_connections 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/3627533738 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9860600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 -- 172.21.15.169:0/3627533738 >> 172.21.15.169:0/3627533738 conn(0x5619c97673a0 msgr2=0x5619c985bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 -- 172.21.15.169:0/3627533738 shutdown_connections 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 -- 172.21.15.169:0/3627533738 wait complete. 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.173+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a7e06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9868120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a7e06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619c97785c0 con 0x5619c976b760 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9868120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9868120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33070/0 (socket says 172.21.15.169:33070) 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a5905640 1 -- 172.21.15.169:0/2880229371 learned_addr learned my addr 172.21.15.169:0/2880229371 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a5905640 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c9868660 con 0x5619c976b760 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9868120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb49800c010 tx=0x7fb498000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb392604640 1 -- 172.21.15.169:0/2880229371 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb498012070 con 0x5619c976b760 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb392604640 1 -- 172.21.15.169:0/2880229371 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49801a7a0 con 0x5619c976b760 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619c98688f0 con 0x5619c976b760 2024-04-24T01:24:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb392604640 1 -- 172.21.15.169:0/2880229371 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49801aa80 con 0x5619c976b760 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.174+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c986b5a0 con 0x5619c976b760 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.175+0000 7fb392604640 1 -- 172.21.15.169:0/2880229371 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb498015020 con 0x5619c976b760 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.175+0000 7fb392604640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb38c036950 0x7fb38c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.175+0000 7fb392604640 1 -- 172.21.15.169:0/2880229371 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb498020070 con 0x5619c976b760 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb49d104640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb38c036950 0x7fb38c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c976d2a0 0x5619c986f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c986f8a0 con 0x5619c976d2a0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c976d2a0 0x5619c986f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb49d104640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb38c036950 0x7fb38c038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb490054000 tx=0x7fb49004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c976d2a0 0x5619c986f360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a6106640 1 -- 172.21.15.169:0/2880229371 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c976d2a0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.176+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c986c930 con 0x5619c976d2a0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a6106640 1 -- 172.21.15.169:0/2880229371 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c976d2a0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c9871bf0 0x5619c9873fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98746d0 con 0x5619c9871bf0 2024-04-24T01:24:19.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c9871bf0 0x5619c9873fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c9871bf0 0x5619c9873fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a5905640 1 -- 172.21.15.169:0/2880229371 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb49802b070 con 0x5619c9871bf0 2024-04-24T01:24:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.177+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c9870ba0 con 0x5619c976d2a0 2024-04-24T01:24:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb4a6106640 1 -- 172.21.15.169:0/2880229371 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c976d2a0 2024-04-24T01:24:19.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5619c9875b80 0x5619c9877fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c9878730 con 0x5619c9875b80 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb49d104640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5619c9875b80 0x5619c9877fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb49d104640 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5619c9875b80 0x5619c9877fd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.178+0000 7fb49d104640 1 -- 172.21.15.169:0/2880229371 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb49005a040 con 0x5619c9875b80 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a7e06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a7e06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619c965e6b0 con 0x5619c9886b70 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33074/0 (socket says 172.21.15.169:33074) 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a5905640 1 -- 172.21.15.169:0/722458520 learned_addr learned my addr 172.21.15.169:0/722458520 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a5905640 1 -- 172.21.15.169:0/722458520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c98874d0 con 0x5619c9886b70 2024-04-24T01:24:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb4a5905640 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb49804aa30 tx=0x7fb49804ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.179+0000 7fb38b7fe640 1 -- 172.21.15.169:0/722458520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49804c3f0 con 0x5619c9886b70 2024-04-24T01:24:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb38b7fe640 1 -- 172.21.15.169:0/722458520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4980490e0 con 0x5619c9886b70 2024-04-24T01:24:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619c9887f40 con 0x5619c9886b70 2024-04-24T01:24:19.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb38b7fe640 1 -- 172.21.15.169:0/722458520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb4980493c0 con 0x5619c9886b70 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c9887f40 con 0x5619c9886b70 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb38b7fe640 1 -- 172.21.15.169:0/722458520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb498044000 con 0x5619c9886b70 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb38b7fe640 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 0x7fb380038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb38b7fe640 1 -- 172.21.15.169:0/722458520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb49800a830 con 0x5619c9886b70 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.180+0000 7fb49d104640 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 0x7fb380038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb49d104640 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 0x7fb380038fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb490055040 tx=0x7fb490005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a7e06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a7e06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619c9860f50 con 0x5619c9893b50 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33080/0 (socket says 172.21.15.169:33080) 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a5905640 1 -- 172.21.15.169:0/2977578607 learned_addr learned my addr 172.21.15.169:0/2977578607 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a5905640 1 -- 172.21.15.169:0/2977578607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c9894540 con 0x5619c9893b50 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2977578607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb49801a6f0 tx=0x7fb498049560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8543c8c8358c417 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.181+0000 7fb3897fa640 1 -- 172.21.15.169:0/2977578607 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49805c070 con 0x5619c9893b50 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb3897fa640 1 -- 172.21.15.169:0/2977578607 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49800a620 con 0x5619c9893b50 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb3897fa640 1 -- 172.21.15.169:0/2977578607 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49803d070 con 0x5619c9893b50 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2977578607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 msgr2=0x5619c9893f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2977578607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb49801a6f0 tx=0x7fb498049560 comp rx=0 tx=0).stop 2024-04-24T01:24:19.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2977578607 shutdown_connections 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2977578607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c9893f70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2977578607 >> 172.21.15.169:0/2977578607 conn(0x5619c988fe20 msgr2=0x5619c988de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2977578607 shutdown_connections 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2977578607 wait complete. 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 Processor -- start 2024-04-24T01:24:19.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.182+0000 7fb4a7e06800 1 -- start start 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a7e06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a7e06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619c9894ba0 con 0x5619c9893b50 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a5905640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33084/0 (socket says 172.21.15.169:33084) 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 learned_addr learned my addr 172.21.15.169:0/2415486846 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619c989b400 con 0x5619c9893b50 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bc10 tx=0x7fb49800a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb3777fe640 1 -- 172.21.15.169:0/2415486846 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb498067020 con 0x5619c9893b50 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb3777fe640 1 -- 172.21.15.169:0/2415486846 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49800d3d0 con 0x5619c9893b50 2024-04-24T01:24:19.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619c989b400 con 0x5619c9893b50 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb3777fe640 1 -- 172.21.15.169:0/2415486846 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb49805c040 con 0x5619c9893b50 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.183+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619c989b400 con 0x5619c9893b50 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.184+0000 7fb3777fe640 1 -- 172.21.15.169:0/2415486846 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb49806a020 con 0x5619c9893b50 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.184+0000 7fb3777fe640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb370036950 0x7fb370038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.184+0000 7fb3777fe640 1 -- 172.21.15.169:0/2415486846 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb498052030 con 0x5619c9893b50 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.184+0000 7fb49d104640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb370036950 0x7fb370038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb49d104640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb370036950 0x7fb370038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5619c9878b30 tx=0x7fb49004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c98a6630 0x5619c98a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98a9240 con 0x5619c98a6630 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c98a6630 0x5619c98a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c98a6630 0x5619c98a8af0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 20 realm 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.185+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98a9650 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98a9f20 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c98ab020 0x5619c98ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ad9d0 con 0x5619c98ab020 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.186+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c98ab020 0x5619c98ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a5905640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c98ab020 0x5619c98ad410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a7e06800 20 searching for the correct realm 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5619c98af980 0x5619c98b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b2510 con 0x5619c98af980 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb49d104640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5619c98af980 0x5619c98b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.187+0000 7fb49d104640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5619c98af980 0x5619c98b1e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb49d104640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb49005c410 0x7fb49005c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b2510 con 0x7fb49005c410 2024-04-24T01:24:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb49005c410 0x7fb49005c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb4a6106640 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb49005c410 0x7fb49005c850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.188+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.189+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x7fb49005c410 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.190+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.223 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x7fb49005c410 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.191+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.192+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.193+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x7fb49005c410 2024-04-24T01:24:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.194+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x7fb49005c410 2024-04-24T01:24:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98af980 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.195+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98ab020 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x5619c98a6630 2024-04-24T01:24:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aa2c0 con 0x7fb49005c410 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ae290 con 0x5619c98a6630 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.196+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ae290 con 0x5619c98a6630 2024-04-24T01:24:19.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ae290 con 0x7fb49005c410 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 zone default found 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 4 Realm: () 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 zonegroup default 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98aeb80 con 0x5619c98ab020 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.197+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b4370 con 0x5619c98af980 2024-04-24T01:24:19.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b4710 con 0x5619c98af980 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 20 started sync module instance, tier type = 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.198+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b3810 con 0x7fb49005c410 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.199+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.199+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94668755516416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b3810 con 0x7fb49005c410 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.199+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b50d0 con 0x5619c98a6630 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.200+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94668755516416] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.200+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.200+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94668755514688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b50d0 con 0x5619c98a6630 2024-04-24T01:24:19.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.200+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b5a90 con 0x5619c98af980 2024-04-24T01:24:19.250 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.201+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94668755514688] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.201+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.201+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94668755520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b5040 con 0x5619c98af980 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.202+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b6900 con 0x7fb49005c410 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94668755520544] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94668755526736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b6d20 con 0x7fb49005c410 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b76e0 con 0x5619c98a6630 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.203+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94668755530288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b7b00 con 0x5619c98a6630 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.204+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b8580 con 0x5619c98ab020 2024-04-24T01:24:19.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.204+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94668755526736] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.204+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94668755530288] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.205+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.205+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94668755527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b7b00 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.205+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b8e50 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.206+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.206+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94668755538416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b9ac0 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.206+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ba4c0 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.206+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94668755527792] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94668755538416] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94668755531344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ba480 con 0x5619c98ab020 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=0 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=1 2024-04-24T01:24:19.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=2 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=3 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=4 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=5 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=6 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94668755531344] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 20 add_watcher() i=7 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.207+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ba480 con 0x5619c98a6630 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.208+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.208+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94668755541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ba430 con 0x5619c98a6630 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94668755541968] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb3577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a7e06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a7e06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a7e06800 5 note: GC not initialized 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb3567fc640 20 reqs_thread_entry: start 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a7e06800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.209+0000 7fb4a7e06800 20 Filter name: none 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb2c7fff640 20 reqs_thread_entry: start 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98f06b0 con 0x5619c98ab020 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:19.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.210+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98eee50 con 0x5619c98a6630 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=7 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5619c98ef240 con 0x5619c98a6630 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:19.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.211+0000 7fb4a7e06800 20 get_user_info_from_index found 0 xattrs 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.212+0000 7fb3577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.212+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94668755541968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98a2800 con 0x5619c98a6630 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.213+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94668755541968] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.213+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94668755516416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b9fd0 con 0x7fb49005c410 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.214+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94668755516416] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.214+0000 7fb4a7e06800 20 remove_watcher() i=0 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.214+0000 7fb4a7e06800 2 removed watcher, disabling cache 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.214+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94668755514688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b9fd0 con 0x5619c98a6630 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.215+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94668755514688] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.215+0000 7fb4a7e06800 20 remove_watcher() i=1 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.215+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94668755520544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b9fd0 con 0x5619c98af980 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.216+0000 7fb49d104640 1 -- 172.21.15.169:0/2415486846 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94668755520544] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49005a040 con 0x5619c98af980 2024-04-24T01:24:19.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.216+0000 7fb4a7e06800 20 remove_watcher() i=2 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.216+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94668755526736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b4c20 con 0x7fb49005c410 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.217+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94668755526736] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x7fb49005c410 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.217+0000 7fb4a7e06800 20 remove_watcher() i=3 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.217+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94668755530288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b6450 con 0x5619c98a6630 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.218+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94668755530288] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb4a000a4a0 con 0x5619c98a6630 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.218+0000 7fb4a7e06800 20 remove_watcher() i=4 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.218+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94668755527792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b4c20 con 0x5619c98ab020 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94668755527792] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a7e06800 20 remove_watcher() i=5 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94668755538416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b7230 con 0x5619c98ab020 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94668755538416] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a7e06800 20 remove_watcher() i=6 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.219+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94668755531344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5619c98b4c20 con 0x5619c98ab020 2024-04-24T01:24:19.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.220+0000 7fb4a5905640 1 -- 172.21.15.169:0/2415486846 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94668755531344] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb49802b070 con 0x5619c98ab020 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.220+0000 7fb4a7e06800 20 remove_watcher() i=7 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c98ab020 msgr2=0x5619c98ad410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c98ab020 0x5619c98ad410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c98a6630 msgr2=0x5619c98a8af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c98a6630 0x5619c98a8af0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb49005c410 msgr2=0x7fb49005c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb49005c410 0x7fb49005c850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5619c98af980 msgr2=0x5619c98b1e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5619c98af980 0x5619c98b1e40 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb370036950 msgr2=0x7fb370038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb370036950 0x7fb370038e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x5619c9878b30 tx=0x7fb49004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 msgr2=0x5619c989aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb49800bc10 tx=0x7fb49800a4d0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a6106640 1 -- 172.21.15.169:0/2415486846 reap_dead start 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 shutdown_connections 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2415486846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9893b50 0x5619c989aec0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 >> 172.21.15.169:0/2415486846 conn(0x5619c988fe20 msgr2=0x5619c988d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 shutdown_connections 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2415486846 wait complete. 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 msgr2=0x7fb380038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 0x7fb380038fb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb490055040 tx=0x7fb490005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 msgr2=0x5619c9886f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb49804aa30 tx=0x7fb49804ac30 comp rx=0 tx=0).stop 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 shutdown_connections 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb380036af0 0x7fb380038fb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/722458520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c9886b70 0x5619c9886f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 >> 172.21.15.169:0/722458520 conn(0x5619c987ac10 msgr2=0x5619c987b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 shutdown_connections 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.221+0000 7fb4a7e06800 1 -- 172.21.15.169:0/722458520 wait complete. 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c9871bf0 msgr2=0x5619c9873fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619c9871bf0 0x5619c9873fe0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c976d2a0 msgr2=0x5619c986f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619c976d2a0 0x5619c986f360 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5619c9875b80 msgr2=0x5619c9877fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5619c9875b80 0x5619c9877fd0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb38c036950 msgr2=0x7fb38c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb38c036950 0x7fb38c038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb490054000 tx=0x7fb49004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 msgr2=0x5619c9868120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 --2- 172.21.15.169:0/2880229371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619c976b760 0x5619c9868120 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb49800c010 tx=0x7fb498000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a6106640 1 -- 172.21.15.169:0/2880229371 reap_dead start 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 shutdown_connections 2024-04-24T01:24:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 >> 172.21.15.169:0/2880229371 conn(0x5619c97673a0 msgr2=0x5619c985a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 shutdown_connections 2024-04-24T01:24:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.222+0000 7fb4a7e06800 1 -- 172.21.15.169:0/2880229371 wait complete. 2024-04-24T01:24:19.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.261 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:19.304 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.304 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.303+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.303+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7797175800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b11058b1c0 0x55b11061a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7797175800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1104d6d40 con 0x55b11061af50 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7797175800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b1104a94d0 con 0x55b11058b1c0 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7794c74640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b11058b1c0 0x55b11061a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7794473640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b11061af50 0x55b11061d410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34622/0 (socket says 172.21.15.169:34622) 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7794473640 1 -- 172.21.15.169:0/972685868 learned_addr learned my addr 172.21.15.169:0/972685868 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7794c74640 1 -- 172.21.15.169:0/972685868 >> v1:172.21.15.142:6789/0 conn(0x55b11061af50 legacy=0x55b11061d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7793c72640 1 -- 172.21.15.169:0/972685868 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588572410 0 0) 0x55b1104d6d40 con 0x55b11061af50 2024-04-24T01:24:19.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.304+0000 7f7794c74640 1 -- 172.21.15.169:0/972685868 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1104d5590 con 0x55b11058b1c0 2024-04-24T01:24:19.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.306+0000 7f7794c74640 1 --2- 172.21.15.169:0/972685868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b11061a9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f778400a470 tx=0x7f778401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39100b8bb4bf7ec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.306+0000 7f7793c72640 1 -- 172.21.15.169:0/972685868 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784057070 con 0x55b11058b1c0 2024-04-24T01:24:19.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.306+0000 7f7793c72640 1 -- 172.21.15.169:0/972685868 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784052570 con 0x55b11058b1c0 2024-04-24T01:24:19.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.306+0000 7f7793c72640 1 -- 172.21.15.169:0/972685868 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784052870 con 0x55b11058b1c0 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 -- 172.21.15.169:0/972685868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 msgr2=0x55b11061a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 --2- 172.21.15.169:0/972685868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b11061a9e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f778400a470 tx=0x7f778401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 -- 172.21.15.169:0/972685868 shutdown_connections 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 --2- 172.21.15.169:0/972685868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b11061a9e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 -- 172.21.15.169:0/972685868 >> 172.21.15.169:0/972685868 conn(0x55b110612380 msgr2=0x55b1106147a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 -- 172.21.15.169:0/972685868 shutdown_connections 2024-04-24T01:24:19.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.307+0000 7f7797175800 1 -- 172.21.15.169:0/972685868 wait complete. 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.318+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7797175800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7797175800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b1105633c0 con 0x55b11058b1c0 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33104/0 (socket says 172.21.15.169:33104) 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7794c74640 1 -- 172.21.15.169:0/2948574545 learned_addr learned my addr 172.21.15.169:0/2948574545 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7794c74640 1 -- 172.21.15.169:0/2948574545 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1107094f0 con 0x55b11058b1c0 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.319+0000 7f7794c74640 1 --2- 172.21.15.169:0/2948574545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7784055040 tx=0x7f778404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2d2441289c7c9d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7682e0d640 1 -- 172.21.15.169:0/2948574545 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784057070 con 0x55b11058b1c0 2024-04-24T01:24:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7682e0d640 1 -- 172.21.15.169:0/2948574545 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784063070 con 0x55b11058b1c0 2024-04-24T01:24:19.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7682e0d640 1 -- 172.21.15.169:0/2948574545 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784052720 con 0x55b11058b1c0 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 -- 172.21.15.169:0/2948574545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 msgr2=0x55b110708f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 --2- 172.21.15.169:0/2948574545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7784055040 tx=0x7f778404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 -- 172.21.15.169:0/2948574545 shutdown_connections 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 --2- 172.21.15.169:0/2948574545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110708f20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 -- 172.21.15.169:0/2948574545 >> 172.21.15.169:0/2948574545 conn(0x55b110612380 msgr2=0x55b110704840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 -- 172.21.15.169:0/2948574545 shutdown_connections 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.320+0000 7f7797175800 1 -- 172.21.15.169:0/2948574545 wait complete. 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7797175800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110710960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7797175800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b11061efa0 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110710960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110710960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33116/0 (socket says 172.21.15.169:33116) 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7794c74640 1 -- 172.21.15.169:0/4110548220 learned_addr learned my addr 172.21.15.169:0/4110548220 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.321+0000 7f7794c74640 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b110710ea0 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f7794c74640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110710960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7784060040 tx=0x7f7784002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f768160a640 1 -- 172.21.15.169:0/4110548220 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784052e30 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f768160a640 1 -- 172.21.15.169:0/4110548220 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778406c070 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f768160a640 1 -- 172.21.15.169:0/4110548220 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f778405e5f0 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b110711130 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.322+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b110713de0 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f768160a640 1 -- 172.21.15.169:0/4110548220 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f778405e790 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f768160a640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f767c036900 0x7f767c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f768160a640 1 -- 172.21.15.169:0/4110548220 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f778408e8f0 con 0x55b11058b1c0 2024-04-24T01:24:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7794473640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f767c036900 0x7f767c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11061af50 0x55b110717ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1107180e0 con 0x55b11061af50 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7795475640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11061af50 0x55b110717ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7794473640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f767c036900 0x7f767c038dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7788000c00 tx=0x7f77880013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.323+0000 7f7795475640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11061af50 0x55b110717ba0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7795475640 1 -- 172.21.15.169:0/4110548220 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11061af50 2024-04-24T01:24:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110715150 con 0x55b11061af50 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7795475640 1 -- 172.21.15.169:0/4110548220 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11061af50 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b11071a410 0x55b11071c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b11071ced0 con 0x55b11071a410 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7794c74640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b11071a410 0x55b11071c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.324+0000 7f7794c74640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b11071a410 0x55b11071c800 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7794c74640 1 -- 172.21.15.169:0/4110548220 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7784071990 con 0x55b11071a410 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1107193c0 con 0x55b11061af50 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7795475640 1 -- 172.21.15.169:0/4110548220 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11061af50 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b11071e310 0x55b1107207d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110720f60 con 0x55b11071e310 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7794473640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b11071e310 0x55b1107207d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.325+0000 7f7794473640 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b11071e310 0x55b1107207d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7794473640 1 -- 172.21.15.169:0/4110548220 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f778800f670 con 0x55b11071e310 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7797175800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7797175800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b1105096b0 con 0x55b11072f410 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.326+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33122/0 (socket says 172.21.15.169:33122) 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7794c74640 1 -- 172.21.15.169:0/3909725673 learned_addr learned my addr 172.21.15.169:0/3909725673 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7794c74640 1 -- 172.21.15.169:0/3909725673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11072fd70 con 0x55b11072f410 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7794c74640 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77840529c0 tx=0x7f7784067500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f767a7fc640 1 -- 172.21.15.169:0/3909725673 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7784092030 con 0x55b11072f410 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f767a7fc640 1 -- 172.21.15.169:0/3909725673 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784058040 con 0x55b11072f410 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1107307e0 con 0x55b11072f410 2024-04-24T01:24:19.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f767a7fc640 1 -- 172.21.15.169:0/3909725673 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77840099f0 con 0x55b11072f410 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.327+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b110730ce0 con 0x55b11072f410 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f767a7fc640 1 -- 172.21.15.169:0/3909725673 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7784095070 con 0x55b11072f410 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f767a7fc640 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 0x7f766c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f767a7fc640 1 -- 172.21.15.169:0/3909725673 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f7784093070 con 0x55b11072f410 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f7794473640 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 0x7f766c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f7794473640 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 0x7f766c038dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55b1107185b0 tx=0x7f7788006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.328+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7797175800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7797175800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b1107097b0 con 0x55b11073c580 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33134/0 (socket says 172.21.15.169:33134) 2024-04-24T01:24:19.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7794c74640 1 -- 172.21.15.169:0/3236855479 learned_addr learned my addr 172.21.15.169:0/3236855479 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7794c74640 1 -- 172.21.15.169:0/3236855479 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b11073cf70 con 0x55b11073c580 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f7794c74640 1 --2- 172.21.15.169:0/3236855479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77840675d0 tx=0x7f77840023d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704c2831ee96efe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f766bfff640 1 -- 172.21.15.169:0/3236855479 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77840aa020 con 0x55b11073c580 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f766bfff640 1 -- 172.21.15.169:0/3236855479 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778408e390 con 0x55b11073c580 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.329+0000 7f766bfff640 1 -- 172.21.15.169:0/3236855479 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f778408e6b0 con 0x55b11073c580 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- 172.21.15.169:0/3236855479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 msgr2=0x55b11073c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 --2- 172.21.15.169:0/3236855479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f77840675d0 tx=0x7f77840023d0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- 172.21.15.169:0/3236855479 shutdown_connections 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 --2- 172.21.15.169:0/3236855479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b11073c9a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- 172.21.15.169:0/3236855479 >> 172.21.15.169:0/3236855479 conn(0x55b110738890 msgr2=0x55b1107368f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- 172.21.15.169:0/3236855479 shutdown_connections 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- 172.21.15.169:0/3236855479 wait complete. 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 Processor -- start 2024-04-24T01:24:19.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- start start 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7797175800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b11073d600 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7794c74640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33150/0 (socket says 172.21.15.169:33150) 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.330+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 learned_addr learned my addr 172.21.15.169:0/3955101475 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b110743ed0 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f7794c74640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f778404b3b0 tx=0x7f7784089eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f766a7fc640 1 -- 172.21.15.169:0/3955101475 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77840bf070 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f766a7fc640 1 -- 172.21.15.169:0/3955101475 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784084ab0 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b110743ed0 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f766a7fc640 1 -- 172.21.15.169:0/3955101475 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77840666b0 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.331+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b110743ed0 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f766a7fc640 1 -- 172.21.15.169:0/3955101475 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f77840c2070 con 0x55b11073c580 2024-04-24T01:24:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f766a7fc640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7660036950 0x7f7660038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f766a7fc640 1 -- 172.21.15.169:0/3955101475 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f77840b5030 con 0x55b11073c580 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7794473640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7660036950 0x7f7660038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11074ee60 0x55b110751320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110751a70 con 0x55b11074ee60 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7795475640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11074ee60 0x55b110751320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.332+0000 7f7794473640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7660036950 0x7f7660038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b110721360 tx=0x7f7788023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7795475640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11074ee60 0x55b110751320 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 realm 2024-04-24T01:24:19.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110751e80 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110752750 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.333+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b1107535e0 0x55b1107559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110756110 con 0x55b1107535e0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7794c74640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b1107535e0 0x55b1107559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7794c74640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b1107535e0 0x55b1107559d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 20 searching for the correct realm 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b1107581b0 0x55b11075a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.334+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b11075ad40 con 0x55b1107581b0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7794473640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b1107581b0 0x55b11075a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7794473640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b1107581b0 0x55b11075a670 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7794473640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f778803a3c0 0x7f778803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b11075ad40 con 0x7f778803a3c0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.335+0000 7f7795475640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f778803a3c0 0x7f778803a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f778803a3c0 0x7f778803a810 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.336+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x7f778803a3c0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.337+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x7f778803a3c0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.338+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.339+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.340+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x7f778803a3c0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.341+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x7f778803a3c0 2024-04-24T01:24:19.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107581b0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.342+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b1107535e0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x55b11074ee60 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b110752af0 con 0x7f778803a3c0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.343+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110756ab0 con 0x55b11074ee60 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110756ab0 con 0x55b11074ee60 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110756a60 con 0x7f778803a3c0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 zone default found 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 4 Realm: () 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 zonegroup default 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.344+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b110756ea0 con 0x55b1107535e0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b11075cba0 con 0x55b1107581b0 2024-04-24T01:24:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b11075cf40 con 0x55b1107581b0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 started sync module instance, tier type = 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.345+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075c040 con 0x7f778803a3c0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.346+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.346+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94218973725792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075c040 con 0x7f778803a3c0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.346+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d790 con 0x55b11074ee60 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.347+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94218973725792] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.347+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.347+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94218973723808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d790 con 0x55b11074ee60 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.347+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075e150 con 0x55b1107581b0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.349+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94218973723808] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.349+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.349+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94218973729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d700 con 0x55b1107581b0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.349+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075efc0 con 0x7f778803a3c0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.350+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94218973729504] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.350+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.350+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94218973735696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075f3e0 con 0x7f778803a3c0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.350+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075fda0 con 0x55b11074ee60 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.351+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.351+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94218973735696] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.351+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94218973739248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1107601c0 con 0x55b11074ee60 2024-04-24T01:24:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.351+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075ef50 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.352+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94218973739248] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.352+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.352+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94218973740784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110760be0 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.352+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110761470 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.353+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94218973740784] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.353+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.353+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94218973742896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110761d10 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.353+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1107626d0 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94218973742896] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94218973747776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1107626d0 con 0x55b1107535e0 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=0 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=1 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=2 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=3 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=4 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=5 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.356+0000 7f7797175800 20 add_watcher() i=6 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.357+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94218973747776] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.357+0000 7f7797175800 20 add_watcher() i=7 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.357+0000 7f7797175800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.358+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1107659b0 con 0x55b11074ee60 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.358+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.358+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94218973750160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110762c60 con 0x55b11074ee60 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94218973750160] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f764afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7797175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7797175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7797175800 5 note: GC not initialized 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7649fe3640 20 reqs_thread_entry: start 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7797175800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.359+0000 7f7797175800 20 Filter name: none 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.360+0000 7f75bb7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.360+0000 7f7797175800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.360+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1107988a0 con 0x55b11074ee60 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.360+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.360+0000 7f7797175800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:19.370 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:19.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.361+0000 7f764afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.361+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94218973750160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110764e00 con 0x55b11074ee60 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.362+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94218973750160] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.362+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94218973725792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110762390 con 0x7f778803a3c0 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.363+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94218973725792] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.363+0000 7f7797175800 20 remove_watcher() i=0 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.363+0000 7f7797175800 2 removed watcher, disabling cache 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.363+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94218973723808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110762390 con 0x55b11074ee60 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.364+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94218973723808] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.364+0000 7f7797175800 20 remove_watcher() i=1 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.364+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94218973729504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b110762390 con 0x55b1107581b0 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.365+0000 7f7794473640 1 -- 172.21.15.169:0/3955101475 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94218973729504] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7788037040 con 0x55b1107581b0 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.365+0000 7f7797175800 20 remove_watcher() i=2 2024-04-24T01:24:19.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.365+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94218973735696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d2e0 con 0x7f778803a3c0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.366+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94218973735696] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x7f778803a3c0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.366+0000 7f7797175800 20 remove_watcher() i=3 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.366+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94218973739248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d2e0 con 0x55b11074ee60 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.367+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94218973739248] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f778c00a4a0 con 0x55b11074ee60 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.367+0000 7f7797175800 20 remove_watcher() i=4 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.367+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94218973740784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075f8f0 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.368+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94218973740784] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.368+0000 7f7797175800 20 remove_watcher() i=5 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.368+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94218973742896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075d2e0 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.369+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94218973742896] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.369+0000 7f7797175800 20 remove_watcher() i=6 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.369+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94218973747776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b11075f8f0 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7794c74640 1 -- 172.21.15.169:0/3955101475 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94218973747776] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f77840c1030 con 0x55b1107535e0 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 20 remove_watcher() i=7 2024-04-24T01:24:19.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b1107535e0 msgr2=0x55b1107559d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b1107535e0 0x55b1107559d0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11074ee60 msgr2=0x55b110751320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11074ee60 0x55b110751320 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f778803a3c0 msgr2=0x7f778803a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f778803a3c0 0x7f778803a810 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b1107581b0 msgr2=0x55b11075a670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b1107581b0 0x55b11075a670 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7660036950 msgr2=0x7f7660038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7660036950 0x7f7660038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55b110721360 tx=0x7f7788023040 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 msgr2=0x55b110743990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7795475640 1 -- 172.21.15.169:0/3955101475 reap_dead start 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f778404b3b0 tx=0x7f7784089eb0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 shutdown_connections 2024-04-24T01:24:19.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 --2- 172.21.15.169:0/3955101475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11073c580 0x55b110743990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 >> 172.21.15.169:0/3955101475 conn(0x55b110738890 msgr2=0x55b110735ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.370+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 shutdown_connections 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3955101475 wait complete. 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 msgr2=0x7f766c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 0x7f766c038dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55b1107185b0 tx=0x7f7788006000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 msgr2=0x55b11072f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77840529c0 tx=0x7f7784067500 comp rx=0 tx=0).stop 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 shutdown_connections 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f766c036900 0x7f766c038dc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/3909725673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11072f410 0x55b11072f830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 >> 172.21.15.169:0/3909725673 conn(0x55b1107234b0 msgr2=0x55b1107238b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 shutdown_connections 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/3909725673 wait complete. 2024-04-24T01:24:19.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b11071a410 msgr2=0x55b11071c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b11071a410 0x55b11071c800 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11061af50 msgr2=0x55b110717ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b11061af50 0x55b110717ba0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b11071e310 msgr2=0x55b1107207d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b11071e310 0x55b1107207d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f767c036900 msgr2=0x7f767c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f767c036900 0x7f767c038dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7788000c00 tx=0x7f77880013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 msgr2=0x55b110710960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 --2- 172.21.15.169:0/4110548220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b11058b1c0 0x55b110710960 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7784060040 tx=0x7f7784002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7795475640 1 -- 172.21.15.169:0/4110548220 reap_dead start 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 shutdown_connections 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 >> 172.21.15.169:0/4110548220 conn(0x55b110612380 msgr2=0x55b1107030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 shutdown_connections 2024-04-24T01:24:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.371+0000 7f7797175800 1 -- 172.21.15.169:0/4110548220 wait complete. 2024-04-24T01:24:19.381 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:19.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T01:24:19.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T01:24:19.382 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T01:24:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.464+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.464+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.464+0000 7fd46cb36800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5590242cc970 0x5590242ced60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd46cb36800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55902418ad40 con 0x5590242cf2a0 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd46cb36800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55902415d4d0 con 0x5590242cc970 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd4688cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5590242cc970 0x5590242ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd463fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5590242cf2a0 0x5590242d1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34636/0 (socket says 172.21.15.169:34636) 2024-04-24T01:24:19.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd463fff640 1 -- 172.21.15.169:0/2448821715 learned_addr learned my addr 172.21.15.169:0/2448821715 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:19.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd4688cc640 1 -- 172.21.15.169:0/2448821715 >> v1:172.21.15.142:6789/0 conn(0x5590242cf2a0 legacy=0x5590242d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.465+0000 7fd4688cc640 1 -- 172.21.15.169:0/2448821715 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559024189590 con 0x5590242cc970 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.467+0000 7fd4688cc640 1 --2- 172.21.15.169:0/2448821715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242ced60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00a470 tx=0x7fd45c01cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74034d8eb9a65795 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.467+0000 7fd4637fe640 1 -- 172.21.15.169:0/2448821715 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c057070 con 0x5590242cc970 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.467+0000 7fd4637fe640 1 -- 172.21.15.169:0/2448821715 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c04ac70 con 0x5590242cc970 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.467+0000 7fd4637fe640 1 -- 172.21.15.169:0/2448821715 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c052440 con 0x5590242cc970 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 -- 172.21.15.169:0/2448821715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 msgr2=0x5590242ced60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2448821715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242ced60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00a470 tx=0x7fd45c01cce0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 -- 172.21.15.169:0/2448821715 shutdown_connections 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2448821715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242ced60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 -- 172.21.15.169:0/2448821715 >> 172.21.15.169:0/2448821715 conn(0x5590242c6320 msgr2=0x5590242c8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 -- 172.21.15.169:0/2448821715 shutdown_connections 2024-04-24T01:24:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.468+0000 7fd46cb36800 1 -- 172.21.15.169:0/2448821715 wait complete. 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.479+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd46cb36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd46cb36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590242173c0 con 0x5590242cc970 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33174/0 (socket says 172.21.15.169:33174) 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd4688cc640 1 -- 172.21.15.169:0/3541437386 learned_addr learned my addr 172.21.15.169:0/3541437386 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd4688cc640 1 -- 172.21.15.169:0/3541437386 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590242ca870 con 0x5590242cc970 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.480+0000 7fd4688cc640 1 --2- 172.21.15.169:0/3541437386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd45c055040 tx=0x7fd45c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325a5501479d0de2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd356e05640 1 -- 172.21.15.169:0/3541437386 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c057040 con 0x5590242cc970 2024-04-24T01:24:19.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd356e05640 1 -- 172.21.15.169:0/3541437386 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c063070 con 0x5590242cc970 2024-04-24T01:24:19.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd356e05640 1 -- 172.21.15.169:0/3541437386 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c00a2e0 con 0x5590242cc970 2024-04-24T01:24:19.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 -- 172.21.15.169:0/3541437386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 msgr2=0x5590242cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3541437386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd45c055040 tx=0x7fd45c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 -- 172.21.15.169:0/3541437386 shutdown_connections 2024-04-24T01:24:19.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3541437386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590242cc2b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 -- 172.21.15.169:0/3541437386 >> 172.21.15.169:0/3541437386 conn(0x5590242c6320 msgr2=0x5590243b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 -- 172.21.15.169:0/3541437386 shutdown_connections 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 -- 172.21.15.169:0/3541437386 wait complete. 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.481+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd46cb36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590243c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd46cb36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590242d50c0 con 0x5590242cc970 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590243c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590243c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33188/0 (socket says 172.21.15.169:33188) 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd4688cc640 1 -- 172.21.15.169:0/3801921617 learned_addr learned my addr 172.21.15.169:0/3801921617 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd4688cc640 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590243c72d0 con 0x5590242cc970 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd4688cc640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590243c6d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd45c060040 tx=0x7fd45c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd355602640 1 -- 172.21.15.169:0/3801921617 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c057040 con 0x5590242cc970 2024-04-24T01:24:19.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd355602640 1 -- 172.21.15.169:0/3801921617 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c05d8b0 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590243c7560 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.482+0000 7fd355602640 1 -- 172.21.15.169:0/3801921617 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c05dbd0 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.483+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590243ca210 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.483+0000 7fd355602640 1 -- 172.21.15.169:0/3801921617 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd45c052440 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.483+0000 7fd355602640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd350036950 0x7fd350038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.483+0000 7fd355602640 1 -- 172.21.15.169:0/3801921617 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd45c08e210 con 0x5590242cc970 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.483+0000 7fd463fff640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd350036950 0x7fd350038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590242cf2a0 0x5590243cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590243ce550 con 0x5590242cf2a0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd4690cd640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590242cf2a0 0x5590243cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd463fff640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd350036950 0x7fd350038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b340 tx=0x7fd454001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd4690cd640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590242cf2a0 0x5590243cdfd0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd4690cd640 1 -- 172.21.15.169:0/3801921617 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x5590242cf2a0 2024-04-24T01:24:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590243cb580 con 0x5590242cf2a0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.484+0000 7fd4690cd640 1 -- 172.21.15.169:0/3801921617 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd46400a4a0 con 0x5590242cf2a0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5590243d0890 0x5590243d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590243d3370 con 0x5590243d0890 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd4688cc640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5590243d0890 0x5590243d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd4688cc640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5590243d0890 0x5590243d2c80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd4688cc640 1 -- 172.21.15.169:0/3801921617 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd45c05a040 con 0x5590243d0890 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590243cf840 con 0x5590242cf2a0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.485+0000 7fd4690cd640 1 -- 172.21.15.169:0/3801921617 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd46400a4a0 con 0x5590242cf2a0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590243d4820 0x5590243d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590243d73d0 con 0x5590243d4820 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd463fff640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590243d4820 0x5590243d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd463fff640 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590243d4820 0x5590243d6c70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd463fff640 1 -- 172.21.15.169:0/3801921617 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd45400f870 con 0x5590243d4820 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.486+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd46cb36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd46cb36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590241bd6b0 con 0x5590243e5830 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33200/0 (socket says 172.21.15.169:33200) 2024-04-24T01:24:19.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd4688cc640 1 -- 172.21.15.169:0/2637883745 learned_addr learned my addr 172.21.15.169:0/2637883745 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd4688cc640 1 -- 172.21.15.169:0/2637883745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590243e6190 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd4688cc640 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd45c05dfd0 tx=0x7fd45c067eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd34e7fc640 1 -- 172.21.15.169:0/2637883745 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c080040 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd34e7fc640 1 -- 172.21.15.169:0/2637883745 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c078b80 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590243e6c00 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd34e7fc640 1 -- 172.21.15.169:0/2637883745 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c078e60 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.487+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590243e6c00 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.488+0000 7fd34e7fc640 1 -- 172.21.15.169:0/2637883745 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd45c067750 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.488+0000 7fd34e7fc640 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 0x7fd340038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.488+0000 7fd34e7fc640 1 -- 172.21.15.169:0/2637883745 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd45c08fd10 con 0x5590243e5830 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.488+0000 7fd463fff640 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 0x7fd340038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd463fff640 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 0x7fd340038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5590243cee40 tx=0x7fd454006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd46cb36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd46cb36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590242cab30 con 0x5590243f28c0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33212/0 (socket says 172.21.15.169:33212) 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd4688cc640 1 -- 172.21.15.169:0/1020680423 learned_addr learned my addr 172.21.15.169:0/1020680423 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd4688cc640 1 -- 172.21.15.169:0/1020680423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590243f32b0 con 0x5590243f28c0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd4688cc640 1 --2- 172.21.15.169:0/1020680423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd45c05afd0 tx=0x7fd45c0527f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904842e3af201fcd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.489+0000 7fd33ffff640 1 -- 172.21.15.169:0/1020680423 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c0863f0 con 0x5590243f28c0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd33ffff640 1 -- 172.21.15.169:0/1020680423 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c052ab0 con 0x5590243f28c0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd33ffff640 1 -- 172.21.15.169:0/1020680423 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c097570 con 0x5590243f28c0 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- 172.21.15.169:0/1020680423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 msgr2=0x5590243f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 --2- 172.21.15.169:0/1020680423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd45c05afd0 tx=0x7fd45c0527f0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- 172.21.15.169:0/1020680423 shutdown_connections 2024-04-24T01:24:19.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 --2- 172.21.15.169:0/1020680423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f2ce0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- 172.21.15.169:0/1020680423 >> 172.21.15.169:0/1020680423 conn(0x5590243eeb40 msgr2=0x5590243ecba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- 172.21.15.169:0/1020680423 shutdown_connections 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- 172.21.15.169:0/1020680423 wait complete. 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 Processor -- start 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- start start 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.490+0000 7fd46cb36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590243f3920 con 0x5590243f28c0 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd4688cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33222/0 (socket says 172.21.15.169:33222) 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 learned_addr learned my addr 172.21.15.169:0/2937472356 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590243fa0d0 con 0x5590243f28c0 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd4688cc640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd45c063fd0 tx=0x7fd45c065f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd33e7fc640 1 -- 172.21.15.169:0/2937472356 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c0863f0 con 0x5590243f28c0 2024-04-24T01:24:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd33e7fc640 1 -- 172.21.15.169:0/2937472356 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd45c079c70 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590243fa0d0 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd33e7fc640 1 -- 172.21.15.169:0/2937472356 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd45c086830 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.491+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590243fa0d0 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.492+0000 7fd33e7fc640 1 -- 172.21.15.169:0/2937472356 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd45c0a8030 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.492+0000 7fd33e7fc640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd334036950 0x7fd334038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.492+0000 7fd33e7fc640 1 -- 172.21.15.169:0/2937472356 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd45c0a6020 con 0x5590243f28c0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.492+0000 7fd463fff640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd334036950 0x7fd334038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559024405310 0x5590244077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024407f20 con 0x559024405310 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd463fff640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd334036950 0x7fd334038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5590243d77d0 tx=0x7fd454010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd4690cd640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559024405310 0x5590244077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd4690cd640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559024405310 0x5590244077d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 20 realm 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.493+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024408330 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024408c00 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559024409d00 0x55902440c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902440c700 con 0x559024409d00 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.494+0000 7fd4688cc640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559024409d00 0x55902440c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd4688cc640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559024409d00 0x55902440c0f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd46cb36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd46cb36800 20 searching for the correct realm 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55902440e6b0 0x559024410b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024411240 con 0x55902440e6b0 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd463fff640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55902440e6b0 0x559024410b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.495+0000 7fd463fff640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55902440e6b0 0x559024410b70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd463fff640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd45403a3c0 0x7fd45403a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024411240 con 0x7fd45403a3c0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd4690cd640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd45403a3c0 0x7fd45403a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd4690cd640 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd45403a3c0 0x7fd45403a7f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.496+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.497+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x7fd45403a3c0 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.498+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x7fd45403a3c0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.499+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.500+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x7fd45403a3c0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.501+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.502+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x7fd45403a3c0 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x55902440e6b0 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024409d00 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x559024405310 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.503+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559024408fa0 con 0x7fd45403a3c0 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902440cfc0 con 0x559024405310 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902440cfc0 con 0x559024405310 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902440cfc0 con 0x7fd45403a3c0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 zone default found 2024-04-24T01:24:19.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 4 Realm: () 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 zonegroup default 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.504+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902440d860 con 0x559024409d00 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590244130a0 con 0x55902440e6b0 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024413440 con 0x55902440e6b0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 started sync module instance, tier type = 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.505+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412540 con 0x7fd45403a3c0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.506+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.506+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94077571901744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412540 con 0x7fd45403a3c0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.506+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024413cd0 con 0x559024405310 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.508+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94077571901744] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.508+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.508+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94077571905504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412540 con 0x559024405310 2024-04-24T01:24:19.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.508+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024414780 con 0x55902440e6b0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.509+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94077571905504] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.509+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.509+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94077571899536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590244124b0 con 0x55902440e6b0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.509+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024415640 con 0x7fd45403a3c0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.510+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.510+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94077571899536] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.510+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94077571912592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024415ee0 con 0x7fd45403a3c0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.510+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024414b70 con 0x559024405310 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.511+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94077571912592] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.511+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.511+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94077571914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024416470 con 0x559024405310 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.511+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024416e30 con 0x559024409d00 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.512+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.512+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94077571914032] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.512+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94077571918208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590244176d0 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.512+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024415d90 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.513+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94077571918208] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94077571922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590244184e0 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024418d70 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94077571925728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024419190 con 0x559024409d00 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=0 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=1 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=2 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=3 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=4 2024-04-24T01:24:19.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.514+0000 7fd46cb36800 20 add_watcher() i=5 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.515+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94077571922960] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.515+0000 7fd46cb36800 20 add_watcher() i=6 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.516+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94077571925728] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.516+0000 7fd46cb36800 20 add_watcher() i=7 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.516+0000 7fd46cb36800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.516+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559024418030 con 0x559024405310 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.517+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.517+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94077571927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024418030 con 0x559024405310 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94077571927072] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd31efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 5 note: GC not initialized 2024-04-24T01:24:19.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd31dfe3640 20 reqs_thread_entry: start 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 20 Filter name: none 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd28f7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.518+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902444f450 con 0x559024405310 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55902444ef30 con 0x7fd45403a3c0 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.519+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590244556c0 con 0x559024405310 2024-04-24T01:24:19.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.520+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.520+0000 7fd46cb36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.520+0000 7fd46cb36800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.520+0000 7fd46cb36800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.520+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94077572174672 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5590244523e0 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94077571914032 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fd464026410 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd33ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94077571914032 notifier 4311 bl.length()=567 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd33ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd33ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify cookie 94077572174672 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd33ffff640 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd32c003ea0 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.521+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94077572174672 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd4640265e0 con 0x559024405310 2024-04-24T01:24:19.533 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.522+0000 7fd31efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.522+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94077571927072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024401810 con 0x559024405310 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.523+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94077571927072] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.523+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94077571901744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024418be0 con 0x7fd45403a3c0 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.524+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94077571901744] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.524+0000 7fd46cb36800 20 remove_watcher() i=0 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.524+0000 7fd46cb36800 2 removed watcher, disabling cache 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.524+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94077571905504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412930 con 0x559024405310 2024-04-24T01:24:19.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.525+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94077571905504] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.525+0000 7fd46cb36800 20 remove_watcher() i=1 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.525+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94077571899536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5590244137e0 con 0x55902440e6b0 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.526+0000 7fd463fff640 1 -- 172.21.15.169:0/2937472356 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94077571899536] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd454037040 con 0x55902440e6b0 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.526+0000 7fd46cb36800 20 remove_watcher() i=2 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.526+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94077571912592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412090 con 0x7fd45403a3c0 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.527+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94077571912592] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x7fd45403a3c0 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.527+0000 7fd46cb36800 20 remove_watcher() i=3 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.527+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94077571914032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412090 con 0x559024405310 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.528+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94077571914032] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd46400a4a0 con 0x559024405310 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.528+0000 7fd46cb36800 20 remove_watcher() i=4 2024-04-24T01:24:19.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.528+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94077571918208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412090 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.529+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94077571918208] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.529+0000 7fd46cb36800 20 remove_watcher() i=5 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.529+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94077571922960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024412090 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.530+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94077571922960] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.530+0000 7fd46cb36800 20 remove_watcher() i=6 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.530+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94077571925728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559024417c10 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd4688cc640 1 -- 172.21.15.169:0/2937472356 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94077571925728] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd45c094020 con 0x559024409d00 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 20 remove_watcher() i=7 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559024409d00 msgr2=0x55902440c0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559024409d00 0x55902440c0f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559024405310 msgr2=0x5590244077d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559024405310 0x5590244077d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd45403a3c0 msgr2=0x7fd45403a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd45403a3c0 0x7fd45403a7f0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55902440e6b0 msgr2=0x559024410b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55902440e6b0 0x559024410b70 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd334036950 msgr2=0x7fd334038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd334036950 0x7fd334038e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x5590243d77d0 tx=0x7fd454010000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 msgr2=0x5590243f9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd45c063fd0 tx=0x7fd45c065f20 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd4690cd640 1 -- 172.21.15.169:0/2937472356 reap_dead start 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 shutdown_connections 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2937472356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243f28c0 0x5590243f9b90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.531+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 >> 172.21.15.169:0/2937472356 conn(0x5590243eeb40 msgr2=0x5590243ec1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 shutdown_connections 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2937472356 wait complete. 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 msgr2=0x7fd340038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 0x7fd340038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5590243cee40 tx=0x7fd454006000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 msgr2=0x5590243e5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd45c05dfd0 tx=0x7fd45c067eb0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 shutdown_connections 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd340036900 0x7fd340038dc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/2637883745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590243e5830 0x5590243e5c50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 >> 172.21.15.169:0/2637883745 conn(0x5590243d98d0 msgr2=0x5590243d9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 shutdown_connections 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/2637883745 wait complete. 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5590243d0890 msgr2=0x5590243d2c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5590243d0890 0x5590243d2c80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590242cf2a0 msgr2=0x5590243cdfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590242cf2a0 0x5590243cdfd0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590243d4820 msgr2=0x5590243d6c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590243d4820 0x5590243d6c70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd350036950 msgr2=0x7fd350038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd350036950 0x7fd350038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd45400b340 tx=0x7fd454001520 comp rx=0 tx=0).stop 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 msgr2=0x5590243c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 --2- 172.21.15.169:0/3801921617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590242cc970 0x5590243c6d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd45c060040 tx=0x7fd45c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd4690cd640 1 -- 172.21.15.169:0/3801921617 reap_dead start 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 shutdown_connections 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 >> 172.21.15.169:0/3801921617 conn(0x5590242c6320 msgr2=0x5590243b8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 shutdown_connections 2024-04-24T01:24:19.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.532+0000 7fd46cb36800 1 -- 172.21.15.169:0/3801921617 wait complete. 2024-04-24T01:24:19.544 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:19.545 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.545 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.628 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.627+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.627+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.627+0000 7f5cdfd2d800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x561f8dfa73c0 0x561f8dfa97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.627+0000 7f5cdfd2d800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f8de61d40 con 0x561f8dfa38b0 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.627+0000 7f5cdfd2d800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x561f8de344d0 con 0x561f8dfa73c0 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cd3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x561f8dfa73c0 0x561f8dfa97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cd3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x561f8dfa73c0 0x561f8dfa97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33224/0 (socket says 172.21.15.169:33224) 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cd3fff640 1 -- 172.21.15.169:0/370259330 learned_addr learned my addr 172.21.15.169:0/370259330 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cd3fff640 1 -- 172.21.15.169:0/370259330 >> v1:172.21.15.142:6789/0 conn(0x561f8dfa38b0 legacy=0x561f8dfa5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cdb17e640 1 -- 172.21.15.169:0/370259330 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017044108 0 0) 0x561f8de61d40 con 0x561f8dfa38b0 2024-04-24T01:24:19.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.628+0000 7f5cd3fff640 1 -- 172.21.15.169:0/370259330 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8de60590 con 0x561f8dfa73c0 2024-04-24T01:24:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.630+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/370259330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa73c0 0x561f8dfa97b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400a520 tx=0x7f5cc401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3436b7d797e523a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.630+0000 7f5cdb17e640 1 -- 172.21.15.169:0/370259330 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc4057070 con 0x561f8dfa73c0 2024-04-24T01:24:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.630+0000 7f5cdb17e640 1 -- 172.21.15.169:0/370259330 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc4052570 con 0x561f8dfa73c0 2024-04-24T01:24:19.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.630+0000 7f5cdb17e640 1 -- 172.21.15.169:0/370259330 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cc404ae60 con 0x561f8dfa73c0 2024-04-24T01:24:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/370259330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa73c0 msgr2=0x561f8dfa97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/370259330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa73c0 0x561f8dfa97b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400a520 tx=0x7f5cc401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/370259330 shutdown_connections 2024-04-24T01:24:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/370259330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa73c0 0x561f8dfa97b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/370259330 >> 172.21.15.169:0/370259330 conn(0x561f8df9d380 msgr2=0x561f8df9f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/370259330 shutdown_connections 2024-04-24T01:24:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.631+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/370259330 wait complete. 2024-04-24T01:24:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.642+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.642+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.642+0000 7f5cdfd2d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.642+0000 7f5cdfd2d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561f8deee3c0 con 0x561f8dfa38b0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33226/0 (socket says 172.21.15.169:33226) 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5cdb97f640 1 -- 172.21.15.169:0/3258802025 learned_addr learned my addr 172.21.15.169:0/3258802025 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5cdb97f640 1 -- 172.21.15.169:0/3258802025 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8e0944e0 con 0x561f8dfa38b0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/3258802025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc001e00 tx=0x7f5ccc00b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f034731f46162e22 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5bc9e0b640 1 -- 172.21.15.169:0/3258802025 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc016070 con 0x561f8dfa38b0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5bc9e0b640 1 -- 172.21.15.169:0/3258802025 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc00d4b0 con 0x561f8dfa38b0 2024-04-24T01:24:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.643+0000 7f5bc9e0b640 1 -- 172.21.15.169:0/3258802025 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc00d810 con 0x561f8dfa38b0 2024-04-24T01:24:19.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3258802025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 msgr2=0x561f8e093f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3258802025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc001e00 tx=0x7f5ccc00b650 comp rx=0 tx=0).stop 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3258802025 shutdown_connections 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3258802025 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e093f10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3258802025 >> 172.21.15.169:0/3258802025 conn(0x561f8df9d380 msgr2=0x561f8e08f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3258802025 shutdown_connections 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3258802025 wait complete. 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.644+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdfd2d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e09bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdfd2d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561f8dfa9ff0 con 0x561f8dfa38b0 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e09bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e09bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33230/0 (socket says 172.21.15.169:33230) 2024-04-24T01:24:19.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdb97f640 1 -- 172.21.15.169:0/3824055208 learned_addr learned my addr 172.21.15.169:0/3824055208 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdb97f640 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8e09c050 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.645+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e09bb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc001ed0 tx=0x7f5ccc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5bc3fff640 1 -- 172.21.15.169:0/3824055208 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc016070 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5bc3fff640 1 -- 172.21.15.169:0/3824055208 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc023070 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f8e09c2e0 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5bc3fff640 1 -- 172.21.15.169:0/3824055208 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc011a90 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8e09ef90 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.646+0000 7f5bc3fff640 1 -- 172.21.15.169:0/3824055208 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ccc011c30 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5bc3fff640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bc4036950 0x7f5bc4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5bc3fff640 1 -- 172.21.15.169:0/3824055208 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5ccc04c590 con 0x561f8dfa38b0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bc4036950 0x7f5bc4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8dfa73c0 0x561f8e0a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0a3320 con 0x561f8dfa73c0 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdc180640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8dfa73c0 0x561f8e0a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bc4036950 0x7f5bc4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4054000 tx=0x7f5cc404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdc180640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8dfa73c0 0x561f8e0a2d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdc180640 1 -- 172.21.15.169:0/3824055208 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8dfa73c0 2024-04-24T01:24:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.647+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0a0320 con 0x561f8dfa73c0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdc180640 1 -- 172.21.15.169:0/3824055208 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8dfa73c0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0a5630 0x561f8e0a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0a80c0 con 0x561f8e0a5630 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0a5630 0x561f8e0a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0a5630 0x561f8e0a7a20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.648+0000 7f5cdb97f640 1 -- 172.21.15.169:0/3824055208 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5ccc01dc90 con 0x561f8e0a5630 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0a45e0 con 0x561f8dfa73c0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cdc180640 1 -- 172.21.15.169:0/3824055208 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8dfa73c0 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561f8e0a9570 0x561f8e0ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ac120 con 0x561f8e0a9570 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561f8e0a9570 0x561f8e0ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561f8e0a9570 0x561f8e0ab9c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.649+0000 7f5cd3fff640 1 -- 172.21.15.169:0/3824055208 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cc405a040 con 0x561f8e0a9570 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdfd2d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdfd2d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561f8de946b0 con 0x561f8e0ba580 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33240/0 (socket says 172.21.15.169:33240) 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdb97f640 1 -- 172.21.15.169:0/2747654743 learned_addr learned my addr 172.21.15.169:0/2747654743 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.650+0000 7f5cdb97f640 1 -- 172.21.15.169:0/2747654743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8e0baee0 con 0x561f8e0ba580 2024-04-24T01:24:19.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04ac20 tx=0x7f5ccc01d660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5bc17fa640 1 -- 172.21.15.169:0/2747654743 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc037070 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5bc17fa640 1 -- 172.21.15.169:0/2747654743 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc017040 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f8e0bb950 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5bc17fa640 1 -- 172.21.15.169:0/2747654743 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc01d910 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8e0bbe50 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.651+0000 7f5bc17fa640 1 -- 172.21.15.169:0/2747654743 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ccc00fa20 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5bc17fa640 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 0x7f5bb4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5bc17fa640 1 -- 172.21.15.169:0/2747654743 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5ccc03ee00 con 0x561f8e0ba580 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 0x7f5bb4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 0x7f5bb4038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x561f8e0a0240 tx=0x7f5cc4005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdfd2d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdfd2d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561f8e094860 con 0x561f8e0c9770 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33252/0 (socket says 172.21.15.169:33252) 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.652+0000 7f5cdb97f640 1 -- 172.21.15.169:0/362233831 learned_addr learned my addr 172.21.15.169:0/362233831 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdb97f640 1 -- 172.21.15.169:0/362233831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8e0ca160 con 0x561f8e0c9770 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/362233831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00f9b0 tx=0x7f5ccc04ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6267244f3969ee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5bbaffd640 1 -- 172.21.15.169:0/362233831 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc05c070 con 0x561f8e0c9770 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5bbaffd640 1 -- 172.21.15.169:0/362233831 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc028770 con 0x561f8e0c9770 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5bbaffd640 1 -- 172.21.15.169:0/362233831 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc049210 con 0x561f8e0c9770 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/362233831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 msgr2=0x561f8e0c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/362233831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00f9b0 tx=0x7f5ccc04ce10 comp rx=0 tx=0).stop 2024-04-24T01:24:19.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/362233831 shutdown_connections 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/362233831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0c9b90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/362233831 >> 172.21.15.169:0/362233831 conn(0x561f8dfa18e0 msgr2=0x561f8dfa1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/362233831 shutdown_connections 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.653+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/362233831 wait complete. 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdfd2d800 1 Processor -- start 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdfd2d800 1 -- start start 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdfd2d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdfd2d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561f8e0cab10 con 0x561f8e0c9770 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdb97f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33256/0 (socket says 172.21.15.169:33256) 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 learned_addr learned my addr 172.21.15.169:0/1631716124 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f8e0d1430 con 0x561f8e0c9770 2024-04-24T01:24:19.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.654+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00f6d0 tx=0x7f5ccc04d870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5bb97fa640 1 -- 172.21.15.169:0/1631716124 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc071070 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5bb97fa640 1 -- 172.21.15.169:0/1631716124 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ccc027bf0 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5bb97fa640 1 -- 172.21.15.169:0/1631716124 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ccc04d000 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f8e0d1430 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f8e0d1430 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.655+0000 7f5bb97fa640 1 -- 172.21.15.169:0/1631716124 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5ccc074070 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5bb97fa640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5ba4036900 0x7f5ba4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5bb97fa640 1 -- 172.21.15.169:0/1631716124 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5ccc077ca0 con 0x561f8e0c9770 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5ba4036900 0x7f5ba4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8e0dc580 0x561f8e0dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0df190 con 0x561f8e0dc580 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdc180640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8e0dc580 0x561f8e0dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5ba4036900 0x7f5ba4038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdc180640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8e0dc580 0x561f8e0dea40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.656+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 realm 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0df5a0 con 0x561f8e0dc580 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0dfe40 con 0x561f8e0dc580 2024-04-24T01:24:19.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0dc580 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0e0f40 0x561f8e0e3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e3870 con 0x561f8e0e0f40 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.657+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0e0f40 0x561f8e0e3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdb97f640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0e0f40 0x561f8e0e3330 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdfd2d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdfd2d800 20 searching for the correct realm 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561f8e0e58f0 0x561f8e0e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e8480 con 0x561f8e0e58f0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561f8e0e58f0 0x561f8e0e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.658+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561f8e0e58f0 0x561f8e0e7db0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cd3fff640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5cc4074040 0x7f5cc4081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e8480 con 0x7f5cc4074040 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cdc180640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5cc4074040 0x7f5cc4081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cdc180640 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5cc4074040 0x7f5cc4081410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.659+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0dc580 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0dc580 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.660+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x7f5cc4074040 2024-04-24T01:24:19.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e58f0 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0dc580 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.661+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0dc580 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x7f5cc4074040 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e01e0 con 0x561f8e0e58f0 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.662+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e0f40 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.663+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0dc580 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0dc580 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.664+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e0f40 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x7f5cc4074040 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.665+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0dc580 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e0f40 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e0f40 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.666+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x7f5cc4074040 2024-04-24T01:24:19.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e58f0 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0e0f40 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.667+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x561f8e0dc580 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5cc408e040 con 0x7f5cc4074040 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e41f0 con 0x561f8e0dc580 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.668+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e41f0 con 0x561f8e0dc580 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e41c0 con 0x7f5cc4074040 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 zone default found 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 4 Realm: () 2024-04-24T01:24:19.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 zonegroup default 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e45e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ea2e0 con 0x561f8e0e58f0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.669+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ea680 con 0x561f8e0e58f0 2024-04-24T01:24:19.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cdfd2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cdfd2d800 20 started sync module instance, tier type = 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cdfd2d800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.670+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e4e50 con 0x7f5cc4074040 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.671+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.671+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94693527294944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e9e40 con 0x7f5cc4074040 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.671+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0eb080 con 0x561f8e0dc580 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.672+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94693527294944] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.672+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.672+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94693527296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0eb040 con 0x561f8e0dc580 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.672+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ebb10 con 0x561f8e0e58f0 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.673+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.673+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94693527303744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ec3b0 con 0x561f8e0e58f0 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.673+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ece70 con 0x7f5cc4074040 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.673+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94693527296240] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.674+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94693527303744] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.674+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.674+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94693527305984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0eab90 con 0x7f5cc4074040 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.674+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ed710 con 0x561f8e0dc580 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.675+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94693527305984] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.675+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.675+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94693527308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ed6c0 con 0x561f8e0dc580 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.675+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ee120 con 0x561f8e0e0f40 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.676+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94693527308608] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.676+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.676+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94693527310864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ed630 con 0x561f8e0e0f40 2024-04-24T01:24:19.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.676+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0eee20 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.677+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94693527310864] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.677+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.677+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94693527316128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ef6c0 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.677+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0f0080 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94693527316128] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94693527319536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0f0080 con 0x561f8e0e0f40 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=0 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=1 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=2 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=3 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=4 2024-04-24T01:24:19.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=5 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.678+0000 7f5cdfd2d800 20 add_watcher() i=6 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.679+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94693527319536] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.679+0000 7f5cdfd2d800 20 add_watcher() i=7 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.679+0000 7f5cdfd2d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.679+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0f33a0 con 0x561f8e0dc580 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.680+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.680+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94693527321920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0f0610 con 0x561f8e0dc580 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94693527321920] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 5 note: GC not initialized 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5b90fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:19.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 20 Filter name: none 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5b0a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.681+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561f8e1262b0 con 0x561f8e0dc580 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.682+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.682+0000 7f5cdfd2d800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:19.694 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.683+0000 7f5b91fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.683+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94693527321920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0f2890 con 0x561f8e0dc580 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.684+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94693527321920] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.684+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94693527294944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0efd40 con 0x7f5cc4074040 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.685+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94693527294944] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.685+0000 7f5cdfd2d800 20 remove_watcher() i=0 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.685+0000 7f5cdfd2d800 2 removed watcher, disabling cache 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.685+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94693527296240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0efd40 con 0x561f8e0dc580 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.686+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94693527296240] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.686+0000 7f5cdfd2d800 20 remove_watcher() i=1 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.686+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94693527303744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0efd40 con 0x561f8e0e58f0 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.687+0000 7f5cd3fff640 1 -- 172.21.15.169:0/1631716124 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94693527303744] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cc407f070 con 0x561f8e0e58f0 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.687+0000 7f5cdfd2d800 20 remove_watcher() i=2 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.687+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94693527305984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e93e0 con 0x7f5cc4074040 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.688+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94693527305984] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x7f5cc4074040 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.688+0000 7f5cdfd2d800 20 remove_watcher() i=3 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.688+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94693527308608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e93e0 con 0x561f8e0dc580 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.689+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94693527308608] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cd400a4a0 con 0x561f8e0dc580 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.689+0000 7f5cdfd2d800 20 remove_watcher() i=4 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.689+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94693527310864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ec940 con 0x561f8e0e0f40 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.690+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94693527310864] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.690+0000 7f5cdfd2d800 20 remove_watcher() i=5 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.690+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94693527316128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0e93e0 con 0x561f8e0e0f40 2024-04-24T01:24:19.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.691+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94693527316128] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.691+0000 7f5cdfd2d800 20 remove_watcher() i=6 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.691+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94693527319536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561f8e0ed210 con 0x561f8e0e0f40 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdb97f640 1 -- 172.21.15.169:0/1631716124 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94693527319536] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5ccc073030 con 0x561f8e0e0f40 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 20 remove_watcher() i=7 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0e0f40 msgr2=0x561f8e0e3330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0e0f40 0x561f8e0e3330 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8e0dc580 msgr2=0x561f8e0dea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8e0dc580 0x561f8e0dea40 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5cc4074040 msgr2=0x7f5cc4081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5cc4074040 0x7f5cc4081410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561f8e0e58f0 msgr2=0x561f8e0e7db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561f8e0e58f0 0x561f8e0e7db0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5ba4036900 msgr2=0x7f5ba4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5ba4036900 0x7f5ba4038dc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 msgr2=0x561f8e0d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdc180640 1 -- 172.21.15.169:0/1631716124 reap_dead start 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc00f6d0 tx=0x7f5ccc04d870 comp rx=0 tx=0).stop 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 shutdown_connections 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/1631716124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0c9770 0x561f8e0d0ef0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 >> 172.21.15.169:0/1631716124 conn(0x561f8dfa18e0 msgr2=0x561f8e0c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 shutdown_connections 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.692+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/1631716124 wait complete. 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 msgr2=0x7f5bb4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 0x7f5bb4038e10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x561f8e0a0240 tx=0x7f5cc4005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 msgr2=0x561f8e0ba9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc04ac20 tx=0x7f5ccc01d660 comp rx=0 tx=0).stop 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 shutdown_connections 2024-04-24T01:24:19.703 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bb4036950 0x7f5bb4038e10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/2747654743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8e0ba580 0x561f8e0ba9a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 >> 172.21.15.169:0/2747654743 conn(0x561f8e0ae620 msgr2=0x561f8e0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 shutdown_connections 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/2747654743 wait complete. 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0a5630 msgr2=0x561f8e0a7a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561f8e0a5630 0x561f8e0a7a20 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8dfa73c0 msgr2=0x561f8e0a2d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561f8dfa73c0 0x561f8e0a2d50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561f8e0a9570 msgr2=0x561f8e0ab9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561f8e0a9570 0x561f8e0ab9c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bc4036950 msgr2=0x7f5bc4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5bc4036950 0x7f5bc4038e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4054000 tx=0x7f5cc404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 msgr2=0x561f8e09bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.704 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 --2- 172.21.15.169:0/3824055208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561f8dfa38b0 0x561f8e09bb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc001ed0 tx=0x7f5ccc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdc180640 1 -- 172.21.15.169:0/3824055208 reap_dead start 2024-04-24T01:24:19.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 shutdown_connections 2024-04-24T01:24:19.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 >> 172.21.15.169:0/3824055208 conn(0x561f8df9d380 msgr2=0x561f8e08e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 shutdown_connections 2024-04-24T01:24:19.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.693+0000 7f5cdfd2d800 1 -- 172.21.15.169:0/3824055208 wait complete. 2024-04-24T01:24:19.706 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:19.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T01:24:19.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T01:24:19.706 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T01:24:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.789 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.788+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.788+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.788+0000 7feddb806800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55865d9c2330 0x55865d9c4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.788+0000 7feddb806800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55865d87cd40 con 0x55865d9bdf90 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.788+0000 7feddb806800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55865d84f4d0 con 0x55865d9c2330 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd3fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55865d9c2330 0x55865d9c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd9305640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55865d9bdf90 0x55865d9be3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34650/0 (socket says 172.21.15.169:34650) 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd9305640 1 -- 172.21.15.169:0/1596652530 learned_addr learned my addr 172.21.15.169:0/1596652530 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd3fff640 1 -- 172.21.15.169:0/1596652530 >> v1:172.21.15.142:6789/0 conn(0x55865d9bdf90 legacy=0x55865d9be3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd8b04640 1 -- 172.21.15.169:0/1596652530 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681041825 0 0) 0x55865d87cd40 con 0x55865d9bdf90 2024-04-24T01:24:19.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.789+0000 7fedd3fff640 1 -- 172.21.15.169:0/1596652530 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865d87b590 con 0x55865d9c2330 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1596652530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9c2330 0x55865d9c4720 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedc400a470 tx=0x7fedc401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4534075120c9ddff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7fedd8b04640 1 -- 172.21.15.169:0/1596652530 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4057070 con 0x55865d9c2330 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7fedd8b04640 1 -- 172.21.15.169:0/1596652530 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4052570 con 0x55865d9c2330 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7fedd8b04640 1 -- 172.21.15.169:0/1596652530 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedc4052870 con 0x55865d9c2330 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7feddb806800 1 -- 172.21.15.169:0/1596652530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9c2330 msgr2=0x55865d9c4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7feddb806800 1 --2- 172.21.15.169:0/1596652530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9c2330 0x55865d9c4720 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fedc400a470 tx=0x7fedc401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7feddb806800 1 -- 172.21.15.169:0/1596652530 shutdown_connections 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7feddb806800 1 --2- 172.21.15.169:0/1596652530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9c2330 0x55865d9c4720 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.791+0000 7feddb806800 1 -- 172.21.15.169:0/1596652530 >> 172.21.15.169:0/1596652530 conn(0x55865d9b9530 msgr2=0x55865d9bb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.792+0000 7feddb806800 1 -- 172.21.15.169:0/1596652530 shutdown_connections 2024-04-24T01:24:19.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.792+0000 7feddb806800 1 -- 172.21.15.169:0/1596652530 wait complete. 2024-04-24T01:24:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.803+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.803+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.803+0000 7feddb806800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.803+0000 7feddb806800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55865d9093c0 con 0x55865d9bdf90 2024-04-24T01:24:19.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33272/0 (socket says 172.21.15.169:33272) 2024-04-24T01:24:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fedd9305640 1 -- 172.21.15.169:0/3931039747 learned_addr learned my addr 172.21.15.169:0/3931039747 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fedd9305640 1 -- 172.21.15.169:0/3931039747 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865daaf510 con 0x55865d9bdf90 2024-04-24T01:24:19.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fedd9305640 1 --2- 172.21.15.169:0/3931039747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00b240 tx=0x7fedcc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1fc558412cbd41 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fecc7606640 1 -- 172.21.15.169:0/3931039747 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc008070 con 0x55865d9bdf90 2024-04-24T01:24:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fecc7606640 1 -- 172.21.15.169:0/3931039747 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc00d500 con 0x55865d9bdf90 2024-04-24T01:24:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.804+0000 7fecc7606640 1 -- 172.21.15.169:0/3931039747 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc00d860 con 0x55865d9bdf90 2024-04-24T01:24:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- 172.21.15.169:0/3931039747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 msgr2=0x55865daaef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 --2- 172.21.15.169:0/3931039747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00b240 tx=0x7fedcc00b700 comp rx=0 tx=0).stop 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- 172.21.15.169:0/3931039747 shutdown_connections 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 --2- 172.21.15.169:0/3931039747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865daaef40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- 172.21.15.169:0/3931039747 >> 172.21.15.169:0/3931039747 conn(0x55865d9b9530 msgr2=0x55865daaa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- 172.21.15.169:0/3931039747 shutdown_connections 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- 172.21.15.169:0/3931039747 wait complete. 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.805+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7feddb806800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865d933950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7feddb806800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55865d9c4ff0 con 0x55865d9bdf90 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865d933950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865d933950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33288/0 (socket says 172.21.15.169:33288) 2024-04-24T01:24:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7fedd9305640 1 -- 172.21.15.169:0/1081755694 learned_addr learned my addr 172.21.15.169:0/1081755694 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7fedd9305640 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865d933e90 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.806+0000 7fedd9305640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865d933950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55865daafcd0 tx=0x7fedcc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7fecc5e03640 1 -- 172.21.15.169:0/1081755694 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc019870 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7fecc5e03640 1 -- 172.21.15.169:0/1081755694 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc019a10 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865d932090 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7fecc5e03640 1 -- 172.21.15.169:0/1081755694 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc019d30 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865d9325b0 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.807+0000 7fecc5e03640 1 -- 172.21.15.169:0/1081755694 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fedcc017040 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fecc5e03640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecc0036950 0x7fecc0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fecc5e03640 1 -- 172.21.15.169:0/1081755694 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fedcc015020 con 0x55865d9bdf90 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecc0036950 0x7fecc0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865d9c2330 0x55865dabff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dac04c0 con 0x55865d9c2330 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865d9c2330 0x55865dabff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecc0036950 0x7fecc0038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedc4054000 tx=0x7fedc404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865d9c2330 0x55865dabff40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.808+0000 7fedd9b06640 1 -- 172.21.15.169:0/1081755694 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865d9c2330 2024-04-24T01:24:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865d932ab0 con 0x55865d9c2330 2024-04-24T01:24:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7fedd9b06640 1 -- 172.21.15.169:0/1081755694 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865d9c2330 2024-04-24T01:24:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dac27f0 0x55865dac4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dac5280 con 0x55865dac27f0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7fedd9305640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dac27f0 0x55865dac4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.809+0000 7fedd9305640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dac27f0 0x55865dac4be0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7fedd9305640 1 -- 172.21.15.169:0/1081755694 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dac27f0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dac17a0 con 0x55865d9c2330 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7fedd9b06640 1 -- 172.21.15.169:0/1081755694 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865d9c2330 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55865dac6730 0x55865dac8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dac92e0 con 0x55865dac6730 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55865dac6730 0x55865dac8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.810+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55865dac6730 0x55865dac8b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7fedd3fff640 1 -- 172.21.15.169:0/1081755694 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fedc4052940 con 0x55865dac6730 2024-04-24T01:24:19.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7feddb806800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7feddb806800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55865d8af6b0 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33290/0 (socket says 172.21.15.169:33290) 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7fedd9305640 1 -- 172.21.15.169:0/1982460618 learned_addr learned my addr 172.21.15.169:0/1982460618 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.811+0000 7fedd9305640 1 -- 172.21.15.169:0/1982460618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865dad80a0 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7fedd9305640 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fedcc04b480 tx=0x7fedcc00f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7fecbeffd640 1 -- 172.21.15.169:0/1982460618 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc01a8f0 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7fecbeffd640 1 -- 172.21.15.169:0/1982460618 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc041e10 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865dad8b10 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7fecbeffd640 1 -- 172.21.15.169:0/1982460618 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc044ba0 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865dad9010 con 0x55865dad7740 2024-04-24T01:24:19.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.812+0000 7fecbeffd640 1 -- 172.21.15.169:0/1982460618 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fedcc044d40 con 0x55865dad7740 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fecbeffd640 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 0x7fecb0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fecbeffd640 1 -- 172.21.15.169:0/1982460618 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fedcc03bc90 con 0x55865dad7740 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 0x7fecb0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 0x7fecb0038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55865d9329d0 tx=0x7fedc4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7feddb806800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7feddb806800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55865daaf890 con 0x55865dae4a00 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33300/0 (socket says 172.21.15.169:33300) 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.813+0000 7fedd9305640 1 -- 172.21.15.169:0/3547375183 learned_addr learned my addr 172.21.15.169:0/3547375183 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7fedd9305640 1 -- 172.21.15.169:0/3547375183 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865dae53f0 con 0x55865dae4a00 2024-04-24T01:24:19.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7fedd9305640 1 --2- 172.21.15.169:0/3547375183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fedcc018600 tx=0x7fedcc026920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260c726bde26bfe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7fecbcff9640 1 -- 172.21.15.169:0/3547375183 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc018810 con 0x55865dae4a00 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7fecbcff9640 1 -- 172.21.15.169:0/3547375183 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc04f030 con 0x55865dae4a00 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7fecbcff9640 1 -- 172.21.15.169:0/3547375183 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc03f4e0 con 0x55865dae4a00 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 -- 172.21.15.169:0/3547375183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 msgr2=0x55865dae4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 --2- 172.21.15.169:0/3547375183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fedcc018600 tx=0x7fedcc026920 comp rx=0 tx=0).stop 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 -- 172.21.15.169:0/3547375183 shutdown_connections 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 --2- 172.21.15.169:0/3547375183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865dae4e20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 -- 172.21.15.169:0/3547375183 >> 172.21.15.169:0/3547375183 conn(0x55865dae0d60 msgr2=0x55865dadedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 -- 172.21.15.169:0/3547375183 shutdown_connections 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.814+0000 7feddb806800 1 -- 172.21.15.169:0/3547375183 wait complete. 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7feddb806800 1 Processor -- start 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7feddb806800 1 -- start start 2024-04-24T01:24:19.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7feddb806800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7feddb806800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55865dae5920 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7fedd9305640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33308/0 (socket says 172.21.15.169:33308) 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 learned_addr learned my addr 172.21.15.169:0/1114340973 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55865daec200 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.815+0000 7fedd9305640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bc50 tx=0x7fedcc008450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7fecaeffd640 1 -- 172.21.15.169:0/1114340973 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc06c020 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7fecaeffd640 1 -- 172.21.15.169:0/1114340973 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc030e40 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55865daec200 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7fecaeffd640 1 -- 172.21.15.169:0/1114340973 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedcc030580 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55865daec200 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7fecaeffd640 1 -- 172.21.15.169:0/1114340973 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fedcc06f020 con 0x55865dae4a00 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.816+0000 7fecaeffd640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7feca40368b0 0x7feca4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7fecaeffd640 1 -- 172.21.15.169:0/1114340973 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fedcc064070 con 0x55865dae4a00 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7feca40368b0 0x7feca4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7feca40368b0 0x7feca4038d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedc4052fd0 tx=0x7fedc404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865daf7300 0x55865daf97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865daf9f10 con 0x55865daf7300 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865daf7300 0x55865daf97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.817+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865daf7300 0x55865daf97c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 realm 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafa320 con 0x55865daf7300 2024-04-24T01:24:19.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafabf0 con 0x55865daf7300 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865daf7300 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dafbcf0 0x55865dafe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.818+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafe6f0 con 0x55865dafbcf0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7fedd9305640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dafbcf0 0x55865dafe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7fedd9305640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dafbcf0 0x55865dafe0e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7feddb806800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7feddb806800 20 searching for the correct realm 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55865db006a0 0x55865db02b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865db03230 con 0x55865db006a0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.819+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55865db006a0 0x55865db02b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55865db006a0 0x55865db02b60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd3fff640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fedc4076040 0x7fedc4083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865db03230 con 0x7fedc4076040 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fedc4076040 0x7fedc4083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.820+0000 7fedd9b06640 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fedc4076040 0x7fedc4083410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865dafbcf0 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865daf7300 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865daf7300 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865dafbcf0 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.821+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865dafbcf0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x7fedc4076040 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865db006a0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865daf7300 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.822+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865dafbcf0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865daf7300 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x7fedc4076040 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55865dafaf90 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.823+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865dafbcf0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.824+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865daf7300 2024-04-24T01:24:19.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865daf7300 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865dafbcf0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.825+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x7fedc4076040 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865daf7300 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865dafbcf0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.826+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865dafbcf0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x7fedc4076040 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865db006a0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.827+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865dafbcf0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x55865daf7300 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fedc4090040 con 0x7fedc4076040 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.828+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafefb0 con 0x55865daf7300 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafefb0 con 0x55865daf7300 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865dafefb0 con 0x7fedc4076040 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 zone default found 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 4 Realm: () 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 zonegroup default 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.829+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865daff850 con 0x55865dafbcf0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db05090 con 0x55865db006a0 2024-04-24T01:24:19.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db05430 con 0x55865db006a0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 started sync module instance, tier type = 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.830+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db04530 con 0x7fedc4076040 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.831+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.831+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94035585813120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db04530 con 0x7fedc4076040 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.831+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db05d00 con 0x55865daf7300 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.832+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94035585813120] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.833+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.833+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94035585816528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db04530 con 0x55865daf7300 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.833+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db067a0 con 0x55865db006a0 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.834+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.834+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94035585819280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db07040 con 0x55865db006a0 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.834+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db07b30 con 0x7fedc4076040 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.834+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94035585816528] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.835+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94035585819280] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.835+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.835+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94035585821584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db04080 con 0x7fedc4076040 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.835+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db083d0 con 0x55865daf7300 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.836+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94035585821584] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.836+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.836+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94035585824256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db08350 con 0x55865daf7300 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.836+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db08de0 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.837+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94035585824256] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.837+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.837+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94035585826464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db082c0 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.837+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db09c50 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.838+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94035585826464] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.838+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.838+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94035585831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0a4a0 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.838+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0acf0 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94035585831296] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94035585837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0b110 con 0x55865dafbcf0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=0 2024-04-24T01:24:19.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=1 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=2 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=3 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=4 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=5 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.839+0000 7feddb806800 20 add_watcher() i=6 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94035585837120] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7feddb806800 20 add_watcher() i=7 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7feddb806800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db0e450 con 0x55865daf7300 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.840+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94035585838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0b6a0 con 0x55865daf7300 2024-04-24T01:24:19.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.841+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94035585838544] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7fec8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 5 note: GC not initialized 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7fec8e7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 Filter name: none 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7febfffff640 20 reqs_thread_entry: start 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db41800 con 0x55865daf7300 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:19.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.842+0000 7feddb806800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.843+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db44290 con 0x7fedc4076040 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.843+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.843+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db479f0 con 0x55865daf7300 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7feddb806800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7feddb806800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7feddb806800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94035586085984 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55865db43280 con 0x55865daf7300 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94035585824256 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fedd40266e0 con 0x55865daf7300 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify cookie 94035586085984 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fecbcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94035585824256 notifier 4325 bl.length()=567 2024-04-24T01:24:19.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fecbcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:19.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fecbcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:19.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.844+0000 7fecbcff9640 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fec9c003ea0 con 0x55865daf7300 2024-04-24T01:24:19.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.845+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94035586085984 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fedd4018d60 con 0x55865daf7300 2024-04-24T01:24:19.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.845+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.858 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.845+0000 7fec8f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.845+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94035585838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0daf0 con 0x55865daf7300 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.846+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94035585838544] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.846+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94035585813120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0add0 con 0x7fedc4076040 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.847+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94035585813120] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.847+0000 7feddb806800 20 remove_watcher() i=0 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.847+0000 7feddb806800 2 removed watcher, disabling cache 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.847+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94035585816528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0add0 con 0x55865daf7300 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.848+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94035585816528] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.848+0000 7feddb806800 20 remove_watcher() i=1 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.848+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94035585819280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db0add0 con 0x55865db006a0 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.849+0000 7fedd3fff640 1 -- 172.21.15.169:0/1114340973 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94035585819280] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedc4081070 con 0x55865db006a0 2024-04-24T01:24:19.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.849+0000 7feddb806800 20 remove_watcher() i=2 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.849+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94035585821584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db057d0 con 0x7fedc4076040 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.850+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94035585821584] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x7fedc4076040 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.850+0000 7feddb806800 20 remove_watcher() i=3 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.850+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94035585824256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db057d0 con 0x55865daf7300 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94035585824256] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedd400a4a0 con 0x55865daf7300 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7feddb806800 20 remove_watcher() i=4 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94035585826464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db07600 con 0x55865dafbcf0 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94035585826464] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7feddb806800 20 remove_watcher() i=5 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.852+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94035585831296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db057d0 con 0x55865dafbcf0 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.853+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94035585831296] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.853+0000 7feddb806800 20 remove_watcher() i=6 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.853+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94035585837120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55865db07ea0 con 0x55865dafbcf0 2024-04-24T01:24:19.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7fedd9305640 1 -- 172.21.15.169:0/1114340973 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94035585837120] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fedcc02d070 con 0x55865dafbcf0 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 20 remove_watcher() i=7 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dafbcf0 msgr2=0x55865dafe0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dafbcf0 0x55865dafe0e0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865daf7300 msgr2=0x55865daf97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865daf7300 0x55865daf97c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fedc4076040 msgr2=0x7fedc4083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fedc4076040 0x7fedc4083410 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55865db006a0 msgr2=0x55865db02b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55865db006a0 0x55865db02b60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7feca40368b0 msgr2=0x7feca4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7feca40368b0 0x7feca4038d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fedc4052fd0 tx=0x7fedc404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 msgr2=0x55865daebcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7fedd9b06640 1 -- 172.21.15.169:0/1114340973 reap_dead start 2024-04-24T01:24:19.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bc50 tx=0x7fedcc008450 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 shutdown_connections 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 --2- 172.21.15.169:0/1114340973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dae4a00 0x55865daebcc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.854+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 >> 172.21.15.169:0/1114340973 conn(0x55865dae0d60 msgr2=0x55865dade3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 shutdown_connections 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1114340973 wait complete. 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 msgr2=0x7fecb0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 0x7fecb0038e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x55865d9329d0 tx=0x7fedc4005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 msgr2=0x55865dad7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fedcc04b480 tx=0x7fedcc00f840 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 shutdown_connections 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecb0036950 0x7fecb0038e10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1982460618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865dad7740 0x55865dad7b60 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 >> 172.21.15.169:0/1982460618 conn(0x55865dacb7e0 msgr2=0x55865dacbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 shutdown_connections 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1982460618 wait complete. 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dac27f0 msgr2=0x55865dac4be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55865dac27f0 0x55865dac4be0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865d9c2330 msgr2=0x55865dabff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55865d9c2330 0x55865dabff40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55865dac6730 msgr2=0x55865dac8b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55865dac6730 0x55865dac8b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecc0036950 msgr2=0x7fecc0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fecc0036950 0x7fecc0038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fedc4054000 tx=0x7fedc404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 msgr2=0x55865d933950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 --2- 172.21.15.169:0/1081755694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55865d9bdf90 0x55865d933950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x55865daafcd0 tx=0x7fedcc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7fedd9b06640 1 -- 172.21.15.169:0/1081755694 reap_dead start 2024-04-24T01:24:19.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 shutdown_connections 2024-04-24T01:24:19.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 >> 172.21.15.169:0/1081755694 conn(0x55865d9b9530 msgr2=0x55865daa9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 shutdown_connections 2024-04-24T01:24:19.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.855+0000 7feddb806800 1 -- 172.21.15.169:0/1081755694 wait complete. 2024-04-24T01:24:19.870 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:19.870 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.870 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:19.870 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:19.953 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:19.953 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff88a333800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f8fe76f2e0 0x55f8fe777de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff88a333800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8fe62dd40 con 0x55f8fe76d7a0 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff88a333800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55f8fe6004d0 con 0x55f8fe76f2e0 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.952+0000 7ff8857f4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f8fe76f2e0 0x55f8fe777de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff885ff5640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55f8fe76d7a0 0x55f8fe76dbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34652/0 (socket says 172.21.15.169:34652) 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff885ff5640 1 -- 172.21.15.169:0/1545251995 learned_addr learned my addr 172.21.15.169:0/1545251995 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff884ff3640 1 -- 172.21.15.169:0/1545251995 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284707675 0 0) 0x55f8fe62dd40 con 0x55f8fe76d7a0 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff884ff3640 1 -- 172.21.15.169:0/1545251995 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff870001e10 con 0x55f8fe76d7a0 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff8857f4640 1 -- 172.21.15.169:0/1545251995 >> v1:172.21.15.142:6789/0 conn(0x55f8fe76d7a0 legacy=0x55f8fe76dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.953+0000 7ff8857f4640 1 -- 172.21.15.169:0/1545251995 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe62c590 con 0x55f8fe76f2e0 2024-04-24T01:24:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff8857f4640 1 --2- 172.21.15.169:0/1545251995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76f2e0 0x55f8fe777de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a470 tx=0x7ff87c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a16db973d36e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff884ff3640 1 -- 172.21.15.169:0/1545251995 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c057070 con 0x55f8fe76f2e0 2024-04-24T01:24:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff884ff3640 1 -- 172.21.15.169:0/1545251995 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff87c052440 con 0x55f8fe76f2e0 2024-04-24T01:24:19.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff884ff3640 1 -- 172.21.15.169:0/1545251995 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff87c052740 con 0x55f8fe76f2e0 2024-04-24T01:24:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 -- 172.21.15.169:0/1545251995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76f2e0 msgr2=0x55f8fe777de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 --2- 172.21.15.169:0/1545251995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76f2e0 0x55f8fe777de0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00a470 tx=0x7ff87c01cdb0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 -- 172.21.15.169:0/1545251995 shutdown_connections 2024-04-24T01:24:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 --2- 172.21.15.169:0/1545251995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76f2e0 0x55f8fe777de0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 -- 172.21.15.169:0/1545251995 >> 172.21.15.169:0/1545251995 conn(0x55f8fe769320 msgr2=0x55f8fe76b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 -- 172.21.15.169:0/1545251995 shutdown_connections 2024-04-24T01:24:19.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.955+0000 7ff88a333800 1 -- 172.21.15.169:0/1545251995 wait complete. 2024-04-24T01:24:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff88a333800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff88a333800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f8fe6ba3c0 con 0x55f8fe76d7a0 2024-04-24T01:24:19.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33326/0 (socket says 172.21.15.169:33326) 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.967+0000 7ff885ff5640 1 -- 172.21.15.169:0/3008236780 learned_addr learned my addr 172.21.15.169:0/3008236780 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.968+0000 7ff885ff5640 1 -- 172.21.15.169:0/3008236780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe8628d0 con 0x55f8fe76d7a0 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.968+0000 7ff885ff5640 1 --2- 172.21.15.169:0/3008236780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff880001de0 tx=0x7ff88000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a834f034b63b0667 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.968+0000 7ff773e07640 1 -- 172.21.15.169:0/3008236780 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880012020 con 0x55f8fe76d7a0 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.968+0000 7ff773e07640 1 -- 172.21.15.169:0/3008236780 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88000e5a0 con 0x55f8fe76d7a0 2024-04-24T01:24:19.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.968+0000 7ff773e07640 1 -- 172.21.15.169:0/3008236780 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88000e900 con 0x55f8fe76d7a0 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- 172.21.15.169:0/3008236780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 msgr2=0x55f8fe862300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 --2- 172.21.15.169:0/3008236780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff880001de0 tx=0x7ff88000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- 172.21.15.169:0/3008236780 shutdown_connections 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 --2- 172.21.15.169:0/3008236780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe862300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- 172.21.15.169:0/3008236780 >> 172.21.15.169:0/3008236780 conn(0x55f8fe769320 msgr2=0x55f8fe85dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- 172.21.15.169:0/3008236780 shutdown_connections 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- 172.21.15.169:0/3008236780 wait complete. 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe869eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff88a333800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f8fe77a600 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe869eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe869eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33342/0 (socket says 172.21.15.169:33342) 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.969+0000 7ff885ff5640 1 -- 172.21.15.169:0/2317544485 learned_addr learned my addr 172.21.15.169:0/2317544485 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff885ff5640 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe86a3f0 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff885ff5640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe869eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff880000fb0 tx=0x7ff880000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff772604640 1 -- 172.21.15.169:0/2317544485 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880012030 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff772604640 1 -- 172.21.15.169:0/2317544485 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88001a7a0 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff772604640 1 -- 172.21.15.169:0/2317544485 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88001aa80 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8fe86a680 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.970+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8fe86d330 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff772604640 1 -- 172.21.15.169:0/2317544485 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff880015020 con 0x55f8fe76d7a0 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff772604640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff76c036950 0x7ff76c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff772604640 1 -- 172.21.15.169:0/2317544485 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff880020030 con 0x55f8fe76d7a0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff8857f4640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff76c036950 0x7ff76c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe76f2e0 0x55f8fe8710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe871630 con 0x55f8fe76f2e0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff8867f6640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe76f2e0 0x55f8fe8710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff8857f4640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff76c036950 0x7ff76c038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff87c054000 tx=0x7ff87c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.971+0000 7ff8867f6640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe76f2e0 0x55f8fe8710f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff8867f6640 1 -- 172.21.15.169:0/2317544485 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe76f2e0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe86e6c0 con 0x55f8fe76f2e0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff8867f6640 1 -- 172.21.15.169:0/2317544485 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe76f2e0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe873970 0x55f8fe875d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe876450 con 0x55f8fe873970 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff885ff5640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe873970 0x55f8fe875d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.972+0000 7ff885ff5640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe873970 0x55f8fe875d60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff885ff5640 1 -- 172.21.15.169:0/2317544485 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe873970 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe872920 con 0x55f8fe76f2e0 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff8867f6640 1 -- 172.21.15.169:0/2317544485 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe76f2e0 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f8fe877900 0x55f8fe879d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe87a4b0 con 0x55f8fe877900 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.973+0000 7ff8857f4640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f8fe877900 0x55f8fe879d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff8857f4640 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f8fe877900 0x55f8fe879d50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff8857f4640 1 -- 172.21.15.169:0/2317544485 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff87c052910 con 0x55f8fe877900 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff88a333800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.974+0000 7ff88a333800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f8fe6606b0 con 0x55f8fe8888c0 2024-04-24T01:24:19.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33354/0 (socket says 172.21.15.169:33354) 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff885ff5640 1 -- 172.21.15.169:0/477779644 learned_addr learned my addr 172.21.15.169:0/477779644 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff885ff5640 1 -- 172.21.15.169:0/477779644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe889220 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff885ff5640 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff88001a6f0 tx=0x7ff880045f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff76b7fe640 1 -- 172.21.15.169:0/477779644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8800441e0 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff76b7fe640 1 -- 172.21.15.169:0/477779644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff88003b070 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff76b7fe640 1 -- 172.21.15.169:0/477779644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880044530 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8fe889c90 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.975+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8fe889c90 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff76b7fe640 1 -- 172.21.15.169:0/477779644 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff880041420 con 0x55f8fe8888c0 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff76b7fe640 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 0x7ff760038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff76b7fe640 1 -- 172.21.15.169:0/477779644 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff880048050 con 0x55f8fe8888c0 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff8857f4640 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 0x7ff760038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.976+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff8857f4640 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 0x7ff760038e30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55f8fe871f20 tx=0x7ff87c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff88a333800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff88a333800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f8fe862c50 con 0x55f8fe895890 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33368/0 (socket says 172.21.15.169:33368) 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff885ff5640 1 -- 172.21.15.169:0/187352814 learned_addr learned my addr 172.21.15.169:0/187352814 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff885ff5640 1 -- 172.21.15.169:0/187352814 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe896280 con 0x55f8fe895890 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff885ff5640 1 --2- 172.21.15.169:0/187352814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff880041fb0 tx=0x7ff8800365d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d8f313fd1be93 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff7697fa640 1 -- 172.21.15.169:0/187352814 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88001be10 con 0x55f8fe895890 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff7697fa640 1 -- 172.21.15.169:0/187352814 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800245e0 con 0x55f8fe895890 2024-04-24T01:24:19.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.977+0000 7ff7697fa640 1 -- 172.21.15.169:0/187352814 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88004c7d0 con 0x55f8fe895890 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- 172.21.15.169:0/187352814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 msgr2=0x55f8fe895cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 --2- 172.21.15.169:0/187352814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff880041fb0 tx=0x7ff8800365d0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- 172.21.15.169:0/187352814 shutdown_connections 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 --2- 172.21.15.169:0/187352814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe895cb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- 172.21.15.169:0/187352814 >> 172.21.15.169:0/187352814 conn(0x55f8fe891b10 msgr2=0x55f8fe88fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- 172.21.15.169:0/187352814 shutdown_connections 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- 172.21.15.169:0/187352814 wait complete. 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 Processor -- start 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- start start 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.978+0000 7ff88a333800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f8fe8968f0 con 0x55f8fe895890 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff885ff5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33370/0 (socket says 172.21.15.169:33370) 2024-04-24T01:24:19.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 learned_addr learned my addr 172.21.15.169:0/151701490 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8fe89d1b0 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff885ff5640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff88002dca0 tx=0x7ff880014e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff7577fe640 1 -- 172.21.15.169:0/151701490 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff88001be10 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff7577fe640 1 -- 172.21.15.169:0/151701490 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800448b0 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff7577fe640 1 -- 172.21.15.169:0/151701490 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff880049550 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8fe89d1b0 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.979+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8fe89d1b0 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff7577fe640 1 -- 172.21.15.169:0/151701490 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff880070030 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff7577fe640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff750036950 0x7ff750038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff7577fe640 1 -- 172.21.15.169:0/151701490 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff88006e070 con 0x55f8fe895890 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff8857f4640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff750036950 0x7ff750038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe8a8290 0x55f8fe8aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8aaea0 con 0x55f8fe8a8290 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.980+0000 7ff8867f6640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe8a8290 0x55f8fe8aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff8857f4640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff750036950 0x7ff750038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff87c01cdf0 tx=0x7ff87c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff8867f6640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe8a8290 0x55f8fe8aa750 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 realm 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8ab2b0 con 0x55f8fe8a8290 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abb80 con 0x55f8fe8a8290 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.981+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8a8290 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe8aca10 0x55f8fe8aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8af560 con 0x55f8fe8aca10 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff885ff5640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe8aca10 0x55f8fe8aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff885ff5640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe8aca10 0x55f8fe8aee00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:19.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 20 searching for the correct realm 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8fe8b1610 0x55f8fe8b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.982+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b41a0 con 0x55f8fe8b1610 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8857f4640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8fe8b1610 0x55f8fe8b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8857f4640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8fe8b1610 0x55f8fe8b3ad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8857f4640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff87c076040 0x7ff87c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b41a0 con 0x7ff87c076040 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.983+0000 7ff8867f6640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff87c076040 0x7ff87c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff87c076040 0x7ff87c083410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8aca10 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8a8290 2024-04-24T01:24:19.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8a8290 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.984+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8aca10 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.985+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.985+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8aca10 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.985+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.985+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x7ff87c076040 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8b1610 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8a8290 2024-04-24T01:24:19.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8aca10 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.986+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8a8290 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x7ff87c076040 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8abf20 con 0x55f8fe8b1610 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:19.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.987+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8aca10 2024-04-24T01:24:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8a8290 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.988+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8a8290 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8aca10 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x7ff87c076040 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.989+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8a8290 2024-04-24T01:24:20.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.990+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x7ff87c076040 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8b1610 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.991+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x55f8fe8a8290 2024-04-24T01:24:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff87c090040 con 0x7ff87c076040 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8aff10 con 0x55f8fe8a8290 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8aff10 con 0x55f8fe8a8290 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.992+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8afee0 con 0x7ff87c076040 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 zone default found 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 4 Realm: () 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 zonegroup default 2024-04-24T01:24:20.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b0300 con 0x55f8fe8aca10 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6000 con 0x55f8fe8b1610 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.993+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b63a0 con 0x55f8fe8b1610 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.994+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.994+0000 7ff88a333800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.994+0000 7ff88a333800 20 started sync module instance, tier type = 2024-04-24T01:24:20.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.994+0000 7ff88a333800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.994+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b54a0 con 0x7ff87c076040 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.995+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.995+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94527910795408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b54a0 con 0x7ff87c076040 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.995+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6bf0 con 0x55f8fe8a8290 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.996+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94527910795408] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.996+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.996+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94527910793472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6bf0 con 0x55f8fe8a8290 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.996+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b74a0 con 0x55f8fe8b1610 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.997+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94527910793472] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.997+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.997+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94527910799648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b7890 con 0x55f8fe8b1610 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.997+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b8290 con 0x7ff87c076040 2024-04-24T01:24:20.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.998+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94527910799648] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.998+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.998+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94527910800768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b8680 con 0x7ff87c076040 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.998+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b9040 con 0x55f8fe8a8290 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.999+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94527910800768] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.999+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.999+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94527910804896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b9040 con 0x55f8fe8a8290 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:19.999+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b9a50 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.000+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94527910804896] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.000+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.000+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94527910808464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b8fb0 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.001+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8ba7c0 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.001+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94527910808464] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.002+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.002+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94527910813728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bb060 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.002+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bba20 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94527910813728] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94527910819184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bbe40 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=0 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=1 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=2 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=3 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=4 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=5 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=6 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94527910819184] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 20 add_watcher() i=7 2024-04-24T01:24:20.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.003+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bf0b0 con 0x55f8fe8a8290 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.004+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.004+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94527910820608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bc3d0 con 0x55f8fe8a8290 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94527910820608] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff88a333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff88a333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff88a333800 5 note: GC not initialized 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff7367fc640 20 reqs_thread_entry: start 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff88a333800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.005+0000 7ff88a333800 20 Filter name: none 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.006+0000 7ff6a7fff640 20 reqs_thread_entry: start 2024-04-24T01:24:20.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.006+0000 7ff88a333800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.006+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8f2010 con 0x55f8fe8a8290 2024-04-24T01:24:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.006+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.006+0000 7ff88a333800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:20.019 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.007+0000 7ff7377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.007+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94527910820608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8be5d0 con 0x55f8fe8a8290 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.008+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94527910820608] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.008+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94527910795408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bbb00 con 0x7ff87c076040 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.009+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94527910795408] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.009+0000 7ff88a333800 20 remove_watcher() i=0 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.009+0000 7ff88a333800 2 removed watcher, disabling cache 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.009+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94527910793472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bbb00 con 0x55f8fe8a8290 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.010+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94527910793472] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.010+0000 7ff88a333800 20 remove_watcher() i=1 2024-04-24T01:24:20.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.010+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94527910799648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b5100 con 0x55f8fe8b1610 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.011+0000 7ff8857f4640 1 -- 172.21.15.169:0/151701490 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94527910799648] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87c081070 con 0x55f8fe8b1610 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.011+0000 7ff88a333800 20 remove_watcher() i=2 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.011+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94527910800768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8bbb00 con 0x7ff87c076040 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.012+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94527910800768] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x7ff87c076040 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.012+0000 7ff88a333800 20 remove_watcher() i=3 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.012+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94527910804896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6dd0 con 0x55f8fe8a8290 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.013+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94527910804896] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff87800a4a0 con 0x55f8fe8a8290 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.013+0000 7ff88a333800 20 remove_watcher() i=4 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.013+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94527910808464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6dd0 con 0x55f8fe8aca10 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.014+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94527910808464] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.014+0000 7ff88a333800 20 remove_watcher() i=5 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.014+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94527910813728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6dd0 con 0x55f8fe8aca10 2024-04-24T01:24:20.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.015+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94527910813728] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.015+0000 7ff88a333800 20 remove_watcher() i=6 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.015+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94527910819184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8fe8b6dd0 con 0x55f8fe8aca10 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff885ff5640 1 -- 172.21.15.169:0/151701490 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94527910819184] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff880018950 con 0x55f8fe8aca10 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 20 remove_watcher() i=7 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe8aca10 msgr2=0x55f8fe8aee00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe8aca10 0x55f8fe8aee00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe8a8290 msgr2=0x55f8fe8aa750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe8a8290 0x55f8fe8aa750 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff87c076040 msgr2=0x7ff87c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff87c076040 0x7ff87c083410 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8fe8b1610 msgr2=0x55f8fe8b3ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8fe8b1610 0x55f8fe8b3ad0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff750036950 msgr2=0x7ff750038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.016+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff750036950 0x7ff750038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff87c01cdf0 tx=0x7ff87c04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 msgr2=0x55f8fe89cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff8867f6640 1 -- 172.21.15.169:0/151701490 reap_dead start 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff88002dca0 tx=0x7ff880014e80 comp rx=0 tx=0).stop 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 shutdown_connections 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/151701490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe895890 0x55f8fe89cc70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 >> 172.21.15.169:0/151701490 conn(0x55f8fe891b10 msgr2=0x55f8fe88f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 shutdown_connections 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/151701490 wait complete. 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 msgr2=0x7ff760038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 0x7ff760038e30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55f8fe871f20 tx=0x7ff87c005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 msgr2=0x55f8fe888ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff88001a6f0 tx=0x7ff880045f20 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 shutdown_connections 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff760036970 0x7ff760038e30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/477779644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe8888c0 0x55f8fe888ce0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 >> 172.21.15.169:0/477779644 conn(0x55f8fe87c960 msgr2=0x55f8fe87cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 shutdown_connections 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/477779644 wait complete. 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe873970 msgr2=0x55f8fe875d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f8fe873970 0x55f8fe875d60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe76f2e0 msgr2=0x55f8fe8710f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f8fe76f2e0 0x55f8fe8710f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f8fe877900 msgr2=0x55f8fe879d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.017+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f8fe877900 0x55f8fe879d50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff76c036950 msgr2=0x7ff76c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff76c036950 0x7ff76c038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff87c054000 tx=0x7ff87c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 msgr2=0x55f8fe869eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 --2- 172.21.15.169:0/2317544485 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8fe76d7a0 0x55f8fe869eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff880000fb0 tx=0x7ff880000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff8867f6640 1 -- 172.21.15.169:0/2317544485 reap_dead start 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 shutdown_connections 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 >> 172.21.15.169:0/2317544485 conn(0x55f8fe769320 msgr2=0x55f8fe85c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 shutdown_connections 2024-04-24T01:24:20.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.018+0000 7ff88a333800 1 -- 172.21.15.169:0/2317544485 wait complete. 2024-04-24T01:24:20.031 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T01:24:20.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-04-24T01:24:20.032 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-04-24T01:24:20.118 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.118 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.117+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.117+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd25fd2b800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558e68f46160 0x558e68f48600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd25fd2b800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558e68e00d40 con 0x558e68eb5200 2024-04-24T01:24:20.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd25fd2b800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x558e68dd34d0 con 0x558e68f46160 2024-04-24T01:24:20.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd253fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558e68f46160 0x558e68f48600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd253fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558e68f46160 0x558e68f48600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33378/0 (socket says 172.21.15.169:33378) 2024-04-24T01:24:20.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd253fff640 1 -- 172.21.15.169:0/2805036659 learned_addr learned my addr 172.21.15.169:0/2805036659 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd253fff640 1 -- 172.21.15.169:0/2805036659 >> v1:172.21.15.142:6789/0 conn(0x558e68eb5200 legacy=0x558e68f449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.118+0000 7fd253fff640 1 -- 172.21.15.169:0/2805036659 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e68dff590 con 0x558e68f46160 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.120+0000 7fd253fff640 1 --2- 172.21.15.169:0/2805036659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68f46160 0x558e68f48600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd24400a520 tx=0x7fd24401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47059be2668f132 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.120+0000 7fd25b2c1640 1 -- 172.21.15.169:0/2805036659 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd244057070 con 0x558e68f46160 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.120+0000 7fd25b2c1640 1 -- 172.21.15.169:0/2805036659 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd244052570 con 0x558e68f46160 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.120+0000 7fd25b2c1640 1 -- 172.21.15.169:0/2805036659 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24404ae60 con 0x558e68f46160 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2805036659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68f46160 msgr2=0x558e68f48600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2805036659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68f46160 0x558e68f48600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd24400a520 tx=0x7fd24401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:20.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2805036659 shutdown_connections 2024-04-24T01:24:20.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2805036659 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68f46160 0x558e68f48600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2805036659 >> 172.21.15.169:0/2805036659 conn(0x558e68f3c3a0 msgr2=0x558e68f3e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2805036659 shutdown_connections 2024-04-24T01:24:20.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.121+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2805036659 wait complete. 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.132+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.132+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25fd2b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25fd2b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558e68e8d3e0 con 0x558e68eb5200 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33390/0 (socket says 172.21.15.169:33390) 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25bac2640 1 -- 172.21.15.169:0/484812873 learned_addr learned my addr 172.21.15.169:0/484812873 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25bac2640 1 -- 172.21.15.169:0/484812873 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e69033790 con 0x558e68eb5200 2024-04-24T01:24:20.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd25bac2640 1 --2- 172.21.15.169:0/484812873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd24c001d20 tx=0x7fd24c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdb6edaff2b926a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd149e0b640 1 -- 172.21.15.169:0/484812873 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c00f400 con 0x558e68eb5200 2024-04-24T01:24:20.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd149e0b640 1 -- 172.21.15.169:0/484812873 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c00f5a0 con 0x558e68eb5200 2024-04-24T01:24:20.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.133+0000 7fd149e0b640 1 -- 172.21.15.169:0/484812873 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c00f7d0 con 0x558e68eb5200 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- 172.21.15.169:0/484812873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 msgr2=0x558e690331c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/484812873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd24c001d20 tx=0x7fd24c00b5b0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- 172.21.15.169:0/484812873 shutdown_connections 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/484812873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e690331c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- 172.21.15.169:0/484812873 >> 172.21.15.169:0/484812873 conn(0x558e68f3c3a0 msgr2=0x558e6902eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- 172.21.15.169:0/484812873 shutdown_connections 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- 172.21.15.169:0/484812873 wait complete. 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.134+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25fd2b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e6903ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25fd2b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558e68f48f80 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e6903ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e6903ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33392/0 (socket says 172.21.15.169:33392) 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25bac2640 1 -- 172.21.15.169:0/3904613773 learned_addr learned my addr 172.21.15.169:0/3904613773 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25bac2640 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6903b250 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25bac2640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e6903ad10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558e69033f50 tx=0x7fd24c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd143fff640 1 -- 172.21.15.169:0/3904613773 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c01a690 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd143fff640 1 -- 172.21.15.169:0/3904613773 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c01a830 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6903b4e0 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.135+0000 7fd143fff640 1 -- 172.21.15.169:0/3904613773 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c01ab30 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.136+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6903e190 con 0x558e68eb5200 2024-04-24T01:24:20.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.136+0000 7fd143fff640 1 -- 172.21.15.169:0/3904613773 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd24c017070 con 0x558e68eb5200 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.136+0000 7fd143fff640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd144036950 0x7fd144038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.136+0000 7fd143fff640 1 -- 172.21.15.169:0/3904613773 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd24c015020 con 0x558e68eb5200 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.136+0000 7fd253fff640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd144036950 0x7fd144038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e68f46160 0x558e69041f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690424d0 con 0x558e68f46160 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e68f46160 0x558e69041f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd253fff640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd144036950 0x7fd144038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd244054000 tx=0x7fd24404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e68f46160 0x558e69041f50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25c2c3640 1 -- 172.21.15.169:0/3904613773 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e68f46160 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.137+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6903f520 con 0x558e68f46160 2024-04-24T01:24:20.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.138+0000 7fd25c2c3640 1 -- 172.21.15.169:0/3904613773 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e68f46160 2024-04-24T01:24:20.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.138+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e690447e0 0x558e69046bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.138+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690472c0 con 0x558e690447e0 2024-04-24T01:24:20.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.138+0000 7fd25bac2640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e690447e0 0x558e69046bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.138+0000 7fd25bac2640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e690447e0 0x558e69046bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.141+0000 7fd25bac2640 1 -- 172.21.15.169:0/3904613773 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd24c02e070 con 0x558e690447e0 2024-04-24T01:24:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.141+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69043790 con 0x558e68f46160 2024-04-24T01:24:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd25c2c3640 1 -- 172.21.15.169:0/3904613773 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e68f46160 2024-04-24T01:24:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558e69048770 0x558e6904abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6904b320 con 0x558e69048770 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd253fff640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558e69048770 0x558e6904abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd253fff640 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558e69048770 0x558e6904abc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.142+0000 7fd253fff640 1 -- 172.21.15.169:0/3904613773 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd24405a040 con 0x558e69048770 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25fd2b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25fd2b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558e68e336b0 con 0x558e69059780 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33398/0 (socket says 172.21.15.169:33398) 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25bac2640 1 -- 172.21.15.169:0/1418948752 learned_addr learned my addr 172.21.15.169:0/1418948752 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.143+0000 7fd25bac2640 1 -- 172.21.15.169:0/1418948752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6905a0e0 con 0x558e69059780 2024-04-24T01:24:20.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd25bac2640 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd24c04af80 tx=0x7fd24c01df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd1417fa640 1 -- 172.21.15.169:0/1418948752 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c04c4d0 con 0x558e69059780 2024-04-24T01:24:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd1417fa640 1 -- 172.21.15.169:0/1418948752 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c04c670 con 0x558e69059780 2024-04-24T01:24:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6905ab50 con 0x558e69059780 2024-04-24T01:24:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd1417fa640 1 -- 172.21.15.169:0/1418948752 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c04c950 con 0x558e69059780 2024-04-24T01:24:20.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6905ab50 con 0x558e69059780 2024-04-24T01:24:20.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.144+0000 7fd1417fa640 1 -- 172.21.15.169:0/1418948752 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd24c044d10 con 0x558e69059780 2024-04-24T01:24:20.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd1417fa640 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 0x7fd134038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd1417fa640 1 -- 172.21.15.169:0/1418948752 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd24c037020 con 0x558e69059780 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd253fff640 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 0x7fd134038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd253fff640 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 0x7fd134038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558e69042d90 tx=0x7fd244005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25fd2b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25fd2b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558e69033b10 con 0x558e69066730 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33410/0 (socket says 172.21.15.169:33410) 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.145+0000 7fd25bac2640 1 -- 172.21.15.169:0/2957400833 learned_addr learned my addr 172.21.15.169:0/2957400833 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25bac2640 1 -- 172.21.15.169:0/2957400833 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e69067120 con 0x558e69066730 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25bac2640 1 --2- 172.21.15.169:0/2957400833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd24c017670 tx=0x7fd24c03ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa1a23f68c2d59b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd13affd640 1 -- 172.21.15.169:0/2957400833 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0303e0 con 0x558e69066730 2024-04-24T01:24:20.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd13affd640 1 -- 172.21.15.169:0/2957400833 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c03f120 con 0x558e69066730 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd13affd640 1 -- 172.21.15.169:0/2957400833 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c03de80 con 0x558e69066730 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2957400833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 msgr2=0x558e69066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2957400833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd24c017670 tx=0x7fd24c03ff00 comp rx=0 tx=0).stop 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2957400833 shutdown_connections 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2957400833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e69066b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2957400833 >> 172.21.15.169:0/2957400833 conn(0x558e69062a90 msgr2=0x558e69060af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2957400833 shutdown_connections 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.146+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2957400833 wait complete. 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25fd2b800 1 Processor -- start 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25fd2b800 1 -- start start 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25fd2b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25fd2b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558e690677d0 con 0x558e69066730 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25bac2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33424/0 (socket says 172.21.15.169:33424) 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 learned_addr learned my addr 172.21.15.169:0/2125122764 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e6906e040 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.147+0000 7fd25bac2640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd24c049d50 tx=0x7fd24c014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd1397fa640 1 -- 172.21.15.169:0/2125122764 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c00e590 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd1397fa640 1 -- 172.21.15.169:0/2125122764 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd24c05d070 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd1397fa640 1 -- 172.21.15.169:0/2125122764 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd24c0410b0 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e6906e040 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e6906e040 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.148+0000 7fd1397fa640 1 -- 172.21.15.169:0/2125122764 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd24c00e070 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd1397fa640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd124036950 0x7fd124038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd1397fa640 1 -- 172.21.15.169:0/2125122764 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd24c06c030 con 0x558e69066730 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd253fff640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd124036950 0x7fd124038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e690791e0 0x558e6907b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6907bdf0 con 0x558e690791e0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd253fff640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd124036950 0x7fd124038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x558e6904b720 tx=0x7fd24404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.149+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e690791e0 0x558e6907b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e690791e0 0x558e6907b6a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 realm 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6907c200 con 0x558e690791e0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6907cad0 con 0x558e690791e0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.150+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e690791e0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e6907dbd0 0x558e6907ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690805d0 con 0x558e6907dbd0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25bac2640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e6907dbd0 0x558e6907ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25bac2640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e6907dbd0 0x558e6907ffc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 20 searching for the correct realm 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558e69082580 0x558e69084a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e69085110 con 0x558e69082580 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.151+0000 7fd253fff640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558e69082580 0x558e69084a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd253fff640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558e69082580 0x558e69084a40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd253fff640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd244074040 0x7fd244081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e69085110 con 0x7fd244074040 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd244074040 0x7fd244081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.152+0000 7fd25c2c3640 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd244074040 0x7fd244081410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e6907dbd0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e690791e0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e690791e0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.153+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e6907dbd0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e6907dbd0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x7fd244074040 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e69082580 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.154+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e690791e0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e6907dbd0 2024-04-24T01:24:20.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e690791e0 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.155+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x7fd244074040 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558e6907ce70 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e6907dbd0 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.156+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.157+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e6907dbd0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x7fd244074040 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.158+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e6907dbd0 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e6907dbd0 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x7fd244074040 2024-04-24T01:24:20.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.159+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e69082580 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e6907dbd0 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x558e690791e0 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fd24408e040 con 0x7fd244074040 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.160+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69080e90 con 0x558e690791e0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69080e90 con 0x558e690791e0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69080e90 con 0x7fd244074040 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 zone default found 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 4 Realm: () 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 zonegroup default 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69081730 con 0x558e6907dbd0 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.161+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69086f70 con 0x558e69082580 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e69087310 con 0x558e69082580 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 started sync module instance, tier type = 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.162+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69086410 con 0x7fd244074040 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.163+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.163+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94070135875632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69086410 con 0x7fd244074040 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.163+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69087ba0 con 0x558e690791e0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.164+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94070135875632] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.164+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.164+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94070135879344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69086410 con 0x558e690791e0 2024-04-24T01:24:20.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.164+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69088640 con 0x558e69082580 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.165+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94070135879344] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.165+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.165+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94070135873376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69086380 con 0x558e69082580 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.165+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69089430 con 0x7fd244074040 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.166+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94070135873376] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.167+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.167+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94070135884384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69089820 con 0x7fd244074040 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.167+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908a220 con 0x558e690791e0 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.168+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.168+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94070135889200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908a190 con 0x558e690791e0 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.168+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908b1f0 con 0x558e6907dbd0 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.168+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94070135884384] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.169+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94070135889200] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.169+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.169+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94070135891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69088e80 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.169+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908ba90 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.170+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94070135891472] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.170+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.170+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94070135893216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908c2e0 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.170+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908cb70 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94070135893216] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94070135897648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908cdf0 con 0x558e6907dbd0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=0 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=1 2024-04-24T01:24:20.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=2 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=3 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=4 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=5 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25fd2b800 20 add_watcher() i=6 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.171+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94070135897648] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.172+0000 7fd25fd2b800 20 add_watcher() i=7 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.172+0000 7fd25fd2b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.172+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e6908cdf0 con 0x558e690791e0 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.172+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.172+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94070135903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908dc00 con 0x558e690791e0 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94070135903024] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25fd2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25fd2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25fd2b800 5 note: GC not initialized 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd110fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25fd2b800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.173+0000 7fd25fd2b800 20 Filter name: none 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd08a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690c3710 con 0x558e690791e0 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:20.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690c4180 con 0x558e6907dbd0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.174+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e690c9b50 con 0x558e690791e0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25fd2b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25fd2b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25fd2b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:20.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94070136149440 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690c5220 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94070135889200 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7fd254018cb0 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd13affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94070135889200 notifier 4339 bl.length()=678 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd13affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd13affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify cookie 94070136149440 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd13affd640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd120003ea0 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94070136149440 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd254044430 con 0x558e690791e0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.176+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e690c95c0 con 0x558e6907dbd0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd25fd2b800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd25fd2b800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd25fd2b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:20.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94070136149440 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558e690c4d70 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 94070135873376 notify 137438953472 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fd244088040 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd13a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94070135873376 notifier 4339 bl.length()=177 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [notify cookie 94070136149440 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd13a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd13a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd13a7fc640 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd090003400 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify_complete (2) cookie 94070136149440 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558e68dff590 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.178+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.192 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:24:20.176654Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.179+0000 7fd111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.179+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94070135903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e690c5650 con 0x558e690791e0 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.180+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94070135903024] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.180+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94070135875632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908d330 con 0x7fd244074040 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.181+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94070135875632] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.181+0000 7fd25fd2b800 20 remove_watcher() i=0 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.181+0000 7fd25fd2b800 2 removed watcher, disabling cache 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.181+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94070135879344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908d330 con 0x558e690791e0 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.182+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94070135879344] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.182+0000 7fd25fd2b800 20 remove_watcher() i=1 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.182+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94070135873376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e690876b0 con 0x558e69082580 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.183+0000 7fd253fff640 1 -- 172.21.15.169:0/2125122764 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94070135873376] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24407f070 con 0x558e69082580 2024-04-24T01:24:20.198 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.183+0000 7fd25fd2b800 20 remove_watcher() i=2 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.183+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94070135884384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e6908d330 con 0x7fd244074040 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.184+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94070135884384] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x7fd244074040 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.184+0000 7fd25fd2b800 20 remove_watcher() i=3 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.184+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94070135889200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69085f60 con 0x558e690791e0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.185+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94070135889200] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd25400a4a0 con 0x558e690791e0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.185+0000 7fd25fd2b800 20 remove_watcher() i=4 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.185+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94070135891472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e690876b0 con 0x558e6907dbd0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.186+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94070135891472] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.186+0000 7fd25fd2b800 20 remove_watcher() i=5 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.186+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94070135893216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69088a60 con 0x558e6907dbd0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.187+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94070135893216] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.187+0000 7fd25fd2b800 20 remove_watcher() i=6 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.187+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94070135897648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558e69085f60 con 0x558e6907dbd0 2024-04-24T01:24:20.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25bac2640 1 -- 172.21.15.169:0/2125122764 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94070135897648] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd24c02e070 con 0x558e6907dbd0 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 20 remove_watcher() i=7 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e6907dbd0 msgr2=0x558e6907ffc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e6907dbd0 0x558e6907ffc0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e690791e0 msgr2=0x558e6907b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e690791e0 0x558e6907b6a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd244074040 msgr2=0x7fd244081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd244074040 0x7fd244081410 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558e69082580 msgr2=0x558e69084a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558e69082580 0x558e69084a40 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd124036950 msgr2=0x7fd124038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd124036950 0x7fd124038e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x558e6904b720 tx=0x7fd24404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 msgr2=0x558e6906db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25c2c3640 1 -- 172.21.15.169:0/2125122764 reap_dead start 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd24c049d50 tx=0x7fd24c014f70 comp rx=0 tx=0).stop 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 shutdown_connections 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/2125122764 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69066730 0x558e6906db00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 >> 172.21.15.169:0/2125122764 conn(0x558e69062a90 msgr2=0x558e690600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 shutdown_connections 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.188+0000 7fd25fd2b800 1 -- 172.21.15.169:0/2125122764 wait complete. 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 msgr2=0x7fd134038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 0x7fd134038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x558e69042d90 tx=0x7fd244005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 msgr2=0x558e69059ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd24c04af80 tx=0x7fd24c01df90 comp rx=0 tx=0).stop 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 shutdown_connections 2024-04-24T01:24:20.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd134036900 0x7fd134038dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/1418948752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e69059780 0x558e69059ba0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 >> 172.21.15.169:0/1418948752 conn(0x558e6904d820 msgr2=0x558e6904dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 shutdown_connections 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/1418948752 wait complete. 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e690447e0 msgr2=0x558e69046bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558e690447e0 0x558e69046bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e68f46160 msgr2=0x558e69041f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558e68f46160 0x558e69041f50 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558e69048770 msgr2=0x558e6904abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558e69048770 0x558e6904abc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd144036950 msgr2=0x7fd144038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd144036950 0x7fd144038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd244054000 tx=0x7fd24404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 msgr2=0x558e6903ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 --2- 172.21.15.169:0/3904613773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e68eb5200 0x558e6903ad10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x558e69033f50 tx=0x7fd24c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25c2c3640 1 -- 172.21.15.169:0/3904613773 reap_dead start 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 shutdown_connections 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 >> 172.21.15.169:0/3904613773 conn(0x558e68f3c3a0 msgr2=0x558e6902d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 shutdown_connections 2024-04-24T01:24:20.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.189+0000 7fd25fd2b800 1 -- 172.21.15.169:0/3904613773 wait complete. 2024-04-24T01:24:20.204 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:24:20.176654Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.204 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.204 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:20.247 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.247 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.246+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.246+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.246+0000 7f2dc9e12800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ef07f4a3c0 0x55ef07f4c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.246+0000 7f2dc9e12800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef07e04d40 con 0x55ef07f468b0 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.246+0000 7f2dc9e12800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55ef07dd74d0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dbffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ef07f4a3c0 0x55ef07f4c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dc53ee640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55ef07f468b0 0x55ef07f48ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34672/0 (socket says 172.21.15.169:34672) 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dc53ee640 1 -- 172.21.15.169:0/686571985 learned_addr learned my addr 172.21.15.169:0/686571985 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dbffff640 1 -- 172.21.15.169:0/686571985 >> v1:172.21.15.142:6789/0 conn(0x55ef07f468b0 legacy=0x55ef07f48ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dc4bed640 1 -- 172.21.15.169:0/686571985 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932018237 0 0) 0x55ef07e04d40 con 0x55ef07f468b0 2024-04-24T01:24:20.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.247+0000 7f2dbffff640 1 -- 172.21.15.169:0/686571985 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef07e03590 con 0x55ef07f4a3c0 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dbffff640 1 --2- 172.21.15.169:0/686571985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f4a3c0 0x55ef07f4c7b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2db000a470 tx=0x7f2db001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f69fdc032ab85 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc4bed640 1 -- 172.21.15.169:0/686571985 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db0057070 con 0x55ef07f4a3c0 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc4bed640 1 -- 172.21.15.169:0/686571985 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0052570 con 0x55ef07f4a3c0 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc4bed640 1 -- 172.21.15.169:0/686571985 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db0052870 con 0x55ef07f4a3c0 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 -- 172.21.15.169:0/686571985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f4a3c0 msgr2=0x55ef07f4c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/686571985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f4a3c0 0x55ef07f4c7b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2db000a470 tx=0x7f2db001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 -- 172.21.15.169:0/686571985 shutdown_connections 2024-04-24T01:24:20.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/686571985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f4a3c0 0x55ef07f4c7b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 -- 172.21.15.169:0/686571985 >> 172.21.15.169:0/686571985 conn(0x55ef07f40380 msgr2=0x55ef07f427a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 -- 172.21.15.169:0/686571985 shutdown_connections 2024-04-24T01:24:20.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.249+0000 7f2dc9e12800 1 -- 172.21.15.169:0/686571985 wait complete. 2024-04-24T01:24:20.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.261+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.261+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.261+0000 7f2dc9e12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.261+0000 7f2dc9e12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ef07e913c0 con 0x55ef07f468b0 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33448/0 (socket says 172.21.15.169:33448) 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2dc53ee640 1 -- 172.21.15.169:0/815947795 learned_addr learned my addr 172.21.15.169:0/815947795 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2dc53ee640 1 -- 172.21.15.169:0/815947795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef080374e0 con 0x55ef07f468b0 2024-04-24T01:24:20.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/815947795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2db800b210 tx=0x7f2db800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4bf4918a1eac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2cb3606640 1 -- 172.21.15.169:0/815947795 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8008070 con 0x55ef07f468b0 2024-04-24T01:24:20.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2cb3606640 1 -- 172.21.15.169:0/815947795 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db800d500 con 0x55ef07f468b0 2024-04-24T01:24:20.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.262+0000 7f2cb3606640 1 -- 172.21.15.169:0/815947795 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db800d840 con 0x55ef07f468b0 2024-04-24T01:24:20.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- 172.21.15.169:0/815947795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 msgr2=0x55ef08036f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/815947795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f2db800b210 tx=0x7f2db800b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- 172.21.15.169:0/815947795 shutdown_connections 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/815947795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef08036f10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- 172.21.15.169:0/815947795 >> 172.21.15.169:0/815947795 conn(0x55ef07f40380 msgr2=0x55ef08032830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- 172.21.15.169:0/815947795 shutdown_connections 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- 172.21.15.169:0/815947795 wait complete. 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef0803ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc9e12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ef07f4cff0 con 0x55ef07f468b0 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef0803ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef0803ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33458/0 (socket says 172.21.15.169:33458) 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.263+0000 7f2dc53ee640 1 -- 172.21.15.169:0/897857668 learned_addr learned my addr 172.21.15.169:0/897857668 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2dc53ee640 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0803efd0 con 0x55ef07f468b0 2024-04-24T01:24:20.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef0803ea90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2db800b210 tx=0x7f2db8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2cb1e03640 1 -- 172.21.15.169:0/897857668 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db800f950 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2cb1e03640 1 -- 172.21.15.169:0/897857668 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db800faf0 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2cb1e03640 1 -- 172.21.15.169:0/897857668 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db800fdd0 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef0803f260 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.264+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef08041f10 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2cb1e03640 1 -- 172.21.15.169:0/897857668 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2db8017040 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2cb1e03640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2cac036900 0x7f2cac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2cb1e03640 1 -- 172.21.15.169:0/897857668 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2db8015020 con 0x55ef07f468b0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2dbffff640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2cac036900 0x7f2cac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef07f4a3c0 0x55ef08045cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08046210 con 0x55ef07f4a3c0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.265+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef07f4a3c0 0x55ef08045cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dbffff640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2cac036900 0x7f2cac038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2db0054000 tx=0x7f2db004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef07f4a3c0 0x55ef08045cd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc5bef640 1 -- 172.21.15.169:0/897857668 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef080432a0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc5bef640 1 -- 172.21.15.169:0/897857668 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08048520 0x55ef0804a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef0804b000 con 0x55ef08048520 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.266+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08048520 0x55ef0804a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.267+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08048520 0x55ef0804a910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.267+0000 7f2dc53ee640 1 -- 172.21.15.169:0/897857668 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2db802d070 con 0x55ef08048520 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.267+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef080474d0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dc5bef640 1 -- 172.21.15.169:0/897857668 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef07f4a3c0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ef0804c4b0 0x55ef0804e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef0804f060 con 0x55ef0804c4b0 2024-04-24T01:24:20.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dbffff640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ef0804c4b0 0x55ef0804e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dbffff640 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ef0804c4b0 0x55ef0804e900 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.268+0000 7f2dbffff640 1 -- 172.21.15.169:0/897857668 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2db0052940 con 0x55ef0804c4b0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc9e12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc9e12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ef07e376b0 con 0x55ef0805d4c0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33468/0 (socket says 172.21.15.169:33468) 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc53ee640 1 -- 172.21.15.169:0/1629544648 learned_addr learned my addr 172.21.15.169:0/1629544648 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc53ee640 1 -- 172.21.15.169:0/1629544648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0805de20 con 0x55ef0805d4c0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2db804b4b0 tx=0x7f2db801aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.269+0000 7f2caaffd640 1 -- 172.21.15.169:0/1629544648 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db801ade0 con 0x55ef0805d4c0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2caaffd640 1 -- 172.21.15.169:0/1629544648 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8019470 con 0x55ef0805d4c0 2024-04-24T01:24:20.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef0805e890 con 0x55ef0805d4c0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2caaffd640 1 -- 172.21.15.169:0/1629544648 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8019750 con 0x55ef0805d4c0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef0805ed90 con 0x55ef0805d4c0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2caaffd640 1 -- 172.21.15.169:0/1629544648 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2db803f1b0 con 0x55ef0805d4c0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2caaffd640 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 0x7f2ca0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2caaffd640 1 -- 172.21.15.169:0/1629544648 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2db803cc50 con 0x55ef0805d4c0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.270+0000 7f2dbffff640 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 0x7f2ca0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dbffff640 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 0x7f2ca0038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55ef08046ad0 tx=0x7f2db0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc9e12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc9e12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ef08037860 con 0x55ef0806a840 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33476/0 (socket says 172.21.15.169:33476) 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2587197034 learned_addr learned my addr 172.21.15.169:0/2587197034 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2587197034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef0806b230 con 0x55ef0806a840 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.271+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/2587197034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2db801ac40 tx=0x7f2db80264f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233230b9db71a985 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2ca8ff9640 1 -- 172.21.15.169:0/2587197034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8027df0 con 0x55ef0806a840 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2ca8ff9640 1 -- 172.21.15.169:0/2587197034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8030d50 con 0x55ef0806a840 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2ca8ff9640 1 -- 172.21.15.169:0/2587197034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db8040a30 con 0x55ef0806a840 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2587197034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 msgr2=0x55ef0806ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2587197034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2db801ac40 tx=0x7f2db80264f0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2587197034 shutdown_connections 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2587197034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef0806ac60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2587197034 >> 172.21.15.169:0/2587197034 conn(0x55ef08066ba0 msgr2=0x55ef08064c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2587197034 shutdown_connections 2024-04-24T01:24:20.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2587197034 wait complete. 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.272+0000 7f2dc9e12800 1 Processor -- start 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc9e12800 1 -- start start 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc9e12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc9e12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ef0806b8e0 con 0x55ef0806a840 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc53ee640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33486/0 (socket says 172.21.15.169:33486) 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 learned_addr learned my addr 172.21.15.169:0/2460899860 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef07f448e0 con 0x55ef0806a840 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2db801ac40 tx=0x7f2db801d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2c96ffd640 1 -- 172.21.15.169:0/2460899860 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db801c710 con 0x55ef0806a840 2024-04-24T01:24:20.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2c96ffd640 1 -- 172.21.15.169:0/2460899860 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db8069070 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2c96ffd640 1 -- 172.21.15.169:0/2460899860 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2db803f610 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef07f448e0 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.273+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef07f448e0 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.274+0000 7f2c96ffd640 1 -- 172.21.15.169:0/2460899860 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2db804da90 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.274+0000 7f2c96ffd640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2c90036950 0x7f2c90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.274+0000 7f2dbffff640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2c90036950 0x7f2c90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.274+0000 7f2c96ffd640 1 -- 172.21.15.169:0/2460899860 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2db8065150 con 0x55ef0806a840 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef0807f3d0 0x55ef08081890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08081fe0 con 0x55ef0807f3d0 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dbffff640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2c90036950 0x7f2c90038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2db0052fd0 tx=0x7f2db004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef0807f3d0 0x55ef08081890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef0807f3d0 0x55ef08081890 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 20 realm 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.275+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef080823f0 con 0x55ef0807f3d0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08082cc0 con 0x55ef0807f3d0 2024-04-24T01:24:20.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef0807f3d0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08083b50 0x55ef08085f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef080866a0 con 0x55ef08083b50 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.276+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08083b50 0x55ef08085f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc53ee640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08083b50 0x55ef08085f40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc9e12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc9e12800 20 searching for the correct realm 2024-04-24T01:24:20.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ef08088750 0x55ef0808ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808b2e0 con 0x55ef08088750 2024-04-24T01:24:20.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dbffff640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ef08088750 0x55ef0808ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.277+0000 7f2dbffff640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ef08088750 0x55ef0808ac10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dbffff640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2db0076040 0x7f2db0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808b2e0 con 0x7f2db0076040 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2db0076040 0x7f2db0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dc5bef640 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2db0076040 0x7f2db0083410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.278+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef0807f3d0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef0807f3d0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.279+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x7f2db0076040 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08088750 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef0807f3d0 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.280+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08083b50 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef0807f3d0 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x7f2db0076040 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ef08083060 con 0x55ef08088750 2024-04-24T01:24:20.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.281+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08083b50 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.282+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef0807f3d0 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef0807f3d0 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08083b50 2024-04-24T01:24:20.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.283+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x7f2db0076040 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef0807f3d0 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08083b50 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.284+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08083b50 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x7f2db0076040 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08088750 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.285+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef08083b50 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x55ef0807f3d0 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2db0090040 con 0x7f2db0076040 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08087050 con 0x55ef0807f3d0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.286+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08087050 con 0x55ef0807f3d0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08087020 con 0x7f2db0076040 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 zone default found 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 4 Realm: () 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 zonegroup default 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.287+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08087440 con 0x55ef08083b50 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08087030 con 0x55ef08088750 2024-04-24T01:24:20.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808d140 con 0x55ef08088750 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 started sync module instance, tier type = 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.288+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808c5e0 con 0x7f2db0076040 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.289+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.289+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94485120338656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808c5e0 con 0x7f2db0076040 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.289+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808db40 con 0x55ef0807f3d0 2024-04-24T01:24:20.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.290+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.290+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94485120338656] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.290+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94485120341584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808daf0 con 0x55ef0807f3d0 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.290+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808c150 con 0x55ef08088750 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.291+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94485120341584] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.291+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.291+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94485120343856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808eab0 con 0x55ef08088750 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.291+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808f470 con 0x7f2db0076040 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.292+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94485120343856] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.292+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.292+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94485120348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808f890 con 0x7f2db0076040 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.293+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08090250 con 0x55ef0807f3d0 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.293+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.293+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94485120348096] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.294+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94485120351648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef080901c0 con 0x55ef0807f3d0 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.294+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808f420 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.294+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94485120351648] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.295+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.295+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94485120353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08091140 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.295+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef080919f0 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.296+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94485120353856] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.296+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.296+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94485120355472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092240 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.296+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092c00 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94485120355472] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94485120359824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092de0 con 0x55ef08083b50 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=0 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=1 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=2 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=3 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=4 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=5 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=6 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94485120359824] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 20 add_watcher() i=7 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.297+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef08095fd0 con 0x55ef0807f3d0 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.298+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.298+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94485120362896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08093260 con 0x55ef0807f3d0 2024-04-24T01:24:20.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94485120362896] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 5 note: GC not initialized 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2c7a7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 20 Filter name: none 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2bebfff640 20 reqs_thread_entry: start 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.299+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ef080c8eb0 con 0x55ef0807f3d0 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.300+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.300+0000 7f2dc9e12800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T01:24:20.317 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:24:20.176654Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.301+0000 7f2c7b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.301+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94485120362896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef080c7a60 con 0x55ef0807f3d0 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.302+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94485120362896] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.302+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94485120338656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092990 con 0x7f2db0076040 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.303+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94485120338656] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.303+0000 7f2dc9e12800 20 remove_watcher() i=0 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.303+0000 7f2dc9e12800 2 removed watcher, disabling cache 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.303+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94485120341584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092990 con 0x55ef0807f3d0 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.304+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94485120341584] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.304+0000 7f2dc9e12800 20 remove_watcher() i=1 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.304+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94485120343856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08092990 con 0x55ef08088750 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.305+0000 7f2dbffff640 1 -- 172.21.15.169:0/2460899860 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94485120343856] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db0081070 con 0x55ef08088750 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.305+0000 7f2dc9e12800 20 remove_watcher() i=2 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.305+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94485120348096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808d650 con 0x7f2db0076040 2024-04-24T01:24:20.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.306+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94485120348096] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x7f2db0076040 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.306+0000 7f2dc9e12800 20 remove_watcher() i=3 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.306+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94485120351648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808d650 con 0x55ef0807f3d0 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.307+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94485120351648] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2dc000a4a0 con 0x55ef0807f3d0 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.307+0000 7f2dc9e12800 20 remove_watcher() i=4 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.307+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94485120353856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808fda0 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.309+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94485120353856] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.309+0000 7f2dc9e12800 20 remove_watcher() i=5 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.309+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94485120355472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef0808d650 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.310+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94485120355472] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.310+0000 7f2dc9e12800 20 remove_watcher() i=6 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.310+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94485120359824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ef08090c90 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc53ee640 1 -- 172.21.15.169:0/2460899860 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94485120359824] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2db8050020 con 0x55ef08083b50 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 20 remove_watcher() i=7 2024-04-24T01:24:20.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08083b50 msgr2=0x55ef08085f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08083b50 0x55ef08085f40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef0807f3d0 msgr2=0x55ef08081890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef0807f3d0 0x55ef08081890 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2db0076040 msgr2=0x7f2db0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2db0076040 0x7f2db0083410 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ef08088750 msgr2=0x55ef0808ac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ef08088750 0x55ef0808ac10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2c90036950 msgr2=0x7f2c90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2c90036950 0x7f2c90038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2db0052fd0 tx=0x7f2db004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 msgr2=0x55ef07f461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc5bef640 1 -- 172.21.15.169:0/2460899860 reap_dead start 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2db801ac40 tx=0x7f2db801d3c0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 shutdown_connections 2024-04-24T01:24:20.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/2460899860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0806a840 0x55ef07f461f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 >> 172.21.15.169:0/2460899860 conn(0x55ef08066ba0 msgr2=0x55ef08064200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 shutdown_connections 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/2460899860 wait complete. 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 msgr2=0x7f2ca0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 0x7f2ca0038dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x55ef08046ad0 tx=0x7f2db0005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 msgr2=0x55ef0805d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2db804b4b0 tx=0x7f2db801aaf0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 shutdown_connections 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2ca0036900 0x7f2ca0038dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/1629544648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef0805d4c0 0x55ef0805d8e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 >> 172.21.15.169:0/1629544648 conn(0x55ef08051560 msgr2=0x55ef08051960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 shutdown_connections 2024-04-24T01:24:20.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.311+0000 7f2dc9e12800 1 -- 172.21.15.169:0/1629544648 wait complete. 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08048520 msgr2=0x55ef0804a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ef08048520 0x55ef0804a910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef07f4a3c0 msgr2=0x55ef08045cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ef07f4a3c0 0x55ef08045cd0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ef0804c4b0 msgr2=0x55ef0804e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ef0804c4b0 0x55ef0804e900 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2cac036900 msgr2=0x7f2cac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2cac036900 0x7f2cac038dc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2db0054000 tx=0x7f2db004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 msgr2=0x55ef0803ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 --2- 172.21.15.169:0/897857668 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef07f468b0 0x55ef0803ea90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2db800b210 tx=0x7f2db8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc5bef640 1 -- 172.21.15.169:0/897857668 reap_dead start 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 shutdown_connections 2024-04-24T01:24:20.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 >> 172.21.15.169:0/897857668 conn(0x55ef07f40380 msgr2=0x55ef080310b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 shutdown_connections 2024-04-24T01:24:20.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.312+0000 7f2dc9e12800 1 -- 172.21.15.169:0/897857668 wait complete. 2024-04-24T01:24:20.328 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:24:20.176654Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.328 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T01:24:20.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-04-24T01:24:20.328 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-04-24T01:24:20.407 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.408 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ee336800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a9dff8f3e0 0x55a9dff917d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ee336800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a9dfe49d40 con 0x55a9dff8b8d0 2024-04-24T01:24:20.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ee336800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55a9dfe1c4d0 con 0x55a9dff8f3e0 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94e98cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a9dff8f3e0 0x55a9dff917d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94e98cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a9dff8f3e0 0x55a9dff917d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33492/0 (socket says 172.21.15.169:33492) 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94e98cb640 1 -- 172.21.15.169:0/636248752 learned_addr learned my addr 172.21.15.169:0/636248752 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.407+0000 7f94ea0cc640 1 --1- 172.21.15.169:0/636248752 >> v1:172.21.15.142:6789/0 conn(0x55a9dff8b8d0 0x55a9dff8dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34684/0 (socket says 172.21.15.169:34684) 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.408+0000 7f94e98cb640 1 -- 172.21.15.169:0/636248752 >> v1:172.21.15.142:6789/0 conn(0x55a9dff8b8d0 legacy=0x55a9dff8dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.408+0000 7f94e90ca640 1 -- 172.21.15.169:0/636248752 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837464310 0 0) 0x55a9dfe49d40 con 0x55a9dff8b8d0 2024-04-24T01:24:20.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.408+0000 7f94e98cb640 1 -- 172.21.15.169:0/636248752 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9dfe48590 con 0x55a9dff8f3e0 2024-04-24T01:24:20.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.409+0000 7f94e98cb640 1 --2- 172.21.15.169:0/636248752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8f3e0 0x55a9dff917d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a520 tx=0x7f94dc01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54f5ff3870e1e0e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94e90ca640 1 -- 172.21.15.169:0/636248752 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94dc057070 con 0x55a9dff8f3e0 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94e90ca640 1 -- 172.21.15.169:0/636248752 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc052570 con 0x55a9dff8f3e0 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94e90ca640 1 -- 172.21.15.169:0/636248752 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94dc04ae60 con 0x55a9dff8f3e0 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 -- 172.21.15.169:0/636248752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8f3e0 msgr2=0x55a9dff917d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 --2- 172.21.15.169:0/636248752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8f3e0 0x55a9dff917d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a520 tx=0x7f94dc01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 -- 172.21.15.169:0/636248752 shutdown_connections 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 --2- 172.21.15.169:0/636248752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8f3e0 0x55a9dff917d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 -- 172.21.15.169:0/636248752 >> 172.21.15.169:0/636248752 conn(0x55a9dff853a0 msgr2=0x55a9dff877c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 -- 172.21.15.169:0/636248752 shutdown_connections 2024-04-24T01:24:20.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.410+0000 7f94ee336800 1 -- 172.21.15.169:0/636248752 wait complete. 2024-04-24T01:24:20.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ee336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ee336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a9dfed63b0 con 0x55a9dff8b8d0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33508/0 (socket says 172.21.15.169:33508) 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.422+0000 7f94ea0cc640 1 -- 172.21.15.169:0/3688337226 learned_addr learned my addr 172.21.15.169:0/3688337226 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.423+0000 7f94ea0cc640 1 -- 172.21.15.169:0/3688337226 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e007c4a0 con 0x55a9dff8b8d0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.423+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/3688337226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94e000b210 tx=0x7f94e000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245aa5af64fd1a2c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.423+0000 7f93d8608640 1 -- 172.21.15.169:0/3688337226 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0008070 con 0x55a9dff8b8d0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.423+0000 7f93d8608640 1 -- 172.21.15.169:0/3688337226 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e000d500 con 0x55a9dff8b8d0 2024-04-24T01:24:20.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.423+0000 7f93d8608640 1 -- 172.21.15.169:0/3688337226 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e000d840 con 0x55a9dff8b8d0 2024-04-24T01:24:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- 172.21.15.169:0/3688337226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 msgr2=0x55a9e007bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 --2- 172.21.15.169:0/3688337226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94e000b210 tx=0x7f94e000b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- 172.21.15.169:0/3688337226 shutdown_connections 2024-04-24T01:24:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 --2- 172.21.15.169:0/3688337226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e007bed0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- 172.21.15.169:0/3688337226 >> 172.21.15.169:0/3688337226 conn(0x55a9dff853a0 msgr2=0x55a9e00777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- 172.21.15.169:0/3688337226 shutdown_connections 2024-04-24T01:24:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- 172.21.15.169:0/3688337226 wait complete. 2024-04-24T01:24:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e0083aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ee336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a9dff92010 con 0x55a9dff8b8d0 2024-04-24T01:24:20.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e0083aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e0083aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33516/0 (socket says 172.21.15.169:33516) 2024-04-24T01:24:20.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.424+0000 7f94ea0cc640 1 -- 172.21.15.169:0/3707475534 learned_addr learned my addr 172.21.15.169:0/3707475534 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f94ea0cc640 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e0083fe0 con 0x55a9dff8b8d0 2024-04-24T01:24:20.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e0083aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94e0001e60 tx=0x7f94e0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f93d6e05640 1 -- 172.21.15.169:0/3707475534 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0019870 con 0x55a9dff8b8d0 2024-04-24T01:24:20.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f93d6e05640 1 -- 172.21.15.169:0/3707475534 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e0019a10 con 0x55a9dff8b8d0 2024-04-24T01:24:20.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9e0084270 con 0x55a9dff8b8d0 2024-04-24T01:24:20.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f93d6e05640 1 -- 172.21.15.169:0/3707475534 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0019cf0 con 0x55a9dff8b8d0 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.425+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9e0086f20 con 0x55a9dff8b8d0 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f93d6e05640 1 -- 172.21.15.169:0/3707475534 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94e0017040 con 0x55a9dff8b8d0 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f93d6e05640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93d0036950 0x7f93d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f93d6e05640 1 -- 172.21.15.169:0/3707475534 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94e0015020 con 0x55a9dff8b8d0 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f94e98cb640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93d0036950 0x7f93d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9dff8f3e0 0x55a9e008ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e008b260 con 0x55a9dff8f3e0 2024-04-24T01:24:20.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9dff8f3e0 0x55a9e008ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.426+0000 7f94e98cb640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93d0036950 0x7f93d0038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94dc054000 tx=0x7f94dc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9dff8f3e0 0x55a9e008ace0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ea8cd640 1 -- 172.21.15.169:0/3707475534 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9dff8f3e0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00882b0 con 0x55a9dff8f3e0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ea8cd640 1 -- 172.21.15.169:0/3707475534 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9dff8f3e0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e008d5b0 0x55a9e008f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e0090040 con 0x55a9e008d5b0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.427+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e008d5b0 0x55a9e008f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e008d5b0 0x55a9e008f9a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ea0cc640 1 -- 172.21.15.169:0/3707475534 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e008d5b0 2024-04-24T01:24:20.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e008c560 con 0x55a9dff8f3e0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ea8cd640 1 -- 172.21.15.169:0/3707475534 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9dff8f3e0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a9e00914f0 0x55a9e0093940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00940a0 con 0x55a9e00914f0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.428+0000 7f94e98cb640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a9e00914f0 0x55a9e0093940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94e98cb640 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a9e00914f0 0x55a9e0093940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94e98cb640 1 -- 172.21.15.169:0/3707475534 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94dc05a040 con 0x55a9e00914f0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94ee336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.429+0000 7f94ee336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a9dfe7c6b0 con 0x55a9e00a2500 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33526/0 (socket says 172.21.15.169:33526) 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ea0cc640 1 -- 172.21.15.169:0/2954618777 learned_addr learned my addr 172.21.15.169:0/2954618777 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ea0cc640 1 -- 172.21.15.169:0/2954618777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e00a2e60 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94e004b370 tx=0x7f94e000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f93cffff640 1 -- 172.21.15.169:0/2954618777 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e00449d0 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f93cffff640 1 -- 172.21.15.169:0/2954618777 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e0044b70 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9e00a38d0 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f93cffff640 1 -- 172.21.15.169:0/2954618777 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0044e50 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.430+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9e00a3dd0 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.431+0000 7f93cffff640 1 -- 172.21.15.169:0/2954618777 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94e003f1b0 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.431+0000 7f93cffff640 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 0x7f93c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.431+0000 7f93cffff640 1 -- 172.21.15.169:0/2954618777 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94e003cc50 con 0x55a9e00a2500 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.431+0000 7f94e98cb640 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 0x7f93c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94e98cb640 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 0x7f93c4038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55a9e00881d0 tx=0x7f94dc005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ee336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ee336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a9e007c820 con 0x55a9e00af7a0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33532/0 (socket says 172.21.15.169:33532) 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ea0cc640 1 -- 172.21.15.169:0/816270398 learned_addr learned my addr 172.21.15.169:0/816270398 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ea0cc640 1 -- 172.21.15.169:0/816270398 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e00b0190 con 0x55a9e00af7a0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/816270398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94e001cf70 tx=0x7f94e0018f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851049cdcc7bd1ef server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f93cdffb640 1 -- 172.21.15.169:0/816270398 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0026b20 con 0x55a9e00af7a0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f93cdffb640 1 -- 172.21.15.169:0/816270398 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e0045e70 con 0x55a9e00af7a0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.432+0000 7f93cdffb640 1 -- 172.21.15.169:0/816270398 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0026430 con 0x55a9e00af7a0 2024-04-24T01:24:20.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- 172.21.15.169:0/816270398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 msgr2=0x55a9e00afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 --2- 172.21.15.169:0/816270398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f94e001cf70 tx=0x7f94e0018f30 comp rx=0 tx=0).stop 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- 172.21.15.169:0/816270398 shutdown_connections 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 --2- 172.21.15.169:0/816270398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00afbc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- 172.21.15.169:0/816270398 >> 172.21.15.169:0/816270398 conn(0x55a9e00abb00 msgr2=0x55a9e00a9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- 172.21.15.169:0/816270398 shutdown_connections 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- 172.21.15.169:0/816270398 wait complete. 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 Processor -- start 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- start start 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.433+0000 7f94ee336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a9e00b0840 con 0x55a9e00af7a0 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ea0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33542/0 (socket says 172.21.15.169:33542) 2024-04-24T01:24:20.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 learned_addr learned my addr 172.21.15.169:0/550161302 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9e00b70d0 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00b6b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94e0027d70 tx=0x7f94e0016ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f93bbfff640 1 -- 172.21.15.169:0/550161302 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e0026b20 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f93bbfff640 1 -- 172.21.15.169:0/550161302 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e005c070 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9e00b70d0 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f93bbfff640 1 -- 172.21.15.169:0/550161302 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94e000fde0 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.434+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9e00b70d0 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.435+0000 7f93bbfff640 1 -- 172.21.15.169:0/550161302 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94e0052070 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.435+0000 7f93bbfff640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93b40368b0 0x7f93b4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.435+0000 7f93bbfff640 1 -- 172.21.15.169:0/550161302 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f94e006b030 con 0x55a9e00af7a0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.435+0000 7f94e98cb640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93b40368b0 0x7f93b4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.435+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9e00c2330 0x55a9e00c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c4f40 con 0x55a9e00c2330 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94e98cb640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93b40368b0 0x7f93b4038d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94dc055040 tx=0x7f94dc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9e00c2330 0x55a9e00c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9e00c2330 0x55a9e00c47f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 20 realm 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5350 con 0x55a9e00c2330 2024-04-24T01:24:20.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.436+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5c20 con 0x55a9e00c2330 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e00c6d20 0x55a9e00c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c9720 con 0x55a9e00c6d20 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e00c6d20 0x55a9e00c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.437+0000 7f94ea0cc640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e00c6d20 0x55a9e00c9110 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94ee336800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94ee336800 20 searching for the correct realm 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a9e00cb6d0 0x55a9e00cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00ce260 con 0x55a9e00cb6d0 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94e98cb640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a9e00cb6d0 0x55a9e00cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94e98cb640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a9e00cb6d0 0x55a9e00cdb90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94e98cb640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f94dc082040 0x7f94dc083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.438+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00ce260 con 0x7f94dc082040 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.439+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f94dc082040 0x7f94dc083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.439+0000 7f94ea8cd640 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f94dc082040 0x7f94dc083430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.439+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.439+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.440+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x7f94dc082040 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.441+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x7f94dc082040 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.442+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.443+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.444+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x7f94dc082040 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.445+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x7f94dc082040 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.446+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c6d20 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x55a9e00c2330 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c5fc0 con 0x7f94dc082040 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c9fe0 con 0x55a9e00c2330 2024-04-24T01:24:20.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.447+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c9fe0 con 0x55a9e00c2330 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00c9fe0 con 0x7f94dc082040 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 zone default found 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 4 Realm: () 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 zonegroup default 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00ca880 con 0x55a9e00c6d20 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.448+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d00c0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d0460 con 0x55a9e00cb6d0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 20 started sync module instance, tier type = 2024-04-24T01:24:20.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.449+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00cf560 con 0x7f94dc082040 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.450+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.450+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94188096780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00cf560 con 0x7f94dc082040 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.450+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d0cf0 con 0x55a9e00c2330 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.451+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94188096780624] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.451+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.451+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94188096784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00cf560 con 0x55a9e00c2330 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.451+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d1740 con 0x55a9e00cb6d0 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.452+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.452+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94188096787024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d2010 con 0x55a9e00cb6d0 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.452+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d2a70 con 0x7f94dc082040 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.452+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94188096784384] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.453+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94188096787024] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.453+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.453+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94188096789344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d2550 con 0x7f94dc082040 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.453+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d3350 con 0x55a9e00c2330 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.454+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94188096789344] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.454+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.454+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94188096778416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d32c0 con 0x55a9e00c2330 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.454+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d3d60 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.455+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94188096778416] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.455+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.455+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94188096794128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d3230 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.456+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d4ab0 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.456+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.456+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94188096802384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d5720 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.456+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d6190 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94188096794128] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94188096802384] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94188096803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d4140 con 0x55a9e00c6d20 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=0 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=1 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=2 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=3 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=4 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=5 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.457+0000 7f94ee336800 20 add_watcher() i=6 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.458+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94188096803440] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.458+0000 7f94ee336800 20 add_watcher() i=7 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.458+0000 7f94ee336800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.458+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d9400 con 0x55a9e00c2330 2024-04-24T01:24:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.459+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.459+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94188096805984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d68c0 con 0x55a9e00c2330 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94188096805984] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f93a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 5 note: GC not initialized 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f931b7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 20 Filter name: none 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f93197fa640 20 reqs_thread_entry: start 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.460+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e010c7f0 con 0x55a9e00c2330 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ee336800 20 rados_obj.operate() r=0 bl.length=502 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ee336800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ee336800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ee336800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.461+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e0112ea0 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ee336800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ee336800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ee336800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94188097054992 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e010e590 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94188096778416 notify 137438953476 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f94e4026410 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(64 notify.4 [notify cookie 94188097054992 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f93cdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94188096778416 notifier 4353 bl.length()=567 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f93cdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f93cdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f93cdffb640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f93b0003ea0 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.462+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94188097054992 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f94e40265e0 con 0x55a9e00c2330 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.463+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e0112910 con 0x55a9e00c6d20 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f94ee336800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94188097054992 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a9e010e0e0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 94188096787024 notify 137438953473 ret 0) ==== 212+0+0 (crc 0 0 0) 0x7f94dc08c040 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f93cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94188096787024 notifier 4353 bl.length()=170 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 notify.2 [notify cookie 94188097054992 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.464+0000 7f93cd7fa640 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f93200032c0 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.465+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify_complete (2) cookie 94188097054992 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9dfe48590 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.465+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.485 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.465+0000 7f93a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.465+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94188096805984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e010aed0 con 0x55a9e00c2330 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.466+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94188096805984] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.466+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94188096780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d5c60 con 0x7f94dc082040 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.467+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94188096780624] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.467+0000 7f94ee336800 20 remove_watcher() i=0 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.467+0000 7f94ee336800 2 removed watcher, disabling cache 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.467+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94188096784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d5c60 con 0x55a9e00c2330 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.469+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94188096784384] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.469+0000 7f94ee336800 20 remove_watcher() i=1 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.469+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94188096787024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d0800 con 0x55a9e00cb6d0 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.470+0000 7f94e98cb640 1 -- 172.21.15.169:0/550161302 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94188096787024] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc07f070 con 0x55a9e00cb6d0 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.470+0000 7f94ee336800 20 remove_watcher() i=2 2024-04-24T01:24:20.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.470+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94188096789344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d1250 con 0x7f94dc082040 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.471+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94188096789344] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x7f94dc082040 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.471+0000 7f94ee336800 20 remove_watcher() i=3 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.471+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94188096778416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d0800 con 0x55a9e00c2330 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.472+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94188096778416] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e400a4a0 con 0x55a9e00c2330 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.472+0000 7f94ee336800 20 remove_watcher() i=4 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.472+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94188096794128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d1250 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.473+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94188096794128] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.473+0000 7f94ee336800 20 remove_watcher() i=5 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.473+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94188096802384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00cf0b0 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.474+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94188096802384] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.474+0000 7f94ee336800 20 remove_watcher() i=6 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.474+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94188096803440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a9e00d0800 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ea0cc640 1 -- 172.21.15.169:0/550161302 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94188096803440] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e002d070 con 0x55a9e00c6d20 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 20 remove_watcher() i=7 2024-04-24T01:24:20.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e00c6d20 msgr2=0x55a9e00c9110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e00c6d20 0x55a9e00c9110 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9e00c2330 msgr2=0x55a9e00c47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9e00c2330 0x55a9e00c47f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f94dc082040 msgr2=0x7f94dc083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f94dc082040 0x7f94dc083430 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a9e00cb6d0 msgr2=0x55a9e00cdb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a9e00cb6d0 0x55a9e00cdb90 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93b40368b0 msgr2=0x7f93b4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93b40368b0 0x7f93b4038d70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f94dc055040 tx=0x7f94dc04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 msgr2=0x55a9e00b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 --2- 172.21.15.169:0/550161302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00af7a0 0x55a9e00b6b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94e0027d70 tx=0x7f94e0016ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 reap_dead start 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ea8cd640 1 -- 172.21.15.169:0/550161302 reap_dead start 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 shutdown_connections 2024-04-24T01:24:20.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 >> 172.21.15.169:0/550161302 conn(0x55a9e00abb00 msgr2=0x55a9e00a9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 shutdown_connections 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.475+0000 7f94ee336800 1 -- 172.21.15.169:0/550161302 wait complete. 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 msgr2=0x7f93c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 0x7f93c4038dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x55a9e00881d0 tx=0x7f94dc005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 msgr2=0x55a9e00a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94e004b370 tx=0x7f94e000ed80 comp rx=0 tx=0).stop 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 shutdown_connections 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93c4036900 0x7f93c4038dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/2954618777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9e00a2500 0x55a9e00a2920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 >> 172.21.15.169:0/2954618777 conn(0x55a9e00965a0 msgr2=0x55a9e00969a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 shutdown_connections 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/2954618777 wait complete. 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e008d5b0 msgr2=0x55a9e008f9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a9e008d5b0 0x55a9e008f9a0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9dff8f3e0 msgr2=0x55a9e008ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a9dff8f3e0 0x55a9e008ace0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a9e00914f0 msgr2=0x55a9e0093940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a9e00914f0 0x55a9e0093940 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93d0036950 msgr2=0x7f93d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f93d0036950 0x7f93d0038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94dc054000 tx=0x7f94dc04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 msgr2=0x55a9e0083aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 --2- 172.21.15.169:0/3707475534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a9dff8b8d0 0x55a9e0083aa0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94e0001e60 tx=0x7f94e0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ea8cd640 1 -- 172.21.15.169:0/3707475534 reap_dead start 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 shutdown_connections 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 >> 172.21.15.169:0/3707475534 conn(0x55a9dff853a0 msgr2=0x55a9e0076050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 shutdown_connections 2024-04-24T01:24:20.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.476+0000 7f94ee336800 1 -- 172.21.15.169:0/3707475534 wait complete. 2024-04-24T01:24:20.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.497 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T01:24:20.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-04-24T01:24:20.497 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-04-24T01:24:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.542 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.541+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.541+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.541+0000 7fd676816800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac9a47d990 0x55ac9a47fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.541+0000 7fd676816800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac9a33bd40 con 0x55ac9a4802c0 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.541+0000 7fd676816800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55ac9a30e4d0 con 0x55ac9a47d990 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671e84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac9a47d990 0x55ac9a47fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671e84640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac9a47d990 0x55ac9a47fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33554/0 (socket says 172.21.15.169:33554) 2024-04-24T01:24:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd669683640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55ac9a4802c0 0x55ac9a4826b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34688/0 (socket says 172.21.15.169:34688) 2024-04-24T01:24:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671e84640 1 -- 172.21.15.169:0/1684094120 learned_addr learned my addr 172.21.15.169:0/1684094120 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671e84640 1 -- 172.21.15.169:0/1684094120 >> v1:172.21.15.142:6789/0 conn(0x55ac9a4802c0 legacy=0x55ac9a4826b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671683640 1 -- 172.21.15.169:0/1684094120 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605070600 0 0) 0x55ac9a33bd40 con 0x55ac9a4802c0 2024-04-24T01:24:20.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.542+0000 7fd671e84640 1 -- 172.21.15.169:0/1684094120 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a33a590 con 0x55ac9a47d990 2024-04-24T01:24:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd671e84640 1 --2- 172.21.15.169:0/1684094120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a47fd80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd66400a520 tx=0x7fd66401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c3828a4250f176 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd671683640 1 -- 172.21.15.169:0/1684094120 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664057070 con 0x55ac9a47d990 2024-04-24T01:24:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd671683640 1 -- 172.21.15.169:0/1684094120 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd664052570 con 0x55ac9a47d990 2024-04-24T01:24:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd671683640 1 -- 172.21.15.169:0/1684094120 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66404ae60 con 0x55ac9a47d990 2024-04-24T01:24:20.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 -- 172.21.15.169:0/1684094120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 msgr2=0x55ac9a47fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 --2- 172.21.15.169:0/1684094120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a47fd80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd66400a520 tx=0x7fd66401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 -- 172.21.15.169:0/1684094120 shutdown_connections 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 --2- 172.21.15.169:0/1684094120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a47fd80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 -- 172.21.15.169:0/1684094120 >> 172.21.15.169:0/1684094120 conn(0x55ac9a477340 msgr2=0x55ac9a479760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 -- 172.21.15.169:0/1684094120 shutdown_connections 2024-04-24T01:24:20.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.544+0000 7fd676816800 1 -- 172.21.15.169:0/1684094120 wait complete. 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.556+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.556+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.556+0000 7fd676816800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.556+0000 7fd676816800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac9a3c83b0 con 0x55ac9a47d990 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33562/0 (socket says 172.21.15.169:33562) 2024-04-24T01:24:20.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd671e84640 1 -- 172.21.15.169:0/1274118648 learned_addr learned my addr 172.21.15.169:0/1274118648 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd671e84640 1 -- 172.21.15.169:0/1274118648 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a56e510 con 0x55ac9a47d990 2024-04-24T01:24:20.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd671e84640 1 --2- 172.21.15.169:0/1274118648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd664055040 tx=0x7fd66404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1aea26399d396a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd55fe07640 1 -- 172.21.15.169:0/1274118648 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664057040 con 0x55ac9a47d990 2024-04-24T01:24:20.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd55fe07640 1 -- 172.21.15.169:0/1274118648 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd664052720 con 0x55ac9a47d990 2024-04-24T01:24:20.560 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.557+0000 7fd55fe07640 1 -- 172.21.15.169:0/1274118648 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664052a40 con 0x55ac9a47d990 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 -- 172.21.15.169:0/1274118648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 msgr2=0x55ac9a56df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 --2- 172.21.15.169:0/1274118648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd664055040 tx=0x7fd66404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 -- 172.21.15.169:0/1274118648 shutdown_connections 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 --2- 172.21.15.169:0/1274118648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a56df40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 -- 172.21.15.169:0/1274118648 >> 172.21.15.169:0/1274118648 conn(0x55ac9a477340 msgr2=0x55ac9a569860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 -- 172.21.15.169:0/1274118648 shutdown_connections 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 -- 172.21.15.169:0/1274118648 wait complete. 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.558+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd676816800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a5759c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd676816800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac9a4860e0 con 0x55ac9a47d990 2024-04-24T01:24:20.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a5759c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a5759c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33574/0 (socket says 172.21.15.169:33574) 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd671e84640 1 -- 172.21.15.169:0/54824153 learned_addr learned my addr 172.21.15.169:0/54824153 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd671e84640 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a575f00 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd671e84640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a5759c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd664052540 tx=0x7fd664003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd55e604640 1 -- 172.21.15.169:0/54824153 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664073070 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd55e604640 1 -- 172.21.15.169:0/54824153 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66405d440 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd55e604640 1 -- 172.21.15.169:0/54824153 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664057070 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.559+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac9a576190 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.560+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9a578e40 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.560+0000 7fd55e604640 1 -- 172.21.15.169:0/54824153 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd664076070 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.560+0000 7fd55e604640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd558036900 0x7fd558038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.560+0000 7fd55e604640 1 -- 172.21.15.169:0/54824153 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd66408dbe0 con 0x55ac9a47d990 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd669683640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd558036900 0x7fd558038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a4802c0 0x55ac9a57cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a57d140 con 0x55ac9a4802c0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd672685640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a4802c0 0x55ac9a57cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd669683640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd558036900 0x7fd558038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000c00 tx=0x7fd65c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd672685640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a4802c0 0x55ac9a57cc00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd672685640 1 -- 172.21.15.169:0/54824153 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a4802c0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.561+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a57a1b0 con 0x55ac9a4802c0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd672685640 1 -- 172.21.15.169:0/54824153 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a4802c0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a57f430 0x55ac9a581820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a581ef0 con 0x55ac9a57f430 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd671e84640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a57f430 0x55ac9a581820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd671e84640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a57f430 0x55ac9a581820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.562+0000 7fd671e84640 1 -- 172.21.15.169:0/54824153 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a57f430 2024-04-24T01:24:20.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a57e3e0 con 0x55ac9a4802c0 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd672685640 1 -- 172.21.15.169:0/54824153 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a4802c0 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac9a583330 0x55ac9a5857f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a585f80 con 0x55ac9a583330 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd669683640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac9a583330 0x55ac9a5857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd669683640 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac9a583330 0x55ac9a5857f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.563+0000 7fd669683640 1 -- 172.21.15.169:0/54824153 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd65c00f670 con 0x55ac9a583330 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd676816800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd676816800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac9a36e6b0 con 0x55ac9a594430 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33576/0 (socket says 172.21.15.169:33576) 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd671e84640 1 -- 172.21.15.169:0/2176707012 learned_addr learned my addr 172.21.15.169:0/2176707012 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd671e84640 1 -- 172.21.15.169:0/2176707012 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a594d90 con 0x55ac9a594430 2024-04-24T01:24:20.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.564+0000 7fd671e84640 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd664076450 tx=0x7fd664077ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd5577fe640 1 -- 172.21.15.169:0/2176707012 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd664083040 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd5577fe640 1 -- 172.21.15.169:0/2176707012 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd664091070 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd5577fe640 1 -- 172.21.15.169:0/2176707012 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66405cde0 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac9a595800 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9a595d00 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.565+0000 7fd5577fe640 1 -- 172.21.15.169:0/2176707012 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd664093020 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd5577fe640 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 0x7fd54c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd5577fe640 1 -- 172.21.15.169:0/2176707012 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd664060110 con 0x55ac9a594430 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd669683640 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 0x7fd54c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd669683640 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 0x7fd54c038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55ac9a57d5d0 tx=0x7fd65c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd676816800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd676816800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac9a56e7d0 con 0x55ac9a5a15f0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.566+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33582/0 (socket says 172.21.15.169:33582) 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd671e84640 1 -- 172.21.15.169:0/3945380168 learned_addr learned my addr 172.21.15.169:0/3945380168 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd671e84640 1 -- 172.21.15.169:0/3945380168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a5a1fe0 con 0x55ac9a5a15f0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd671e84640 1 --2- 172.21.15.169:0/3945380168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd66406e710 tx=0x7fd664080c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a837f10b40a33d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd5557fa640 1 -- 172.21.15.169:0/3945380168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6640af070 con 0x55ac9a5a15f0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd5557fa640 1 -- 172.21.15.169:0/3945380168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66405d720 con 0x55ac9a5a15f0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd5557fa640 1 -- 172.21.15.169:0/3945380168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66405c3e0 con 0x55ac9a5a15f0 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd676816800 1 -- 172.21.15.169:0/3945380168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 msgr2=0x55ac9a5a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.567+0000 7fd676816800 1 --2- 172.21.15.169:0/3945380168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd66406e710 tx=0x7fd664080c80 comp rx=0 tx=0).stop 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- 172.21.15.169:0/3945380168 shutdown_connections 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 --2- 172.21.15.169:0/3945380168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a1a10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- 172.21.15.169:0/3945380168 >> 172.21.15.169:0/3945380168 conn(0x55ac9a59d900 msgr2=0x55ac9a59b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- 172.21.15.169:0/3945380168 shutdown_connections 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- 172.21.15.169:0/3945380168 wait complete. 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 Processor -- start 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- start start 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd676816800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac9a5a2670 con 0x55ac9a5a15f0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd671e84640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33598/0 (socket says 172.21.15.169:33598) 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 learned_addr learned my addr 172.21.15.169:0/3628075901 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.568+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9a5a8ee0 con 0x55ac9a5a15f0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd671e84640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd66408fd90 tx=0x7fd66404fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd5437fe640 1 -- 172.21.15.169:0/3628075901 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6640b9020 con 0x55ac9a5a15f0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd5437fe640 1 -- 172.21.15.169:0/3628075901 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6640b0040 con 0x55ac9a5a15f0 2024-04-24T01:24:20.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac9a5a8ee0 con 0x55ac9a5a15f0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd5437fe640 1 -- 172.21.15.169:0/3628075901 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6640af070 con 0x55ac9a5a15f0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9a5a9380 con 0x55ac9a5a15f0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.569+0000 7fd5437fe640 1 -- 172.21.15.169:0/3628075901 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd6640bc020 con 0x55ac9a5a15f0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd5437fe640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd53c036900 0x7fd53c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd5437fe640 1 -- 172.21.15.169:0/3628075901 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd6640bfc60 con 0x55ac9a5a15f0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd669683640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd53c036900 0x7fd53c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd669683640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd53c036900 0x7fd53c038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55ac9a586380 tx=0x7fd65c023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a5b3fe0 0x55ac9a5b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b6bf0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.570+0000 7fd672685640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a5b3fe0 0x55ac9a5b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd672685640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a5b3fe0 0x55ac9a5b64a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 realm 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7000 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b78d0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.571+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a5b89d0 0x55ac9a5badc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bb380 con 0x55ac9a5b89d0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd671e84640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a5b89d0 0x55ac9a5badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd671e84640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a5b89d0 0x55ac9a5badc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 20 searching for the correct realm 2024-04-24T01:24:20.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac9a5bd330 0x55ac9a5bf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.572+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bfec0 con 0x55ac9a5bd330 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd669683640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac9a5bd330 0x55ac9a5bf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd669683640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac9a5bd330 0x55ac9a5bf7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd669683640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd65c03a3c0 0x7fd65c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bfec0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.573+0000 7fd672685640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd65c03a3c0 0x7fd65c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd65c03a3c0 0x7fd65c03a810 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.574+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x7fd65c03a3c0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.575+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.576+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x7fd65c03a3c0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.577+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.578+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x7fd65c03a3c0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.579+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.580+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x7fd65c03a3c0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5bd330 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b89d0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.581+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5b7c70 con 0x7fd65c03a3c0 2024-04-24T01:24:20.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bbc40 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bbc40 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bbc40 con 0x7fd65c03a3c0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 zone default found 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 4 Realm: () 2024-04-24T01:24:20.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 zonegroup default 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.582+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5bc4e0 con 0x55ac9a5b89d0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c1d20 con 0x55ac9a5bd330 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c20c0 con 0x55ac9a5bd330 2024-04-24T01:24:20.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 started sync module instance, tier type = 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.583+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c11c0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.584+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.584+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199812462304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c11c0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.584+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c2a80 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.585+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199812462304] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.585+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.585+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199812460272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c2a80 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.586+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c3480 con 0x55ac9a5bd330 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.586+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199812460272] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.587+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.587+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199812466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c29f0 con 0x55ac9a5bd330 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.587+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c4340 con 0x7fd65c03a3c0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.588+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199812466128] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.588+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.588+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199812472464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c42b0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.588+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c5200 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.589+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199812472464] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.589+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.589+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199812474528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c5200 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.589+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c5bc0 con 0x55ac9a5b89d0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.590+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.590+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199812478736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c6410 con 0x55ac9a5b89d0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.590+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c6e10 con 0x55ac9a5b89d0 2024-04-24T01:24:20.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.590+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199812474528] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.591+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.591+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199812476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7200 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.591+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7c00 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.591+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199812478736] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199812476240] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199812480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7710 con 0x55ac9a5b89d0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=0 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=1 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=2 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=3 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=4 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=5 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=6 2024-04-24T01:24:20.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199812480864] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 20 add_watcher() i=7 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.592+0000 7fd676816800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.593+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5cabf0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.593+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.593+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199812486928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c8010 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199812486928] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd5237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd676816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd676816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd676816800 5 note: GC not initialized 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd5227fc640 20 reqs_thread_entry: start 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd676816800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.594+0000 7fd676816800 20 Filter name: none 2024-04-24T01:24:20.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd493fff640 20 reqs_thread_entry: start 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5fddb0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5fe820 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.595+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a6041f0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.596+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.596+0000 7fd676816800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.596+0000 7fd676816800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.596+0000 7fd676816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.596+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94199812734048 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5ff830 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== watch-notify(notify (1) cookie 94199812474528 notify 137438953477 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fd66c026780 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd5557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94199812474528 notifier 4360 bl.length()=732 2024-04-24T01:24:20.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify cookie 94199812734048 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd5557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd5557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd5557fa640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd534003ea0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify_complete (2) cookie 94199812734048 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd66c018d60 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.597+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a603c60 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd676816800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd676816800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd676816800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94199812734048 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5ff380 con 0x7fd65c03a3c0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== watch-notify(notify (1) cookie 94199812462304 notify 137438953474 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fd66c018d60 con 0x7fd65c03a3c0 2024-04-24T01:24:20.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd5557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94199812462304 notifier 4360 bl.length()=166 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd5557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd5557fa640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd5557fa640 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd534003ea0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.598+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.0 [notify cookie 94199812734048 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.599+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== watch-notify(notify_complete (2) cookie 94199812734048 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd66c026a20 con 0x7fd65c03a3c0 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.599+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.620 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"W6d5vOHxmIMGaeYTv3fNq3VUlRp1XcRpv5g5p9OG","active":true,"create_date":"2024-04-24T01:24:20.597544Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.600+0000 7fd5237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.600+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199812486928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5fc960 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.601+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94199812486928] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.601+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199812462304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7710 con 0x7fd65c03a3c0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.602+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94199812462304] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.602+0000 7fd676816800 20 remove_watcher() i=0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.602+0000 7fd676816800 2 removed watcher, disabling cache 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.602+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199812460272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7710 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.603+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94199812460272] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.603+0000 7fd676816800 20 remove_watcher() i=1 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.603+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199812466128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c0ef0 con 0x55ac9a5bd330 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.604+0000 7fd669683640 1 -- 172.21.15.169:0/3628075901 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94199812466128] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd65c037040 con 0x55ac9a5bd330 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.604+0000 7fd676816800 20 remove_watcher() i=2 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.604+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199812472464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7710 con 0x7fd65c03a3c0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.605+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94199812472464] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x7fd65c03a3c0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.605+0000 7fd676816800 20 remove_watcher() i=3 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.605+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199812474528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c25d0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.606+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94199812474528] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd66c00a4a0 con 0x55ac9a5b3fe0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.606+0000 7fd676816800 20 remove_watcher() i=4 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.606+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199812478736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c3e90 con 0x55ac9a5b89d0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.607+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94199812478736] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.607+0000 7fd676816800 20 remove_watcher() i=5 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.607+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199812476240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c7710 con 0x55ac9a5b89d0 2024-04-24T01:24:20.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.608+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94199812476240] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.608+0000 7fd676816800 20 remove_watcher() i=6 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.608+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199812480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ac9a5c25d0 con 0x55ac9a5b89d0 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd671e84640 1 -- 172.21.15.169:0/3628075901 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94199812480864] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd664075030 con 0x55ac9a5b89d0 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 20 remove_watcher() i=7 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a5b89d0 msgr2=0x55ac9a5badc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a5b89d0 0x55ac9a5badc0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a5b3fe0 msgr2=0x55ac9a5b64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a5b3fe0 0x55ac9a5b64a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd65c03a3c0 msgr2=0x7fd65c03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd65c03a3c0 0x7fd65c03a810 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac9a5bd330 msgr2=0x55ac9a5bf7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac9a5bd330 0x55ac9a5bf7f0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd53c036900 msgr2=0x7fd53c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd53c036900 0x7fd53c038dc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55ac9a586380 tx=0x7fd65c023040 comp rx=0 tx=0).stop 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 msgr2=0x55ac9a5a89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd672685640 1 -- 172.21.15.169:0/3628075901 reap_dead start 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd66408fd90 tx=0x7fd66404fee0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 shutdown_connections 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/3628075901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a5a15f0 0x55ac9a5a89a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 >> 172.21.15.169:0/3628075901 conn(0x55ac9a59d900 msgr2=0x55ac9a59af60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 shutdown_connections 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/3628075901 wait complete. 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 msgr2=0x7fd54c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 0x7fd54c038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55ac9a57d5d0 tx=0x7fd65c006000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 msgr2=0x55ac9a594850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd664076450 tx=0x7fd664077ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 shutdown_connections 2024-04-24T01:24:20.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd54c036900 0x7fd54c038dc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 --2- 172.21.15.169:0/2176707012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a594430 0x55ac9a594850 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 >> 172.21.15.169:0/2176707012 conn(0x55ac9a5884d0 msgr2=0x55ac9a5888d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 shutdown_connections 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.609+0000 7fd676816800 1 -- 172.21.15.169:0/2176707012 wait complete. 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a57f430 msgr2=0x55ac9a581820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac9a57f430 0x55ac9a581820 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a4802c0 msgr2=0x55ac9a57cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac9a4802c0 0x55ac9a57cc00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac9a583330 msgr2=0x55ac9a5857f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac9a583330 0x55ac9a5857f0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd558036900 msgr2=0x7fd558038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd558036900 0x7fd558038dc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd65c000c00 tx=0x7fd65c0013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 msgr2=0x55ac9a5759c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 --2- 172.21.15.169:0/54824153 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac9a47d990 0x55ac9a5759c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd664052540 tx=0x7fd664003020 comp rx=0 tx=0).stop 2024-04-24T01:24:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd672685640 1 -- 172.21.15.169:0/54824153 reap_dead start 2024-04-24T01:24:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 shutdown_connections 2024-04-24T01:24:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 >> 172.21.15.169:0/54824153 conn(0x55ac9a477340 msgr2=0x55ac9a568060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 shutdown_connections 2024-04-24T01:24:20.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.610+0000 7fd676816800 1 -- 172.21.15.169:0/54824153 wait complete. 2024-04-24T01:24:20.631 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'W6d5vOHxmIMGaeYTv3fNq3VUlRp1XcRpv5g5p9OG', 'active': True, 'create_date': '2024-04-24T01:24:20.597544Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.631 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T01:24:20.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-04-24T01:24:20.632 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-04-24T01:24:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.679 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.678+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.678+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.678+0000 7f272d63f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5609b68c6460 0x5609b68c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.678+0000 7f272d63f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609b6780d40 con 0x5609b68c2950 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.678+0000 7f272d63f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5609b67534d0 con 0x5609b68c6460 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f2723fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5609b68c6460 0x5609b68c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f272b13e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5609b68c2950 0x5609b68c4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34696/0 (socket says 172.21.15.169:34696) 2024-04-24T01:24:20.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f272b13e640 1 -- 172.21.15.169:0/2837100061 learned_addr learned my addr 172.21.15.169:0/2837100061 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f2723fff640 1 -- 172.21.15.169:0/2837100061 >> v1:172.21.15.142:6789/0 conn(0x5609b68c2950 legacy=0x5609b68c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f2723fff640 1 -- 172.21.15.169:0/2837100061 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b677f590 con 0x5609b68c6460 2024-04-24T01:24:20.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.679+0000 7f272a93d640 1 -- 172.21.15.169:0/2837100061 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103143104 0 0) 0x5609b6780d40 con 0x5609b68c2950 2024-04-24T01:24:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f2723fff640 1 --2- 172.21.15.169:0/2837100061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c6460 0x5609b68c8850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f271400a470 tx=0x7f271401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ab63c4159aed45 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272a93d640 1 -- 172.21.15.169:0/2837100061 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2714057070 con 0x5609b68c6460 2024-04-24T01:24:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272a93d640 1 -- 172.21.15.169:0/2837100061 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2714052570 con 0x5609b68c6460 2024-04-24T01:24:20.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272a93d640 1 -- 172.21.15.169:0/2837100061 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2714052870 con 0x5609b68c6460 2024-04-24T01:24:20.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272d63f800 1 -- 172.21.15.169:0/2837100061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c6460 msgr2=0x5609b68c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272d63f800 1 --2- 172.21.15.169:0/2837100061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c6460 0x5609b68c8850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f271400a470 tx=0x7f271401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:20.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272d63f800 1 -- 172.21.15.169:0/2837100061 shutdown_connections 2024-04-24T01:24:20.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272d63f800 1 --2- 172.21.15.169:0/2837100061 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c6460 0x5609b68c8850 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.681+0000 7f272d63f800 1 -- 172.21.15.169:0/2837100061 >> 172.21.15.169:0/2837100061 conn(0x5609b68bc3a0 msgr2=0x5609b68be7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.682+0000 7f272d63f800 1 -- 172.21.15.169:0/2837100061 shutdown_connections 2024-04-24T01:24:20.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.682+0000 7f272d63f800 1 -- 172.21.15.169:0/2837100061 wait complete. 2024-04-24T01:24:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.693+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.693+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272d63f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272d63f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5609b680d3e0 con 0x5609b68c2950 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33622/0 (socket says 172.21.15.169:33622) 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272b13e640 1 -- 172.21.15.169:0/911901995 learned_addr learned my addr 172.21.15.169:0/911901995 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272b13e640 1 -- 172.21.15.169:0/911901995 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b69b3590 con 0x5609b68c2950 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.694+0000 7f272b13e640 1 --2- 172.21.15.169:0/911901995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b210 tx=0x7f271c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff09c18fb70abe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f261960a640 1 -- 172.21.15.169:0/911901995 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c008070 con 0x5609b68c2950 2024-04-24T01:24:20.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f261960a640 1 -- 172.21.15.169:0/911901995 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c00d500 con 0x5609b68c2950 2024-04-24T01:24:20.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f261960a640 1 -- 172.21.15.169:0/911901995 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c00d840 con 0x5609b68c2950 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 -- 172.21.15.169:0/911901995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 msgr2=0x5609b69b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 --2- 172.21.15.169:0/911901995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b210 tx=0x7f271c00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 -- 172.21.15.169:0/911901995 shutdown_connections 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 --2- 172.21.15.169:0/911901995 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69b2fc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 -- 172.21.15.169:0/911901995 >> 172.21.15.169:0/911901995 conn(0x5609b68bc3a0 msgr2=0x5609b69ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 -- 172.21.15.169:0/911901995 shutdown_connections 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.695+0000 7f272d63f800 1 -- 172.21.15.169:0/911901995 wait complete. 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272d63f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69bab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272d63f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5609b68cb0a0 con 0x5609b68c2950 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69bab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.700 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69bab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33630/0 (socket says 172.21.15.169:33630) 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272b13e640 1 -- 172.21.15.169:0/2643676798 learned_addr learned my addr 172.21.15.169:0/2643676798 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.696+0000 7f272b13e640 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b69bb080 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f272b13e640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69bab40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b210 tx=0x7f271c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f2617e07640 1 -- 172.21.15.169:0/2643676798 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c00f950 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f2617e07640 1 -- 172.21.15.169:0/2643676798 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c00faf0 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b69bb310 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f2617e07640 1 -- 172.21.15.169:0/2643676798 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c00fdd0 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.697+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b69bdfc0 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f2617e07640 1 -- 172.21.15.169:0/2643676798 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f271c017040 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f2617e07640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2610036900 0x7f2610038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f2617e07640 1 -- 172.21.15.169:0/2643676798 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f271c015020 con 0x5609b68c2950 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f2723fff640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2610036900 0x7f2610038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b68c6460 0x5609b69c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69c22c0 con 0x5609b68c6460 2024-04-24T01:24:20.701 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f272b93f640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b68c6460 0x5609b69c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f2723fff640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2610036900 0x7f2610038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2714054000 tx=0x7f271404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.698+0000 7f272b93f640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b68c6460 0x5609b69c1d80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272b93f640 1 -- 172.21.15.169:0/2643676798 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b68c6460 2024-04-24T01:24:20.702 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69bf350 con 0x5609b68c6460 2024-04-24T01:24:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272b93f640 1 -- 172.21.15.169:0/2643676798 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b68c6460 2024-04-24T01:24:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69c4640 0x5609b69c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69c70d0 con 0x5609b69c4640 2024-04-24T01:24:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272b13e640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69c4640 0x5609b69c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.699+0000 7f272b13e640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69c4640 0x5609b69c6a30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f272b13e640 1 -- 172.21.15.169:0/2643676798 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f271c02d070 con 0x5609b69c4640 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69c35f0 con 0x5609b68c6460 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f272b93f640 1 -- 172.21.15.169:0/2643676798 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b68c6460 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5609b69c8580 0x5609b69ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69cb130 con 0x5609b69c8580 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f2723fff640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5609b69c8580 0x5609b69ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.700+0000 7f2723fff640 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5609b69c8580 0x5609b69ca9d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.701+0000 7f2723fff640 1 -- 172.21.15.169:0/2643676798 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2714052940 con 0x5609b69c8580 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.701+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.701+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.701+0000 7f272d63f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.701+0000 7f272d63f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5609b67b36b0 con 0x5609b69d9540 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33634/0 (socket says 172.21.15.169:33634) 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272b13e640 1 -- 172.21.15.169:0/2769396568 learned_addr learned my addr 172.21.15.169:0/2769396568 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272b13e640 1 -- 172.21.15.169:0/2769396568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b69d9ea0 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272b13e640 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f271c04b4b0 tx=0x7f271c01aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f2615602640 1 -- 172.21.15.169:0/2769396568 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c019470 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f2615602640 1 -- 172.21.15.169:0/2769396568 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c019610 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b69da910 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f2615602640 1 -- 172.21.15.169:0/2769396568 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c0198f0 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.702+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b69dae10 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f2615602640 1 -- 172.21.15.169:0/2769396568 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f271c03f1b0 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f2615602640 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 0x7f2604038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f2615602640 1 -- 172.21.15.169:0/2769396568 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f271c03cc50 con 0x5609b69d9540 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f2723fff640 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 0x7f2604038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.703+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f2723fff640 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 0x7f2604038e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5609b69bf270 tx=0x7f2714005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272d63f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272d63f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5609b69b3910 con 0x5609b69e6890 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33644/0 (socket says 172.21.15.169:33644) 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272b13e640 1 -- 172.21.15.169:0/1680713654 learned_addr learned my addr 172.21.15.169:0/1680713654 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272b13e640 1 -- 172.21.15.169:0/1680713654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b69e7240 con 0x5609b69e6890 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f272b13e640 1 --2- 172.21.15.169:0/1680713654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e6b0 tx=0x7f271c0268b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42e976234ef15a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f260effd640 1 -- 172.21.15.169:0/1680713654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c040e20 con 0x5609b69e6890 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f260effd640 1 -- 172.21.15.169:0/1680713654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c04b530 con 0x5609b69e6890 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.704+0000 7f260effd640 1 -- 172.21.15.169:0/1680713654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c040900 con 0x5609b69e6890 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- 172.21.15.169:0/1680713654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 msgr2=0x5609b69e6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 --2- 172.21.15.169:0/1680713654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f271c00e6b0 tx=0x7f271c0268b0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- 172.21.15.169:0/1680713654 shutdown_connections 2024-04-24T01:24:20.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 --2- 172.21.15.169:0/1680713654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69e6c70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- 172.21.15.169:0/1680713654 >> 172.21.15.169:0/1680713654 conn(0x5609b69e2b60 msgr2=0x5609b69e0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- 172.21.15.169:0/1680713654 shutdown_connections 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- 172.21.15.169:0/1680713654 wait complete. 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 Processor -- start 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- start start 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272d63f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5609b69e7950 con 0x5609b69e6890 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272b13e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33658/0 (socket says 172.21.15.169:33658) 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.705+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 learned_addr learned my addr 172.21.15.169:0/4283843466 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b69ee0e0 con 0x5609b69e6890 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f272b13e640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f271c04d0f0 tx=0x7f271c027450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f260d7fa640 1 -- 172.21.15.169:0/4283843466 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c04dca0 con 0x5609b69e6890 2024-04-24T01:24:20.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f260d7fa640 1 -- 172.21.15.169:0/4283843466 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f271c06a030 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609b69ee0e0 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f260d7fa640 1 -- 172.21.15.169:0/4283843466 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f271c030450 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.706+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b69ee0e0 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f260d7fa640 1 -- 172.21.15.169:0/4283843466 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f271c0305f0 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f260d7fa640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f25f4036950 0x7f25f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f260d7fa640 1 -- 172.21.15.169:0/4283843466 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f271c059150 con 0x5609b69e6890 2024-04-24T01:24:20.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f2723fff640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f25f4036950 0x7f25f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f2723fff640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f25f4036950 0x7f25f4038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2714052fd0 tx=0x7f271404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b69f91f0 0x5609b69fb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.707+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fbe00 con 0x5609b69f91f0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272b93f640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b69f91f0 0x5609b69fb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272b93f640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b69f91f0 0x5609b69fb6b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 realm 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fc210 con 0x5609b69f91f0 2024-04-24T01:24:20.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fcae0 con 0x5609b69f91f0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.708+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69f91f0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69fdbe0 0x5609b69fffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a005e0 con 0x5609b69fdbe0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272b13e640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69fdbe0 0x5609b69fffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.727 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.709+0000 7f272b13e640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69fdbe0 0x5609b69fffd0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f272d63f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f272d63f800 20 searching for the correct realm 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5609b6a02590 0x5609b6a04a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a05120 con 0x5609b6a02590 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f2723fff640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5609b6a02590 0x5609b6a04a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f2723fff640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5609b6a02590 0x5609b6a04a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f2723fff640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2714076040 0x7f2714083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.710+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a05120 con 0x7f2714076040 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.711+0000 7f272b93f640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2714076040 0x7f2714083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.711+0000 7f272b93f640 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2714076040 0x7f2714083410 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.711+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.711+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69f91f0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69f91f0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.712+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x7f2714076040 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b6a02590 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69f91f0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.713+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69fdbe0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b69f91f0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x7f2714076040 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.714+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609b69fce80 con 0x5609b6a02590 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69fdbe0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.715+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69f91f0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69f91f0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69fdbe0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.716+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x7f2714076040 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69f91f0 2024-04-24T01:24:20.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.717+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x7f2714076040 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b6a02590 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.718+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x5609b69f91f0 2024-04-24T01:24:20.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f2714090040 con 0x7f2714076040 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a00ea0 con 0x5609b69f91f0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.719+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a00ea0 con 0x5609b69f91f0 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a00ea0 con 0x7f2714076040 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 zone default found 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 4 Realm: () 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 zonegroup default 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.720+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a01740 con 0x5609b69fdbe0 2024-04-24T01:24:20.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06f80 con 0x5609b6a02590 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a07320 con 0x5609b6a02590 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 started sync module instance, tier type = 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.721+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06420 con 0x7f2714076040 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.722+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.722+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599718660160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06420 con 0x7f2714076040 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.722+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a07b70 con 0x5609b69f91f0 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.723+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599718660160] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.723+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.723+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599718664352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06420 con 0x5609b69f91f0 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.723+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a08580 con 0x5609b6a02590 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.724+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599718664352] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.724+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.724+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599718657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06390 con 0x5609b6a02590 2024-04-24T01:24:20.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.725+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a09470 con 0x7f2714076040 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.725+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599718657904] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.726+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.726+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599718670272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a09890 con 0x7f2714076040 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.726+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0a250 con 0x5609b69f91f0 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.727+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.727+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599718673824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0a670 con 0x5609b69f91f0 2024-04-24T01:24:20.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.727+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0b0f0 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.727+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599718670272] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.728+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.728+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599718677472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0b4e0 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.728+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0bee0 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.728+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599718673824] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.728+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.729+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599718674880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0c730 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.729+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0d0f0 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.729+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599718677472] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.729+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599718674880] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.729+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599718671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0d0f0 con 0x5609b69fdbe0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=0 2024-04-24T01:24:20.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=1 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=2 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=3 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=4 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=5 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=6 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599718671328] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 20 add_watcher() i=7 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.730+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a10220 con 0x5609b69f91f0 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.731+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.731+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599718685760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a0d510 con 0x5609b69f91f0 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599718685760] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f25e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 5 note: GC not initialized 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f25e0fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 20 Filter name: none 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f255a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.732+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a43620 con 0x5609b69f91f0 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272d63f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272d63f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272d63f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272d63f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:20.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.733+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a49da0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272d63f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272d63f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272d63f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94599718934576 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a454f0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94599718673824 notify 137438953478 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f2724026780 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f260effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94599718673824 notifier 4367 bl.length()=732 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(64 notify.4 [notify cookie 94599718934576 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f260effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f260effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.734+0000 7f260effd640 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f25f0003ea0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.735+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.735+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94599718934576 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2724018cd0 con 0x5609b69f91f0 2024-04-24T01:24:20.746 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.736+0000 7f25e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.736+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599718685760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a45040 con 0x5609b69f91f0 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.737+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94599718685760] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.737+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599718660160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a454f0 con 0x7f2714076040 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.738+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94599718660160] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.738+0000 7f272d63f800 20 remove_watcher() i=0 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.738+0000 7f272d63f800 2 removed watcher, disabling cache 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.738+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599718664352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a454f0 con 0x5609b69f91f0 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.739+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94599718664352] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.739+0000 7f272d63f800 20 remove_watcher() i=1 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.739+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599718657904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a454f0 con 0x5609b6a02590 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.740+0000 7f2723fff640 1 -- 172.21.15.169:0/4283843466 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94599718657904] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2714081070 con 0x5609b6a02590 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.740+0000 7f272d63f800 20 remove_watcher() i=2 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.740+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599718670272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a06840 con 0x7f2714076040 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.741+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94599718670272] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x7f2714076040 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.741+0000 7f272d63f800 20 remove_watcher() i=3 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.741+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599718673824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a078a0 con 0x5609b69f91f0 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.742+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94599718673824] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272400a4a0 con 0x5609b69f91f0 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.742+0000 7f272d63f800 20 remove_watcher() i=4 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.742+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599718677472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a05f70 con 0x5609b69fdbe0 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.743+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94599718677472] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.743+0000 7f272d63f800 20 remove_watcher() i=5 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.743+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599718674880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a08fc0 con 0x5609b69fdbe0 2024-04-24T01:24:20.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.744+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94599718674880] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.744+0000 7f272d63f800 20 remove_watcher() i=6 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.744+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599718671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609b6a078a0 con 0x5609b69fdbe0 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272b13e640 1 -- 172.21.15.169:0/4283843466 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94599718671328] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f271c076070 con 0x5609b69fdbe0 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 20 remove_watcher() i=7 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69fdbe0 msgr2=0x5609b69fffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69fdbe0 0x5609b69fffd0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b69f91f0 msgr2=0x5609b69fb6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b69f91f0 0x5609b69fb6b0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2714076040 msgr2=0x7f2714083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2714076040 0x7f2714083410 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5609b6a02590 msgr2=0x5609b6a04a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5609b6a02590 0x5609b6a04a50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f25f4036950 msgr2=0x7f25f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f25f4036950 0x7f25f4038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2714052fd0 tx=0x7f271404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272b93f640 1 -- 172.21.15.169:0/4283843466 reap_dead start 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 msgr2=0x5609b69edba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f271c04d0f0 tx=0x7f271c027450 comp rx=0 tx=0).stop 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 shutdown_connections 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/4283843466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69e6890 0x5609b69edba0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 >> 172.21.15.169:0/4283843466 conn(0x5609b69e2b60 msgr2=0x5609b69e01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 shutdown_connections 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/4283843466 wait complete. 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 msgr2=0x7f2604038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.745+0000 7f272d63f800 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 0x7f2604038e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5609b69bf270 tx=0x7f2714005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 msgr2=0x5609b69d9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f271c04b4b0 tx=0x7f271c01aaf0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 shutdown_connections 2024-04-24T01:24:20.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2604036970 0x7f2604038e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2769396568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b69d9540 0x5609b69d9960 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 >> 172.21.15.169:0/2769396568 conn(0x5609b69cd5e0 msgr2=0x5609b69cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 shutdown_connections 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2769396568 wait complete. 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69c4640 msgr2=0x5609b69c6a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5609b69c4640 0x5609b69c6a30 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b68c6460 msgr2=0x5609b69c1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5609b68c6460 0x5609b69c1d80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5609b69c8580 msgr2=0x5609b69ca9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5609b69c8580 0x5609b69ca9d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2610036900 msgr2=0x7f2610038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2610036900 0x7f2610038dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2714054000 tx=0x7f271404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 msgr2=0x5609b69bab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 --2- 172.21.15.169:0/2643676798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5609b68c2950 0x5609b69bab40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f271c00b210 tx=0x7f271c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272b93f640 1 -- 172.21.15.169:0/2643676798 reap_dead start 2024-04-24T01:24:20.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 shutdown_connections 2024-04-24T01:24:20.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 >> 172.21.15.169:0/2643676798 conn(0x5609b68bc3a0 msgr2=0x5609b69ad180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 shutdown_connections 2024-04-24T01:24:20.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.746+0000 7f272d63f800 1 -- 172.21.15.169:0/2643676798 wait complete. 2024-04-24T01:24:20.757 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.757 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.757 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.757 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:20.799 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.800 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85de11f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56431dc471b0 0x56431dc495a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85de11f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56431db02d40 con 0x56431dc42d20 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85de11f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x56431dad54d0 con 0x56431dc471b0 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85d95e6640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56431dc471b0 0x56431dc495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85d9de7640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x56431dc42d20 0x56431dc43140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34698/0 (socket says 172.21.15.169:34698) 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.799+0000 7f85d9de7640 1 -- 172.21.15.169:0/3562952442 learned_addr learned my addr 172.21.15.169:0/3562952442 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:20.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.800+0000 7f85d95e6640 1 -- 172.21.15.169:0/3562952442 >> v1:172.21.15.142:6789/0 conn(0x56431dc42d20 legacy=0x56431dc43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.800+0000 7f85d8de5640 1 -- 172.21.15.169:0/3562952442 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3595582845 0 0) 0x56431db02d40 con 0x56431dc42d20 2024-04-24T01:24:20.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.800+0000 7f85d95e6640 1 -- 172.21.15.169:0/3562952442 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431db01590 con 0x56431dc471b0 2024-04-24T01:24:20.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3562952442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc471b0 0x56431dc495a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a470 tx=0x7f85d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af307744f10d89d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85d8de5640 1 -- 172.21.15.169:0/3562952442 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d0057070 con 0x56431dc471b0 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85d8de5640 1 -- 172.21.15.169:0/3562952442 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d0052570 con 0x56431dc471b0 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85d8de5640 1 -- 172.21.15.169:0/3562952442 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85d0052870 con 0x56431dc471b0 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 -- 172.21.15.169:0/3562952442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc471b0 msgr2=0x56431dc495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 --2- 172.21.15.169:0/3562952442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc471b0 0x56431dc495a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85d000a470 tx=0x7f85d001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 -- 172.21.15.169:0/3562952442 shutdown_connections 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 --2- 172.21.15.169:0/3562952442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc471b0 0x56431dc495a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 -- 172.21.15.169:0/3562952442 >> 172.21.15.169:0/3562952442 conn(0x56431dc3e380 msgr2=0x56431dc407a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 -- 172.21.15.169:0/3562952442 shutdown_connections 2024-04-24T01:24:20.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.802+0000 7f85de11f800 1 -- 172.21.15.169:0/3562952442 wait complete. 2024-04-24T01:24:20.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.814+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.814+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.814+0000 7f85de11f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.814+0000 7f85de11f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56431db8f3c0 con 0x56431dc42d20 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33682/0 (socket says 172.21.15.169:33682) 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f85d9de7640 1 -- 172.21.15.169:0/1269875577 learned_addr learned my addr 172.21.15.169:0/1269875577 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f85d9de7640 1 -- 172.21.15.169:0/1269875577 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431dd34380 con 0x56431dc42d20 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f85d9de7640 1 --2- 172.21.15.169:0/1269875577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b260 tx=0x7f85cc00b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74057a32571ee95a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f84c7e07640 1 -- 172.21.15.169:0/1269875577 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc008070 con 0x56431dc42d20 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f84c7e07640 1 -- 172.21.15.169:0/1269875577 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc00d500 con 0x56431dc42d20 2024-04-24T01:24:20.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.815+0000 7f84c7e07640 1 -- 172.21.15.169:0/1269875577 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc00d820 con 0x56431dc42d20 2024-04-24T01:24:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- 172.21.15.169:0/1269875577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 msgr2=0x56431dd33db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 --2- 172.21.15.169:0/1269875577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b260 tx=0x7f85cc00b720 comp rx=0 tx=0).stop 2024-04-24T01:24:20.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- 172.21.15.169:0/1269875577 shutdown_connections 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 --2- 172.21.15.169:0/1269875577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd33db0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- 172.21.15.169:0/1269875577 >> 172.21.15.169:0/1269875577 conn(0x56431dc3e380 msgr2=0x56431dd2f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- 172.21.15.169:0/1269875577 shutdown_connections 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- 172.21.15.169:0/1269875577 wait complete. 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.816+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85de11f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd3ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85de11f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56431dc49e70 con 0x56431dc42d20 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd3ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd3ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33694/0 (socket says 172.21.15.169:33694) 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85d9de7640 1 -- 172.21.15.169:0/2614457140 learned_addr learned my addr 172.21.15.169:0/2614457140 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85d9de7640 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431dd3cfa0 con 0x56431dc42d20 2024-04-24T01:24:20.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85d9de7640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd3ca60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b760 tx=0x7f85cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f84c6604640 1 -- 172.21.15.169:0/2614457140 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc00f950 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f84c6604640 1 -- 172.21.15.169:0/2614457140 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc00fb10 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431dd3d230 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f84c6604640 1 -- 172.21.15.169:0/2614457140 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc00fe30 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.817+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431dd3fee0 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.818+0000 7f84c6604640 1 -- 172.21.15.169:0/2614457140 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85cc017040 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.818+0000 7f84c6604640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84c0036950 0x7f84c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.818+0000 7f84c6604640 1 -- 172.21.15.169:0/2614457140 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85cc015020 con 0x56431dc42d20 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.818+0000 7f85d95e6640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84c0036950 0x7f84c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dc471b0 0x56431dd43ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd441e0 con 0x56431dc471b0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85da5e8640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dc471b0 0x56431dd43ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85d95e6640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84c0036950 0x7f84c0038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85d0054000 tx=0x7f85d004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85da5e8640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dc471b0 0x56431dd43ca0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85da5e8640 1 -- 172.21.15.169:0/2614457140 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dc471b0 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd41270 con 0x56431dc471b0 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85da5e8640 1 -- 172.21.15.169:0/2614457140 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dc471b0 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.819+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd46580 0x56431dd48970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.820+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd49010 con 0x56431dd46580 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.820+0000 7f85d9de7640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd46580 0x56431dd48970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.820+0000 7f85d9de7640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd46580 0x56431dd48970 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.820+0000 7f85d9de7640 1 -- 172.21.15.169:0/2614457140 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f85cc02d070 con 0x56431dd46580 2024-04-24T01:24:20.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.820+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd45530 con 0x56431dc471b0 2024-04-24T01:24:20.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85da5e8640 1 -- 172.21.15.169:0/2614457140 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dc471b0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56431dd4a4c0 0x56431dd4c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd4d070 con 0x56431dd4a4c0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85d95e6640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56431dd4a4c0 0x56431dd4c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85d95e6640 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56431dd4a4c0 0x56431dd4c910 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85d95e6640 1 -- 172.21.15.169:0/2614457140 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f85d0052a40 con 0x56431dd4a4c0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.821+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85de11f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85de11f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56431db356b0 con 0x56431dd5b440 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33700/0 (socket says 172.21.15.169:33700) 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85d9de7640 1 -- 172.21.15.169:0/3318119803 learned_addr learned my addr 172.21.15.169:0/3318119803 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85d9de7640 1 -- 172.21.15.169:0/3318119803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431dd5bda0 con 0x56431dd5b440 2024-04-24T01:24:20.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85d9de7640 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f85cc04b350 tx=0x7f85cc00e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f84bf7fe640 1 -- 172.21.15.169:0/3318119803 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc02b040 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f84bf7fe640 1 -- 172.21.15.169:0/3318119803 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc019470 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f84bf7fe640 1 -- 172.21.15.169:0/3318119803 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc019750 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.822+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431dd5c810 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.823+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431dd5cd10 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.823+0000 7f84bf7fe640 1 -- 172.21.15.169:0/3318119803 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85cc044980 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.823+0000 7f84bf7fe640 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 0x7f84b4038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.823+0000 7f84bf7fe640 1 -- 172.21.15.169:0/3318119803 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85cc03bc50 con 0x56431dd5b440 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.823+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 0x7f84b4038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 0x7f84b4038e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x56431dd41190 tx=0x7f85d0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85de11f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85de11f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56431dd34700 con 0x56431dd320a0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33708/0 (socket says 172.21.15.169:33708) 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85d9de7640 1 -- 172.21.15.169:0/3351618990 learned_addr learned my addr 172.21.15.169:0/3351618990 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.824+0000 7f85d9de7640 1 -- 172.21.15.169:0/3351618990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431dd32550 con 0x56431dd320a0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85d9de7640 1 --2- 172.21.15.169:0/3351618990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85cc026f90 tx=0x7f85cc0199b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c01186947e2f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f84bd7fa640 1 -- 172.21.15.169:0/3351618990 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc00c280 con 0x56431dd320a0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f84bd7fa640 1 -- 172.21.15.169:0/3351618990 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc044660 con 0x56431dd320a0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f84bd7fa640 1 -- 172.21.15.169:0/3351618990 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc026cc0 con 0x56431dd320a0 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 -- 172.21.15.169:0/3351618990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 msgr2=0x56431dd30790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 --2- 172.21.15.169:0/3351618990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85cc026f90 tx=0x7f85cc0199b0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 -- 172.21.15.169:0/3351618990 shutdown_connections 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 --2- 172.21.15.169:0/3351618990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd30790 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 -- 172.21.15.169:0/3351618990 >> 172.21.15.169:0/3351618990 conn(0x56431dd64b20 msgr2=0x56431dd62b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 -- 172.21.15.169:0/3351618990 shutdown_connections 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 -- 172.21.15.169:0/3351618990 wait complete. 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.825+0000 7f85de11f800 1 Processor -- start 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85de11f800 1 -- start start 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85de11f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85de11f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56431dd32550 con 0x56431dd320a0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85d9de7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33710/0 (socket says 172.21.15.169:33710) 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 learned_addr learned my addr 172.21.15.169:0/3354719732 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56431dd721f0 con 0x56431dd320a0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.826+0000 7f85d9de7640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85cc026f90 tx=0x7f85cc008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f84ab7fe640 1 -- 172.21.15.169:0/3354719732 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc00c280 con 0x56431dd320a0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f84ab7fe640 1 -- 172.21.15.169:0/3354719732 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85cc01cc60 con 0x56431dd320a0 2024-04-24T01:24:20.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56431dd721f0 con 0x56431dd320a0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f84ab7fe640 1 -- 172.21.15.169:0/3354719732 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85cc01ce10 con 0x56431dd320a0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56431dd721f0 con 0x56431dd320a0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.827+0000 7f84ab7fe640 1 -- 172.21.15.169:0/3354719732 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85cc044c70 con 0x56431dd320a0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f84ab7fe640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84a40368b0 0x7f84a4038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f84ab7fe640 1 -- 172.21.15.169:0/3354719732 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f85cc05b070 con 0x56431dd320a0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84a40368b0 0x7f84a4038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dd7d240 0x56431dd7f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd7fe50 con 0x56431dd7d240 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85da5e8640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dd7d240 0x56431dd7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84a40368b0 0x7f84a4038d70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85d0052fd0 tx=0x7f85d004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.828+0000 7f85da5e8640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dd7d240 0x56431dd7f700 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 realm 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80260 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80b30 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd819c0 0x56431dd83db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.829+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd84510 con 0x56431dd819c0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85d9de7640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd819c0 0x56431dd83db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85d9de7640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd819c0 0x56431dd83db0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85de11f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85de11f800 20 searching for the correct realm 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56431dd865c0 0x56431dd88a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd89150 con 0x56431dd865c0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56431dd865c0 0x56431dd88a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.830+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56431dd865c0 0x56431dd88a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85d95e6640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f85d0076040 0x7f85d0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd89150 con 0x7f85d0076040 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85da5e8640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f85d0076040 0x7f85d0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85da5e8640 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f85d0076040 0x7f85d0083410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.831+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd819c0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd7d240 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd7d240 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd819c0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.832+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd819c0 2024-04-24T01:24:20.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x7f85d0076040 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd865c0 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd7d240 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.833+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd819c0 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd7d240 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x7f85d0076040 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56431dd80ed0 con 0x56431dd865c0 2024-04-24T01:24:20.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.834+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd819c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.835+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd7d240 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd7d240 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd819c0 2024-04-24T01:24:20.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.836+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x7f85d0076040 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd7d240 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd819c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.837+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd819c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x7f85d0076040 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd865c0 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd819c0 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.838+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x56431dd7d240 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f85d0090040 con 0x7f85d0076040 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:20.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd84ec0 con 0x56431dd7d240 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd84ec0 con 0x56431dd7d240 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.839+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd84ec0 con 0x7f85d0076040 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:20.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 zone default found 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 4 Realm: () 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 zonegroup default 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd852b0 con 0x56431dd819c0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8afb0 con 0x56431dd865c0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.840+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd84ec0 con 0x56431dd865c0 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.841+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.841+0000 7f85de11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.841+0000 7f85de11f800 20 started sync module instance, tier type = 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.841+0000 7f85de11f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.841+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a450 con 0x7f85d0076040 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.842+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.842+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846263535952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a450 con 0x7f85d0076040 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.842+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8b9b0 con 0x56431dd7d240 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.843+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846263535952] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.843+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.843+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846263538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a450 con 0x56431dd7d240 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.843+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8c3c0 con 0x56431dd865c0 2024-04-24T01:24:20.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.844+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846263538880] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.844+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.844+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846263533472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a3c0 con 0x56431dd865c0 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.844+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8d280 con 0x7f85d0076040 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.845+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846263533472] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.845+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.846+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846263545296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8d6a0 con 0x7f85d0076040 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.846+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8e060 con 0x56431dd7d240 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.846+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846263545296] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.847+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.847+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846263546832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8e060 con 0x56431dd7d240 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.847+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8ea20 con 0x56431dd819c0 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.848+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.848+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846263546832] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.848+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846263548848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8dfd0 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.848+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8f7d0 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.849+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.849+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846263556976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd90440 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.849+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd90f30 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.849+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846263548848] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846263556976] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846263558032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8ee20 con 0x56431dd819c0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=0 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=1 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=2 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=3 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=4 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=5 2024-04-24T01:24:20.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.850+0000 7f85de11f800 20 add_watcher() i=6 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846263558032] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85de11f800 20 add_watcher() i=7 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85de11f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431dd941d0 con 0x56431dd7d240 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.851+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846263560704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd916f0 con 0x56431dd7d240 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846263560704] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f848b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f85de11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f85de11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f85de11f800 5 note: GC not initialized 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f848a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.852+0000 7f85de11f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:20.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f85de11f800 20 Filter name: none 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f83fbfff640 20 reqs_thread_entry: start 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f85de11f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56431ddc7020 con 0x56431dd7d240 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.853+0000 7f85de11f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:24:20.865 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.854+0000 7f848b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.854+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846263560704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431ddc5c30 con 0x56431dd7d240 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.855+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94846263560704] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.855+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846263535952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd90a00 con 0x7f85d0076040 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.856+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94846263535952] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.856+0000 7f85de11f800 20 remove_watcher() i=0 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.856+0000 7f85de11f800 2 removed watcher, disabling cache 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.856+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846263538880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a950 con 0x56431dd7d240 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.857+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94846263538880] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.857+0000 7f85de11f800 20 remove_watcher() i=1 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.857+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846263533472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8a950 con 0x56431dd865c0 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.858+0000 7f85d95e6640 1 -- 172.21.15.169:0/3354719732 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94846263533472] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d0081070 con 0x56431dd865c0 2024-04-24T01:24:20.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.858+0000 7f85de11f800 20 remove_watcher() i=2 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.858+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846263545296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd89fa0 con 0x7f85d0076040 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.859+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94846263545296] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x7f85d0076040 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.859+0000 7f85de11f800 20 remove_watcher() i=3 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.859+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846263546832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8cdd0 con 0x56431dd7d240 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.860+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94846263546832] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85d400a4a0 con 0x56431dd7d240 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.860+0000 7f85de11f800 20 remove_watcher() i=4 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.860+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846263548848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd89fa0 con 0x56431dd819c0 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.861+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94846263548848] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.861+0000 7f85de11f800 20 remove_watcher() i=5 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.861+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846263556976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8d3d0 con 0x56431dd819c0 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.863+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94846263556976] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.863+0000 7f85de11f800 20 remove_watcher() i=6 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.863+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846263558032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56431dd8cdd0 con 0x56431dd819c0 2024-04-24T01:24:20.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85d9de7640 1 -- 172.21.15.169:0/3354719732 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94846263558032] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f85cc053070 con 0x56431dd819c0 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 20 remove_watcher() i=7 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd819c0 msgr2=0x56431dd83db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd819c0 0x56431dd83db0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dd7d240 msgr2=0x56431dd7f700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dd7d240 0x56431dd7f700 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f85d0076040 msgr2=0x7f85d0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f85d0076040 0x7f85d0083410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56431dd865c0 msgr2=0x56431dd88a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56431dd865c0 0x56431dd88a80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84a40368b0 msgr2=0x7f84a4038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84a40368b0 0x7f84a4038d70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f85d0052fd0 tx=0x7f85d004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 msgr2=0x56431dd71cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85da5e8640 1 -- 172.21.15.169:0/3354719732 reap_dead start 2024-04-24T01:24:20.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f85cc026f90 tx=0x7f85cc008eb0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 shutdown_connections 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3354719732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd320a0 0x56431dd71cb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 >> 172.21.15.169:0/3354719732 conn(0x56431dd64b20 msgr2=0x56431dd62180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 shutdown_connections 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3354719732 wait complete. 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 msgr2=0x7f84b4038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 0x7f84b4038e80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x56431dd41190 tx=0x7f85d0005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 msgr2=0x56431dd5b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f85cc04b350 tx=0x7f85cc00e630 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 shutdown_connections 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84b40369c0 0x7f84b4038e80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 --2- 172.21.15.169:0/3318119803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dd5b440 0x56431dd5b860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 >> 172.21.15.169:0/3318119803 conn(0x56431dd4f4e0 msgr2=0x56431dd4f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 shutdown_connections 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.864+0000 7f85de11f800 1 -- 172.21.15.169:0/3318119803 wait complete. 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd46580 msgr2=0x56431dd48970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56431dd46580 0x56431dd48970 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dc471b0 msgr2=0x56431dd43ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56431dc471b0 0x56431dd43ca0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56431dd4a4c0 msgr2=0x56431dd4c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56431dd4a4c0 0x56431dd4c910 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84c0036950 msgr2=0x7f84c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f84c0036950 0x7f84c0038e10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85d0054000 tx=0x7f85d004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 msgr2=0x56431dd3ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 --2- 172.21.15.169:0/2614457140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56431dc42d20 0x56431dd3ca60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00b760 tx=0x7f85cc000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85da5e8640 1 -- 172.21.15.169:0/2614457140 reap_dead start 2024-04-24T01:24:20.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 shutdown_connections 2024-04-24T01:24:20.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 >> 172.21.15.169:0/2614457140 conn(0x56431dc3e380 msgr2=0x56431dd329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 shutdown_connections 2024-04-24T01:24:20.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.865+0000 7f85de11f800 1 -- 172.21.15.169:0/2614457140 wait complete. 2024-04-24T01:24:20.877 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:20.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:20.877 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:20.960 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:20.960 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.959+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.959+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.959+0000 7f337ae0f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5583cc7962c0 0x5583cc79edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.959+0000 7f337ae0f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583cc654d40 con 0x5583cc794780 2024-04-24T01:24:20.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.959+0000 7f337ae0f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5583cc6274d0 con 0x5583cc7962c0 2024-04-24T01:24:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.960+0000 7f3375d46640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5583cc7962c0 0x5583cc79edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.960+0000 7f3375d46640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5583cc7962c0 0x5583cc79edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33712/0 (socket says 172.21.15.169:33712) 2024-04-24T01:24:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.960+0000 7f3375d46640 1 -- 172.21.15.169:0/1365023316 learned_addr learned my addr 172.21.15.169:0/1365023316 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.960+0000 7f3375d46640 1 -- 172.21.15.169:0/1365023316 >> v1:172.21.15.142:6789/0 conn(0x5583cc794780 legacy=0x5583cc794ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.960+0000 7f3375d46640 1 -- 172.21.15.169:0/1365023316 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc653590 con 0x5583cc7962c0 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f3375d46640 1 --2- 172.21.15.169:0/1365023316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc7962c0 0x5583cc79edc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a520 tx=0x7f336c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f08ae3109cb0e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f3375545640 1 -- 172.21.15.169:0/1365023316 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c057070 con 0x5583cc7962c0 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f3375545640 1 -- 172.21.15.169:0/1365023316 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c052570 con 0x5583cc7962c0 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f3375545640 1 -- 172.21.15.169:0/1365023316 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336c052870 con 0x5583cc7962c0 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 -- 172.21.15.169:0/1365023316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc7962c0 msgr2=0x5583cc79edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 --2- 172.21.15.169:0/1365023316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc7962c0 0x5583cc79edc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f336c00a520 tx=0x7f336c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 -- 172.21.15.169:0/1365023316 shutdown_connections 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 --2- 172.21.15.169:0/1365023316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc7962c0 0x5583cc79edc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 -- 172.21.15.169:0/1365023316 >> 172.21.15.169:0/1365023316 conn(0x5583cc790320 msgr2=0x5583cc792740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 -- 172.21.15.169:0/1365023316 shutdown_connections 2024-04-24T01:24:20.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.962+0000 7f337ae0f800 1 -- 172.21.15.169:0/1365023316 wait complete. 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.974+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.974+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.974+0000 7f337ae0f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.974+0000 7f337ae0f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5583cc6e13c0 con 0x5583cc794780 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33728/0 (socket says 172.21.15.169:33728) 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3376547640 1 -- 172.21.15.169:0/1528763646 learned_addr learned my addr 172.21.15.169:0/1528763646 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3376547640 1 -- 172.21.15.169:0/1528763646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc889ba0 con 0x5583cc794780 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3376547640 1 --2- 172.21.15.169:0/1528763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3368001cd0 tx=0x7f336800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2ced112e4ffc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3264608640 1 -- 172.21.15.169:0/1528763646 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336800be10 con 0x5583cc794780 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3264608640 1 -- 172.21.15.169:0/1528763646 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336800f400 con 0x5583cc794780 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.975+0000 7f3264608640 1 -- 172.21.15.169:0/1528763646 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336800f720 con 0x5583cc794780 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- 172.21.15.169:0/1528763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 msgr2=0x5583cc8895d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 --2- 172.21.15.169:0/1528763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3368001cd0 tx=0x7f336800b5b0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- 172.21.15.169:0/1528763646 shutdown_connections 2024-04-24T01:24:20.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 --2- 172.21.15.169:0/1528763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc8895d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- 172.21.15.169:0/1528763646 >> 172.21.15.169:0/1528763646 conn(0x5583cc790320 msgr2=0x5583cc884ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- 172.21.15.169:0/1528763646 shutdown_connections 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- 172.21.15.169:0/1528763646 wait complete. 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.976+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f337ae0f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc891120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f337ae0f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5583cc7a15e0 con 0x5583cc794780 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc891120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc891120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33742/0 (socket says 172.21.15.169:33742) 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3376547640 1 -- 172.21.15.169:0/3211423976 learned_addr learned my addr 172.21.15.169:0/3211423976 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3376547640 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc891660 con 0x5583cc794780 2024-04-24T01:24:20.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3376547640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc891120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f336800b5f0 tx=0x7f3368000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3262e05640 1 -- 172.21.15.169:0/3211423976 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336801a7c0 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3262e05640 1 -- 172.21.15.169:0/3211423976 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336801a960 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583cc8918f0 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f3262e05640 1 -- 172.21.15.169:0/3211423976 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336801ac60 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.977+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583cc8945a0 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f3262e05640 1 -- 172.21.15.169:0/3211423976 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3368017070 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f3262e05640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f325c036950 0x7f325c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f3262e05640 1 -- 172.21.15.169:0/3211423976 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3368015020 con 0x5583cc794780 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f3375d46640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f325c036950 0x7f325c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc7962c0 0x5583cc898360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.978+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8988e0 con 0x5583cc7962c0 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f3376d48640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc7962c0 0x5583cc898360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f3375d46640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f325c036950 0x7f325c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f336c054000 tx=0x7f336c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f3376d48640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc7962c0 0x5583cc898360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f3376d48640 1 -- 172.21.15.169:0/3211423976 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc7962c0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc895930 con 0x5583cc7962c0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f3376d48640 1 -- 172.21.15.169:0/3211423976 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc7962c0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc89abf0 0x5583cc89cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.979+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc89d680 con 0x5583cc89abf0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.980+0000 7f3376547640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc89abf0 0x5583cc89cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.980+0000 7f3376547640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc89abf0 0x5583cc89cfe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.980+0000 7f3376547640 1 -- 172.21.15.169:0/3211423976 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f336802e070 con 0x5583cc89abf0 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.980+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc899ba0 con 0x5583cc7962c0 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f3376d48640 1 -- 172.21.15.169:0/3211423976 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc7962c0 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5583cc89eb30 0x5583cc8a0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8a16e0 con 0x5583cc89eb30 2024-04-24T01:24:20.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f3375d46640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5583cc89eb30 0x5583cc8a0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f3375d46640 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5583cc89eb30 0x5583cc8a0f80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f3375d46640 1 -- 172.21.15.169:0/3211423976 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f336c05a040 con 0x5583cc89eb30 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.981+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f337ae0f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f337ae0f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5583cc6876b0 con 0x5583cc8afb40 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33752/0 (socket says 172.21.15.169:33752) 2024-04-24T01:24:20.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f3376547640 1 -- 172.21.15.169:0/97693504 learned_addr learned my addr 172.21.15.169:0/97693504 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f3376547640 1 -- 172.21.15.169:0/97693504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc8b04a0 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f3376547640 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f33680017c0 tx=0x7f3368017ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f325bfff640 1 -- 172.21.15.169:0/97693504 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336802c040 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f325bfff640 1 -- 172.21.15.169:0/97693504 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368017490 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f325bfff640 1 -- 172.21.15.169:0/97693504 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3368044240 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.982+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583cc8b0f10 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.983+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583cc8b0f10 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.983+0000 7f325bfff640 1 -- 172.21.15.169:0/97693504 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f336800e070 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.983+0000 7f325bfff640 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 0x7f3250038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.983+0000 7f325bfff640 1 -- 172.21.15.169:0/97693504 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3368037030 con 0x5583cc8afb40 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.983+0000 7f3375d46640 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 0x7f3250038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f3375d46640 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 0x7f3250038dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5583cc895850 tx=0x7f336c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f337ae0f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f337ae0f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5583cc889f20 con 0x5583cc8bcb90 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33756/0 (socket says 172.21.15.169:33756) 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f3376547640 1 -- 172.21.15.169:0/3744575266 learned_addr learned my addr 172.21.15.169:0/3744575266 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.984+0000 7f3376547640 1 -- 172.21.15.169:0/3744575266 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc8bd580 con 0x5583cc8bcb90 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f3376547640 1 --2- 172.21.15.169:0/3744575266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3368044400 tx=0x7f336804df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7b54a777fd7d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f3259ffb640 1 -- 172.21.15.169:0/3744575266 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336801b3d0 con 0x5583cc8bcb90 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f3259ffb640 1 -- 172.21.15.169:0/3744575266 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368042450 con 0x5583cc8bcb90 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f3259ffb640 1 -- 172.21.15.169:0/3744575266 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f336801b570 con 0x5583cc8bcb90 2024-04-24T01:24:20.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 -- 172.21.15.169:0/3744575266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 msgr2=0x5583cc8bcfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3744575266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3368044400 tx=0x7f336804df30 comp rx=0 tx=0).stop 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 -- 172.21.15.169:0/3744575266 shutdown_connections 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3744575266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8bcfb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 -- 172.21.15.169:0/3744575266 >> 172.21.15.169:0/3744575266 conn(0x5583cc8b8e10 msgr2=0x5583cc8b6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 -- 172.21.15.169:0/3744575266 shutdown_connections 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.985+0000 7f337ae0f800 1 -- 172.21.15.169:0/3744575266 wait complete. 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f337ae0f800 1 Processor -- start 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f337ae0f800 1 -- start start 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f337ae0f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f337ae0f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5583cc8bdbf0 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f3376547640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33764/0 (socket says 172.21.15.169:33764) 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 learned_addr learned my addr 172.21.15.169:0/2325008151 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583cc8c43b0 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.986+0000 7f3376547640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8c3e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3368047660 tx=0x7f336802ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f3247fff640 1 -- 172.21.15.169:0/2325008151 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33680193e0 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f3247fff640 1 -- 172.21.15.169:0/2325008151 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3368019580 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583cc8c43b0 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f3247fff640 1 -- 172.21.15.169:0/2325008151 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3368049470 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583cc8c43b0 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f3247fff640 1 -- 172.21.15.169:0/2325008151 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3368060070 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.987+0000 7f3247fff640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3240036950 0x7f3240038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3247fff640 1 -- 172.21.15.169:0/2325008151 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f336805e020 con 0x5583cc8bcb90 2024-04-24T01:24:21.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3375d46640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3240036950 0x7f3240038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc8cf530 0x5583cc8d19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d2140 con 0x5583cc8cf530 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3376d48640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc8cf530 0x5583cc8d19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3375d46640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3240036950 0x7f3240038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5583cc8a1ae0 tx=0x7f336c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3376d48640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc8cf530 0x5583cc8d19f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 20 realm 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.988+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d2550 con 0x5583cc8cf530 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d2e20 con 0x5583cc8cf530 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8cf530 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc8d3cb0 0x5583cc8d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d6800 con 0x5583cc8d3cb0 2024-04-24T01:24:21.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.989+0000 7f3376547640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc8d3cb0 0x5583cc8d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f3376547640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc8d3cb0 0x5583cc8d60a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f337ae0f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f337ae0f800 20 searching for the correct realm 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5583cc8d88b0 0x5583cc8dad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8db440 con 0x5583cc8d88b0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f3375d46640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5583cc8d88b0 0x5583cc8dad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.990+0000 7f3375d46640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5583cc8d88b0 0x5583cc8dad70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3375d46640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f336c074040 0x7f336c081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8db440 con 0x7f336c074040 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3376d48640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f336c074040 0x7f336c081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3376d48640 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f336c074040 0x7f336c081410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.991+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8cf530 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8cf530 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.992+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x7f336c074040 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d88b0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.993+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8cf530 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8cf530 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x7f336c074040 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.994+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d31c0 con 0x5583cc8d88b0 2024-04-24T01:24:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d3cb0 2024-04-24T01:24:21.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.995+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8cf530 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8cf530 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.996+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d3cb0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x7f336c074040 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8cf530 2024-04-24T01:24:21.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.997+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x7f336c074040 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.998+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d88b0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x5583cc8cf530 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f336c08e040 con 0x7f336c074040 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:20.999+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d71b0 con 0x5583cc8cf530 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d71b0 con 0x5583cc8cf530 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d71b0 con 0x7f336c074040 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 zone default found 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 4 Realm: () 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 zonegroup default 2024-04-24T01:24:21.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.000+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8d75a0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dd2a0 con 0x5583cc8d88b0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dd640 con 0x5583cc8d88b0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 started sync module instance, tier type = 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.001+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dc740 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.002+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.002+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024560921392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dc740 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.002+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dde90 con 0x5583cc8cf530 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.003+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024560921392] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.004+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.004+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024560919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dde90 con 0x5583cc8cf530 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.004+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8de740 con 0x5583cc8d88b0 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.005+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.005+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024560926864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8df010 con 0x5583cc8d88b0 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.005+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024560919456] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.005+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dfb00 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.006+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024560926864] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.006+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.006+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024560929632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dd9e0 con 0x7f336c074040 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.006+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e03a0 con 0x5583cc8cf530 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.007+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024560929632] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.007+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.007+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024560932304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e0350 con 0x5583cc8cf530 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.007+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e0db0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.008+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.008+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024560937216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e1650 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.008+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e20a0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.008+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024560932304] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.009+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024560937216] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.009+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.009+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024560941968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2440 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.009+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2cd0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024560941968] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024560934560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2eb0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=0 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=1 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=2 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=3 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=4 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=5 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.010+0000 7f337ae0f800 20 add_watcher() i=6 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024560934560] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f337ae0f800 20 add_watcher() i=7 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f337ae0f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e6280 con 0x5583cc8cf530 2024-04-24T01:24:21.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.011+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024560946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e3670 con 0x5583cc8cf530 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.012+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024560946592] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f322cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 5 note: GC not initialized 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f31a77fe640 20 reqs_thread_entry: start 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 Filter name: none 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f31a57fa640 20 reqs_thread_entry: start 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5583cc918f60 con 0x5583cc8cf530 2024-04-24T01:24:21.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.013+0000 7f337ae0f800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:24:21.027 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.014+0000 7f322cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.014+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024560946592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc917b70 con 0x5583cc8cf530 2024-04-24T01:24:21.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.015+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94024560946592] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.015+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024560921392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2da0 con 0x7f336c074040 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.016+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94024560921392] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.016+0000 7f337ae0f800 20 remove_watcher() i=0 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.016+0000 7f337ae0f800 2 removed watcher, disabling cache 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.016+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024560919456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2da0 con 0x5583cc8cf530 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.017+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94024560919456] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.017+0000 7f337ae0f800 20 remove_watcher() i=1 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.018+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024560926864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8dc3a0 con 0x5583cc8d88b0 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.018+0000 7f3375d46640 1 -- 172.21.15.169:0/2325008151 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94024560926864] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f336c07f070 con 0x5583cc8d88b0 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.019+0000 7f337ae0f800 20 remove_watcher() i=2 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.019+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024560929632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2da0 con 0x7f336c074040 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.019+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94024560929632] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x7f336c074040 2024-04-24T01:24:21.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.019+0000 7f337ae0f800 20 remove_watcher() i=3 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.019+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024560932304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8deb60 con 0x5583cc8cf530 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.020+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94024560932304] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f337000a4a0 con 0x5583cc8cf530 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.020+0000 7f337ae0f800 20 remove_watcher() i=4 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.020+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024560937216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e2da0 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.021+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94024560937216] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.021+0000 7f337ae0f800 20 remove_watcher() i=5 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.021+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024560941968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8deb60 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.022+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94024560941968] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.022+0000 7f337ae0f800 20 remove_watcher() i=6 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.022+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024560934560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5583cc8e0900 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f3376547640 1 -- 172.21.15.169:0/2325008151 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94024560934560] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3368077070 con 0x5583cc8d3cb0 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 20 remove_watcher() i=7 2024-04-24T01:24:21.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc8d3cb0 msgr2=0x5583cc8d60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc8d3cb0 0x5583cc8d60a0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc8cf530 msgr2=0x5583cc8d19f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc8cf530 0x5583cc8d19f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f336c074040 msgr2=0x7f336c081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f336c074040 0x7f336c081410 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5583cc8d88b0 msgr2=0x5583cc8dad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5583cc8d88b0 0x5583cc8dad70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3240036950 msgr2=0x7f3240038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3240036950 0x7f3240038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x5583cc8a1ae0 tx=0x7f336c04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 msgr2=0x5583cc8c3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 --2- 172.21.15.169:0/2325008151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8bcb90 0x5583cc8c3e70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3368047660 tx=0x7f336802ff70 comp rx=0 tx=0).stop 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 reap_dead start 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f3376d48640 1 -- 172.21.15.169:0/2325008151 reap_dead start 2024-04-24T01:24:21.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 shutdown_connections 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 >> 172.21.15.169:0/2325008151 conn(0x5583cc8b8e10 msgr2=0x5583cc8b6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.023+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 shutdown_connections 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/2325008151 wait complete. 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 msgr2=0x7f3250038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 0x7f3250038dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5583cc895850 tx=0x7f336c005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 msgr2=0x5583cc8aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f33680017c0 tx=0x7f3368017ab0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 shutdown_connections 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3250036900 0x7f3250038dc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/97693504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc8afb40 0x5583cc8aff60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 >> 172.21.15.169:0/97693504 conn(0x5583cc8a3be0 msgr2=0x5583cc8a3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 shutdown_connections 2024-04-24T01:24:21.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/97693504 wait complete. 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc89abf0 msgr2=0x5583cc89cfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5583cc89abf0 0x5583cc89cfe0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc7962c0 msgr2=0x5583cc898360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5583cc7962c0 0x5583cc898360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5583cc89eb30 msgr2=0x5583cc8a0f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5583cc89eb30 0x5583cc8a0f80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f325c036950 msgr2=0x7f325c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f325c036950 0x7f325c038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f336c054000 tx=0x7f336c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 msgr2=0x5583cc891120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 --2- 172.21.15.169:0/3211423976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5583cc794780 0x5583cc891120 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f336800b5f0 tx=0x7f3368000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f3376d48640 1 -- 172.21.15.169:0/3211423976 reap_dead start 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 shutdown_connections 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 >> 172.21.15.169:0/3211423976 conn(0x5583cc790320 msgr2=0x5583cc8836f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 shutdown_connections 2024-04-24T01:24:21.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.024+0000 7f337ae0f800 1 -- 172.21.15.169:0/3211423976 wait complete. 2024-04-24T01:24:21.038 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.039 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T01:24:21.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-04-24T01:24:21.039 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-04-24T01:24:21.126 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.126 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.125+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.125+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65c5e05800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5647da9d64a0 0x5647da9d8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65c5e05800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5647da890d40 con 0x5647da9d2990 2024-04-24T01:24:21.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65c5e05800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5647da8634d0 con 0x5647da9d64a0 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65bbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5647da9d64a0 0x5647da9d8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65c3904640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5647da9d2990 0x5647da9d4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34718/0 (socket says 172.21.15.169:34718) 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65c3904640 1 -- 172.21.15.169:0/4191850162 learned_addr learned my addr 172.21.15.169:0/4191850162 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65bbfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5647da9d64a0 0x5647da9d8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33772/0 (socket says 172.21.15.169:33772) 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65bbfff640 1 -- 172.21.15.169:0/4191850162 >> v1:172.21.15.142:6789/0 conn(0x5647da9d2990 legacy=0x5647da9d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.126+0000 7f65bbfff640 1 -- 172.21.15.169:0/4191850162 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647da88f590 con 0x5647da9d64a0 2024-04-24T01:24:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.128+0000 7f65bbfff640 1 --2- 172.21.15.169:0/4191850162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d8890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00a470 tx=0x7f65ac01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7c25d64d4075df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.128+0000 7f65c3103640 1 -- 172.21.15.169:0/4191850162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac057070 con 0x5647da9d64a0 2024-04-24T01:24:21.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.128+0000 7f65c3103640 1 -- 172.21.15.169:0/4191850162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac052570 con 0x5647da9d64a0 2024-04-24T01:24:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.128+0000 7f65c3103640 1 -- 172.21.15.169:0/4191850162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65ac052870 con 0x5647da9d64a0 2024-04-24T01:24:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 -- 172.21.15.169:0/4191850162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 msgr2=0x5647da9d8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 --2- 172.21.15.169:0/4191850162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d8890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00a470 tx=0x7f65ac01ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:21.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 -- 172.21.15.169:0/4191850162 shutdown_connections 2024-04-24T01:24:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 --2- 172.21.15.169:0/4191850162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d8890 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 -- 172.21.15.169:0/4191850162 >> 172.21.15.169:0/4191850162 conn(0x5647da9cc340 msgr2=0x5647da9ce760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 -- 172.21.15.169:0/4191850162 shutdown_connections 2024-04-24T01:24:21.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.129+0000 7f65c5e05800 1 -- 172.21.15.169:0/4191850162 wait complete. 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.140+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c5e05800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c5e05800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5647da91d3e0 con 0x5647da9d2990 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33788/0 (socket says 172.21.15.169:33788) 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c3904640 1 -- 172.21.15.169:0/395240850 learned_addr learned my addr 172.21.15.169:0/395240850 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c3904640 1 -- 172.21.15.169:0/395240850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647daac3790 con 0x5647da9d2990 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f65c3904640 1 --2- 172.21.15.169:0/395240850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65b4001de0 tx=0x7f65b400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80fdad5519452cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f64b1e0b640 1 -- 172.21.15.169:0/395240850 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b4012020 con 0x5647da9d2990 2024-04-24T01:24:21.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f64b1e0b640 1 -- 172.21.15.169:0/395240850 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b400e5a0 con 0x5647da9d2990 2024-04-24T01:24:21.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.141+0000 7f64b1e0b640 1 -- 172.21.15.169:0/395240850 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b400e8c0 con 0x5647da9d2990 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 -- 172.21.15.169:0/395240850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 msgr2=0x5647daac31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 --2- 172.21.15.169:0/395240850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f65b4001de0 tx=0x7f65b400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 -- 172.21.15.169:0/395240850 shutdown_connections 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 --2- 172.21.15.169:0/395240850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d2990 0x5647daac31c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 -- 172.21.15.169:0/395240850 >> 172.21.15.169:0/395240850 conn(0x5647da9cc340 msgr2=0x5647daabeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 -- 172.21.15.169:0/395240850 shutdown_connections 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 -- 172.21.15.169:0/395240850 wait complete. 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.142+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c5e05800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c5e05800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5647da9db0e0 con 0x5647da9d64a0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33804/0 (socket says 172.21.15.169:33804) 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c3904640 1 -- 172.21.15.169:0/114425400 learned_addr learned my addr 172.21.15.169:0/114425400 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c3904640 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647da9d09c0 con 0x5647da9d64a0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f65c3904640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d22d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c010 tx=0x7f65b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f64abfff640 1 -- 172.21.15.169:0/114425400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b4012070 con 0x5647da9d64a0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f64abfff640 1 -- 172.21.15.169:0/114425400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b4001440 con 0x5647da9d64a0 2024-04-24T01:24:21.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.143+0000 7f64abfff640 1 -- 172.21.15.169:0/114425400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b401a830 con 0x5647da9d64a0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.144+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647da9d0c50 con 0x5647da9d64a0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.144+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647da9d1170 con 0x5647da9d64a0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.144+0000 7f64abfff640 1 -- 172.21.15.169:0/114425400 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65b4015020 con 0x5647da9d64a0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.144+0000 7f64abfff640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f64ac036950 0x7f64ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.144+0000 7f64abfff640 1 -- 172.21.15.169:0/114425400 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65b4020070 con 0x5647da9d64a0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65bbfff640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f64ac036950 0x7f64ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647daad2300 0x5647daad46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647daad4c70 con 0x5647daad2300 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c4105640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647daad2300 0x5647daad46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65bbfff640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f64ac036950 0x7f64ac038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65ac054000 tx=0x7f65ac04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c4105640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647daad2300 0x5647daad46f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c4105640 1 -- 172.21.15.169:0/114425400 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647daad2300 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.145+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647daad5530 con 0x5647daad2300 2024-04-24T01:24:21.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.146+0000 7f65c4105640 1 -- 172.21.15.169:0/114425400 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647daad2300 2024-04-24T01:24:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.146+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647daad6f60 0x5647daad93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.146+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647daad9b80 con 0x5647daad6f60 2024-04-24T01:24:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.146+0000 7f65c3904640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647daad6f60 0x5647daad93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.146+0000 7f65c3904640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647daad6f60 0x5647daad93f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65c3904640 1 -- 172.21.15.169:0/114425400 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f65b402b070 con 0x5647daad6f60 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647daad5d80 con 0x5647daad2300 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65c4105640 1 -- 172.21.15.169:0/114425400 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647daad2300 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5647daadafe0 0x5647daadd450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647daaddbb0 con 0x5647daadafe0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65bbfff640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5647daadafe0 0x5647daadd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65bbfff640 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5647daadafe0 0x5647daadd450 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.147+0000 7f65bbfff640 1 -- 172.21.15.169:0/114425400 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65ac052a40 con 0x5647daadafe0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c5e05800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c5e05800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5647da9d2810 con 0x5647daaebfd0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33806/0 (socket says 172.21.15.169:33806) 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.148+0000 7f65c3904640 1 -- 172.21.15.169:0/2257389722 learned_addr learned my addr 172.21.15.169:0/2257389722 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f65c3904640 1 -- 172.21.15.169:0/2257389722 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647daaec930 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f65c3904640 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65b404a820 tx=0x7f65b404af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f64a97fa640 1 -- 172.21.15.169:0/2257389722 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b4033070 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f64a97fa640 1 -- 172.21.15.169:0/2257389722 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b4042070 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647daaed3a0 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f64a97fa640 1 -- 172.21.15.169:0/2257389722 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b401a9d0 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.149+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647daaed8a0 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f64a97fa640 1 -- 172.21.15.169:0/2257389722 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65b4036070 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f64a97fa640 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 0x7f649c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f64a97fa640 1 -- 172.21.15.169:0/2257389722 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65b403ce00 con 0x5647daaebfd0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65bbfff640 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 0x7f649c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65bbfff640 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 0x7f649c038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5647da9d1590 tx=0x7f65ac005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c5e05800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c5e05800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5647da8c36b0 con 0x5647daaf91a0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33822/0 (socket says 172.21.15.169:33822) 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.150+0000 7f65c3904640 1 -- 172.21.15.169:0/3651486369 learned_addr learned my addr 172.21.15.169:0/3651486369 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c3904640 1 -- 172.21.15.169:0/3651486369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647daaf9b90 con 0x5647daaf91a0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c3904640 1 --2- 172.21.15.169:0/3651486369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65b404efd0 tx=0x7f65b4044f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7befd8518f6d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f64a2ffd640 1 -- 172.21.15.169:0/3651486369 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b4024460 con 0x5647daaf91a0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f64a2ffd640 1 -- 172.21.15.169:0/3651486369 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b405a070 con 0x5647daaf91a0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f64a2ffd640 1 -- 172.21.15.169:0/3651486369 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b402e480 con 0x5647daaf91a0 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 -- 172.21.15.169:0/3651486369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 msgr2=0x5647daaf95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 --2- 172.21.15.169:0/3651486369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f65b404efd0 tx=0x7f65b4044f50 comp rx=0 tx=0).stop 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 -- 172.21.15.169:0/3651486369 shutdown_connections 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 --2- 172.21.15.169:0/3651486369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647daaf95c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 -- 172.21.15.169:0/3651486369 >> 172.21.15.169:0/3651486369 conn(0x5647daaf5470 msgr2=0x5647daaf34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 -- 172.21.15.169:0/3651486369 shutdown_connections 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.151+0000 7f65c5e05800 1 -- 172.21.15.169:0/3651486369 wait complete. 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c5e05800 1 Processor -- start 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c5e05800 1 -- start start 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c5e05800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c5e05800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5647daafa0e0 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c3904640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33832/0 (socket says 172.21.15.169:33832) 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 learned_addr learned my addr 172.21.15.169:0/277570423 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.152+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647dab00900 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f65c3904640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65b402bff0 tx=0x7f65b4024f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f64a17fa640 1 -- 172.21.15.169:0/277570423 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b4024640 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f64a17fa640 1 -- 172.21.15.169:0/277570423 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65b4044e30 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647dab00900 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f64a17fa640 1 -- 172.21.15.169:0/277570423 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65b401ca50 con 0x5647daaf91a0 2024-04-24T01:24:21.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647dab00900 con 0x5647daaf91a0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.153+0000 7f64a17fa640 1 -- 172.21.15.169:0/277570423 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65b40445e0 con 0x5647daaf91a0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f64a17fa640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f648c036950 0x7f648c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f64a17fa640 1 -- 172.21.15.169:0/277570423 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f65b4052040 con 0x5647daaf91a0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65bbfff640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f648c036950 0x7f648c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65bbfff640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f648c036950 0x7f648c038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f65ac052fd0 tx=0x7f65ac04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647dab0bb40 0x5647dab0e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0e750 con 0x5647dab0bb40 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.154+0000 7f65c4105640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647dab0bb40 0x5647dab0e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c4105640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647dab0bb40 0x5647dab0e000 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 realm 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0eb60 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f430 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.155+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647dab10530 0x5647dab12920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab12f30 con 0x5647dab10530 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c3904640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647dab10530 0x5647dab12920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c3904640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647dab10530 0x5647dab12920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 20 searching for the correct realm 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5647dab14ee0 0x5647dab173a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.156+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab17a70 con 0x5647dab14ee0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65bbfff640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5647dab14ee0 0x5647dab173a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65bbfff640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5647dab14ee0 0x5647dab173a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65bbfff640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65ac076040 0x7f65ac083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab17a70 con 0x7f65ac076040 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.157+0000 7f65c4105640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65ac076040 0x7f65ac083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c4105640 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65ac076040 0x7f65ac083410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab0bb40 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.158+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab0bb40 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x7f65ac076040 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.159+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab14ee0 2024-04-24T01:24:21.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab0bb40 2024-04-24T01:24:21.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab10530 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab0bb40 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.160+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x7f65ac076040 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5647dab0f7d0 con 0x5647dab14ee0 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.161+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab10530 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.162+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.163+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab10530 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.163+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.163+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.163+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.163+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x7f65ac076040 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.164+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x7f65ac076040 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab14ee0 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.165+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x5647dab0bb40 2024-04-24T01:24:21.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f65ac090040 con 0x7f65ac076040 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab137f0 con 0x5647dab0bb40 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab137f0 con 0x5647dab0bb40 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.166+0000 7f65c5e05800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab137f0 con 0x7f65ac076040 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 zone default found 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 4 Realm: () 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 zonegroup default 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab140e0 con 0x5647dab10530 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab198d0 con 0x5647dab14ee0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.167+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab19c70 con 0x5647dab14ee0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 20 started sync module instance, tier type = 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.168+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab18d70 con 0x7f65ac076040 2024-04-24T01:24:21.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.169+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.169+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94866611737168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab18d70 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.169+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1a630 con 0x5647dab0bb40 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.170+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94866611737168] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.170+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.170+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94866611735200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1a630 con 0x5647dab0bb40 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.170+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1b030 con 0x5647dab14ee0 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.171+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.171+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94866611735200] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.171+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94866611743552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1b420 con 0x5647dab14ee0 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.171+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1be20 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.172+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94866611743552] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.172+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.172+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94866611741056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1c210 con 0x7f65ac076040 2024-04-24T01:24:21.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.172+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1cc10 con 0x5647dab0bb40 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.173+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.173+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94866611750688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1cb40 con 0x5647dab0bb40 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.173+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1db60 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.173+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94866611741056] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.174+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94866611750688] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.174+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.174+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94866611752960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1b930 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.174+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1e400 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.175+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94866611752960] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.176+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.176+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94866611754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1ec50 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.176+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1f520 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94866611754576] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94866611759008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1f070 con 0x5647dab10530 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=0 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=1 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=2 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=3 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=4 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=5 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.177+0000 7f65c5e05800 20 add_watcher() i=6 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94866611759008] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c5e05800 20 add_watcher() i=7 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c5e05800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab229d0 con 0x5647dab0bb40 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.178+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94866611760528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1fe50 con 0x5647dab0bb40 2024-04-24T01:24:21.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94866611760528] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f6479fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f65c5e05800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f65c5e05800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f65c5e05800 5 note: GC not initialized 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f6478fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.179+0000 7f65c5e05800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 20 Filter name: none 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f63f27fc640 20 reqs_thread_entry: start 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab55d00 con 0x5647dab0bb40 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab56a60 con 0x7f65ac076040 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.180+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab5c7c0 con 0x5647dab0bb40 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.181+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.181+0000 7f65c5e05800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.181+0000 7f65c5e05800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.181+0000 7f65c5e05800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.181+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94866612011600 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab59350 con 0x5647dab0bb40 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94866611750688 notify 137438953479 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f65bc0267f0 con 0x5647dab0bb40 2024-04-24T01:24:21.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f64a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94866611750688 notifier 4388 bl.length()=849 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify cookie 94866612011600 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f64a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f64a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f64a2ffd640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6488003ea0 con 0x5647dab0bb40 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94866612011600 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65bc018d40 con 0x5647dab0bb40 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.182+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab5c250 con 0x7f65ac076040 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.183+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.183+0000 7f65c5e05800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.183+0000 7f65c5e05800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.183+0000 7f65c5e05800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.183+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94866612011600 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5647dab59300 con 0x7f65ac076040 2024-04-24T01:24:21.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== watch-notify(notify (1) cookie 94866611737168 notify 137438953475 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f65bc018d40 con 0x7f65ac076040 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f64a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94866611737168 notifier 4388 bl.length()=166 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f64a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f64a2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f64a2ffd640 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6488003ea0 con 0x7f65ac076040 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(68 notify.0 [notify cookie 94866612011600 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== watch-notify(notify_complete (2) cookie 94866612011600 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f65bc026ab0 con 0x7f65ac076040 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.184+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.196 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:24:21.182656Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.185+0000 7f6479fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.185+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94866611760528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab56d60 con 0x5647dab0bb40 2024-04-24T01:24:21.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.186+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94866611760528] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.186+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94866611737168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1ed60 con 0x7f65ac076040 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.187+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94866611737168] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.187+0000 7f65c5e05800 20 remove_watcher() i=0 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.187+0000 7f65c5e05800 2 removed watcher, disabling cache 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.187+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94866611735200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab19250 con 0x5647dab0bb40 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.188+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94866611735200] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.188+0000 7f65c5e05800 20 remove_watcher() i=1 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.188+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94866611743552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab19250 con 0x5647dab14ee0 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.189+0000 7f65bbfff640 1 -- 172.21.15.169:0/277570423 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94866611743552] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65ac081070 con 0x5647dab14ee0 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.189+0000 7f65c5e05800 20 remove_watcher() i=2 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.189+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94866611741056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1ed60 con 0x7f65ac076040 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.190+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94866611741056] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x7f65ac076040 2024-04-24T01:24:21.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.190+0000 7f65c5e05800 20 remove_watcher() i=3 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.190+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94866611750688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1a180 con 0x5647dab0bb40 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.191+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94866611750688] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65bc00a4a0 con 0x5647dab0bb40 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.191+0000 7f65c5e05800 20 remove_watcher() i=4 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.191+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94866611752960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1c720 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.192+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94866611752960] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.192+0000 7f65c5e05800 20 remove_watcher() i=5 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.192+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94866611754576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1c720 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.193+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94866611754576] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.193+0000 7f65c5e05800 20 remove_watcher() i=6 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.193+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94866611759008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5647dab1d650 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c3904640 1 -- 172.21.15.169:0/277570423 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94866611759008] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65b4070020 con 0x5647dab10530 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 20 remove_watcher() i=7 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647dab10530 msgr2=0x5647dab12920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647dab10530 0x5647dab12920 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647dab0bb40 msgr2=0x5647dab0e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647dab0bb40 0x5647dab0e000 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65ac076040 msgr2=0x7f65ac083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65ac076040 0x7f65ac083410 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5647dab14ee0 msgr2=0x5647dab173a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5647dab14ee0 0x5647dab173a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f648c036950 msgr2=0x7f648c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f648c036950 0x7f648c038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f65ac052fd0 tx=0x7f65ac04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c4105640 1 -- 172.21.15.169:0/277570423 reap_dead start 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 msgr2=0x5647dab003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f65b402bff0 tx=0x7f65b4024f70 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 shutdown_connections 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 --2- 172.21.15.169:0/277570423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaf91a0 0x5647dab003c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 >> 172.21.15.169:0/277570423 conn(0x5647daaf5470 msgr2=0x5647daaf2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 shutdown_connections 2024-04-24T01:24:21.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.194+0000 7f65c5e05800 1 -- 172.21.15.169:0/277570423 wait complete. 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 msgr2=0x7f649c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 0x7f649c038dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5647da9d1590 tx=0x7f65ac005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 msgr2=0x5647daaec3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f65b404a820 tx=0x7f65b404af90 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 shutdown_connections 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f649c036900 0x7f649c038dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/2257389722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647daaebfd0 0x5647daaec3f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 >> 172.21.15.169:0/2257389722 conn(0x5647daae0070 msgr2=0x5647daae0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 shutdown_connections 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/2257389722 wait complete. 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647daad6f60 msgr2=0x5647daad93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5647daad6f60 0x5647daad93f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647daad2300 msgr2=0x5647daad46f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5647daad2300 0x5647daad46f0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5647daadafe0 msgr2=0x5647daadd450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5647daadafe0 0x5647daadd450 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f64ac036950 msgr2=0x7f64ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f64ac036950 0x7f64ac038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65ac054000 tx=0x7f65ac04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 msgr2=0x5647da9d22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 --2- 172.21.15.169:0/114425400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5647da9d64a0 0x5647da9d22d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65b400c010 tx=0x7f65b4000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c4105640 1 -- 172.21.15.169:0/114425400 reap_dead start 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 shutdown_connections 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 >> 172.21.15.169:0/114425400 conn(0x5647da9cc340 msgr2=0x5647daabd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 shutdown_connections 2024-04-24T01:24:21.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.195+0000 7f65c5e05800 1 -- 172.21.15.169:0/114425400 wait complete. 2024-04-24T01:24:21.207 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:24:21.182656Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.207 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:24:21.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:24:21.207 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:24:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.250 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.249+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.249+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.249+0000 7f968dc62800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556c8c0081c0 0x556c8c0979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968dc62800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c8bf53d40 con 0x556c8c097f50 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968dc62800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x556c8bf264d0 con 0x556c8c0081c0 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968b768640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556c8c0081c0 0x556c8c0979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968b768640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556c8c0081c0 0x556c8c0979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33836/0 (socket says 172.21.15.169:33836) 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968b768640 1 -- 172.21.15.169:0/4177473478 learned_addr learned my addr 172.21.15.169:0/4177473478 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968b768640 1 -- 172.21.15.169:0/4177473478 >> v1:172.21.15.142:6789/0 conn(0x556c8c097f50 legacy=0x556c8c09a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.252 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.250+0000 7f968b768640 1 -- 172.21.15.169:0/4177473478 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8bf52590 con 0x556c8c0081c0 2024-04-24T01:24:21.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.252+0000 7f968b768640 1 --2- 172.21.15.169:0/4177473478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0979e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f967c00a520 tx=0x7f967c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e26b320a4d9b4f46 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.252+0000 7f968af67640 1 -- 172.21.15.169:0/4177473478 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c057070 con 0x556c8c0081c0 2024-04-24T01:24:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.252+0000 7f968af67640 1 -- 172.21.15.169:0/4177473478 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c052570 con 0x556c8c0081c0 2024-04-24T01:24:21.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.252+0000 7f968af67640 1 -- 172.21.15.169:0/4177473478 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c04ae60 con 0x556c8c0081c0 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 -- 172.21.15.169:0/4177473478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 msgr2=0x556c8c0979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 --2- 172.21.15.169:0/4177473478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0979e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f967c00a520 tx=0x7f967c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 -- 172.21.15.169:0/4177473478 shutdown_connections 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 --2- 172.21.15.169:0/4177473478 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0979e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 -- 172.21.15.169:0/4177473478 >> 172.21.15.169:0/4177473478 conn(0x556c8c08f380 msgr2=0x556c8c0917a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 -- 172.21.15.169:0/4177473478 shutdown_connections 2024-04-24T01:24:21.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.253+0000 7f968dc62800 1 -- 172.21.15.169:0/4177473478 wait complete. 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.264+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.264+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968dc62800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968dc62800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c8bfe03c0 con 0x556c8c0081c0 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33852/0 (socket says 172.21.15.169:33852) 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968b768640 1 -- 172.21.15.169:0/1705500182 learned_addr learned my addr 172.21.15.169:0/1705500182 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968b768640 1 -- 172.21.15.169:0/1705500182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8c186660 con 0x556c8c0081c0 2024-04-24T01:24:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.265+0000 7f968b768640 1 --2- 172.21.15.169:0/1705500182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f967c01d050 tx=0x7f967c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50e214d312da3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f957960a640 1 -- 172.21.15.169:0/1705500182 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c057040 con 0x556c8c0081c0 2024-04-24T01:24:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f957960a640 1 -- 172.21.15.169:0/1705500182 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c052720 con 0x556c8c0081c0 2024-04-24T01:24:21.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f957960a640 1 -- 172.21.15.169:0/1705500182 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c052a40 con 0x556c8c0081c0 2024-04-24T01:24:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 -- 172.21.15.169:0/1705500182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 msgr2=0x556c8c186090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 --2- 172.21.15.169:0/1705500182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f967c01d050 tx=0x7f967c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 -- 172.21.15.169:0/1705500182 shutdown_connections 2024-04-24T01:24:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 --2- 172.21.15.169:0/1705500182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c186090 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 -- 172.21.15.169:0/1705500182 >> 172.21.15.169:0/1705500182 conn(0x556c8c08f380 msgr2=0x556c8c1819b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 -- 172.21.15.169:0/1705500182 shutdown_connections 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.266+0000 7f968dc62800 1 -- 172.21.15.169:0/1705500182 wait complete. 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968dc62800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0952c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968dc62800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c8c09bf40 con 0x556c8c0081c0 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33864/0 (socket says 172.21.15.169:33864) 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968b768640 1 -- 172.21.15.169:0/455565602 learned_addr learned my addr 172.21.15.169:0/455565602 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.267+0000 7f968b768640 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8c095800 con 0x556c8c0081c0 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f968b768640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0952c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f967c01cfe0 tx=0x7f967c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f9577e07640 1 -- 172.21.15.169:0/455565602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c073070 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f9577e07640 1 -- 172.21.15.169:0/455565602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c05d440 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f9577e07640 1 -- 172.21.15.169:0/455565602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c057070 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c8c093a00 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8c093f20 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.268+0000 7f9577e07640 1 -- 172.21.15.169:0/455565602 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f967c076070 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f9577e07640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9570036950 0x7f9570038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f9577e07640 1 -- 172.21.15.169:0/455565602 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f967c08dce0 con 0x556c8c0081c0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f9682f67640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9570036950 0x7f9570038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c097f50 0x556c8c196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1974b0 con 0x556c8c097f50 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f968bf69640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c097f50 0x556c8c196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f9682f67640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9570036950 0x7f9570038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9674001e10 tx=0x7f9674001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f968bf69640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c097f50 0x556c8c196f70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.269+0000 7f968bf69640 1 -- 172.21.15.169:0/455565602 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c097f50 2024-04-24T01:24:21.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c197d30 con 0x556c8c097f50 2024-04-24T01:24:21.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968bf69640 1 -- 172.21.15.169:0/455565602 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c097f50 2024-04-24T01:24:21.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c199640 0x556c8c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c19c260 con 0x556c8c199640 2024-04-24T01:24:21.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968b768640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c199640 0x556c8c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.270+0000 7f968b768640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c199640 0x556c8c19bad0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f968b768640 1 -- 172.21.15.169:0/455565602 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f967c075030 con 0x556c8c199640 2024-04-24T01:24:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1985b0 con 0x556c8c097f50 2024-04-24T01:24:21.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f968bf69640 1 -- 172.21.15.169:0/455565602 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c097f50 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c8c19d710 0x556c8c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1a02e0 con 0x556c8c19d710 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f9682f67640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c8c19d710 0x556c8c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.271+0000 7f9682f67640 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c8c19d710 0x556c8c19fb80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f9682f67640 1 -- 172.21.15.169:0/455565602 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f96740106a0 con 0x556c8c19d710 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968dc62800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968dc62800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c8bf866b0 con 0x556c8c1ae740 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33868/0 (socket says 172.21.15.169:33868) 2024-04-24T01:24:21.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.272+0000 7f968b768640 1 -- 172.21.15.169:0/3660996962 learned_addr learned my addr 172.21.15.169:0/3660996962 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f968b768640 1 -- 172.21.15.169:0/3660996962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8c1af0a0 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f968b768640 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f967c006900 tx=0x7f967c077720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f9575602640 1 -- 172.21.15.169:0/3660996962 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c092070 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f9575602640 1 -- 172.21.15.169:0/3660996962 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c007e70 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c8c1afb10 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f9575602640 1 -- 172.21.15.169:0/3660996962 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c076c80 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.273+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8c1b0010 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f9575602640 1 -- 172.21.15.169:0/3660996962 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f967c095070 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f9575602640 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 0x7f9564038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f9575602640 1 -- 172.21.15.169:0/3660996962 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f967c087050 con 0x556c8c1ae740 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f9682f67640 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 0x7f9564038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f9682f67640 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 0x7f9564038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x556c8c094340 tx=0x7f9674006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f968dc62800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.274+0000 7f968dc62800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c8c186920 con 0x556c8c1bb7f0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33872/0 (socket says 172.21.15.169:33872) 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968b768640 1 -- 172.21.15.169:0/1584436128 learned_addr learned my addr 172.21.15.169:0/1584436128 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968b768640 1 -- 172.21.15.169:0/1584436128 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8c1bc1e0 con 0x556c8c1bb7f0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968b768640 1 --2- 172.21.15.169:0/1584436128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f967c0529e0 tx=0x7f967c078b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2e3c52ee3ea6cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f956effd640 1 -- 172.21.15.169:0/1584436128 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c098d60 con 0x556c8c1bb7f0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f956effd640 1 -- 172.21.15.169:0/1584436128 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c077a90 con 0x556c8c1bb7f0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f956effd640 1 -- 172.21.15.169:0/1584436128 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c0766f0 con 0x556c8c1bb7f0 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968dc62800 1 -- 172.21.15.169:0/1584436128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 msgr2=0x556c8c1bbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.275+0000 7f968dc62800 1 --2- 172.21.15.169:0/1584436128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f967c0529e0 tx=0x7f967c078b90 comp rx=0 tx=0).stop 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- 172.21.15.169:0/1584436128 shutdown_connections 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 --2- 172.21.15.169:0/1584436128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1bbc10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- 172.21.15.169:0/1584436128 >> 172.21.15.169:0/1584436128 conn(0x556c8c1b7b50 msgr2=0x556c8c1b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- 172.21.15.169:0/1584436128 shutdown_connections 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- 172.21.15.169:0/1584436128 wait complete. 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 Processor -- start 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- start start 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1c2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968dc62800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c8c1bc890 con 0x556c8c1bb7f0 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1c2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968b768640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1c2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33884/0 (socket says 172.21.15.169:33884) 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.276+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 learned_addr learned my addr 172.21.15.169:0/894247408 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8c1c3140 con 0x556c8c1bb7f0 2024-04-24T01:24:21.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f968b768640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1c2c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f967c078e70 tx=0x7f967c04b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f956d7fa640 1 -- 172.21.15.169:0/894247408 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c0b4070 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f956d7fa640 1 -- 172.21.15.169:0/894247408 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f967c078570 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f956d7fa640 1 -- 172.21.15.169:0/894247408 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f967c076860 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c8c1c3140 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.277+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8c1c3140 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f956d7fa640 1 -- 172.21.15.169:0/894247408 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f967c06f810 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f956d7fa640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9554036860 0x7f9554038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f956d7fa640 1 -- 172.21.15.169:0/894247408 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f967c0bc980 con 0x556c8c1bb7f0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f9682f67640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9554036860 0x7f9554038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c1ce330 0x556c8c1d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d0f40 con 0x556c8c1ce330 2024-04-24T01:24:21.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f968bf69640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c1ce330 0x556c8c1d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.278+0000 7f9682f67640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9554036860 0x7f9554038d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x556c8c1a06e0 tx=0x7f9674011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968bf69640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c1ce330 0x556c8c1d07f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 realm 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1350 con 0x556c8c1ce330 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1c20 con 0x556c8c1ce330 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.279+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c1d2ab0 0x556c8c1d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d5600 con 0x556c8c1d2ab0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968b768640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c1d2ab0 0x556c8c1d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968b768640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c1d2ab0 0x556c8c1d4ea0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968dc62800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968dc62800 20 searching for the correct realm 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c8c1d76b0 0x556c8c1d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1da240 con 0x556c8c1d76b0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.280+0000 7f9682f67640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c8c1d76b0 0x556c8c1d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f9682f67640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c8c1d76b0 0x556c8c1d9b70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f9682f67640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f96740393c0 0x7f9674039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1da240 con 0x7f96740393c0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f968bf69640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f96740393c0 0x7f9674039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.281+0000 7f968bf69640 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f96740393c0 0x7f9674039810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.282+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x7f96740393c0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.283+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x7f96740393c0 2024-04-24T01:24:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.284+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.285+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.286+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x7f96740393c0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.287+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x7f96740393c0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d76b0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.288+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x556c8c1ce330 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d1fc0 con 0x7f96740393c0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.289+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d5fb0 con 0x556c8c1ce330 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d5fb0 con 0x556c8c1ce330 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d5f80 con 0x7f96740393c0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 zone default found 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 4 Realm: () 2024-04-24T01:24:21.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 zonegroup default 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.290+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1d63a0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dc0a0 con 0x556c8c1d76b0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dc440 con 0x556c8c1d76b0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 started sync module instance, tier type = 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.291+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1db540 con 0x7f96740393c0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.292+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.292+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93924695587168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1db540 con 0x7f96740393c0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.292+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dcc90 con 0x556c8c1ce330 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.293+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93924695587168] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.293+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.293+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93924695585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dcc90 con 0x556c8c1ce330 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.293+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dd650 con 0x556c8c1d76b0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.294+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93924695585184] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.295+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.295+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93924695590880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dcc00 con 0x556c8c1d76b0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.295+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1de4c0 con 0x7f96740393c0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.296+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93924695590880] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.296+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.296+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93924695597072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1de8e0 con 0x7f96740393c0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.296+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1df2a0 con 0x556c8c1ce330 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.297+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93924695597072] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.297+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.297+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93924695598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1df2a0 con 0x556c8c1ce330 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.297+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dfc60 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.298+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93924695598608] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.298+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.298+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93924695600624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1df210 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.298+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e09c0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.299+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93924695600624] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.299+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.299+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93924695605728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e1210 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.299+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e1bd0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93924695605728] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93924695611648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e2330 con 0x556c8c1d2ab0 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=0 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=1 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=2 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=3 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=4 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=5 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.300+0000 7f968dc62800 20 add_watcher() i=6 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93924695611648] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968dc62800 20 add_watcher() i=7 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968dc62800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e0df0 con 0x556c8c1ce330 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.301+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93924695612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1e0df0 con 0x556c8c1ce330 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.302+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93924695612864] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.302+0000 7f9541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 5 note: GC not initialized 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f9540fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 20 Filter name: none 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f94ba7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.303+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556c8c218190 con 0x556c8c1ce330 2024-04-24T01:24:21.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.304+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.304+0000 7f968dc62800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T01:24:21.316 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:24:21.182656Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.304+0000 7f9541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.304+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93924695612864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c2186d0 con 0x556c8c1ce330 2024-04-24T01:24:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.305+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93924695612864] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.305+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93924695587168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c2186d0 con 0x7f96740393c0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.306+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93924695587168] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.306+0000 7f968dc62800 20 remove_watcher() i=0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.306+0000 7f968dc62800 2 removed watcher, disabling cache 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.306+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93924695585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1db960 con 0x556c8c1ce330 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.307+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93924695585184] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.307+0000 7f968dc62800 20 remove_watcher() i=1 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.307+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93924695590880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1db960 con 0x556c8c1d76b0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.308+0000 7f9682f67640 1 -- 172.21.15.169:0/894247408 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93924695590880] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9674036040 con 0x556c8c1d76b0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.308+0000 7f968dc62800 20 remove_watcher() i=2 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.308+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93924695597072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dc7e0 con 0x7f96740393c0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.309+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93924695597072] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x7f96740393c0 2024-04-24T01:24:21.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.309+0000 7f968dc62800 20 remove_watcher() i=3 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.309+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93924695598608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1de010 con 0x556c8c1ce330 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.310+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93924695598608] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f968400a4a0 con 0x556c8c1ce330 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.310+0000 7f968dc62800 20 remove_watcher() i=4 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.310+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93924695600624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dc7e0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.311+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93924695600624] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.311+0000 7f968dc62800 20 remove_watcher() i=5 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.311+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93924695605728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1de010 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.312+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93924695605728] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.312+0000 7f968dc62800 20 remove_watcher() i=6 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.312+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93924695611648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556c8c1dedf0 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968b768640 1 -- 172.21.15.169:0/894247408 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93924695611648] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f967c0c1020 con 0x556c8c1d2ab0 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 20 remove_watcher() i=7 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c1d2ab0 msgr2=0x556c8c1d4ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c1d2ab0 0x556c8c1d4ea0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c1ce330 msgr2=0x556c8c1d07f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c1ce330 0x556c8c1d07f0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f96740393c0 msgr2=0x7f9674039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f96740393c0 0x7f9674039810 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c8c1d76b0 msgr2=0x556c8c1d9b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c8c1d76b0 0x556c8c1d9b70 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9554036860 msgr2=0x7f9554038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9554036860 0x7f9554038d20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x556c8c1a06e0 tx=0x7f9674011000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 msgr2=0x556c8c1c2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 --2- 172.21.15.169:0/894247408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1bb7f0 0x556c8c1c2c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f967c078e70 tx=0x7f967c04b390 comp rx=0 tx=0).stop 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 reap_dead start 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968bf69640 1 -- 172.21.15.169:0/894247408 reap_dead start 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 shutdown_connections 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 >> 172.21.15.169:0/894247408 conn(0x556c8c1b7b50 msgr2=0x556c8c1b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 shutdown_connections 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.313+0000 7f968dc62800 1 -- 172.21.15.169:0/894247408 wait complete. 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 msgr2=0x7f9564038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 0x7f9564038dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x556c8c094340 tx=0x7f9674006000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 msgr2=0x556c8c1aeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f967c006900 tx=0x7f967c077720 comp rx=0 tx=0).stop 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 shutdown_connections 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9564036900 0x7f9564038dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/3660996962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c1ae740 0x556c8c1aeb60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 >> 172.21.15.169:0/3660996962 conn(0x556c8c1a27e0 msgr2=0x556c8c1a2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 shutdown_connections 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/3660996962 wait complete. 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c199640 msgr2=0x556c8c19bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c8c199640 0x556c8c19bad0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c097f50 msgr2=0x556c8c196f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c8c097f50 0x556c8c196f70 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c8c19d710 msgr2=0x556c8c19fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c8c19d710 0x556c8c19fb80 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9570036950 msgr2=0x7f9570038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9570036950 0x7f9570038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9674001e10 tx=0x7f9674001390 comp rx=0 tx=0).stop 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 msgr2=0x556c8c0952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 --2- 172.21.15.169:0/455565602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c8c0081c0 0x556c8c0952c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f967c01cfe0 tx=0x7f967c003020 comp rx=0 tx=0).stop 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968bf69640 1 -- 172.21.15.169:0/455565602 reap_dead start 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 shutdown_connections 2024-04-24T01:24:21.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 >> 172.21.15.169:0/455565602 conn(0x556c8c08f380 msgr2=0x556c8c180210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 shutdown_connections 2024-04-24T01:24:21.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.314+0000 7f968dc62800 1 -- 172.21.15.169:0/455565602 wait complete. 2024-04-24T01:24:21.329 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:24:21.182656Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.329 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T01:24:21.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-04-24T01:24:21.329 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-04-24T01:24:21.415 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.415 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f424212f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557f564d34a0 0x557f564d5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f424212f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557f5638dd40 con 0x557f564cf990 2024-04-24T01:24:21.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f424212f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x557f563604d0 con 0x557f564d34a0 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423d6c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557f564d34a0 0x557f564d5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423d6c4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557f564d34a0 0x557f564d5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33890/0 (socket says 172.21.15.169:33890) 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423d6c4640 1 -- 172.21.15.169:0/3018112605 learned_addr learned my addr 172.21.15.169:0/3018112605 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423dec5640 1 --1- 172.21.15.169:0/3018112605 >> v1:172.21.15.142:6789/0 conn(0x557f564cf990 0x557f564d1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34724/0 (socket says 172.21.15.169:34724) 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423d6c4640 1 -- 172.21.15.169:0/3018112605 >> v1:172.21.15.142:6789/0 conn(0x557f564cf990 legacy=0x557f564d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.414+0000 7f423d6c4640 1 -- 172.21.15.169:0/3018112605 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f5638c590 con 0x557f564d34a0 2024-04-24T01:24:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.416+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3018112605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564d34a0 0x557f564d5890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f423400a520 tx=0x7f423401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87dd690992eb14a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.416+0000 7f423cec3640 1 -- 172.21.15.169:0/3018112605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4234057070 con 0x557f564d34a0 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.416+0000 7f423cec3640 1 -- 172.21.15.169:0/3018112605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4234052570 con 0x557f564d34a0 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.416+0000 7f423cec3640 1 -- 172.21.15.169:0/3018112605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423404ae60 con 0x557f564d34a0 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 -- 172.21.15.169:0/3018112605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564d34a0 msgr2=0x557f564d5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 --2- 172.21.15.169:0/3018112605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564d34a0 0x557f564d5890 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f423400a520 tx=0x7f423401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 -- 172.21.15.169:0/3018112605 shutdown_connections 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 --2- 172.21.15.169:0/3018112605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564d34a0 0x557f564d5890 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 -- 172.21.15.169:0/3018112605 >> 172.21.15.169:0/3018112605 conn(0x557f564c9320 msgr2=0x557f564cb740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 -- 172.21.15.169:0/3018112605 shutdown_connections 2024-04-24T01:24:21.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.417+0000 7f424212f800 1 -- 172.21.15.169:0/3018112605 wait complete. 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f424212f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f424212f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557f5641a3b0 con 0x557f564cf990 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33900/0 (socket says 172.21.15.169:33900) 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f423dec5640 1 -- 172.21.15.169:0/4268845776 learned_addr learned my addr 172.21.15.169:0/4268845776 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.429+0000 7f423dec5640 1 -- 172.21.15.169:0/4268845776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f564cd890 con 0x557f564cf990 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f423dec5640 1 --2- 172.21.15.169:0/4268845776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4230001e90 tx=0x7f423000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40ac61aae802cbd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f412be07640 1 -- 172.21.15.169:0/4268845776 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423000e5c0 con 0x557f564cf990 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f412be07640 1 -- 172.21.15.169:0/4268845776 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4230006070 con 0x557f564cf990 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f412be07640 1 -- 172.21.15.169:0/4268845776 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423000e890 con 0x557f564cf990 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f424212f800 1 -- 172.21.15.169:0/4268845776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 msgr2=0x557f564cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.430+0000 7f424212f800 1 --2- 172.21.15.169:0/4268845776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4230001e90 tx=0x7f423000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- 172.21.15.169:0/4268845776 shutdown_connections 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 --2- 172.21.15.169:0/4268845776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f564cf2d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- 172.21.15.169:0/4268845776 >> 172.21.15.169:0/4268845776 conn(0x557f564c9320 msgr2=0x557f565bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- 172.21.15.169:0/4268845776 shutdown_connections 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- 172.21.15.169:0/4268845776 wait complete. 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f565c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f424212f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557f564d80e0 con 0x557f564cf990 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f565c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f565c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33912/0 (socket says 172.21.15.169:33912) 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.431+0000 7f423dec5640 1 -- 172.21.15.169:0/2046477522 learned_addr learned my addr 172.21.15.169:0/2046477522 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f423dec5640 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f565ca400 con 0x557f564cf990 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f423dec5640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f565c9ec0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4230001ed0 tx=0x7f4230000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f412a604640 1 -- 172.21.15.169:0/2046477522 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423001a880 con 0x557f564cf990 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f412a604640 1 -- 172.21.15.169:0/2046477522 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423001aa20 con 0x557f564cf990 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f565ca690 con 0x557f564cf990 2024-04-24T01:24:21.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f412a604640 1 -- 172.21.15.169:0/2046477522 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423001ad40 con 0x557f564cf990 2024-04-24T01:24:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.432+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f565cd340 con 0x557f564cf990 2024-04-24T01:24:21.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f412a604640 1 -- 172.21.15.169:0/2046477522 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4230017070 con 0x557f564cf990 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f412a604640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4124036950 0x7f4124038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f412a604640 1 -- 172.21.15.169:0/2046477522 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4230015020 con 0x557f564cf990 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4124036950 0x7f4124038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f564d34a0 0x557f565d1100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f565d1690 con 0x557f564d34a0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f423e6c6640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f564d34a0 0x557f565d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.433+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4124036950 0x7f4124038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4234054000 tx=0x7f423404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f423e6c6640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f564d34a0 0x557f565d1100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f423e6c6640 1 -- 172.21.15.169:0/2046477522 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f564d34a0 2024-04-24T01:24:21.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f565ce6d0 con 0x557f564d34a0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f423e6c6640 1 -- 172.21.15.169:0/2046477522 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f423800a4a0 con 0x557f564d34a0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f565d39e0 0x557f565d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f565d64c0 con 0x557f565d39e0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.434+0000 7f423dec5640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f565d39e0 0x557f565d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f423dec5640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f565d39e0 0x557f565d5dd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f423dec5640 1 -- 172.21.15.169:0/2046477522 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f423002e070 con 0x557f565d39e0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f565d2990 con 0x557f564d34a0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f423e6c6640 1 -- 172.21.15.169:0/2046477522 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f423800a4a0 con 0x557f564d34a0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557f565d7970 0x557f565d9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f565da520 con 0x557f565d7970 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.435+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557f565d7970 0x557f565d9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557f565d7970 0x557f565d9dc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f423d6c4640 1 -- 172.21.15.169:0/2046477522 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f423405a040 con 0x557f565d7970 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f424212f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.436+0000 7f424212f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557f563c06b0 con 0x557f565e8980 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33926/0 (socket says 172.21.15.169:33926) 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f423dec5640 1 -- 172.21.15.169:0/2051787398 learned_addr learned my addr 172.21.15.169:0/2051787398 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f423dec5640 1 -- 172.21.15.169:0/2051787398 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f565e92e0 con 0x557f565e8980 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f423dec5640 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f423001cfd0 tx=0x7f423001b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f41237fe640 1 -- 172.21.15.169:0/2051787398 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4230017d60 con 0x557f565e8980 2024-04-24T01:24:21.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f41237fe640 1 -- 172.21.15.169:0/2051787398 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4230046040 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f565e9d50 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f41237fe640 1 -- 172.21.15.169:0/2051787398 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423001d580 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.437+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f565ea250 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f41237fe640 1 -- 172.21.15.169:0/2051787398 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f423001d720 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f41237fe640 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 0x7f4118038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f41237fe640 1 -- 172.21.15.169:0/2051787398 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f423003cc90 con 0x557f565e8980 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 0x7f4118038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.438+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423d6c4640 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 0x7f4118038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557f565d1f90 tx=0x7f4234005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f424212f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f424212f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557f564cdc10 con 0x557f565f5b20 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33930/0 (socket says 172.21.15.169:33930) 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423dec5640 1 -- 172.21.15.169:0/924036946 learned_addr learned my addr 172.21.15.169:0/924036946 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423dec5640 1 -- 172.21.15.169:0/924036946 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f565f6510 con 0x557f565f5b20 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f423dec5640 1 --2- 172.21.15.169:0/924036946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4230028df0 tx=0x7f4230031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a310ea56cad0b4f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f41217fa640 1 -- 172.21.15.169:0/924036946 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4230031ce0 con 0x557f565f5b20 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f41217fa640 1 -- 172.21.15.169:0/924036946 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f423001edc0 con 0x557f565f5b20 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.439+0000 7f41217fa640 1 -- 172.21.15.169:0/924036946 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423004b7a0 con 0x557f565f5b20 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- 172.21.15.169:0/924036946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 msgr2=0x557f565f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 --2- 172.21.15.169:0/924036946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4230028df0 tx=0x7f4230031ba0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- 172.21.15.169:0/924036946 shutdown_connections 2024-04-24T01:24:21.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 --2- 172.21.15.169:0/924036946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565f5f40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- 172.21.15.169:0/924036946 >> 172.21.15.169:0/924036946 conn(0x557f565f1da0 msgr2=0x557f565efe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- 172.21.15.169:0/924036946 shutdown_connections 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- 172.21.15.169:0/924036946 wait complete. 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 Processor -- start 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- start start 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f424212f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557f565f6b80 con 0x557f565f5b20 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.440+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f423dec5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33938/0 (socket says 172.21.15.169:33938) 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 learned_addr learned my addr 172.21.15.169:0/3750346760 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f565fd330 con 0x557f565f5b20 2024-04-24T01:24:21.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f423dec5640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4230028df0 tx=0x7f4230044970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f410f7fe640 1 -- 172.21.15.169:0/3750346760 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f423004b7a0 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f410f7fe640 1 -- 172.21.15.169:0/3750346760 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4230031450 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557f565fd330 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f410f7fe640 1 -- 172.21.15.169:0/3750346760 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4230031ce0 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.441+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f565fd330 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.442+0000 7f410f7fe640 1 -- 172.21.15.169:0/3750346760 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42300441f0 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.442+0000 7f410f7fe640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4108036950 0x7f4108038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.442+0000 7f410f7fe640 1 -- 172.21.15.169:0/3750346760 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4230067070 con 0x557f565f5b20 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.442+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4108036950 0x7f4108038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.442+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4108036950 0x7f4108038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557f565da920 tx=0x7f423404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f56608400 0x557f5660a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5660b010 con 0x557f56608400 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f423e6c6640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f56608400 0x557f5660a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f423e6c6640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f56608400 0x557f5660a8c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 20 realm 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.443+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5660b420 con 0x557f56608400 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5660bcf0 con 0x557f56608400 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f56608400 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f5660cdf0 0x557f5660f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5660f7f0 con 0x557f5660cdf0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.444+0000 7f423dec5640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f5660cdf0 0x557f5660f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f423dec5640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f5660cdf0 0x557f5660f1e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f424212f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f424212f800 20 searching for the correct realm 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557f566117a0 0x557f56613c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f56614330 con 0x557f566117a0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557f566117a0 0x557f56613c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.445+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557f566117a0 0x557f56613c60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423d6c4640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4234074040 0x7f4234081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f56614330 con 0x7f4234074040 2024-04-24T01:24:21.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423e6c6640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4234074040 0x7f4234081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423e6c6640 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4234074040 0x7f4234081410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.446+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f56608400 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f56608400 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.447+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x7f4234074040 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f566117a0 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f56608400 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.448+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f5660cdf0 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f56608400 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x7f4234074040 2024-04-24T01:24:21.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.449+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557f5660c090 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f5660cdf0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.450+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f56608400 2024-04-24T01:24:21.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f56608400 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f5660cdf0 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.451+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x7f4234074040 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f56608400 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f5660cdf0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.452+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f5660cdf0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x7f4234074040 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f566117a0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.453+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f5660cdf0 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.454+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.454+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x557f56608400 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.454+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.454+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f423408e040 con 0x7f4234074040 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f566100b0 con 0x557f56608400 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f566100b0 con 0x557f56608400 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f566100b0 con 0x7f4234074040 2024-04-24T01:24:21.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 zone default found 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 4 Realm: () 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 zonegroup default 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.455+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f56610950 con 0x557f5660cdf0 2024-04-24T01:24:21.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f56616190 con 0x557f566117a0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f56616530 con 0x557f566117a0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 started sync module instance, tier type = 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.456+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615630 con 0x7f4234074040 2024-04-24T01:24:21.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.458+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.458+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94005398428192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615630 con 0x7f4234074040 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.458+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56616d80 con 0x557f56608400 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.458+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94005398428192] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.459+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.459+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94005398432432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615630 con 0x557f56608400 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.459+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56617820 con 0x557f566117a0 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.460+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94005398432432] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.460+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.460+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94005398425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566155a0 con 0x557f566117a0 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.460+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566186e0 con 0x7f4234074040 2024-04-24T01:24:21.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.461+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94005398425984] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.461+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.461+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94005398438448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56618b00 con 0x7f4234074040 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.461+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566194c0 con 0x557f56608400 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.462+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94005398438448] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.462+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.462+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94005398439984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566194c0 con 0x557f56608400 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.462+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56619e80 con 0x557f5660cdf0 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.463+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94005398439984] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.463+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.463+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94005398442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56619430 con 0x557f5660cdf0 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.463+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5661ac00 con 0x557f5660cdf0 2024-04-24T01:24:21.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.464+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.464+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94005398450080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5661b870 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.464+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5661c2e0 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94005398442000] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94005398453680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5661c2a0 con 0x557f5660cdf0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=0 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=1 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=2 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=3 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=4 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=5 2024-04-24T01:24:21.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94005398450080] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.465+0000 7f424212f800 20 add_watcher() i=6 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.466+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94005398453680] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.466+0000 7f424212f800 20 add_watcher() i=7 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.466+0000 7f424212f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.466+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f5661b3c0 con 0x557f56608400 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.467+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.467+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94005398446624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f5661b3c0 con 0x557f56608400 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94005398446624] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f40ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 5 note: GC not initialized 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f40ee7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 20 Filter name: none 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f405ffff640 20 reqs_thread_entry: start 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.468+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f56652580 con 0x557f56608400 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f424212f800 20 rados_obj.operate() r=0 bl.length=673 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f424212f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f424212f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f424212f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.469+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566590e0 con 0x557f56608400 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f424212f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f424212f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f424212f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94005398702928 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f56654850 con 0x557f56608400 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94005398439984 notify 137438953480 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f4238018c70 con 0x557f56608400 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f41217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94005398439984 notifier 4402 bl.length()=758 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f41217fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(64 notify.4 [notify cookie 94005398702928 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f41217fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f41217fa640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4100003ea0 con 0x557f56608400 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.470+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.471+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94005398702928 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4238044430 con 0x557f56608400 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.471+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56658b50 con 0x557f56608400 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f424212f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94005398702928 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557f566543a0 con 0x7f4234074040 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== watch-notify(notify (1) cookie 94005398428192 notify 137438953476 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f4238044430 con 0x7f4234074040 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f41217fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94005398428192 notifier 4402 bl.length()=159 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.0 [notify cookie 94005398702928 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f41217fa640 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4100003ea0 con 0x7f4234074040 2024-04-24T01:24:21.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== watch-notify(notify_complete (2) cookie 94005398702928 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f42380446d0 con 0x7f4234074040 2024-04-24T01:24:21.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.472+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.491 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:24:21.182656Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.473+0000 7f40ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.473+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94005398446624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f566543a0 con 0x557f56608400 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.474+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94005398446624] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.474+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94005398428192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56654340 con 0x7f4234074040 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.475+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94005398428192] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.475+0000 7f424212f800 20 remove_watcher() i=0 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.475+0000 7f424212f800 2 removed watcher, disabling cache 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.475+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94005398432432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56654340 con 0x557f56608400 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.476+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94005398432432] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.476+0000 7f424212f800 20 remove_watcher() i=1 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.476+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94005398425984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56654340 con 0x557f566117a0 2024-04-24T01:24:21.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.477+0000 7f423d6c4640 1 -- 172.21.15.169:0/3750346760 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94005398425984] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423407f070 con 0x557f566117a0 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.477+0000 7f424212f800 20 remove_watcher() i=2 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.477+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94005398438448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615a20 con 0x7f4234074040 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.478+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94005398438448] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x7f4234074040 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.478+0000 7f424212f800 20 remove_watcher() i=3 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.478+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94005398439984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56616ab0 con 0x557f56608400 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.479+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94005398439984] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f423800a4a0 con 0x557f56608400 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.479+0000 7f424212f800 20 remove_watcher() i=4 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.479+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94005398442000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615180 con 0x557f5660cdf0 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.480+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94005398442000] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.480+0000 7f424212f800 20 remove_watcher() i=5 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.480+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94005398450080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56618230 con 0x557f5660cdf0 2024-04-24T01:24:21.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.481+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94005398450080] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.481+0000 7f424212f800 20 remove_watcher() i=6 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.481+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94005398453680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557f56615a20 con 0x557f5660cdf0 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f423dec5640 1 -- 172.21.15.169:0/3750346760 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94005398453680] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4230070020 con 0x557f5660cdf0 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 20 remove_watcher() i=7 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f5660cdf0 msgr2=0x557f5660f1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f5660cdf0 0x557f5660f1e0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f56608400 msgr2=0x557f5660a8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f56608400 0x557f5660a8c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4234074040 msgr2=0x7f4234081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4234074040 0x7f4234081410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557f566117a0 msgr2=0x557f56613c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557f566117a0 0x557f56613c60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4108036950 msgr2=0x7f4108038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4108036950 0x7f4108038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x557f565da920 tx=0x7f423404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f423e6c6640 1 -- 172.21.15.169:0/3750346760 reap_dead start 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 msgr2=0x557f565fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4230028df0 tx=0x7f4230044970 comp rx=0 tx=0).stop 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 shutdown_connections 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 --2- 172.21.15.169:0/3750346760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565f5b20 0x557f565fcdf0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 >> 172.21.15.169:0/3750346760 conn(0x557f565f1da0 msgr2=0x557f565ef400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 shutdown_connections 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.482+0000 7f424212f800 1 -- 172.21.15.169:0/3750346760 wait complete. 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 msgr2=0x7f4118038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 0x7f4118038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x557f565d1f90 tx=0x7f4234005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 msgr2=0x557f565e8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f423001cfd0 tx=0x7f423001b960 comp rx=0 tx=0).stop 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 shutdown_connections 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4118036950 0x7f4118038e10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2051787398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f565e8980 0x557f565e8da0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 >> 172.21.15.169:0/2051787398 conn(0x557f565dca20 msgr2=0x557f565dce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 shutdown_connections 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2051787398 wait complete. 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f565d39e0 msgr2=0x557f565d5dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557f565d39e0 0x557f565d5dd0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f564d34a0 msgr2=0x557f565d1100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557f564d34a0 0x557f565d1100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557f565d7970 msgr2=0x557f565d9dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557f565d7970 0x557f565d9dc0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4124036950 msgr2=0x7f4124038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4124036950 0x7f4124038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4234054000 tx=0x7f423404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 msgr2=0x557f565c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 --2- 172.21.15.169:0/2046477522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557f564cf990 0x557f565c9ec0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4230001ed0 tx=0x7f4230000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f423e6c6640 1 -- 172.21.15.169:0/2046477522 reap_dead start 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 shutdown_connections 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 >> 172.21.15.169:0/2046477522 conn(0x557f564c9320 msgr2=0x557f564ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 shutdown_connections 2024-04-24T01:24:21.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.483+0000 7f424212f800 1 -- 172.21.15.169:0/2046477522 wait complete. 2024-04-24T01:24:21.504 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:24:21.182656Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.504 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T01:24:21.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-04-24T01:24:21.504 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-04-24T01:24:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.547 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.546+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.546+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.546+0000 7fbe94933800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c217ac31f0 0x55c217ac55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.546+0000 7fbe94933800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c21797ed40 con 0x55c217abed60 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.546+0000 7fbe94933800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c2179514d0 con 0x55c217ac31f0 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe87fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c217ac31f0 0x55c217ac55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe87fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c217ac31f0 0x55c217ac55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33946/0 (socket says 172.21.15.169:33946) 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe87fff640 1 -- 172.21.15.169:0/3131343483 learned_addr learned my addr 172.21.15.169:0/3131343483 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe905d8640 1 --1- 172.21.15.169:0/3131343483 >> v1:172.21.15.142:6789/0 conn(0x55c217abed60 0x55c217abf180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34728/0 (socket says 172.21.15.169:34728) 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe87fff640 1 -- 172.21.15.169:0/3131343483 >> v1:172.21.15.142:6789/0 conn(0x55c217abed60 legacy=0x55c217abf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.547+0000 7fbe87fff640 1 -- 172.21.15.169:0/3131343483 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21797d590 con 0x55c217ac31f0 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe87fff640 1 --2- 172.21.15.169:0/3131343483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217ac31f0 0x55c217ac55e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800a520 tx=0x7fbe7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94315837166a0873 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe8fdd7640 1 -- 172.21.15.169:0/3131343483 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe78057070 con 0x55c217ac31f0 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe8fdd7640 1 -- 172.21.15.169:0/3131343483 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78052570 con 0x55c217ac31f0 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe8fdd7640 1 -- 172.21.15.169:0/3131343483 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe7804ae60 con 0x55c217ac31f0 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe94933800 1 -- 172.21.15.169:0/3131343483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217ac31f0 msgr2=0x55c217ac55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe94933800 1 --2- 172.21.15.169:0/3131343483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217ac31f0 0x55c217ac55e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800a520 tx=0x7fbe7801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.549+0000 7fbe94933800 1 -- 172.21.15.169:0/3131343483 shutdown_connections 2024-04-24T01:24:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.550+0000 7fbe94933800 1 --2- 172.21.15.169:0/3131343483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217ac31f0 0x55c217ac55e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.550+0000 7fbe94933800 1 -- 172.21.15.169:0/3131343483 >> 172.21.15.169:0/3131343483 conn(0x55c217aba300 msgr2=0x55c217abc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.550+0000 7fbe94933800 1 -- 172.21.15.169:0/3131343483 shutdown_connections 2024-04-24T01:24:21.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.550+0000 7fbe94933800 1 -- 172.21.15.169:0/3131343483 wait complete. 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.561+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.561+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.561+0000 7fbe94933800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.561+0000 7fbe94933800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c217a0b3c0 con 0x55c217abed60 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33958/0 (socket says 172.21.15.169:33958) 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbe905d8640 1 -- 172.21.15.169:0/89019047 learned_addr learned my addr 172.21.15.169:0/89019047 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbe905d8640 1 -- 172.21.15.169:0/89019047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c217bb3e30 con 0x55c217abed60 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbe905d8640 1 --2- 172.21.15.169:0/89019047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000b230 tx=0x7fbe8000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe47285dea7855a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbd7e60c640 1 -- 172.21.15.169:0/89019047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8000e5c0 con 0x55c217abed60 2024-04-24T01:24:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbd7e60c640 1 -- 172.21.15.169:0/89019047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80006070 con 0x55c217abed60 2024-04-24T01:24:21.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.562+0000 7fbd7e60c640 1 -- 172.21.15.169:0/89019047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8000e890 con 0x55c217abed60 2024-04-24T01:24:21.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 -- 172.21.15.169:0/89019047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 msgr2=0x55c217a33880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 --2- 172.21.15.169:0/89019047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000b230 tx=0x7fbe8000b6f0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 -- 172.21.15.169:0/89019047 shutdown_connections 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 --2- 172.21.15.169:0/89019047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217a33880 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 -- 172.21.15.169:0/89019047 >> 172.21.15.169:0/89019047 conn(0x55c217aba300 msgr2=0x55c217bab920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 -- 172.21.15.169:0/89019047 shutdown_connections 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 -- 172.21.15.169:0/89019047 wait complete. 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.563+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe94933800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217bb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe94933800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c217ac5eb0 con 0x55c217abed60 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217bb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217bb8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33964/0 (socket says 172.21.15.169:33964) 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe905d8640 1 -- 172.21.15.169:0/3911168941 learned_addr learned my addr 172.21.15.169:0/3911168941 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe905d8640 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c217bb91c0 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.564+0000 7fbe905d8640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217bb8c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000fd0 tx=0x7fbe80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 -- 172.21.15.169:0/3911168941 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8000f8d0 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 -- 172.21.15.169:0/3911168941 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8000fa90 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c217bb9450 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 -- 172.21.15.169:0/3911168941 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8000fdb0 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c217bbc100 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 -- 172.21.15.169:0/3911168941 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe80017070 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd78036950 0x7fbd78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.565+0000 7fbd7ce09640 1 -- 172.21.15.169:0/3911168941 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe80015020 con 0x55c217abed60 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe87fff640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd78036950 0x7fbd78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217ac31f0 0x55c217bbfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bc0440 con 0x55c217ac31f0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217ac31f0 0x55c217bbfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe87fff640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd78036950 0x7fbd78038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe78054000 tx=0x7fbe7804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217ac31f0 0x55c217bbfec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe90dd9640 1 -- 172.21.15.169:0/3911168941 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217ac31f0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.566+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bbd490 con 0x55c217ac31f0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.567+0000 7fbe90dd9640 1 -- 172.21.15.169:0/3911168941 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217ac31f0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.567+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bc2770 0x55c217bc4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.567+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bc5250 con 0x55c217bc2770 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.567+0000 7fbe905d8640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bc2770 0x55c217bc4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.567+0000 7fbe905d8640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bc2770 0x55c217bc4b60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe905d8640 1 -- 172.21.15.169:0/3911168941 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe8002e070 con 0x55c217bc2770 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bc16f0 con 0x55c217ac31f0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe90dd9640 1 -- 172.21.15.169:0/3911168941 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217ac31f0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c217bc66b0 0x55c217bc8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bc9280 con 0x55c217bc66b0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe87fff640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c217bc66b0 0x55c217bc8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe87fff640 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c217bc66b0 0x55c217bc8b20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.568+0000 7fbe87fff640 1 -- 172.21.15.169:0/3911168941 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe7805a040 con 0x55c217bc66b0 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe94933800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe94933800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2179b16b0 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33978/0 (socket says 172.21.15.169:33978) 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.569+0000 7fbe905d8640 1 -- 172.21.15.169:0/670661847 learned_addr learned my addr 172.21.15.169:0/670661847 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbe905d8640 1 -- 172.21.15.169:0/670661847 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c217bd8040 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbe905d8640 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe8001dfd0 tx=0x7fbe80017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbd75ffb640 1 -- 172.21.15.169:0/670661847 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8001bc60 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbd75ffb640 1 -- 172.21.15.169:0/670661847 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80044c60 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbd75ffb640 1 -- 172.21.15.169:0/670661847 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80044f60 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c217bd8ab0 con 0x55c217bd76e0 2024-04-24T01:24:21.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.570+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c217bd8fb0 con 0x55c217bd76e0 2024-04-24T01:24:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbd75ffb640 1 -- 172.21.15.169:0/670661847 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe80051020 con 0x55c217bd76e0 2024-04-24T01:24:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbd75ffb640 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbd75ffb640 1 -- 172.21.15.169:0/670661847 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe8003dc50 con 0x55c217bd76e0 2024-04-24T01:24:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe87fff640 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe87fff640 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 0x7fbd68038dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55c217bc0d20 tx=0x7fbe78005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe94933800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.571+0000 7fbe94933800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c217bb4180 con 0x55c217bb14d0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:33994/0 (socket says 172.21.15.169:33994) 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe905d8640 1 -- 172.21.15.169:0/3167839963 learned_addr learned my addr 172.21.15.169:0/3167839963 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe905d8640 1 -- 172.21.15.169:0/3167839963 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c217bafca0 con 0x55c217bb14d0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe905d8640 1 --2- 172.21.15.169:0/3167839963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe8001be20 tx=0x7fbe800414f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392ee34d05ded936 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbd677fe640 1 -- 172.21.15.169:0/3167839963 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80057030 con 0x55c217bb14d0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbd677fe640 1 -- 172.21.15.169:0/3167839963 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80041050 con 0x55c217bb14d0 2024-04-24T01:24:21.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbd677fe640 1 -- 172.21.15.169:0/3167839963 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800446c0 con 0x55c217bb14d0 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe94933800 1 -- 172.21.15.169:0/3167839963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 msgr2=0x55c217bb18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.572+0000 7fbe94933800 1 --2- 172.21.15.169:0/3167839963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe8001be20 tx=0x7fbe800414f0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- 172.21.15.169:0/3167839963 shutdown_connections 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 --2- 172.21.15.169:0/3167839963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bb18d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- 172.21.15.169:0/3167839963 >> 172.21.15.169:0/3167839963 conn(0x55c217be0b00 msgr2=0x55c217bdeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- 172.21.15.169:0/3167839963 shutdown_connections 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- 172.21.15.169:0/3167839963 wait complete. 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 Processor -- start 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- start start 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe94933800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c217bb00b0 con 0x55c217bb14d0 2024-04-24T01:24:21.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe905d8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34010/0 (socket says 172.21.15.169:34010) 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.573+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 learned_addr learned my addr 172.21.15.169:0/1895145414 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c217bee390 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbe905d8640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe80010c20 tx=0x7fbe80041330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbd65ffb640 1 -- 172.21.15.169:0/1895145414 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe800030d0 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbd65ffb640 1 -- 172.21.15.169:0/1895145414 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80004a60 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c217bee390 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbd65ffb640 1 -- 172.21.15.169:0/1895145414 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80004d40 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c217bee390 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.574+0000 7fbd65ffb640 1 -- 172.21.15.169:0/1895145414 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe8006b070 con 0x55c217bb14d0 2024-04-24T01:24:21.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbd65ffb640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd58036900 0x7fbd58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbd65ffb640 1 -- 172.21.15.169:0/1895145414 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fbe8005b070 con 0x55c217bb14d0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe87fff640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd58036900 0x7fbd58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe87fff640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd58036900 0x7fbd58038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55c217bc9680 tx=0x7fbe7804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217bf9530 0x55c217bfb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfc140 con 0x55c217bf9530 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.575+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217bf9530 0x55c217bfb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217bf9530 0x55c217bfb9f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 realm 2024-04-24T01:24:21.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfc550 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfce20 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.576+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bfdf20 0x55c217c00310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c00920 con 0x55c217bfdf20 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe905d8640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bfdf20 0x55c217c00310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe905d8640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bfdf20 0x55c217c00310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 20 searching for the correct realm 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c217c028d0 0x55c217c04d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.577+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217c05460 con 0x55c217c028d0 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe87fff640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c217c028d0 0x55c217c04d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe87fff640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c217c028d0 0x55c217c04d90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe87fff640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbe78074040 0x7fbe78081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217c05460 con 0x7fbe78074040 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbe78074040 0x7fbe78081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.578+0000 7fbe90dd9640 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbe78074040 0x7fbe78081410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bfdf20 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bf9530 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bf9530 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.579+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bfdf20 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bfdf20 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x7fbe78074040 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217c028d0 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.580+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bf9530 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bfdf20 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217bf9530 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x7fbe78074040 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.581+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c217bfd1c0 con 0x55c217c028d0 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bfdf20 2024-04-24T01:24:21.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.582+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bf9530 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bf9530 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bfdf20 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.583+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x7fbe78074040 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bf9530 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bfdf20 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.584+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bfdf20 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x7fbe78074040 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217c028d0 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.585+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bfdf20 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x55c217bf9530 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fbe7808e040 con 0x7fbe78074040 2024-04-24T01:24:21.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c011e0 con 0x55c217bf9530 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.586+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c011e0 con 0x55c217bf9530 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c011e0 con 0x7fbe78074040 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 zone default found 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 4 Realm: () 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 zonegroup default 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c01a80 con 0x55c217bfdf20 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.587+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c072c0 con 0x55c217c028d0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c07660 con 0x55c217c028d0 2024-04-24T01:24:21.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 20 started sync module instance, tier type = 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.588+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c06760 con 0x7fbe78074040 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.589+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.589+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94292110502736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c06760 con 0x7fbe78074040 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.589+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c07eb0 con 0x55c217bf9530 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.590+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94292110502736] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.590+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.590+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94292110506976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c06760 con 0x55c217bf9530 2024-04-24T01:24:21.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.590+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c08930 con 0x55c217c028d0 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.591+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94292110506976] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.592+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.592+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94292110500528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c066d0 con 0x55c217c028d0 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.592+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c096c0 con 0x7fbe78074040 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.592+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94292110500528] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.592+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.593+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94292110511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c09ae0 con 0x7fbe78074040 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.593+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.593+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94292110511392] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.594+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.594+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94292110512448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.594+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0aee0 con 0x55c217bfdf20 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.595+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94292110512448] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.595+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.595+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94292110516208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0a410 con 0x55c217bfdf20 2024-04-24T01:24:21.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.595+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0bc30 con 0x55c217bfdf20 2024-04-24T01:24:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.596+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94292110516208] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.596+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.596+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94292110521520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0c480 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.596+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0ce40 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94292110526864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0d260 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=0 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=1 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=2 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=3 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=4 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=5 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94292110521520] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.597+0000 7fbe94933800 20 add_watcher() i=6 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94292110526864] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe94933800 20 add_watcher() i=7 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe94933800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0bfd0 con 0x55c217bf9530 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.598+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94292110527920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0bfd0 con 0x55c217bf9530 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94292110527920] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbd46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbe94933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbe94933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbe94933800 5 note: GC not initialized 2024-04-24T01:24:21.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbd45fdb640 20 reqs_thread_entry: start 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.599+0000 7fbe94933800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 20 Filter name: none 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbcb77fe640 20 reqs_thread_entry: start 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c43690 con 0x55c217bf9530 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 20 rados_obj.operate() r=0 bl.length=582 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.600+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c49c00 con 0x55c217bf9530 2024-04-24T01:24:21.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.601+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.601+0000 7fbe94933800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.601+0000 7fbe94933800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.601+0000 7fbe94933800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.601+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94292110775920 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c217c455c0 con 0x55c217bf9530 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94292110512448 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fbe88026410 con 0x55c217bf9530 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbd677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94292110512448 notifier 4409 bl.length()=732 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbd677fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(64 notify.4 [notify cookie 94292110775920 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbd677fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbd677fe640 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbd5c003ea0 con 0x55c217bf9530 2024-04-24T01:24:21.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.602+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94292110775920 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe880265e0 con 0x55c217bf9530 2024-04-24T01:24:21.623 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-04-24T01:24:21.182656Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.603+0000 7fbd46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.603+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94292110527920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c48550 con 0x55c217bf9530 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.604+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94292110527920] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.604+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94292110502736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0cdb0 con 0x7fbe78074040 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.605+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94292110502736] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.605+0000 7fbe94933800 20 remove_watcher() i=0 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.605+0000 7fbe94933800 2 removed watcher, disabling cache 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.605+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94292110506976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0cdb0 con 0x55c217bf9530 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.606+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94292110506976] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.606+0000 7fbe94933800 20 remove_watcher() i=1 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.606+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94292110500528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0cdb0 con 0x55c217c028d0 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.607+0000 7fbe87fff640 1 -- 172.21.15.169:0/1895145414 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94292110500528] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe7807f070 con 0x55c217c028d0 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.607+0000 7fbe94933800 20 remove_watcher() i=2 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.607+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94292110511392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c062b0 con 0x7fbe78074040 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.608+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94292110511392] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x7fbe78074040 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.608+0000 7fbe94933800 20 remove_watcher() i=3 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.608+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94292110512448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c062b0 con 0x55c217bf9530 2024-04-24T01:24:21.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.609+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94292110512448] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55c217bf9530 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.609+0000 7fbe94933800 20 remove_watcher() i=4 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.609+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94292110516208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c062b0 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.610+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94292110516208] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.610+0000 7fbe94933800 20 remove_watcher() i=5 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.610+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94292110521520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c062b0 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.611+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94292110521520] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.611+0000 7fbe94933800 20 remove_watcher() i=6 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.611+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94292110526864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c217c0b4b0 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe905d8640 1 -- 172.21.15.169:0/1895145414 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94292110526864] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80074020 con 0x55c217bfdf20 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 20 remove_watcher() i=7 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bfdf20 msgr2=0x55c217c00310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bfdf20 0x55c217c00310 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217bf9530 msgr2=0x55c217bfb9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217bf9530 0x55c217bfb9f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbe78074040 msgr2=0x7fbe78081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbe78074040 0x7fbe78081410 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c217c028d0 msgr2=0x55c217c04d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c217c028d0 0x55c217c04d90 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd58036900 msgr2=0x7fbd58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd58036900 0x7fbd58038dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x55c217bc9680 tx=0x7fbe7804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 msgr2=0x55c217bede50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe90dd9640 1 -- 172.21.15.169:0/1895145414 reap_dead start 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe80010c20 tx=0x7fbe80041330 comp rx=0 tx=0).stop 2024-04-24T01:24:21.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 shutdown_connections 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 --2- 172.21.15.169:0/1895145414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bb14d0 0x55c217bede50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 >> 172.21.15.169:0/1895145414 conn(0x55c217be0b00 msgr2=0x55c217bde160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.612+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 shutdown_connections 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/1895145414 wait complete. 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 msgr2=0x7fbd68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 0x7fbd68038dc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55c217bc0d20 tx=0x7fbe78005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 msgr2=0x55c217bd7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe8001dfd0 tx=0x7fbe80017d70 comp rx=0 tx=0).stop 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 shutdown_connections 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/670661847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217bd76e0 0x55c217bd7b00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 >> 172.21.15.169:0/670661847 conn(0x55c217bcb780 msgr2=0x55c217bcbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 shutdown_connections 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/670661847 wait complete. 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bc2770 msgr2=0x55c217bc4b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c217bc2770 0x55c217bc4b60 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217ac31f0 msgr2=0x55c217bbfec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c217ac31f0 0x55c217bbfec0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c217bc66b0 msgr2=0x55c217bc8b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c217bc66b0 0x55c217bc8b20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd78036950 msgr2=0x7fbd78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbd78036950 0x7fbd78038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe78054000 tx=0x7fbe7804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 msgr2=0x55c217bb8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 --2- 172.21.15.169:0/3911168941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c217abed60 0x55c217bb8c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbe80000fd0 tx=0x7fbe80000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe90dd9640 1 -- 172.21.15.169:0/3911168941 reap_dead start 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 shutdown_connections 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 >> 172.21.15.169:0/3911168941 conn(0x55c217aba300 msgr2=0x55c217baa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 shutdown_connections 2024-04-24T01:24:21.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.613+0000 7fbe94933800 1 -- 172.21.15.169:0/3911168941 wait complete. 2024-04-24T01:24:21.635 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-04-24T01:24:21.182656Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.636 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T01:24:21.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-04-24T01:24:21.636 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-04-24T01:24:21.715 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.715 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.714+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.714+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.714+0000 7f6f679a2800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632147d83e0 0x5632147da7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.714+0000 7f6f679a2800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563214692d40 con 0x5632147d48d0 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.714+0000 7f6f679a2800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5632146654d0 con 0x5632147d83e0 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f64ca7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632147d83e0 0x5632147da7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f654a8640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5632147d48d0 0x5632147d6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34738/0 (socket says 172.21.15.169:34738) 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f64ca7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632147d83e0 0x5632147da7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34016/0 (socket says 172.21.15.169:34016) 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f654a8640 1 -- 172.21.15.169:0/917879759 learned_addr learned my addr 172.21.15.169:0/917879759 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f64ca7640 1 -- 172.21.15.169:0/917879759 >> v1:172.21.15.142:6789/0 conn(0x5632147d48d0 legacy=0x5632147d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.715+0000 7f6f64ca7640 1 -- 172.21.15.169:0/917879759 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563214691590 con 0x5632147d83e0 2024-04-24T01:24:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/917879759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d83e0 0x5632147da7d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00a470 tx=0x7f6f5c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25efa53e18d52822 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f57fff640 1 -- 172.21.15.169:0/917879759 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5c057070 con 0x5632147d83e0 2024-04-24T01:24:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f57fff640 1 -- 172.21.15.169:0/917879759 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5c052570 con 0x5632147d83e0 2024-04-24T01:24:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f57fff640 1 -- 172.21.15.169:0/917879759 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5c052870 con 0x5632147d83e0 2024-04-24T01:24:21.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f679a2800 1 -- 172.21.15.169:0/917879759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d83e0 msgr2=0x5632147da7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f679a2800 1 --2- 172.21.15.169:0/917879759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d83e0 0x5632147da7d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00a470 tx=0x7f6f5c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f679a2800 1 -- 172.21.15.169:0/917879759 shutdown_connections 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.717+0000 7f6f679a2800 1 --2- 172.21.15.169:0/917879759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d83e0 0x5632147da7d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.718+0000 7f6f679a2800 1 -- 172.21.15.169:0/917879759 >> 172.21.15.169:0/917879759 conn(0x5632147ce3a0 msgr2=0x5632147d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.718+0000 7f6f679a2800 1 -- 172.21.15.169:0/917879759 shutdown_connections 2024-04-24T01:24:21.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.718+0000 7f6f679a2800 1 -- 172.21.15.169:0/917879759 wait complete. 2024-04-24T01:24:21.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.729+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.729+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.729+0000 7f6f679a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.729+0000 7f6f679a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56321471f3e0 con 0x5632147d48d0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34020/0 (socket says 172.21.15.169:34020) 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6f654a8640 1 -- 172.21.15.169:0/2700391631 learned_addr learned my addr 172.21.15.169:0/2700391631 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6f654a8640 1 -- 172.21.15.169:0/2700391631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632147d27d0 con 0x5632147d48d0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6f654a8640 1 --2- 172.21.15.169:0/2700391631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f580017a0 tx=0x7f6f58001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aaf10a7ec5c72d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6e53606640 1 -- 172.21.15.169:0/2700391631 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58004520 con 0x5632147d48d0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6e53606640 1 -- 172.21.15.169:0/2700391631 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f580046c0 con 0x5632147d48d0 2024-04-24T01:24:21.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.730+0000 7f6e53606640 1 -- 172.21.15.169:0/2700391631 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58004a00 con 0x5632147d48d0 2024-04-24T01:24:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- 172.21.15.169:0/2700391631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 msgr2=0x5632147d4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 --2- 172.21.15.169:0/2700391631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6f580017a0 tx=0x7f6f58001c60 comp rx=0 tx=0).stop 2024-04-24T01:24:21.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- 172.21.15.169:0/2700391631 shutdown_connections 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 --2- 172.21.15.169:0/2700391631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632147d4210 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- 172.21.15.169:0/2700391631 >> 172.21.15.169:0/2700391631 conn(0x5632147ce3a0 msgr2=0x5632148c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- 172.21.15.169:0/2700391631 shutdown_connections 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- 172.21.15.169:0/2700391631 wait complete. 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632148cee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.731+0000 7f6f679a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632147db010 con 0x5632147d48d0 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632148cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632148cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34032/0 (socket says 172.21.15.169:34032) 2024-04-24T01:24:21.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f654a8640 1 -- 172.21.15.169:0/841200404 learned_addr learned my addr 172.21.15.169:0/841200404 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f654a8640 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632148cf3a0 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f654a8640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632148cee60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000f80 tx=0x7f6f58001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6e51e03640 1 -- 172.21.15.169:0/841200404 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58022020 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6e51e03640 1 -- 172.21.15.169:0/841200404 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58014870 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632148cf630 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6e51e03640 1 -- 172.21.15.169:0/841200404 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58014bb0 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.732+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632148d22e0 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6e51e03640 1 -- 172.21.15.169:0/841200404 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f58025020 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6e51e03640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e4c036950 0x7f6e4c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6e51e03640 1 -- 172.21.15.169:0/841200404 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f58018030 con 0x5632147d48d0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e4c036950 0x7f6e4c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632147d83e0 0x5632148d60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.733+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632148d6630 con 0x5632147d83e0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632147d83e0 0x5632148d60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e4c036950 0x7f6e4c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c054000 tx=0x7f6f5c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632147d83e0 0x5632148d60a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f65ca9640 1 -- 172.21.15.169:0/841200404 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f600083e0 con 0x5632147d83e0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632148d3650 con 0x5632147d83e0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f65ca9640 1 -- 172.21.15.169:0/841200404 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f600083e0 con 0x5632147d83e0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632148d8960 0x5632148dad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.734+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632148db440 con 0x5632148d8960 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f654a8640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632148d8960 0x5632148dad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f654a8640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632148d8960 0x5632148dad50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f654a8640 1 -- 172.21.15.169:0/841200404 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6f5801b070 con 0x5632148d8960 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632148d7910 con 0x5632147d83e0 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f65ca9640 1 -- 172.21.15.169:0/841200404 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f600083e0 con 0x5632147d83e0 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632148dc8f0 0x5632148ded20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632148df4b0 con 0x5632148dc8f0 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.735+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632148dc8f0 0x5632148ded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.736+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632148dc8f0 0x5632148ded20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.736+0000 7f6f64ca7640 1 -- 172.21.15.169:0/841200404 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6f5c052a40 con 0x5632148dc8f0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.736+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.736+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f679a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f679a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632146c56b0 con 0x5632148ed8d0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34036/0 (socket says 172.21.15.169:34036) 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f654a8640 1 -- 172.21.15.169:0/3056098112 learned_addr learned my addr 172.21.15.169:0/3056098112 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f654a8640 1 -- 172.21.15.169:0/3056098112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632148ee230 con 0x5632148ed8d0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f654a8640 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6f58006690 tx=0x7f6f580108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6e4affd640 1 -- 172.21.15.169:0/3056098112 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f58044d70 con 0x5632148ed8d0 2024-04-24T01:24:21.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6e4affd640 1 -- 172.21.15.169:0/3056098112 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5801d950 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632148eeca0 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6e4affd640 1 -- 172.21.15.169:0/3056098112 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5801dc30 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.737+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632148ef1a0 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.738+0000 7f6e4affd640 1 -- 172.21.15.169:0/3056098112 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f58010070 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.738+0000 7f6e4affd640 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 0x7f6e3c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.738+0000 7f6e4affd640 1 -- 172.21.15.169:0/3056098112 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f58028c60 con 0x5632148ed8d0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.738+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 0x7f6e3c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 0x7f6e3c038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5632148d6b00 tx=0x7f6f5c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f679a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f679a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632147d2b50 con 0x5632148faa90 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34048/0 (socket says 172.21.15.169:34048) 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f654a8640 1 -- 172.21.15.169:0/3286394110 learned_addr learned my addr 172.21.15.169:0/3286394110 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f654a8640 1 -- 172.21.15.169:0/3286394110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632148fb480 con 0x5632148faa90 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6f654a8640 1 --2- 172.21.15.169:0/3286394110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f58010a40 tx=0x7f6f5800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b79d3e148d9587 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6e48ff9640 1 -- 172.21.15.169:0/3286394110 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5805c020 con 0x5632148faa90 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6e48ff9640 1 -- 172.21.15.169:0/3286394110 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f58033e20 con 0x5632148faa90 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.739+0000 7f6e48ff9640 1 -- 172.21.15.169:0/3286394110 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5804c0d0 con 0x5632148faa90 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- 172.21.15.169:0/3286394110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 msgr2=0x5632148faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3286394110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6f58010a40 tx=0x7f6f5800fec0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- 172.21.15.169:0/3286394110 shutdown_connections 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3286394110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x5632148faeb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- 172.21.15.169:0/3286394110 >> 172.21.15.169:0/3286394110 conn(0x5632148f6d60 msgr2=0x5632148f4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- 172.21.15.169:0/3286394110 shutdown_connections 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- 172.21.15.169:0/3286394110 wait complete. 2024-04-24T01:24:21.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 Processor -- start 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- start start 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x563214901ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.740+0000 7f6f679a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632148fbb50 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x563214901ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f654a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x563214901ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34064/0 (socket says 172.21.15.169:34064) 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 learned_addr learned my addr 172.21.15.169:0/122776400 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563214902430 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f654a8640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x563214901ef0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6f580075f0 tx=0x7f6f5800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6e3affd640 1 -- 172.21.15.169:0/122776400 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5800a0d0 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6e3affd640 1 -- 172.21.15.169:0/122776400 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f5804c0d0 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563214902430 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6e3affd640 1 -- 172.21.15.169:0/122776400 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f5800a270 con 0x5632148faa90 2024-04-24T01:24:21.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.741+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563214902430 con 0x5632148faa90 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.742+0000 7f6e3affd640 1 -- 172.21.15.169:0/122776400 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f58056040 con 0x5632148faa90 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.742+0000 7f6e3affd640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e300368a0 0x7f6e30038d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.742+0000 7f6e3affd640 1 -- 172.21.15.169:0/122776400 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6f58053040 con 0x5632148faa90 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.742+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e300368a0 0x7f6e30038d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e300368a0 0x7f6e30038d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c052fd0 tx=0x7f6f5c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56321490d490 0x56321490f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632149100a0 con 0x56321490d490 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56321490d490 0x56321490f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56321490d490 0x56321490f950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f600083e0 con 0x56321490d490 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 20 realm 2024-04-24T01:24:21.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.743+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632149104b0 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f600083e0 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f600083e0 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214911120 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6f600083e0 con 0x56321490d490 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563214911ae0 0x563214913ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214914520 con 0x563214911ae0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.744+0000 7f6f654a8640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563214911ae0 0x563214913ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f654a8640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563214911ae0 0x563214913ed0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f679a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f679a2800 20 searching for the correct realm 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632149164b0 0x563214918970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214919040 con 0x5632149164b0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632149164b0 0x563214918970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.745+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632149164b0 0x563214918970 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f64ca7640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6f5c076040 0x7f6f5c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214919040 con 0x7f6f5c076040 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6f5c076040 0x7f6f5c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f65ca9640 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6f5c076040 0x7f6f5c083410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f600083e0 con 0x7f6f5c076040 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.746+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x563214911ae0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x56321490d490 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f600083e0 con 0x56321490d490 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x56321490d490 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.747+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x563214911ae0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x563214911ae0 2024-04-24T01:24:21.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x7f6f5c076040 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x5632149164b0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.748+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x56321490d490 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x563214911ae0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x56321490d490 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.749+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x7f6f5c076040 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563214910d80 con 0x5632149164b0 2024-04-24T01:24:21.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x563214911ae0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.750+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x56321490d490 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x56321490d490 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x563214911ae0 2024-04-24T01:24:21.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.751+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x7f6f5c076040 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x56321490d490 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x563214911ae0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.752+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x563214911ae0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x7f6f5c076040 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x5632149164b0 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.753+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x563214911ae0 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x56321490d490 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6f5c090040 con 0x7f6f5c076040 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632149148c0 con 0x56321490d490 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.754+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632149148c0 con 0x56321490d490 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632149148c0 con 0x7f6f5c076040 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 zone default found 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 4 Realm: () 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 zonegroup default 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214915160 con 0x563214911ae0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.755+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56321491aea0 con 0x5632149164b0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56321491b240 con 0x5632149164b0 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 20 started sync module instance, tier type = 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.756+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491a340 con 0x7f6f5c076040 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.757+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.757+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773093443424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491a340 con 0x7f6f5c076040 2024-04-24T01:24:21.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.757+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491ba90 con 0x56321490d490 2024-04-24T01:24:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.758+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773093443424] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.758+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.758+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773093447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491a340 con 0x56321490d490 2024-04-24T01:24:21.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.758+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491c4e0 con 0x5632149164b0 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.759+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.759+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773093449712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491cdb0 con 0x5632149164b0 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.759+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491d8a0 con 0x7f6f5c076040 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.760+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773093447616] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.760+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.760+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773093454704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491dc90 con 0x7f6f5c076040 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.760+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491e690 con 0x56321490d490 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.761+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773093449712] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.761+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773093452032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491e650 con 0x56321490d490 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491f0a0 con 0x563214911ae0 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773093454704] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773093460976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491f490 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773093452032] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.762+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491fe50 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.763+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.763+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773093464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214920270 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.763+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214920c30 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773093460976] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773093441168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214920c30 con 0x563214911ae0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=0 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=1 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=2 2024-04-24T01:24:21.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=3 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=4 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=5 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773093464480] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.764+0000 7f6f679a2800 20 add_watcher() i=6 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.767+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773093441168] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.767+0000 7f6f679a2800 20 add_watcher() i=7 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.767+0000 7f6f679a2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.767+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56321491fdc0 con 0x56321490d490 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.768+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.768+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773093468032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491fdc0 con 0x56321490d490 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773093468032] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6e1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 5 note: GC not initialized 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6e1a7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 20 Filter name: none 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6d8bfff640 20 reqs_thread_entry: start 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.769+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214956f00 con 0x56321490d490 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f679a2800 20 rados_obj.operate() r=0 bl.length=556 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f679a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f679a2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f679a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.770+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321495d610 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f679a2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f679a2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f679a2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94773093716096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214958d20 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94773093452032 notify 137438953482 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6f60010040 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6e48ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94773093452032 notifier 4416 bl.length()=567 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6e48ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6e48ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(64 notify.4 [notify cookie 94773093716096 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6e48ff9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6e28003ea0 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.771+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.772+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94773093716096 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f6002a490 con 0x56321490d490 2024-04-24T01:24:21.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.772+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321495d080 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f679a2800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94773093716096 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563214958870 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== watch-notify(notify (1) cookie 94773093443424 notify 137438953477 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f6f6002a490 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6e48ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94773093443424 notifier 4416 bl.length()=159 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(67 notify.0 [notify cookie 94773093716096 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6e48ff9640 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f6e28003ea0 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== watch-notify(notify_complete (2) cookie 94773093716096 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6f6002a800 con 0x7f6f5c076040 2024-04-24T01:24:21.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.773+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.787 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.774+0000 7f6e1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.774+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773093468032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214958d20 con 0x56321490d490 2024-04-24T01:24:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.775+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94773093468032] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.775+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773093443424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214958d20 con 0x7f6f5c076040 2024-04-24T01:24:21.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.776+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94773093443424] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.776+0000 7f6f679a2800 20 remove_watcher() i=0 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.776+0000 7f6f679a2800 2 removed watcher, disabling cache 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.776+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773093447616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563214958d20 con 0x56321490d490 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.777+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94773093447616] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.777+0000 7f6f679a2800 20 remove_watcher() i=1 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.777+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773093449712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491a760 con 0x5632149164b0 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.778+0000 7f6f64ca7640 1 -- 172.21.15.169:0/122776400 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94773093449712] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5c081070 con 0x5632149164b0 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.778+0000 7f6f679a2800 20 remove_watcher() i=2 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.778+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773093454704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491bff0 con 0x7f6f5c076040 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.779+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94773093454704] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x7f6f5c076040 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.779+0000 7f6f679a2800 20 remove_watcher() i=3 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.779+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773093452032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491d370 con 0x56321490d490 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.780+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94773093452032] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f60026040 con 0x56321490d490 2024-04-24T01:24:21.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.780+0000 7f6f679a2800 20 remove_watcher() i=4 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.780+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773093460976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491bff0 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.781+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94773093460976] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.781+0000 7f6f679a2800 20 remove_watcher() i=5 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.781+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773093464480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491c900 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.782+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94773093464480] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.782+0000 7f6f679a2800 20 remove_watcher() i=6 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.782+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773093441168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56321491ebf0 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f654a8640 1 -- 172.21.15.169:0/122776400 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94773093441168] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6f5805e040 con 0x563214911ae0 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 20 remove_watcher() i=7 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563214911ae0 msgr2=0x563214913ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563214911ae0 0x563214913ed0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56321490d490 msgr2=0x56321490f950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56321490d490 0x56321490f950 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6f5c076040 msgr2=0x7f6f5c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6f5c076040 0x7f6f5c083410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632149164b0 msgr2=0x563214918970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632149164b0 0x563214918970 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e300368a0 msgr2=0x7f6e30038d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e300368a0 0x7f6e30038d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c052fd0 tx=0x7f6f5c04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 msgr2=0x563214901ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 --2- 172.21.15.169:0/122776400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148faa90 0x563214901ef0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6f580075f0 tx=0x7f6f5800aec0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 reap_dead start 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f65ca9640 1 -- 172.21.15.169:0/122776400 reap_dead start 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 shutdown_connections 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 >> 172.21.15.169:0/122776400 conn(0x5632148f6d60 msgr2=0x5632148f43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 shutdown_connections 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.783+0000 7f6f679a2800 1 -- 172.21.15.169:0/122776400 wait complete. 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 msgr2=0x7f6e3c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 0x7f6e3c038dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x5632148d6b00 tx=0x7f6f5c005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 msgr2=0x5632148edcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6f58006690 tx=0x7f6f580108f0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 shutdown_connections 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e3c036900 0x7f6e3c038dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/3056098112 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632148ed8d0 0x5632148edcf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 >> 172.21.15.169:0/3056098112 conn(0x5632148e1970 msgr2=0x5632148e1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 shutdown_connections 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/3056098112 wait complete. 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632148d8960 msgr2=0x5632148dad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632148d8960 0x5632148dad50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632147d83e0 msgr2=0x5632148d60a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632147d83e0 0x5632148d60a0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632148dc8f0 msgr2=0x5632148ded20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632148dc8f0 0x5632148ded20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e4c036950 msgr2=0x7f6e4c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6e4c036950 0x7f6e4c038e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c054000 tx=0x7f6f5c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 msgr2=0x5632148cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 --2- 172.21.15.169:0/841200404 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632147d48d0 0x5632148cee60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6f58000f80 tx=0x7f6f58001250 comp rx=0 tx=0).stop 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f65ca9640 1 -- 172.21.15.169:0/841200404 reap_dead start 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 shutdown_connections 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 >> 172.21.15.169:0/841200404 conn(0x5632147ce3a0 msgr2=0x5632147d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 shutdown_connections 2024-04-24T01:24:21.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.784+0000 7f6f679a2800 1 -- 172.21.15.169:0/841200404 wait complete. 2024-04-24T01:24:21.798 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:21.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:24:21.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:24:21.799 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T01:24:21.842 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:21.842 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:21.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.841+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.841+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.841+0000 7f914d32a800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c42b6467a0 0x55c42b646bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.841+0000 7f914d32a800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c42b506d40 con 0x55c42b647100 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.841+0000 7f914d32a800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c42b4d94d0 con 0x55c42b6467a0 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9149064640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c42b6467a0 0x55c42b646bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9149064640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c42b6467a0 0x55c42b646bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34074/0 (socket says 172.21.15.169:34074) 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9149064640 1 -- 172.21.15.169:0/3450251535 learned_addr learned my addr 172.21.15.169:0/3450251535 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9148863640 1 --1- 172.21.15.169:0/3450251535 >> v1:172.21.15.142:6789/0 conn(0x55c42b647100 0x55c42b6475b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34742/0 (socket says 172.21.15.169:34742) 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9149064640 1 -- 172.21.15.169:0/3450251535 >> v1:172.21.15.142:6789/0 conn(0x55c42b647100 legacy=0x55c42b6475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.842+0000 7f9149064640 1 -- 172.21.15.169:0/3450251535 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b505590 con 0x55c42b6467a0 2024-04-24T01:24:21.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f9149064640 1 --2- 172.21.15.169:0/3450251535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b646bc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f914400a520 tx=0x7f914401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ac89a76254511b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f9143fff640 1 -- 172.21.15.169:0/3450251535 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144057070 con 0x55c42b6467a0 2024-04-24T01:24:21.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f9143fff640 1 -- 172.21.15.169:0/3450251535 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144052570 con 0x55c42b6467a0 2024-04-24T01:24:21.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f9143fff640 1 -- 172.21.15.169:0/3450251535 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144052870 con 0x55c42b6467a0 2024-04-24T01:24:21.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f914d32a800 1 -- 172.21.15.169:0/3450251535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 msgr2=0x55c42b646bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.844+0000 7f914d32a800 1 --2- 172.21.15.169:0/3450251535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b646bc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f914400a520 tx=0x7f914401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:21.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.845+0000 7f914d32a800 1 -- 172.21.15.169:0/3450251535 shutdown_connections 2024-04-24T01:24:21.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.845+0000 7f914d32a800 1 --2- 172.21.15.169:0/3450251535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b646bc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.845+0000 7f914d32a800 1 -- 172.21.15.169:0/3450251535 >> 172.21.15.169:0/3450251535 conn(0x55c42b642320 msgr2=0x55c42b644740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.845+0000 7f914d32a800 1 -- 172.21.15.169:0/3450251535 shutdown_connections 2024-04-24T01:24:21.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.845+0000 7f914d32a800 1 -- 172.21.15.169:0/3450251535 wait complete. 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.856+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.856+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.856+0000 7f914d32a800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.856+0000 7f914d32a800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c42b5933c0 con 0x55c42b6467a0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34088/0 (socket says 172.21.15.169:34088) 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9149064640 1 -- 172.21.15.169:0/2532116131 learned_addr learned my addr 172.21.15.169:0/2532116131 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9149064640 1 -- 172.21.15.169:0/2532116131 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b73b9d0 con 0x55c42b6467a0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9149064640 1 --2- 172.21.15.169:0/2532116131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9144055040 tx=0x7f914404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c851e2ab4eac6465 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9037606640 1 -- 172.21.15.169:0/2532116131 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144057040 con 0x55c42b6467a0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9037606640 1 -- 172.21.15.169:0/2532116131 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144052870 con 0x55c42b6467a0 2024-04-24T01:24:21.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.857+0000 7f9037606640 1 -- 172.21.15.169:0/2532116131 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144052b90 con 0x55c42b6467a0 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 -- 172.21.15.169:0/2532116131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 msgr2=0x55c42b73b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 --2- 172.21.15.169:0/2532116131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9144055040 tx=0x7f914404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 -- 172.21.15.169:0/2532116131 shutdown_connections 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 --2- 172.21.15.169:0/2532116131 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b73b400 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 -- 172.21.15.169:0/2532116131 >> 172.21.15.169:0/2532116131 conn(0x55c42b642320 msgr2=0x55c42b736d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 -- 172.21.15.169:0/2532116131 shutdown_connections 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 -- 172.21.15.169:0/2532116131 wait complete. 2024-04-24T01:24:21.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.858+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f914d32a800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b742f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f914d32a800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c42b647f60 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b742f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b742f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34102/0 (socket says 172.21.15.169:34102) 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9149064640 1 -- 172.21.15.169:0/3576453907 learned_addr learned my addr 172.21.15.169:0/3576453907 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9149064640 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b743480 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9149064640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b742f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9144052540 tx=0x7f9144003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.859+0000 7f9035e03640 1 -- 172.21.15.169:0/3576453907 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144073070 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f9035e03640 1 -- 172.21.15.169:0/3576453907 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914405d570 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42b743710 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f9035e03640 1 -- 172.21.15.169:0/3576453907 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144057070 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42b746320 con 0x55c42b6467a0 2024-04-24T01:24:21.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f9035e03640 1 -- 172.21.15.169:0/3576453907 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9144076070 con 0x55c42b6467a0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f9035e03640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9030036950 0x7f9030038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.860+0000 7f9035e03640 1 -- 172.21.15.169:0/3576453907 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f914408dd80 con 0x55c42b6467a0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f9148863640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9030036950 0x7f9030038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b647100 0x55c42b74a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b74a620 con 0x55c42b647100 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f9149865640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b647100 0x55c42b74a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f9148863640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9030036950 0x7f9030038e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9134000f60 tx=0x7f9134001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f9149865640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b647100 0x55c42b74a0e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f9149865640 1 -- 172.21.15.169:0/3576453907 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b647100 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.861+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7476b0 con 0x55c42b647100 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f9149865640 1 -- 172.21.15.169:0/3576453907 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b647100 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b74c910 0x55c42b74ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b74f3a0 con 0x55c42b74c910 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f9149064640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b74c910 0x55c42b74ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f9149064640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b74c910 0x55c42b74ed00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f9149064640 1 -- 172.21.15.169:0/3576453907 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9144075030 con 0x55c42b74c910 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.862+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b74b8c0 con 0x55c42b647100 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f9149865640 1 -- 172.21.15.169:0/3576453907 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b647100 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c42b750850 0x55c42b752ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b753400 con 0x55c42b750850 2024-04-24T01:24:21.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f9148863640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c42b750850 0x55c42b752ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f9148863640 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c42b750850 0x55c42b752ca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.863+0000 7f9148863640 1 -- 172.21.15.169:0/3576453907 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f913400f690 con 0x55c42b750850 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f914d32a800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f914d32a800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c42b5396b0 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34116/0 (socket says 172.21.15.169:34116) 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f9149064640 1 -- 172.21.15.169:0/3108706853 learned_addr learned my addr 172.21.15.169:0/3108706853 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f9149064640 1 -- 172.21.15.169:0/3108706853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b7621c0 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.864+0000 7f9149064640 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9144006b30 tx=0x7f9144079b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 -- 172.21.15.169:0/3108706853 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144007e30 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 -- 172.21.15.169:0/3108706853 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144007fd0 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 -- 172.21.15.169:0/3108706853 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440773b0 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42b762c30 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42b763130 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 -- 172.21.15.169:0/3108706853 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9144077550 con 0x55c42b761860 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 0x7f9020038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.865+0000 7f902effd640 1 -- 172.21.15.169:0/3108706853 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f914408f0c0 con 0x55c42b761860 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9148863640 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 0x7f9020038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9148863640 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 0x7f9020038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55c42b7475d0 tx=0x7f913400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f914d32a800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f914d32a800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c42b73bc90 con 0x55c42b76ea30 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34118/0 (socket says 172.21.15.169:34118) 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9149064640 1 -- 172.21.15.169:0/2000496920 learned_addr learned my addr 172.21.15.169:0/2000496920 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.866+0000 7f9149064640 1 -- 172.21.15.169:0/2000496920 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b76f420 con 0x55c42b76ea30 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f9149064640 1 --2- 172.21.15.169:0/2000496920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9144052fd0 tx=0x7f91440787c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec984b4c52bcc36 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f902cff9640 1 -- 172.21.15.169:0/2000496920 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914404c0e0 con 0x55c42b76ea30 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f902cff9640 1 -- 172.21.15.169:0/2000496920 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91440791e0 con 0x55c42b76ea30 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f902cff9640 1 -- 172.21.15.169:0/2000496920 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f914405c750 con 0x55c42b76ea30 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- 172.21.15.169:0/2000496920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 msgr2=0x55c42b76ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 --2- 172.21.15.169:0/2000496920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9144052fd0 tx=0x7f91440787c0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- 172.21.15.169:0/2000496920 shutdown_connections 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 --2- 172.21.15.169:0/2000496920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b76ee50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- 172.21.15.169:0/2000496920 >> 172.21.15.169:0/2000496920 conn(0x55c42b76ad00 msgr2=0x55c42b768d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- 172.21.15.169:0/2000496920 shutdown_connections 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- 172.21.15.169:0/2000496920 wait complete. 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 Processor -- start 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.867+0000 7f914d32a800 1 -- start start 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f914d32a800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b775db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f914d32a800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c42b76fa80 con 0x55c42b76ea30 2024-04-24T01:24:21.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b775db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f9149064640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b775db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34132/0 (socket says 172.21.15.169:34132) 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 learned_addr learned my addr 172.21.15.169:0/2642947624 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c42b7762f0 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f9149064640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b775db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9144044880 tx=0x7f914405afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f901effd640 1 -- 172.21.15.169:0/2642947624 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91440ba070 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f901effd640 1 -- 172.21.15.169:0/2642947624 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914405c750 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c42b7762f0 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f901effd640 1 -- 172.21.15.169:0/2642947624 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9144089480 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.868+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c42b7762f0 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f901effd640 1 -- 172.21.15.169:0/2642947624 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f91440bd070 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f901effd640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9014036950 0x7f9014038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f901effd640 1 -- 172.21.15.169:0/2642947624 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f91440b1030 con 0x55c42b76ea30 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f9148863640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9014036950 0x7f9014038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b781550 0x55c42b783a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.869+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b784160 con 0x55c42b781550 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f9149865640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b781550 0x55c42b783a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f9148863640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9014036950 0x7f9014038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55c42b753800 tx=0x7f9134010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f9149865640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b781550 0x55c42b783a10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 20 realm 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b784570 con 0x55c42b781550 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:21.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.870+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b784e10 con 0x55c42b781550 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b785f10 0x55c42b788300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b788840 con 0x55c42b785f10 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f9149064640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b785f10 0x55c42b788300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.871+0000 7f9149064640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b785f10 0x55c42b788300 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f914d32a800 20 searching for the correct realm 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c42b78a8c0 0x55c42b78cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78d450 con 0x55c42b78a8c0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9148863640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c42b78a8c0 0x55c42b78cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9148863640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c42b78a8c0 0x55c42b78cd80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9148863640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f913400f070 0x7f913402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78d450 con 0x7f913400f070 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.872+0000 7f9149865640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f913400f070 0x7f913402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149865640 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f913400f070 0x7f913402e910 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.873+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x7f913400f070 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.874+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.875+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x7f913400f070 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.876+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.877+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x7f913400f070 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.878+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.879+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x7f913400f070 2024-04-24T01:24:21.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b785f10 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x55c42b781550 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.880+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7851b0 con 0x7f913400f070 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:21.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7891c0 con 0x55c42b781550 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7891c0 con 0x55c42b781550 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7891c0 con 0x7f913400f070 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 zone default found 2024-04-24T01:24:21.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 4 Realm: () 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 zonegroup default 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.881+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7895b0 con 0x55c42b785f10 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78f2b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78f650 con 0x55c42b78a8c0 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 started sync module instance, tier type = 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:21.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.882+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78e750 con 0x7f913400f070 2024-04-24T01:24:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.883+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.883+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94301031295808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78e750 con 0x7f913400f070 2024-04-24T01:24:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.883+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78fea0 con 0x55c42b781550 2024-04-24T01:24:21.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.884+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94301031295808] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.885+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.885+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94301031293872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78fea0 con 0x55c42b781550 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.885+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b790860 con 0x55c42b78a8c0 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.885+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.886+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94301031302064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7910b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.886+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b791b10 con 0x7f913400f070 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.886+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94301031293872] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.886+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94301031302064] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.887+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.887+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94301031304192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7915f0 con 0x7f913400f070 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.887+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7923b0 con 0x55c42b781550 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.888+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.888+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94301031304192] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.888+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94301031308928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7927e0 con 0x55c42b781550 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.888+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78fa10 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.889+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94301031308928] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.889+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.889+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94301031309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793280 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.889+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793b10 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.890+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94301031309984] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.890+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.890+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94301031314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b792eb0 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.890+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7948f0 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94301031314976] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94301031318464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7948b0 con 0x55c42b785f10 2024-04-24T01:24:21.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=0 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=1 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=2 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=3 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=4 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=5 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.891+0000 7f914d32a800 20 add_watcher() i=6 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94301031318464] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f914d32a800 20 add_watcher() i=7 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f914d32a800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b797d40 con 0x55c42b781550 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.892+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94301031316720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b795200 con 0x55c42b781550 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94301031316720] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f8fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f914d32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f914d32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f914d32a800 5 note: GC not initialized 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.893+0000 7f8ffe7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 Filter name: none 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f8f6ffff640 20 reqs_thread_entry: start 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7cabe0 con 0x55c42b781550 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 rados->read ofs=0 len=0 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7cb5d0 con 0x55c42b781550 2024-04-24T01:24:21.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.894+0000 7f914d32a800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.895+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7cc5e0 con 0x7f913400f070 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.895+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.895+0000 7f8fff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.896+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94301031316720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7976c0 con 0x55c42b781550 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.896+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94301031316720] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.896+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94301031295808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793cf0 con 0x7f913400f070 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.897+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94301031295808] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.897+0000 7f914d32a800 20 remove_watcher() i=0 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.897+0000 7f914d32a800 2 removed watcher, disabling cache 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.897+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94301031293872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793cf0 con 0x55c42b781550 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.898+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94301031293872] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.899+0000 7f914d32a800 20 remove_watcher() i=1 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.899+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94301031302064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b78e3b0 con 0x55c42b78a8c0 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.899+0000 7f9148863640 1 -- 172.21.15.169:0/2642947624 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94301031302064] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9134037040 con 0x55c42b78a8c0 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.899+0000 7f914d32a800 20 remove_watcher() i=2 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.899+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94301031304192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793cf0 con 0x7f913400f070 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.900+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94301031304192] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x7f913400f070 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.900+0000 7f914d32a800 20 remove_watcher() i=3 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.900+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94301031308928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b7903b0 con 0x55c42b781550 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.902+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94301031308928] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f913c00a4a0 con 0x55c42b781550 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.902+0000 7f914d32a800 20 remove_watcher() i=4 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.902+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94301031309984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b790c00 con 0x55c42b785f10 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.902+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94301031309984] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.902+0000 7f914d32a800 20 remove_watcher() i=5 2024-04-24T01:24:21.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.903+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94301031314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b792310 con 0x55c42b785f10 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.903+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94301031314976] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.903+0000 7f914d32a800 20 remove_watcher() i=6 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.903+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94301031318464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55c42b793cf0 con 0x55c42b785f10 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.904+0000 7f9149064640 1 -- 172.21.15.169:0/2642947624 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94301031318464] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f91440bc030 con 0x55c42b785f10 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 20 remove_watcher() i=7 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b785f10 msgr2=0x55c42b788300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b785f10 0x55c42b788300 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b781550 msgr2=0x55c42b783a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b781550 0x55c42b783a10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f913400f070 msgr2=0x7f913402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f913400f070 0x7f913402e910 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c42b78a8c0 msgr2=0x55c42b78cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c42b78a8c0 0x55c42b78cd80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9014036950 msgr2=0x7f9014038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9014036950 0x7f9014038e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x55c42b753800 tx=0x7f9134010000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 msgr2=0x55c42b775db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/2642947624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b76ea30 0x55c42b775db0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9144044880 tx=0x7f914405afb0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f9149865640 1 -- 172.21.15.169:0/2642947624 reap_dead start 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 shutdown_connections 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 >> 172.21.15.169:0/2642947624 conn(0x55c42b76ad00 msgr2=0x55c42b768360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 shutdown_connections 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/2642947624 wait complete. 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 msgr2=0x7f9020038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 0x7f9020038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55c42b7475d0 tx=0x7f913400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 msgr2=0x55c42b761c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9144006b30 tx=0x7f9144079b40 comp rx=0 tx=0).stop 2024-04-24T01:24:21.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 shutdown_connections 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9020036950 0x7f9020038e10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 --2- 172.21.15.169:0/3108706853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b761860 0x55c42b761c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 >> 172.21.15.169:0/3108706853 conn(0x55c42b755900 msgr2=0x55c42b755d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 shutdown_connections 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.905+0000 7f914d32a800 1 -- 172.21.15.169:0/3108706853 wait complete. 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b74c910 msgr2=0x55c42b74ed00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c42b74c910 0x55c42b74ed00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b647100 msgr2=0x55c42b74a0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c42b647100 0x55c42b74a0e0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c42b750850 msgr2=0x55c42b752ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c42b750850 0x55c42b752ca0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9030036950 msgr2=0x7f9030038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9030036950 0x7f9030038e10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9134000f60 tx=0x7f9134001370 comp rx=0 tx=0).stop 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 msgr2=0x55c42b742f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 --2- 172.21.15.169:0/3576453907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c42b6467a0 0x55c42b742f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9144052540 tx=0x7f9144003020 comp rx=0 tx=0).stop 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f9149865640 1 -- 172.21.15.169:0/3576453907 reap_dead start 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 shutdown_connections 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 >> 172.21.15.169:0/3576453907 conn(0x55c42b642320 msgr2=0x55c42b735520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 shutdown_connections 2024-04-24T01:24:21.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:21.906+0000 7f914d32a800 1 -- 172.21.15.169:0/3576453907 wait complete. 2024-04-24T01:24:21.920 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-04-24T01:24:21.920 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:24:21.920 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T01:24:21.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T01:24:21.921 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T01:24:22.003 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:22.003 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:22.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.002+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.002+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.002+0000 7f2aea925800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56520cb438b0 0x56520cb45ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.002+0000 7f2aea925800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56520ca01d40 con 0x56520cb461e0 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.002+0000 7f2aea925800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x56520c9d44d0 con 0x56520cb438b0 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae66e4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56520cb438b0 0x56520cb45ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae66e4640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56520cb438b0 0x56520cb45ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34134/0 (socket says 172.21.15.169:34134) 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae5ee3640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x56520cb461e0 0x56520cb485d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34750/0 (socket says 172.21.15.169:34750) 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae66e4640 1 -- 172.21.15.169:0/3740583292 learned_addr learned my addr 172.21.15.169:0/3740583292 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae66e4640 1 -- 172.21.15.169:0/3740583292 >> v1:172.21.15.142:6789/0 conn(0x56520cb461e0 legacy=0x56520cb485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.003+0000 7f2ae66e4640 1 -- 172.21.15.169:0/3740583292 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520ca00590 con 0x56520cb438b0 2024-04-24T01:24:22.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.005+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/3740583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb45ca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800a520 tx=0x7f2ad801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288e52d20d86139a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.005+0000 7f2ae56e2640 1 -- 172.21.15.169:0/3740583292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8057070 con 0x56520cb438b0 2024-04-24T01:24:22.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.005+0000 7f2ae56e2640 1 -- 172.21.15.169:0/3740583292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad8052570 con 0x56520cb438b0 2024-04-24T01:24:22.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.005+0000 7f2ae56e2640 1 -- 172.21.15.169:0/3740583292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad804ae60 con 0x56520cb438b0 2024-04-24T01:24:22.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 -- 172.21.15.169:0/3740583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 msgr2=0x56520cb45ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 --2- 172.21.15.169:0/3740583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb45ca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ad800a520 tx=0x7f2ad801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:22.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 -- 172.21.15.169:0/3740583292 shutdown_connections 2024-04-24T01:24:22.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 --2- 172.21.15.169:0/3740583292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb45ca0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 -- 172.21.15.169:0/3740583292 >> 172.21.15.169:0/3740583292 conn(0x56520cb3d380 msgr2=0x56520cb3f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 -- 172.21.15.169:0/3740583292 shutdown_connections 2024-04-24T01:24:22.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.006+0000 7f2aea925800 1 -- 172.21.15.169:0/3740583292 wait complete. 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.017+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2aea925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2aea925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56520ca8e3c0 con 0x56520cb438b0 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34136/0 (socket says 172.21.15.169:34136) 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2ae66e4640 1 -- 172.21.15.169:0/2705358677 learned_addr learned my addr 172.21.15.169:0/2705358677 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2ae66e4640 1 -- 172.21.15.169:0/2705358677 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520cb417b0 con 0x56520cb438b0 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/2705358677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8055040 tx=0x7f2ad804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8bb0f0b9edf1ae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.018+0000 7f29d4608640 1 -- 172.21.15.169:0/2705358677 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8057040 con 0x56520cb438b0 2024-04-24T01:24:22.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f29d4608640 1 -- 172.21.15.169:0/2705358677 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad8052720 con 0x56520cb438b0 2024-04-24T01:24:22.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f29d4608640 1 -- 172.21.15.169:0/2705358677 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8052a40 con 0x56520cb438b0 2024-04-24T01:24:22.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 -- 172.21.15.169:0/2705358677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 msgr2=0x56520cb431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 --2- 172.21.15.169:0/2705358677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8055040 tx=0x7f2ad804c000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 -- 172.21.15.169:0/2705358677 shutdown_connections 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 --2- 172.21.15.169:0/2705358677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cb431f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 -- 172.21.15.169:0/2705358677 >> 172.21.15.169:0/2705358677 conn(0x56520cb3d380 msgr2=0x56520cc2f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 -- 172.21.15.169:0/2705358677 shutdown_connections 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.019+0000 7f2aea925800 1 -- 172.21.15.169:0/2705358677 wait complete. 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2aea925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cc3de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2aea925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56520cb49f90 con 0x56520cb438b0 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cc3de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cc3de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34140/0 (socket says 172.21.15.169:34140) 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1022320950 learned_addr learned my addr 172.21.15.169:0/1022320950 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520cc3e340 con 0x56520cb438b0 2024-04-24T01:24:22.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cc3de00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8052540 tx=0x7f2ad8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f29d2e05640 1 -- 172.21.15.169:0/1022320950 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8073070 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f29d2e05640 1 -- 172.21.15.169:0/1022320950 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad805d440 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56520cc3e5d0 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.020+0000 7f29d2e05640 1 -- 172.21.15.169:0/1022320950 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8057070 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.021+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520cc41280 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.021+0000 7f29d2e05640 1 -- 172.21.15.169:0/1022320950 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ad8076070 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.021+0000 7f29d2e05640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29cc036900 0x7f29cc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.021+0000 7f29d2e05640 1 -- 172.21.15.169:0/1022320950 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ad808dbe0 con 0x56520cb438b0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.021+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29cc036900 0x7f29cc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cb461e0 0x56520cc45040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc45580 con 0x56520cb461e0 2024-04-24T01:24:22.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cb461e0 0x56520cc45040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29cc036900 0x7f29cc038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000f60 tx=0x7f2ad0001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cb461e0 0x56520cc45040 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1022320950 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cb461e0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.022+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc42610 con 0x56520cb461e0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1022320950 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cb461e0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc47920 0x56520cc49d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc4a3b0 con 0x56520cc47920 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc47920 0x56520cc49d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc47920 0x56520cc49d10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.023+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1022320950 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc47920 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc468d0 con 0x56520cb461e0 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1022320950 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cb461e0 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56520cc4b860 0x56520cc4dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc4e410 con 0x56520cc4b860 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56520cc4b860 0x56520cc4dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.024+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56520cc4b860 0x56520cc4dcb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1022320950 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ad000f690 con 0x56520cc4b860 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2aea925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2aea925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56520ca346b0 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34144/0 (socket says 172.21.15.169:34144) 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.025+0000 7f2ae66e4640 1 -- 172.21.15.169:0/500380753 learned_addr learned my addr 172.21.15.169:0/500380753 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f2ae66e4640 1 -- 172.21.15.169:0/500380753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520cc5d160 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8076450 tx=0x7f2ad8077ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f29cbfff640 1 -- 172.21.15.169:0/500380753 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad8083040 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f29cbfff640 1 -- 172.21.15.169:0/500380753 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad8091070 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56520cc5dbd0 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f29cbfff640 1 -- 172.21.15.169:0/500380753 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad805cde0 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.026+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520cc5e0d0 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f29cbfff640 1 -- 172.21.15.169:0/500380753 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ad8093020 con 0x56520cc5c800 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f29cbfff640 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 0x7f29c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f29cbfff640 1 -- 172.21.15.169:0/500380753 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ad8060110 con 0x56520cc5c800 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 0x7f29c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 0x7f29c0038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56520cc42530 tx=0x7f2ad000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2aea925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.027+0000 7f2aea925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56520cb41a70 con 0x56520cc699c0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34154/0 (socket says 172.21.15.169:34154) 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2ae66e4640 1 -- 172.21.15.169:0/3792874506 learned_addr learned my addr 172.21.15.169:0/3792874506 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2ae66e4640 1 -- 172.21.15.169:0/3792874506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520cc6a3b0 con 0x56520cc699c0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/3792874506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2ad806e710 tx=0x7f2ad8080c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7effd0b99f4ae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f29c9ffb640 1 -- 172.21.15.169:0/3792874506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad80af070 con 0x56520cc699c0 2024-04-24T01:24:22.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f29c9ffb640 1 -- 172.21.15.169:0/3792874506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad805d720 con 0x56520cc699c0 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f29c9ffb640 1 -- 172.21.15.169:0/3792874506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad805c3e0 con 0x56520cc699c0 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2aea925800 1 -- 172.21.15.169:0/3792874506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 msgr2=0x56520cc69de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.028+0000 7f2aea925800 1 --2- 172.21.15.169:0/3792874506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2ad806e710 tx=0x7f2ad8080c80 comp rx=0 tx=0).stop 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- 172.21.15.169:0/3792874506 shutdown_connections 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 --2- 172.21.15.169:0/3792874506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc69de0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- 172.21.15.169:0/3792874506 >> 172.21.15.169:0/3792874506 conn(0x56520cc65cd0 msgr2=0x56520cc63d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- 172.21.15.169:0/3792874506 shutdown_connections 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- 172.21.15.169:0/3792874506 wait complete. 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 Processor -- start 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- start start 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2aea925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56520cc6aa40 con 0x56520cc699c0 2024-04-24T01:24:22.044 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2ae66e4640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34166/0 (socket says 172.21.15.169:34166) 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 learned_addr learned my addr 172.21.15.169:0/1755305161 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.029+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520cc712e0 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ad808fd90 tx=0x7f2ad804fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f29b7fff640 1 -- 172.21.15.169:0/1755305161 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad80b9020 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f29b7fff640 1 -- 172.21.15.169:0/1755305161 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad80b0040 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56520cc712e0 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f29b7fff640 1 -- 172.21.15.169:0/1755305161 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ad80af070 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56520cc71780 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.030+0000 7f29b7fff640 1 -- 172.21.15.169:0/1755305161 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2ad80bc020 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f29b7fff640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29b0036900 0x7f29b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f29b7fff640 1 -- 172.21.15.169:0/1755305161 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f2ad80bfc60 con 0x56520cc699c0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29b0036900 0x7f29b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cc7c3a0 0x56520cc7e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc7efb0 con 0x56520cc7c3a0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cc7c3a0 0x56520cc7e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29b0036900 0x7f29b0038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56520cc4e810 tx=0x7f2ad0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.031+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cc7c3a0 0x56520cc7e860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 realm 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc7f3c0 con 0x56520cc7c3a0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc7fc90 con 0x56520cc7c3a0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc80b20 0x56520cc82f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.032+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc83670 con 0x56520cc80b20 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc80b20 0x56520cc82f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2ae66e4640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc80b20 0x56520cc82f10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2aea925800 20 searching for the correct realm 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56520cc85720 0x56520cc87be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc882b0 con 0x56520cc85720 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.033+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56520cc85720 0x56520cc87be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56520cc85720 0x56520cc87be0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae5ee3640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2ad000f070 0x7f2ad002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc882b0 con 0x7f2ad000f070 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2ad000f070 0x7f2ad002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.034+0000 7f2ae6ee5640 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2ad000f070 0x7f2ad002e910 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.035+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x7f2ad000f070 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.036+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x7f2ad000f070 2024-04-24T01:24:22.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.037+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.038+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.038+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.038+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.038+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.038+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.039+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x7f2ad000f070 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.040+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.041+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x7f2ad000f070 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc85720 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc80b20 2024-04-24T01:24:22.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.042+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x56520cc7c3a0 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56520cc80030 con 0x7f2ad000f070 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc84020 con 0x56520cc7c3a0 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc84020 con 0x56520cc7c3a0 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.043+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc83ff0 con 0x7f2ad000f070 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 zone default found 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 4 Realm: () 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:22.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 zonegroup default 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc84410 con 0x56520cc80b20 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8a110 con 0x56520cc85720 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc84010 con 0x56520cc85720 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.044+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.045+0000 7f2aea925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.045+0000 7f2aea925800 20 started sync module instance, tier type = 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.045+0000 7f2aea925800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.045+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc895b0 con 0x7f2ad000f070 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.046+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.046+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910401780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc895b0 con 0x7f2ad000f070 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.046+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8ab50 con 0x56520cc7c3a0 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.047+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910401780432] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.047+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.047+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910401783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc895b0 con 0x56520cc7c3a0 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.047+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8b5a0 con 0x56520cc85720 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.048+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.048+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910401786032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8be70 con 0x56520cc85720 2024-04-24T01:24:22.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.048+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8c930 con 0x7f2ad000f070 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.048+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910401783328] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.049+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910401786032] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.049+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.049+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910401788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc89100 con 0x7f2ad000f070 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.049+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8d1d0 con 0x56520cc7c3a0 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.050+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910401788352] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.051+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.051+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910401790976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8d130 con 0x56520cc7c3a0 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.051+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8dbe0 con 0x56520cc80b20 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.052+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910401790976] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.052+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.052+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910401793152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8d0a0 con 0x56520cc80b20 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.052+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8ea50 con 0x56520cc80b20 2024-04-24T01:24:22.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.053+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910401793152] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.053+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.053+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910401799584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8ee70 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.053+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f830 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910401799584] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910401801120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f830 con 0x56520cc80b20 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=0 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=1 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=2 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=3 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=4 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=5 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.054+0000 7f2aea925800 20 add_watcher() i=6 2024-04-24T01:24:22.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910401801120] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2aea925800 20 add_watcher() i=7 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2aea925800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520cc92b60 con 0x56520cc7c3a0 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.055+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910401803504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8fdc0 con 0x56520cc7c3a0 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.056+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910401803504] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.056+0000 7f299d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.056+0000 7f2aea925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.056+0000 7f2aea925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.056+0000 7f2aea925800 5 note: GC not initialized 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2997fff640 20 reqs_thread_entry: start 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:22.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 20 Filter name: none 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2995ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520ccc5a40 con 0x56520cc7c3a0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.057+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520ccc6430 con 0x56520cc7c3a0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.058+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.058+0000 7f2aea925800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.058+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56520ccc7440 con 0x7f2ad000f070 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.058+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.059+0000 7f299d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.059+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910401803504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc91f80 con 0x56520cc7c3a0 2024-04-24T01:24:22.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.060+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94910401803504] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.060+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910401780432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f4f0 con 0x7f2ad000f070 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.061+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94910401780432] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.061+0000 7f2aea925800 20 remove_watcher() i=0 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.061+0000 7f2aea925800 2 removed watcher, disabling cache 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.061+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910401783328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f4f0 con 0x56520cc7c3a0 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.062+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94910401783328] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.062+0000 7f2aea925800 20 remove_watcher() i=1 2024-04-24T01:24:22.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.062+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910401786032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8a620 con 0x56520cc85720 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.063+0000 7f2ae5ee3640 1 -- 172.21.15.169:0/1755305161 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94910401786032] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad0037040 con 0x56520cc85720 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.063+0000 7f2aea925800 20 remove_watcher() i=2 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.063+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910401788352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f4f0 con 0x7f2ad000f070 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.064+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94910401788352] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x7f2ad000f070 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.064+0000 7f2aea925800 20 remove_watcher() i=3 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.064+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910401790976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8b9c0 con 0x56520cc7c3a0 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.065+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94910401790976] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae000a4a0 con 0x56520cc7c3a0 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.065+0000 7f2aea925800 20 remove_watcher() i=4 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.065+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910401793152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f4f0 con 0x56520cc80b20 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.066+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94910401793152] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.066+0000 7f2aea925800 20 remove_watcher() i=5 2024-04-24T01:24:22.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.066+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910401799584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8cc80 con 0x56520cc80b20 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.067+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94910401799584] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.067+0000 7f2aea925800 20 remove_watcher() i=6 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.067+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910401801120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56520cc8f4f0 con 0x56520cc80b20 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2ae66e4640 1 -- 172.21.15.169:0/1755305161 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94910401801120] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ad8075030 con 0x56520cc80b20 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 20 remove_watcher() i=7 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc80b20 msgr2=0x56520cc82f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc80b20 0x56520cc82f10 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cc7c3a0 msgr2=0x56520cc7e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cc7c3a0 0x56520cc7e860 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2ad000f070 msgr2=0x7f2ad002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2ad000f070 0x7f2ad002e910 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56520cc85720 msgr2=0x56520cc87be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56520cc85720 0x56520cc87be0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29b0036900 msgr2=0x7f29b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29b0036900 0x7f29b0038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x56520cc4e810 tx=0x7f2ad0010000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 msgr2=0x56520cc70da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1755305161 reap_dead start 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ad808fd90 tx=0x7f2ad804fee0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 shutdown_connections 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 --2- 172.21.15.169:0/1755305161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc699c0 0x56520cc70da0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 >> 172.21.15.169:0/1755305161 conn(0x56520cc65cd0 msgr2=0x56520cc63330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 shutdown_connections 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.068+0000 7f2aea925800 1 -- 172.21.15.169:0/1755305161 wait complete. 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 msgr2=0x7f29c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 0x7f29c0038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56520cc42530 tx=0x7f2ad000f000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 msgr2=0x56520cc5cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8076450 tx=0x7f2ad8077ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 shutdown_connections 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29c0036900 0x7f29c0038dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/500380753 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cc5c800 0x56520cc5cc20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 >> 172.21.15.169:0/500380753 conn(0x56520cc508a0 msgr2=0x56520cc50ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 shutdown_connections 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/500380753 wait complete. 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc47920 msgr2=0x56520cc49d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56520cc47920 0x56520cc49d10 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cb461e0 msgr2=0x56520cc45040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56520cb461e0 0x56520cc45040 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56520cc4b860 msgr2=0x56520cc4dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56520cc4b860 0x56520cc4dcb0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29cc036900 msgr2=0x7f29cc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f29cc036900 0x7f29cc038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0000f60 tx=0x7f2ad0001370 comp rx=0 tx=0).stop 2024-04-24T01:24:22.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 msgr2=0x56520cc3de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 --2- 172.21.15.169:0/1022320950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56520cb438b0 0x56520cc3de00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8052540 tx=0x7f2ad8003020 comp rx=0 tx=0).stop 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2ae6ee5640 1 -- 172.21.15.169:0/1022320950 reap_dead start 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 shutdown_connections 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 >> 172.21.15.169:0/1022320950 conn(0x56520cb3d380 msgr2=0x56520cb41fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 shutdown_connections 2024-04-24T01:24:22.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.069+0000 7f2aea925800 1 -- 172.21.15.169:0/1022320950 wait complete. 2024-04-24T01:24:22.083 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-04-24T01:24:22.083 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:24:22.169 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.169 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-04-24T01:24:22.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-04-24T01:24:22.169 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-04-24T01:24:22.214 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:22.214 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:22.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.213+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.213+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.213+0000 7f4ec732b800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a09d1368b0 0x55a09d138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.213+0000 7f4ec732b800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a09cff4d40 con 0x55a09d1391e0 2024-04-24T01:24:22.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.213+0000 7f4ec732b800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55a09cfc74d0 con 0x55a09d1368b0 2024-04-24T01:24:22.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.214+0000 7f4ec2fab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a09d1368b0 0x55a09d138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.214+0000 7f4ec2fab640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a09d1368b0 0x55a09d138ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34178/0 (socket says 172.21.15.169:34178) 2024-04-24T01:24:22.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.214+0000 7f4ec2fab640 1 -- 172.21.15.169:0/1254621076 learned_addr learned my addr 172.21.15.169:0/1254621076 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.214+0000 7f4ec2fab640 1 -- 172.21.15.169:0/1254621076 >> v1:172.21.15.142:6789/0 conn(0x55a09d1391e0 legacy=0x55a09d13b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.214+0000 7f4ec2fab640 1 -- 172.21.15.169:0/1254621076 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09cff3590 con 0x55a09d1368b0 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/1254621076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d138ca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400a520 tx=0x7f4eb401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f1df5b0536e00a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec27aa640 1 -- 172.21.15.169:0/1254621076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4057070 con 0x55a09d1368b0 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec27aa640 1 -- 172.21.15.169:0/1254621076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb4052570 con 0x55a09d1368b0 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec27aa640 1 -- 172.21.15.169:0/1254621076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb404ae60 con 0x55a09d1368b0 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 -- 172.21.15.169:0/1254621076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 msgr2=0x55a09d138ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 --2- 172.21.15.169:0/1254621076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d138ca0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4eb400a520 tx=0x7f4eb401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 -- 172.21.15.169:0/1254621076 shutdown_connections 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 --2- 172.21.15.169:0/1254621076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d138ca0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 -- 172.21.15.169:0/1254621076 >> 172.21.15.169:0/1254621076 conn(0x55a09d130380 msgr2=0x55a09d1327a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 -- 172.21.15.169:0/1254621076 shutdown_connections 2024-04-24T01:24:22.219 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.216+0000 7f4ec732b800 1 -- 172.21.15.169:0/1254621076 wait complete. 2024-04-24T01:24:22.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.228+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.228+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.228+0000 7f4ec732b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.228+0000 7f4ec732b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a09d0813c0 con 0x55a09d1368b0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34190/0 (socket says 172.21.15.169:34190) 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4ec2fab640 1 -- 172.21.15.169:0/159820072 learned_addr learned my addr 172.21.15.169:0/159820072 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4ec2fab640 1 -- 172.21.15.169:0/159820072 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09d2276a0 con 0x55a09d1368b0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/159820072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4055040 tx=0x7f4eb404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9602db1852f34400 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4db0e09640 1 -- 172.21.15.169:0/159820072 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4057040 con 0x55a09d1368b0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4db0e09640 1 -- 172.21.15.169:0/159820072 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb4052720 con 0x55a09d1368b0 2024-04-24T01:24:22.231 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.229+0000 7f4db0e09640 1 -- 172.21.15.169:0/159820072 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4052a40 con 0x55a09d1368b0 2024-04-24T01:24:22.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- 172.21.15.169:0/159820072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 msgr2=0x55a09d2270d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 --2- 172.21.15.169:0/159820072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4055040 tx=0x7f4eb404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- 172.21.15.169:0/159820072 shutdown_connections 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 --2- 172.21.15.169:0/159820072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d2270d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- 172.21.15.169:0/159820072 >> 172.21.15.169:0/159820072 conn(0x55a09d130380 msgr2=0x55a09d2229f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- 172.21.15.169:0/159820072 shutdown_connections 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- 172.21.15.169:0/159820072 wait complete. 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.230+0000 7f4ec732b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d22ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec732b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a09d13cf90 con 0x55a09d1368b0 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d22ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d22ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34192/0 (socket says 172.21.15.169:34192) 2024-04-24T01:24:22.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3045816646 learned_addr learned my addr 172.21.15.169:0/3045816646 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09d22f150 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d22ec10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4052540 tx=0x7f4eb4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4daf606640 1 -- 172.21.15.169:0/3045816646 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4073070 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4daf606640 1 -- 172.21.15.169:0/3045816646 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb405d440 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a09d22f3e0 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4daf606640 1 -- 172.21.15.169:0/3045816646 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4057070 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.231+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09d231ff0 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4daf606640 1 -- 172.21.15.169:0/3045816646 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4eb4076070 con 0x55a09d1368b0 2024-04-24T01:24:22.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4daf606640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4da8036950 0x7f4da8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4daf606640 1 -- 172.21.15.169:0/3045816646 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4eb408dc30 con 0x55a09d1368b0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4da8036950 0x7f4da8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d1391e0 0x55a09d235db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2362f0 con 0x55a09d1391e0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.232+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d1391e0 0x55a09d235db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4da8036950 0x7f4da8038e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001e10 tx=0x7f4eac001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d1391e0 0x55a09d235db0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3045816646 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d1391e0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d236b70 con 0x55a09d1391e0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3045816646 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d1391e0 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d238480 0x55a09d23a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.233+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d23b0a0 con 0x55a09d238480 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.234+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d238480 0x55a09d23a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.234+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d238480 0x55a09d23a910 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.234+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3045816646 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4eb4075030 con 0x55a09d238480 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.234+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2373f0 con 0x55a09d1391e0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3045816646 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d1391e0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a09d23c550 0x55a09d23e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d23f120 con 0x55a09d23c550 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a09d23c550 0x55a09d23e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a09d23c550 0x55a09d23e9c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.235+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3045816646 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4eac0106a0 con 0x55a09d23c550 2024-04-24T01:24:22.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec732b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec732b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a09d0276b0 con 0x55a09d24d580 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34202/0 (socket says 172.21.15.169:34202) 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3991287787 learned_addr learned my addr 172.21.15.169:0/3991287787 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3991287787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09d24dee0 con 0x55a09d24d580 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005280 tx=0x7f4eb406e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4dace01640 1 -- 172.21.15.169:0/3991287787 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4083040 con 0x55a09d24d580 2024-04-24T01:24:22.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.236+0000 7f4dace01640 1 -- 172.21.15.169:0/3991287787 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb4077530 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a09d24e950 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4dace01640 1 -- 172.21.15.169:0/3991287787 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4054dd0 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09d24ee50 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4dace01640 1 -- 172.21.15.169:0/3991287787 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4eb405ca80 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4dace01640 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 0x7f4d9c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4dace01640 1 -- 172.21.15.169:0/3991287787 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4eb4098c60 con 0x55a09d24d580 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.237+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 0x7f4d9c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 0x7f4d9c038d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55a09d2332a0 tx=0x7f4eac006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec732b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec732b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a09d227960 con 0x55a09d135ea0 2024-04-24T01:24:22.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34204/0 (socket says 172.21.15.169:34204) 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec2fab640 1 -- 172.21.15.169:0/2722042546 learned_addr learned my addr 172.21.15.169:0/2722042546 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec2fab640 1 -- 172.21.15.169:0/2722042546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09d1346a0 con 0x55a09d135ea0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.238+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/2722042546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4054940 tx=0x7f4eb406ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f60da5581ebb37 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4da67fc640 1 -- 172.21.15.169:0/2722042546 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb40a5030 con 0x55a09d135ea0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4da67fc640 1 -- 172.21.15.169:0/2722042546 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb40546a0 con 0x55a09d135ea0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4da67fc640 1 -- 172.21.15.169:0/2722042546 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb409c070 con 0x55a09d135ea0 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- 172.21.15.169:0/2722042546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 msgr2=0x55a09d1362c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 --2- 172.21.15.169:0/2722042546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4054940 tx=0x7f4eb406ae90 comp rx=0 tx=0).stop 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- 172.21.15.169:0/2722042546 shutdown_connections 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 --2- 172.21.15.169:0/2722042546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d1362c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- 172.21.15.169:0/2722042546 >> 172.21.15.169:0/2722042546 conn(0x55a09d2569d0 msgr2=0x55a09d254a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- 172.21.15.169:0/2722042546 shutdown_connections 2024-04-24T01:24:22.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- 172.21.15.169:0/2722042546 wait complete. 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 Processor -- start 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.239+0000 7f4ec732b800 1 -- start start 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec732b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec732b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a09d134ab0 con 0x55a09d135ea0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec2fab640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34208/0 (socket says 172.21.15.169:34208) 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 learned_addr learned my addr 172.21.15.169:0/3671512646 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a09d2641c0 con 0x55a09d135ea0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4066fd0 tx=0x7f4eb408da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4da4ff9640 1 -- 172.21.15.169:0/3671512646 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4054080 con 0x55a09d135ea0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4da4ff9640 1 -- 172.21.15.169:0/3671512646 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb40bb070 con 0x55a09d135ea0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4da4ff9640 1 -- 172.21.15.169:0/3671512646 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4eb4078440 con 0x55a09d135ea0 2024-04-24T01:24:22.250 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a09d2641c0 con 0x55a09d135ea0 2024-04-24T01:24:22.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.240+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a09d2641c0 con 0x55a09d135ea0 2024-04-24T01:24:22.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.241+0000 7f4da4ff9640 1 -- 172.21.15.169:0/3671512646 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4eb40785e0 con 0x55a09d135ea0 2024-04-24T01:24:22.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.241+0000 7f4da4ff9640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d8c036950 0x7f4d8c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.241+0000 7f4da4ff9640 1 -- 172.21.15.169:0/3671512646 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4eb40a9070 con 0x55a09d135ea0 2024-04-24T01:24:22.251 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.241+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d8c036950 0x7f4d8c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d26f210 0x55a09d2716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d271e20 con 0x55a09d26f210 2024-04-24T01:24:22.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d26f210 0x55a09d2716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d8c036950 0x7f4d8c038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55a09d23f520 tx=0x7f4eac011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d26f210 0x55a09d2716d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 realm 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272230 con 0x55a09d26f210 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:22.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.242+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272b00 con 0x55a09d26f210 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d273990 0x55a09d275d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2764e0 con 0x55a09d273990 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d273990 0x55a09d275d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.243+0000 7f4ec2fab640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d273990 0x55a09d275d80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4ec732b800 20 searching for the correct realm 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a09d278590 0x55a09d27aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27b120 con 0x55a09d278590 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a09d278590 0x55a09d27aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a09d278590 0x55a09d27aa50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.244+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4eba7aa640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4eac0393c0 0x7f4eac039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27b120 con 0x7f4eac0393c0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4eac0393c0 0x7f4eac039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4ec37ac640 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4eac0393c0 0x7f4eac039810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.245+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.246+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x7f4eac0393c0 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.247+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x7f4eac0393c0 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.248+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.249+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.250+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.250+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.250+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.250+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x7f4eac0393c0 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.251+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x7f4eac0393c0 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.252+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d278590 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.253+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.253+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d273990 2024-04-24T01:24:22.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.253+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.253+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x55a09d26f210 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.253+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a09d272ea0 con 0x7f4eac0393c0 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d276e90 con 0x55a09d26f210 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d276e90 con 0x55a09d26f210 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.254+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d276e90 con 0x7f4eac0393c0 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 zone default found 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 4 Realm: () 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:22.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 zonegroup default 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d277280 con 0x55a09d273990 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27cf80 con 0x55a09d278590 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27d320 con 0x55a09d278590 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.255+0000 7f4ec732b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec732b800 20 started sync module instance, tier type = 2024-04-24T01:24:22.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec732b800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d277af0 con 0x7f4eac0393c0 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94148319756448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27cb60 con 0x7f4eac0393c0 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.256+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27dd70 con 0x55a09d26f210 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.257+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94148319756448] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.258+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.258+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94148319762528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27dd30 con 0x55a09d26f210 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.258+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27e7f0 con 0x55a09d278590 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.258+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.259+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94148319765248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27f090 con 0x55a09d278590 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.259+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27fb50 con 0x7f4eac0393c0 2024-04-24T01:24:22.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.259+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94148319762528] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.260+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.260+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94148319770144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27ff40 con 0x7f4eac0393c0 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.260+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d280940 con 0x55a09d26f210 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.261+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94148319765248] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.261+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.261+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94148319767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d280900 con 0x55a09d26f210 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.261+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d281350 con 0x55a09d273990 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.261+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94148319770144] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.262+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94148319767520] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.262+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.262+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94148319757744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d280900 con 0x55a09d273990 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.262+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d281bf0 con 0x55a09d273990 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.263+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94148319757744] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.263+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.263+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94148319774288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d281bf0 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.263+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2825b0 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94148319774288] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94148319778544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2827d0 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=0 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=1 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=2 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=3 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=4 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=5 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.264+0000 7f4ec732b800 20 add_watcher() i=6 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.265+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94148319778544] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.265+0000 7f4ec732b800 20 add_watcher() i=7 2024-04-24T01:24:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.265+0000 7f4ec732b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.265+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d285960 con 0x55a09d26f210 2024-04-24T01:24:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.266+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.266+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94148319793904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d282700 con 0x55a09d26f210 2024-04-24T01:24:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94148319793904] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4d797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:22.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 5 note: GC not initialized 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4cf3fff640 20 reqs_thread_entry: start 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 20 Filter name: none 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4cf1ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.267+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2b88a0 con 0x55a09d26f210 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec732b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2b9290 con 0x55a09d26f210 2024-04-24T01:24:22.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec732b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2ba2a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.268+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.269+0000 7f4d797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.269+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94148319793904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2a15f0 con 0x55a09d26f210 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.270+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94148319793904] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.270+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94148319756448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2a15f0 con 0x7f4eac0393c0 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.271+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94148319756448] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.271+0000 7f4ec732b800 20 remove_watcher() i=0 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.271+0000 7f4ec732b800 2 removed watcher, disabling cache 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.271+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94148319762528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2a15f0 con 0x55a09d26f210 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.272+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94148319762528] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.272+0000 7f4ec732b800 20 remove_watcher() i=1 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.272+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94148319765248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d2a15f0 con 0x55a09d278590 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.273+0000 7f4eba7aa640 1 -- 172.21.15.169:0/3671512646 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94148319765248] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eac036040 con 0x55a09d278590 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.273+0000 7f4ec732b800 20 remove_watcher() i=2 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.273+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94148319770144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27c080 con 0x7f4eac0393c0 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.274+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94148319770144] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x7f4eac0393c0 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.274+0000 7f4ec732b800 20 remove_watcher() i=3 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.274+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94148319767520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27f620 con 0x55a09d26f210 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.275+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94148319767520] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ebc00a4a0 con 0x55a09d26f210 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.275+0000 7f4ec732b800 20 remove_watcher() i=4 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.275+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94148319757744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27f620 con 0x55a09d273990 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.276+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94148319757744] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.276+0000 7f4ec732b800 20 remove_watcher() i=5 2024-04-24T01:24:22.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.276+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94148319774288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27c080 con 0x55a09d273990 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.277+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94148319774288] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.277+0000 7f4ec732b800 20 remove_watcher() i=6 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.277+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94148319778544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a09d27c080 con 0x55a09d273990 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec2fab640 1 -- 172.21.15.169:0/3671512646 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94148319778544] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4eb409e070 con 0x55a09d273990 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 20 remove_watcher() i=7 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d273990 msgr2=0x55a09d275d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d273990 0x55a09d275d80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d26f210 msgr2=0x55a09d2716d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d26f210 0x55a09d2716d0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4eac0393c0 msgr2=0x7f4eac039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4eac0393c0 0x7f4eac039810 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a09d278590 msgr2=0x55a09d27aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.278+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a09d278590 0x55a09d27aa50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d8c036950 msgr2=0x7f4d8c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d8c036950 0x7f4d8c038e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x55a09d23f520 tx=0x7f4eac011000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 msgr2=0x55a09d263c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3671512646 reap_dead start 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4066fd0 tx=0x7f4eb408da60 comp rx=0 tx=0).stop 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 shutdown_connections 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3671512646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d135ea0 0x55a09d263c80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 >> 172.21.15.169:0/3671512646 conn(0x55a09d2569d0 msgr2=0x55a09d254030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 shutdown_connections 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3671512646 wait complete. 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 msgr2=0x7f4d9c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 0x7f4d9c038d70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55a09d2332a0 tx=0x7f4eac006000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 msgr2=0x55a09d24d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005280 tx=0x7f4eb406e6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 shutdown_connections 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4d9c0368b0 0x7f4d9c038d70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3991287787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d24d580 0x55a09d24d9a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 >> 172.21.15.169:0/3991287787 conn(0x55a09d241620 msgr2=0x55a09d241a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 shutdown_connections 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3991287787 wait complete. 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d238480 msgr2=0x55a09d23a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a09d238480 0x55a09d23a910 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d1391e0 msgr2=0x55a09d235db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a09d1391e0 0x55a09d235db0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a09d23c550 msgr2=0x55a09d23e9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.279+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a09d23c550 0x55a09d23e9c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4da8036950 msgr2=0x7f4da8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4da8036950 0x7f4da8038e10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eac001e10 tx=0x7f4eac001390 comp rx=0 tx=0).stop 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 msgr2=0x55a09d22ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 --2- 172.21.15.169:0/3045816646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a09d1368b0 0x55a09d22ec10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4052540 tx=0x7f4eb4003020 comp rx=0 tx=0).stop 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec37ac640 1 -- 172.21.15.169:0/3045816646 reap_dead start 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 shutdown_connections 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 >> 172.21.15.169:0/3045816646 conn(0x55a09d130380 msgr2=0x55a09d221210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 shutdown_connections 2024-04-24T01:24:22.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.280+0000 7f4ec732b800 1 -- 172.21.15.169:0/3045816646 wait complete. 2024-04-24T01:24:22.296 INFO:teuthology.orchestra.run.smithi169.stdout:["myfoo"] 2024-04-24T01:24:22.296 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T01:24:22.333 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-04-24T01:24:22.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-04-24T01:24:22.333 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-04-24T01:24:22.379 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:22.379 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:22.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.378+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.378+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.378+0000 7fe97b898800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559bf7cd2d10 0x559bf7cd3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.378+0000 7fe97b898800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559bf7b92d40 con 0x559bf7cd3f70 2024-04-24T01:24:22.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.378+0000 7fe97b898800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559bf7b654d0 con 0x559bf7cd2d10 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe979397640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559bf7cd2d10 0x559bf7cd3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe979397640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559bf7cd2d10 0x559bf7cd3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34220/0 (socket says 172.21.15.169:34220) 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe979397640 1 -- 172.21.15.169:0/2138457435 learned_addr learned my addr 172.21.15.169:0/2138457435 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe970b96640 1 --1- 172.21.15.169:0/2138457435 >> v1:172.21.15.142:6789/0 conn(0x559bf7cd3f70 0x559bf7cd43f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34774/0 (socket says 172.21.15.169:34774) 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe979397640 1 -- 172.21.15.169:0/2138457435 >> v1:172.21.15.142:6789/0 conn(0x559bf7cd3f70 legacy=0x559bf7cd43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.379+0000 7fe979397640 1 -- 172.21.15.169:0/2138457435 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7b91590 con 0x559bf7cd2d10 2024-04-24T01:24:22.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe979397640 1 --2- 172.21.15.169:0/2138457435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7cd3130 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a6b0 tx=0x7fe96c01eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbdd248e77df876 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe978b96640 1 -- 172.21.15.169:0/2138457435 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c00a200 con 0x559bf7cd2d10 2024-04-24T01:24:22.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe978b96640 1 -- 172.21.15.169:0/2138457435 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c00a3a0 con 0x559bf7cd2d10 2024-04-24T01:24:22.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe978b96640 1 -- 172.21.15.169:0/2138457435 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c0086e0 con 0x559bf7cd2d10 2024-04-24T01:24:22.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 -- 172.21.15.169:0/2138457435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 msgr2=0x559bf7cd3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 --2- 172.21.15.169:0/2138457435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7cd3130 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a6b0 tx=0x7fe96c01eed0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 -- 172.21.15.169:0/2138457435 shutdown_connections 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 --2- 172.21.15.169:0/2138457435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7cd3130 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 -- 172.21.15.169:0/2138457435 >> 172.21.15.169:0/2138457435 conn(0x559bf7cce370 msgr2=0x559bf7cd0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 -- 172.21.15.169:0/2138457435 shutdown_connections 2024-04-24T01:24:22.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.381+0000 7fe97b898800 1 -- 172.21.15.169:0/2138457435 wait complete. 2024-04-24T01:24:22.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.393+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.393+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.393+0000 7fe97b898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.393+0000 7fe97b898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559bf7c1f3b0 con 0x559bf7cd2d10 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.393+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34224/0 (socket says 172.21.15.169:34224) 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe979397640 1 -- 172.21.15.169:0/1277891959 learned_addr learned my addr 172.21.15.169:0/1277891959 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe979397640 1 -- 172.21.15.169:0/1277891959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7dc3920 con 0x559bf7cd2d10 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe979397640 1 --2- 172.21.15.169:0/1277891959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000c00 tx=0x7fe96c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc59277db0fe04e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe867606640 1 -- 172.21.15.169:0/1277891959 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c065070 con 0x559bf7cd2d10 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe867606640 1 -- 172.21.15.169:0/1277891959 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c008590 con 0x559bf7cd2d10 2024-04-24T01:24:22.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.394+0000 7fe867606640 1 -- 172.21.15.169:0/1277891959 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c00a200 con 0x559bf7cd2d10 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- 172.21.15.169:0/1277891959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 msgr2=0x559bf7dc3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 --2- 172.21.15.169:0/1277891959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000c00 tx=0x7fe96c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- 172.21.15.169:0/1277891959 shutdown_connections 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 --2- 172.21.15.169:0/1277891959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dc3350 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- 172.21.15.169:0/1277891959 >> 172.21.15.169:0/1277891959 conn(0x559bf7cce370 msgr2=0x559bf7dbec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- 172.21.15.169:0/1277891959 shutdown_connections 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- 172.21.15.169:0/1277891959 wait complete. 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dcf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.395+0000 7fe97b898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559bf7c466e0 con 0x559bf7cd2d10 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dcf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dcf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34238/0 (socket says 172.21.15.169:34238) 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe979397640 1 -- 172.21.15.169:0/4078987458 learned_addr learned my addr 172.21.15.169:0/4078987458 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe979397640 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7dcf800 con 0x559bf7cd2d10 2024-04-24T01:24:22.428 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe979397640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dcf2c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01eea0 tx=0x7fe96c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe865e03640 1 -- 172.21.15.169:0/4078987458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c06e070 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe865e03640 1 -- 172.21.15.169:0/4078987458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c008240 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bf7dcfa90 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe865e03640 1 -- 172.21.15.169:0/4078987458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c065040 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.396+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf7dd2740 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe865e03640 1 -- 172.21.15.169:0/4078987458 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe96c008740 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe865e03640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe860036900 0x7fe860038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe865e03640 1 -- 172.21.15.169:0/4078987458 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe96c08d080 con 0x559bf7cd2d10 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe970b96640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe860036900 0x7fe860038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7cd3f70 0x559bf7dd6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7dd6a80 con 0x559bf7cd3f70 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.397+0000 7fe979b98640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7cd3f70 0x559bf7dd6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe970b96640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe860036900 0x7fe860038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe964000f60 tx=0x7fe964001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.429 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe979b98640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7cd3f70 0x559bf7dd6500 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe979b98640 1 -- 172.21.15.169:0/4078987458 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7cd3f70 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7dd3ad0 con 0x559bf7cd3f70 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe979b98640 1 -- 172.21.15.169:0/4078987458 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7cd3f70 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7dd8e00 0x559bf7ddb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7ddb8e0 con 0x559bf7dd8e00 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.398+0000 7fe979397640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7dd8e00 0x559bf7ddb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe979397640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7dd8e00 0x559bf7ddb1f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe979397640 1 -- 172.21.15.169:0/4078987458 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe96c060990 con 0x559bf7dd8e00 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7dd7db0 con 0x559bf7cd3f70 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe979b98640 1 -- 172.21.15.169:0/4078987458 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7cd3f70 2024-04-24T01:24:22.430 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559bf7ddcd90 0x559bf7ddf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7ddf940 con 0x559bf7ddcd90 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.399+0000 7fe970b96640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559bf7ddcd90 0x559bf7ddf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.400+0000 7fe970b96640 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559bf7ddcd90 0x559bf7ddf1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.400+0000 7fe970b96640 1 -- 172.21.15.169:0/4078987458 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe96400f690 con 0x559bf7ddcd90 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.400+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.400+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe97b898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe97b898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559bf7bc56b0 con 0x559bf7dedda0 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.431 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34252/0 (socket says 172.21.15.169:34252) 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe979397640 1 -- 172.21.15.169:0/3386811530 learned_addr learned my addr 172.21.15.169:0/3386811530 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe979397640 1 -- 172.21.15.169:0/3386811530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7dee700 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe979397640 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0075a0 tx=0x7fe96c06bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe85effd640 1 -- 172.21.15.169:0/3386811530 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c082070 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe85effd640 1 -- 172.21.15.169:0/3386811530 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c054600 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bf7def170 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe85effd640 1 -- 172.21.15.169:0/3386811530 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c0548e0 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.401+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf7def670 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.402+0000 7fe85effd640 1 -- 172.21.15.169:0/3386811530 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe96c07c040 con 0x559bf7dedda0 2024-04-24T01:24:22.432 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.402+0000 7fe85effd640 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 0x7fe850038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.402+0000 7fe85effd640 1 -- 172.21.15.169:0/3386811530 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe96c087040 con 0x559bf7dedda0 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.402+0000 7fe970b96640 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 0x7fe850038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe970b96640 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 0x7fe850038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559bf7dd73b0 tx=0x7fe96400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe97b898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe97b898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559bf7dc3c40 con 0x559bf7dfae40 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34266/0 (socket says 172.21.15.169:34266) 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe979397640 1 -- 172.21.15.169:0/2883454490 learned_addr learned my addr 172.21.15.169:0/2883454490 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe979397640 1 -- 172.21.15.169:0/2883454490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7dfb830 con 0x559bf7dfae40 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe979397640 1 --2- 172.21.15.169:0/2883454490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe96c04cf40 tx=0x7fe96c08f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f137035ce0a35972 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe85cff9640 1 -- 172.21.15.169:0/2883454490 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c007610 con 0x559bf7dfae40 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe85cff9640 1 -- 172.21.15.169:0/2883454490 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c07e440 con 0x559bf7dfae40 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.403+0000 7fe85cff9640 1 -- 172.21.15.169:0/2883454490 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c0077b0 con 0x559bf7dfae40 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- 172.21.15.169:0/2883454490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 msgr2=0x559bf7dfb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 --2- 172.21.15.169:0/2883454490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe96c04cf40 tx=0x7fe96c08f3d0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- 172.21.15.169:0/2883454490 shutdown_connections 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 --2- 172.21.15.169:0/2883454490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7dfb260 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- 172.21.15.169:0/2883454490 >> 172.21.15.169:0/2883454490 conn(0x559bf7df71f0 msgr2=0x559bf7df5250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- 172.21.15.169:0/2883454490 shutdown_connections 2024-04-24T01:24:22.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- 172.21.15.169:0/2883454490 wait complete. 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 Processor -- start 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- start start 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.404+0000 7fe97b898800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559bf7dfbf30 con 0x559bf7dfae40 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe979397640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34278/0 (socket says 172.21.15.169:34278) 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 learned_addr learned my addr 172.21.15.169:0/1469628824 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bf7e02740 con 0x559bf7dfae40 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe979397640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe96c079fa0 tx=0x7fe96c070f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe84effd640 1 -- 172.21.15.169:0/1469628824 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c0b5070 con 0x559bf7dfae40 2024-04-24T01:24:22.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe84effd640 1 -- 172.21.15.169:0/1469628824 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c06da10 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559bf7e02740 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe84effd640 1 -- 172.21.15.169:0/1469628824 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c06dcf0 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.405+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bf7e02740 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe84effd640 1 -- 172.21.15.169:0/1469628824 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe96c0b8070 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe84effd640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe844036950 0x7fe844038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe84effd640 1 -- 172.21.15.169:0/1469628824 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe96c0ad070 con 0x559bf7dfae40 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe970b96640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe844036950 0x7fe844038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7e0d890 0x559bf7e0fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe970b96640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe844036950 0x7fe844038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559bf7ddfd40 tx=0x7fe964010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.406+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e104a0 con 0x559bf7e0d890 2024-04-24T01:24:22.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe979b98640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7e0d890 0x559bf7e0fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe979b98640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7e0d890 0x559bf7e0fd50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 realm 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e108b0 con 0x559bf7e0d890 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11180 con 0x559bf7e0d890 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.407+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe97b898800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7e12010 0x559bf7e14400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e14b60 con 0x559bf7e12010 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe979397640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7e12010 0x559bf7e14400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.408+0000 7fe979397640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7e12010 0x559bf7e14400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe97b898800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe97b898800 20 searching for the correct realm 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559bf7e16c10 0x559bf7e190d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e197a0 con 0x559bf7e16c10 2024-04-24T01:24:22.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe970b96640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559bf7e16c10 0x559bf7e190d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe970b96640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559bf7e16c10 0x559bf7e190d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe970b96640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe96400f070 0x7fe96402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e197a0 con 0x7fe96400f070 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.409+0000 7fe979b98640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe96400f070 0x7fe96402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979b98640 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe96400f070 0x7fe96402e910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.410+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.411+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.412+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.413+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.414+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.415+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.416+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.417+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e15510 con 0x559bf7e0d890 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e15510 con 0x559bf7e0d890 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e154e0 con 0x7fe96400f070 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 zone default found 2024-04-24T01:24:22.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 4 Realm: () 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 zonegroup default 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.418+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e15900 con 0x559bf7e12010 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e15510 con 0x559bf7e16c10 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.419+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1b600 con 0x559bf7e16c10 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.420+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.420+0000 7fe97b898800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.420+0000 7fe97b898800 20 started sync module instance, tier type = 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.420+0000 7fe97b898800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.420+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1aaa0 con 0x7fe96400f070 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.421+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.421+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94128367054784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1aaa0 con 0x7fe96400f070 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.421+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1c0d0 con 0x559bf7e0d890 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.422+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94128367054784] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.422+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.422+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94128367057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1aaa0 con 0x559bf7e0d890 2024-04-24T01:24:22.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.422+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1cb70 con 0x559bf7e16c10 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.423+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94128367057856] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.423+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.423+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94128367052272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1aa10 con 0x559bf7e16c10 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.423+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1da30 con 0x7fe96400f070 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.424+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94128367052272] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.424+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.424+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94128367064448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1de50 con 0x7fe96400f070 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.424+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1e810 con 0x559bf7e0d890 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.425+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94128367064448] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.425+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.425+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94128367068480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1de50 con 0x559bf7e0d890 2024-04-24T01:24:22.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.425+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.426+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94128367068480] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.426+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.426+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94128367065504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1ddc0 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.426+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1ffb0 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.427+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94128367065504] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.427+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.427+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128367072704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1ff10 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.427+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e20a10 con 0x559bf7e12010 2024-04-24T01:24:22.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94128367072704] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94128367076608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e209d0 con 0x559bf7e12010 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=0 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=1 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=2 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=3 2024-04-24T01:24:22.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=4 2024-04-24T01:24:22.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=5 2024-04-24T01:24:22.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.428+0000 7fe97b898800 20 add_watcher() i=6 2024-04-24T01:24:22.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.429+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94128367076608] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.429+0000 7fe97b898800 20 add_watcher() i=7 2024-04-24T01:24:22.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.429+0000 7fe97b898800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.429+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e23e60 con 0x559bf7e0d890 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.430+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.430+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94128367073760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e213b0 con 0x559bf7e0d890 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94128367073760] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe82f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:22.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:22.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 5 note: GC not initialized 2024-04-24T01:24:22.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe82e7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:22.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:22.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 20 Filter name: none 2024-04-24T01:24:22.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe79ffff640 20 reqs_thread_entry: start 2024-04-24T01:24:22.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.431+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e56980 con 0x559bf7e16c10 2024-04-24T01:24:22.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e56980 con 0x559bf7e16c10 2024-04-24T01:24:22.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e56980 con 0x559bf7e0d890 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.432+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.433+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.434+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e12010 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e16c10 2024-04-24T01:24:22.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.435+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e16c10 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x7fe96400f070 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.436+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e0d890 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e0d890 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e16c10 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x7fe96400f070 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.437+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.438+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e0d890 2024-04-24T01:24:22.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.438+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.438+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.438+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.438+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e16c10 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x7fe96400f070 2024-04-24T01:24:22.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e12010 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e0d890 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.439+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x559bf7e16c10 2024-04-24T01:24:22.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.440+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.440+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1f220 con 0x7fe96400f070 2024-04-24T01:24:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.440+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.440+0000 7fe97b898800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.440+0000 7fe97b898800 20 RGWRados::pool_iterate: got myfoo 2024-04-24T01:24:22.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.441+0000 7fe82f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.441+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94128367073760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.442+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94128367073760] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.442+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94128367054784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x7fe96400f070 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.443+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94128367054784] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.443+0000 7fe97b898800 20 remove_watcher() i=0 2024-04-24T01:24:22.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.443+0000 7fe97b898800 2 removed watcher, disabling cache 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.443+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94128367057856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e0d890 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.444+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94128367057856] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.444+0000 7fe97b898800 20 remove_watcher() i=1 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.444+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94128367052272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e11520 con 0x559bf7e16c10 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.445+0000 7fe970b96640 1 -- 172.21.15.169:0/1469628824 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94128367052272] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe964037040 con 0x559bf7e16c10 2024-04-24T01:24:22.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.445+0000 7fe97b898800 20 remove_watcher() i=2 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.445+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94128367064448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1a5f0 con 0x7fe96400f070 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.446+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94128367064448] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x7fe96400f070 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.446+0000 7fe97b898800 20 remove_watcher() i=3 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.446+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94128367068480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1d580 con 0x559bf7e0d890 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.447+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94128367068480] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97400a4a0 con 0x559bf7e0d890 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.447+0000 7fe97b898800 20 remove_watcher() i=4 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.447+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94128367065504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1a5f0 con 0x559bf7e12010 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.448+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94128367065504] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.448+0000 7fe97b898800 20 remove_watcher() i=5 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.448+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94128367072704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1e540 con 0x559bf7e12010 2024-04-24T01:24:22.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.449+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94128367072704] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.449+0000 7fe97b898800 20 remove_watcher() i=6 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.449+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94128367076608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559bf7e1bbc0 con 0x559bf7e12010 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe979397640 1 -- 172.21.15.169:0/1469628824 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94128367076608] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c0b7030 con 0x559bf7e12010 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 20 remove_watcher() i=7 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7e12010 msgr2=0x559bf7e14400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7e12010 0x559bf7e14400 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7e0d890 msgr2=0x559bf7e0fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7e0d890 0x559bf7e0fd50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe96400f070 msgr2=0x7fe96402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe96400f070 0x7fe96402e910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559bf7e16c10 msgr2=0x559bf7e190d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559bf7e16c10 0x559bf7e190d0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe844036950 msgr2=0x7fe844038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe844036950 0x7fe844038e10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x559bf7ddfd40 tx=0x7fe964010000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 msgr2=0x559bf7e02200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe979b98640 1 -- 172.21.15.169:0/1469628824 reap_dead start 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe96c079fa0 tx=0x7fe96c070f80 comp rx=0 tx=0).stop 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 shutdown_connections 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/1469628824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dfae40 0x559bf7e02200 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 >> 172.21.15.169:0/1469628824 conn(0x559bf7df71f0 msgr2=0x559bf7df4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 shutdown_connections 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/1469628824 wait complete. 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 msgr2=0x7fe850038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 0x7fe850038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x559bf7dd73b0 tx=0x7fe96400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 msgr2=0x559bf7dee1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0075a0 tx=0x7fe96c06bda0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 shutdown_connections 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe850036950 0x7fe850038e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 --2- 172.21.15.169:0/3386811530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7dedda0 0x559bf7dee1c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 >> 172.21.15.169:0/3386811530 conn(0x559bf7de1e40 msgr2=0x559bf7de2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 shutdown_connections 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.450+0000 7fe97b898800 1 -- 172.21.15.169:0/3386811530 wait complete. 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7dd8e00 msgr2=0x559bf7ddb1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559bf7dd8e00 0x559bf7ddb1f0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7cd3f70 msgr2=0x559bf7dd6500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559bf7cd3f70 0x559bf7dd6500 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559bf7ddcd90 msgr2=0x559bf7ddf1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559bf7ddcd90 0x559bf7ddf1e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe860036900 msgr2=0x7fe860038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe860036900 0x7fe860038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe964000f60 tx=0x7fe964001370 comp rx=0 tx=0).stop 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 msgr2=0x559bf7dcf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 --2- 172.21.15.169:0/4078987458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559bf7cd2d10 0x559bf7dcf2c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe96c01eea0 tx=0x7fe96c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe979b98640 1 -- 172.21.15.169:0/4078987458 reap_dead start 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 shutdown_connections 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 >> 172.21.15.169:0/4078987458 conn(0x559bf7cce370 msgr2=0x559bf7dbd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 shutdown_connections 2024-04-24T01:24:22.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.451+0000 7fe97b898800 1 -- 172.21.15.169:0/4078987458 wait complete. 2024-04-24T01:24:22.491 INFO:teuthology.orchestra.run.smithi169.stdout:["myfoo"] 2024-04-24T01:24:22.492 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-04-24T01:24:22.504 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.517 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.529 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.575 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-04-24T01:24:22.603 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.631 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.662 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:22.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:22.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:22.663 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:24:22.706 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:22.706 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.705+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.705+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.705+0000 7f39a7d2f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f2263ca8f0 0x55f2263ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.705+0000 7f39a7d2f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f226288d40 con 0x55f2263cd220 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.705+0000 7f39a7d2f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55f22625b4d0 con 0x55f2263ca8f0 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f39a3ac5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f2263ca8f0 0x55f2263ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f39a3ac5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f2263ca8f0 0x55f2263ccce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34282/0 (socket says 172.21.15.169:34282) 2024-04-24T01:24:22.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3662478673 learned_addr learned my addr 172.21.15.169:0/3662478673 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f399b2c4640 1 --1- 172.21.15.169:0/3662478673 >> v1:172.21.15.142:6789/0 conn(0x55f2263cd220 0x55f2263cf610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34788/0 (socket says 172.21.15.169:34788) 2024-04-24T01:24:22.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3662478673 >> v1:172.21.15.142:6789/0 conn(0x55f2263cd220 legacy=0x55f2263cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.706+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3662478673 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f226287590 con 0x55f2263ca8f0 2024-04-24T01:24:22.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/3662478673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ccce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f399400a520 tx=0x7f399401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28a26a4adb578603 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a32c4640 1 -- 172.21.15.169:0/3662478673 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994057070 con 0x55f2263ca8f0 2024-04-24T01:24:22.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a32c4640 1 -- 172.21.15.169:0/3662478673 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994052570 con 0x55f2263ca8f0 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a32c4640 1 -- 172.21.15.169:0/3662478673 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399404ae60 con 0x55f2263ca8f0 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3662478673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 msgr2=0x55f2263ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3662478673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ccce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f399400a520 tx=0x7f399401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3662478673 shutdown_connections 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3662478673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ccce0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.708+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3662478673 >> 172.21.15.169:0/3662478673 conn(0x55f2263c4320 msgr2=0x55f2263c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.709+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3662478673 shutdown_connections 2024-04-24T01:24:22.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.709+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3662478673 wait complete. 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.720+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.720+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a7d2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a7d2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f2263153c0 con 0x55f2263ca8f0 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34288/0 (socket says 172.21.15.169:34288) 2024-04-24T01:24:22.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3553908460 learned_addr learned my addr 172.21.15.169:0/3553908460 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3553908460 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2263c87f0 con 0x55f2263ca8f0 2024-04-24T01:24:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/3553908460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3994055040 tx=0x7f399404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595c36fb04cbb7d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f3891e0b640 1 -- 172.21.15.169:0/3553908460 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994057040 con 0x55f2263ca8f0 2024-04-24T01:24:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f3891e0b640 1 -- 172.21.15.169:0/3553908460 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994052720 con 0x55f2263ca8f0 2024-04-24T01:24:22.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.721+0000 7f3891e0b640 1 -- 172.21.15.169:0/3553908460 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994052a40 con 0x55f2263ca8f0 2024-04-24T01:24:22.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3553908460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 msgr2=0x55f2263ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3553908460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3994055040 tx=0x7f399404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3553908460 shutdown_connections 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3553908460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2263ca230 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3553908460 >> 172.21.15.169:0/3553908460 conn(0x55f2263c4320 msgr2=0x55f2264b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3553908460 shutdown_connections 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3553908460 wait complete. 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.722+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a7d2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2264c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a7d2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f2263d0fd0 con 0x55f2263ca8f0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2264c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2264c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34302/0 (socket says 172.21.15.169:34302) 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3609312497 learned_addr learned my addr 172.21.15.169:0/3609312497 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2264c5310 con 0x55f2263ca8f0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2264c4dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3994052540 tx=0x7f3994003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f388bfff640 1 -- 172.21.15.169:0/3609312497 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994073070 con 0x55f2263ca8f0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f388bfff640 1 -- 172.21.15.169:0/3609312497 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399405d440 con 0x55f2263ca8f0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2264c55a0 con 0x55f2263ca8f0 2024-04-24T01:24:22.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.723+0000 7f388bfff640 1 -- 172.21.15.169:0/3609312497 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994057070 con 0x55f2263ca8f0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.724+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2264c8250 con 0x55f2263ca8f0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.724+0000 7f388bfff640 1 -- 172.21.15.169:0/3609312497 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3994076070 con 0x55f2263ca8f0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.724+0000 7f388bfff640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f388c036950 0x7f388c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.724+0000 7f388bfff640 1 -- 172.21.15.169:0/3609312497 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f399408db90 con 0x55f2263ca8f0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f399b2c4640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f388c036950 0x7f388c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2263cd220 0x55f2264cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2264cc550 con 0x55f2263cd220 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a42c6640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2263cd220 0x55f2264cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f399b2c4640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f388c036950 0x7f388c038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f398c000f60 tx=0x7f398c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a42c6640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2263cd220 0x55f2264cc010 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a42c6640 1 -- 172.21.15.169:0/3609312497 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2263cd220 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.725+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2264c95e0 con 0x55f2263cd220 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.726+0000 7f39a42c6640 1 -- 172.21.15.169:0/3609312497 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2263cd220 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.726+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f2264ce8b0 0x55f2264d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.726+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2264d1390 con 0x55f2264ce8b0 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.726+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f2264ce8b0 0x55f2264d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.726+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f2264ce8b0 0x55f2264d0ca0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f39a3ac5640 1 -- 172.21.15.169:0/3609312497 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3994075030 con 0x55f2264ce8b0 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2264cd860 con 0x55f2263cd220 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f39a42c6640 1 -- 172.21.15.169:0/3609312497 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2263cd220 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f2264d2840 0x55f2264d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2264d53f0 con 0x55f2264d2840 2024-04-24T01:24:22.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f399b2c4640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f2264d2840 0x55f2264d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.727+0000 7f399b2c4640 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f2264d2840 0x55f2264d4c90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f399b2c4640 1 -- 172.21.15.169:0/3609312497 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f398c00f690 con 0x55f2264d2840 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a7d2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a7d2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f2262bb6b0 con 0x55f2264e3850 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34306/0 (socket says 172.21.15.169:34306) 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a3ac5640 1 -- 172.21.15.169:0/329428980 learned_addr learned my addr 172.21.15.169:0/329428980 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.728+0000 7f39a3ac5640 1 -- 172.21.15.169:0/329428980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2264e41b0 con 0x55f2264e3850 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3994076b10 tx=0x7f39940776a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f38897fa640 1 -- 172.21.15.169:0/329428980 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994083040 con 0x55f2264e3850 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f38897fa640 1 -- 172.21.15.169:0/329428980 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994054dd0 con 0x55f2264e3850 2024-04-24T01:24:22.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2264e4c20 con 0x55f2264e3850 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f38897fa640 1 -- 172.21.15.169:0/329428980 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399405cbb0 con 0x55f2264e3850 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.729+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2264e5120 con 0x55f2264e3850 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f38897fa640 1 -- 172.21.15.169:0/329428980 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f399405d720 con 0x55f2264e3850 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f38897fa640 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 0x7f387c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f38897fa640 1 -- 172.21.15.169:0/329428980 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f3994098c60 con 0x55f2264e3850 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f399b2c4640 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 0x7f387c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f399b2c4640 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 0x7f387c038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55f2264cce60 tx=0x7f398c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a7d2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a7d2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f2263c8ab0 con 0x55f2264f0940 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.730+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34312/0 (socket says 172.21.15.169:34312) 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a3ac5640 1 -- 172.21.15.169:0/1707796136 learned_addr learned my addr 172.21.15.169:0/1707796136 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a3ac5640 1 -- 172.21.15.169:0/1707796136 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2264f1330 con 0x55f2264f0940 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/1707796136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3994073ff0 tx=0x7f39940885f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad1fec07612f1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f3882ffd640 1 -- 172.21.15.169:0/1707796136 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39940a5030 con 0x55f2264f0940 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f3882ffd640 1 -- 172.21.15.169:0/1707796136 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399408a3e0 con 0x55f2264f0940 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f3882ffd640 1 -- 172.21.15.169:0/1707796136 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399405c890 con 0x55f2264f0940 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a7d2f800 1 -- 172.21.15.169:0/1707796136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 msgr2=0x55f2264f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/1707796136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3994073ff0 tx=0x7f39940885f0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a7d2f800 1 -- 172.21.15.169:0/1707796136 shutdown_connections 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/1707796136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f0d60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.731+0000 7f39a7d2f800 1 -- 172.21.15.169:0/1707796136 >> 172.21.15.169:0/1707796136 conn(0x55f2264eccf0 msgr2=0x55f2264ead50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 -- 172.21.15.169:0/1707796136 shutdown_connections 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 -- 172.21.15.169:0/1707796136 wait complete. 2024-04-24T01:24:22.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 Processor -- start 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 -- start start 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a7d2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f2264f1a30 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a3ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34324/0 (socket says 172.21.15.169:34324) 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 learned_addr learned my addr 172.21.15.169:0/684825701 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.732+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2264f8270 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f399408db60 tx=0x7f399408dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f38817fa640 1 -- 172.21.15.169:0/684825701 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f399407f210 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f38817fa640 1 -- 172.21.15.169:0/684825701 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39940bc070 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2264f8270 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f38817fa640 1 -- 172.21.15.169:0/684825701 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3994061c50 con 0x55f2264f0940 2024-04-24T01:24:22.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.733+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2264f8270 con 0x55f2264f0940 2024-04-24T01:24:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f38817fa640 1 -- 172.21.15.169:0/684825701 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3994078600 con 0x55f2264f0940 2024-04-24T01:24:22.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f38817fa640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f386c0369a0 0x7f386c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f38817fa640 1 -- 172.21.15.169:0/684825701 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f39940a9070 con 0x55f2264f0940 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f399b2c4640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f386c0369a0 0x7f386c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2265032b0 0x55f226505770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.734+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226505ec0 con 0x55f2265032b0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f399b2c4640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f386c0369a0 0x7f386c038e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55f2264d57f0 tx=0x7f398c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a42c6640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2265032b0 0x55f226505770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a42c6640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2265032b0 0x55f226505770 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 20 realm 2024-04-24T01:24:22.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2265062d0 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.735+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226506ba0 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f226507a30 0x55f226509e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22650a580 con 0x55f226507a30 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.736+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f226507a30 0x55f226509e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a3ac5640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f226507a30 0x55f226509e20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a7d2f800 20 searching for the correct realm 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f22650c630 0x55f22650eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f22650f1c0 con 0x55f22650c630 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f399b2c4640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f22650c630 0x55f22650eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f399b2c4640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f22650c630 0x55f22650eaf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.737+0000 7f399b2c4640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f398c00f070 0x7f398c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.738+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f22650f1c0 con 0x7f398c00f070 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.738+0000 7f39a42c6640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f398c00f070 0x7f398c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.738+0000 7f39a42c6640 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f398c00f070 0x7f398c02e910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.738+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.738+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.739+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x7f398c00f070 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.740+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.741+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.741+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.741+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.741+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x7f398c00f070 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.742+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.743+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.744+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x7f398c00f070 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.745+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.745+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.745+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.745+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x7f398c00f070 2024-04-24T01:24:22.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.746+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f22650c630 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f226507a30 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x55f2265032b0 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f226506f40 con 0x7f398c00f070 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:22.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.747+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22650af30 con 0x55f2265032b0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22650af30 con 0x55f2265032b0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22650af00 con 0x7f398c00f070 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 zone default found 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 4 Realm: () 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 zonegroup default 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22650b320 con 0x55f226507a30 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.748+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226511020 con 0x55f22650c630 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2265113c0 con 0x55f22650c630 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 20 started sync module instance, tier type = 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.749+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2265104c0 con 0x7f398c00f070 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.750+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.750+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94498513291440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2265104c0 con 0x7f398c00f070 2024-04-24T01:24:22.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.750+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2265104c0 con 0x55f2265032b0 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.752+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94498513291440] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.752+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.752+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94498513289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226511c10 con 0x55f2265032b0 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.752+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2265125d0 con 0x55f22650c630 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.753+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94498513289504] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.753+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.754+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94498513295200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226511b80 con 0x55f22650c630 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.754+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226513440 con 0x7f398c00f070 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.754+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94498513295200] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.755+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.755+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94498513301392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226513860 con 0x7f398c00f070 2024-04-24T01:24:22.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.755+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226513e80 con 0x55f2265032b0 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.756+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.756+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94498513304496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f2265145a0 con 0x55f2265032b0 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.756+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226514e70 con 0x55f226507a30 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.756+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94498513301392] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.757+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94498513304496] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.758+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.758+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94498513308096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226514160 con 0x55f226507a30 2024-04-24T01:24:22.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.758+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226515930 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.759+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.759+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94498513310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226516200 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.759+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226516cb0 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.759+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94498513308096] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94498513310720] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94498513302448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226515d50 con 0x55f226507a30 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=0 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=1 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=2 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=3 2024-04-24T01:24:22.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=4 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=5 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.760+0000 7f39a7d2f800 20 add_watcher() i=6 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94498513302448] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a7d2f800 20 add_watcher() i=7 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a7d2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226519db0 con 0x55f2265032b0 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.761+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94498513315728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226517230 con 0x55f2265032b0 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.762+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94498513315728] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f3859fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:22.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 5 note: GC not initialized 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f3858fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 20 Filter name: none 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f37d27fc640 20 reqs_thread_entry: start 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.763+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654cff0 con 0x7f398c00f070 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.764+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.764+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.764+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.764+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654d880 con 0x55f22650c630 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:22.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654d410 con 0x7f398c00f070 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.765+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654f340 con 0x55f22650c630 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(65 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 4.39 4:9d52cac0:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654ed90 con 0x55f22650c630 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 4.14 4:28c59c07:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226553cb0 con 0x55f22650c630 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 4.12 4:4beb7fae:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2265568f0 con 0x55f2265032b0 2024-04-24T01:24:22.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 4.3c 4:3df9a53c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226553cb0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 4.9 4:913e3abf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226553cb0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 4.1b 4:d914e85f:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22655dcc0 con 0x7f398c00f070 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2265606d0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(66 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 4.22 4:455fdea3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f22654e820 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 4.b 4:d0af6d59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f2265639a0 con 0x7f398c00f070 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(68 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.766+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 4.18 4:1bc38953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226566350 con 0x7f398c00f070 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 4.1f 4:fb61a447:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f226566cc0 con 0x55f22650c630 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(69 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(70 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(71 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(73 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(75 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.767+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(76 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.768+0000 7f3859fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.768+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94498513315728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f2265032b0 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.769+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94498513315728] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.769+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94498513291440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x7f398c00f070 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.770+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94498513291440] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.770+0000 7f39a7d2f800 20 remove_watcher() i=0 2024-04-24T01:24:22.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.770+0000 7f39a7d2f800 2 removed watcher, disabling cache 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.770+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94498513289504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f2265032b0 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.771+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94498513289504] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.771+0000 7f39a7d2f800 20 remove_watcher() i=1 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.771+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94498513295200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f22650c630 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.772+0000 7f399b2c4640 1 -- 172.21.15.169:0/684825701 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94498513295200] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c037040 con 0x55f22650c630 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.772+0000 7f39a7d2f800 20 remove_watcher() i=2 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.772+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94498513301392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x7f398c00f070 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.773+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94498513301392] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x7f398c00f070 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.773+0000 7f39a7d2f800 20 remove_watcher() i=3 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.773+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94498513304496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f2265032b0 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.774+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94498513304496] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399c00a4a0 con 0x55f2265032b0 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.774+0000 7f39a7d2f800 20 remove_watcher() i=4 2024-04-24T01:24:22.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.774+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94498513308096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.775+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94498513308096] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.775+0000 7f39a7d2f800 20 remove_watcher() i=5 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.775+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94498513310720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.776+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94498513310720] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.776+0000 7f39a7d2f800 20 remove_watcher() i=6 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.776+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94498513302448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f226535730 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a3ac5640 1 -- 172.21.15.169:0/684825701 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94498513302448] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f399409e070 con 0x55f226507a30 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 20 remove_watcher() i=7 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f226507a30 msgr2=0x55f226509e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f226507a30 0x55f226509e20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2265032b0 msgr2=0x55f226505770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2265032b0 0x55f226505770 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f398c00f070 msgr2=0x7f398c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f398c00f070 0x7f398c02e910 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f22650c630 msgr2=0x55f22650eaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f22650c630 0x55f22650eaf0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f386c0369a0 msgr2=0x7f386c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f386c0369a0 0x7f386c038e60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55f2264d57f0 tx=0x7f398c010000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a42c6640 1 -- 172.21.15.169:0/684825701 reap_dead start 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 msgr2=0x55f2264f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f399408db60 tx=0x7f399408dab0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 shutdown_connections 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.777+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/684825701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264f0940 0x55f2264f7d30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 >> 172.21.15.169:0/684825701 conn(0x55f2264eccf0 msgr2=0x55f2264ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 shutdown_connections 2024-04-24T01:24:22.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/684825701 wait complete. 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 msgr2=0x7f387c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 0x7f387c038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x55f2264cce60 tx=0x7f398c00f000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 msgr2=0x55f2264e3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3994076b10 tx=0x7f39940776a0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 shutdown_connections 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f387c036900 0x7f387c038dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/329428980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2264e3850 0x55f2264e3c70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 >> 172.21.15.169:0/329428980 conn(0x55f2264d78f0 msgr2=0x55f2264d7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 shutdown_connections 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/329428980 wait complete. 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f2264ce8b0 msgr2=0x55f2264d0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f2264ce8b0 0x55f2264d0ca0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2263cd220 msgr2=0x55f2264cc010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f2263cd220 0x55f2264cc010 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f2264d2840 msgr2=0x55f2264d4c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f2264d2840 0x55f2264d4c90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f388c036950 msgr2=0x7f388c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f388c036950 0x7f388c038e10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f398c000f60 tx=0x7f398c001370 comp rx=0 tx=0).stop 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 msgr2=0x55f2264c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 --2- 172.21.15.169:0/3609312497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f2263ca8f0 0x55f2264c4dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3994052540 tx=0x7f3994003020 comp rx=0 tx=0).stop 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a42c6640 1 -- 172.21.15.169:0/3609312497 reap_dead start 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 shutdown_connections 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 >> 172.21.15.169:0/3609312497 conn(0x55f2263c4320 msgr2=0x55f2263c9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.778+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 shutdown_connections 2024-04-24T01:24:22.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.779+0000 7f39a7d2f800 1 -- 172.21.15.169:0/3609312497 wait complete. 2024-04-24T01:24:22.796 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0d63dfd5-2f76-4ac8-9c68-cc94814f72e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:24:22.164484Z","creation_time":"2024-04-24T01:24:22.157363Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:24:22.797 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:24:22.164484Z', 'creation_time': '2024-04-24T01:24:22.157363Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:24:22.797 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:24:22.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-04-24T01:24:22.797 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-04-24T01:24:22.880 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:22.880 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.879+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.879+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.879+0000 7f210432f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5556f2212370 0x5556f2214760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.879+0000 7f210432f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5556f20ccd40 con 0x5556f220c100 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.879+0000 7f210432f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5556f209f4d0 con 0x5556f2212370 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20f77ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5556f2212370 0x5556f2214760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20fffae640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5556f220c100 0x5556f220c520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34796/0 (socket says 172.21.15.169:34796) 2024-04-24T01:24:22.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20f77ad640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5556f2212370 0x5556f2214760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34336/0 (socket says 172.21.15.169:34336) 2024-04-24T01:24:22.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20fffae640 1 -- 172.21.15.169:0/2578519111 learned_addr learned my addr 172.21.15.169:0/2578519111 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:22.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20f77ad640 1 -- 172.21.15.169:0/2578519111 >> v1:172.21.15.142:6789/0 conn(0x5556f220c100 legacy=0x5556f220c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.880+0000 7f20f77ad640 1 -- 172.21.15.169:0/2578519111 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f20cb590 con 0x5556f2212370 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.882+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2578519111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2212370 0x5556f2214760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f20e800a470 tx=0x7f20e801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b68a3f86827af8cf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.882+0000 7f20ff7ad640 1 -- 172.21.15.169:0/2578519111 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8057070 con 0x5556f2212370 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.882+0000 7f20ff7ad640 1 -- 172.21.15.169:0/2578519111 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20e8052570 con 0x5556f2212370 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.882+0000 7f20ff7ad640 1 -- 172.21.15.169:0/2578519111 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8052870 con 0x5556f2212370 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 -- 172.21.15.169:0/2578519111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2212370 msgr2=0x5556f2214760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 --2- 172.21.15.169:0/2578519111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2212370 0x5556f2214760 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f20e800a470 tx=0x7f20e801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:22.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 -- 172.21.15.169:0/2578519111 shutdown_connections 2024-04-24T01:24:22.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 --2- 172.21.15.169:0/2578519111 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2212370 0x5556f2214760 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 -- 172.21.15.169:0/2578519111 >> 172.21.15.169:0/2578519111 conn(0x5556f2207b00 msgr2=0x5556f2209f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 -- 172.21.15.169:0/2578519111 shutdown_connections 2024-04-24T01:24:22.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.883+0000 7f210432f800 1 -- 172.21.15.169:0/2578519111 wait complete. 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.894+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.894+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.894+0000 7f210432f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.894+0000 7f210432f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5556f21593c0 con 0x5556f220c100 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34348/0 (socket says 172.21.15.169:34348) 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f20fffae640 1 -- 172.21.15.169:0/2404266250 learned_addr learned my addr 172.21.15.169:0/2404266250 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f20fffae640 1 -- 172.21.15.169:0/2404266250 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f22ff660 con 0x5556f220c100 2024-04-24T01:24:22.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f20fffae640 1 --2- 172.21.15.169:0/2404266250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f20f0001e10 tx=0x7f20f000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d930d3e2c49a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f1fede0b640 1 -- 172.21.15.169:0/2404266250 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0012020 con 0x5556f220c100 2024-04-24T01:24:22.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f1fede0b640 1 -- 172.21.15.169:0/2404266250 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f000e5a0 con 0x5556f220c100 2024-04-24T01:24:22.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.895+0000 7f1fede0b640 1 -- 172.21.15.169:0/2404266250 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f000e8e0 con 0x5556f220c100 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 -- 172.21.15.169:0/2404266250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 msgr2=0x5556f22ff090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 --2- 172.21.15.169:0/2404266250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f20f0001e10 tx=0x7f20f000b780 comp rx=0 tx=0).stop 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 -- 172.21.15.169:0/2404266250 shutdown_connections 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 --2- 172.21.15.169:0/2404266250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f22ff090 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 -- 172.21.15.169:0/2404266250 >> 172.21.15.169:0/2404266250 conn(0x5556f2207b00 msgr2=0x5556f22fa9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 -- 172.21.15.169:0/2404266250 shutdown_connections 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 -- 172.21.15.169:0/2404266250 wait complete. 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.896+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f210432f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f2306c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f210432f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5556f2214fa0 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f2306c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f2306c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34364/0 (socket says 172.21.15.169:34364) 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f20fffae640 1 -- 172.21.15.169:0/348398654 learned_addr learned my addr 172.21.15.169:0/348398654 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f20fffae640 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f23071d0 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f20fffae640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f2306c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b7c0 tx=0x7f20f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f1fe7fff640 1 -- 172.21.15.169:0/348398654 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0012030 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f1fe7fff640 1 -- 172.21.15.169:0/348398654 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f0001470 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f1fe7fff640 1 -- 172.21.15.169:0/348398654 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f001a8d0 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556f2307460 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.897+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f230a110 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.898+0000 7f1fe7fff640 1 -- 172.21.15.169:0/348398654 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20f0015020 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.898+0000 7f1fe7fff640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fe8036950 0x7f1fe8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.898+0000 7f1fe7fff640 1 -- 172.21.15.169:0/348398654 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f20f0020030 con 0x5556f220c100 2024-04-24T01:24:22.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f20f77ad640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fe8036950 0x7f1fe8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2212370 0x5556f230ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f230e410 con 0x5556f2212370 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f21007af640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2212370 0x5556f230ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f20f77ad640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fe8036950 0x7f1fe8038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e8054000 tx=0x7f20e804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f21007af640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2212370 0x5556f230ded0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f21007af640 1 -- 172.21.15.169:0/348398654 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2212370 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.899+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f230b4a0 con 0x5556f2212370 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.900+0000 7f21007af640 1 -- 172.21.15.169:0/348398654 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2212370 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.900+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2310760 0x5556f2312b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.900+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2313240 con 0x5556f2310760 2024-04-24T01:24:22.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.900+0000 7f20fffae640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2310760 0x5556f2312b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.900+0000 7f20fffae640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2310760 0x5556f2312b50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f20fffae640 1 -- 172.21.15.169:0/348398654 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20f0018430 con 0x5556f2310760 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f230f710 con 0x5556f2212370 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f21007af640 1 -- 172.21.15.169:0/348398654 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2212370 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5556f23146f0 0x5556f2316b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f23172a0 con 0x5556f23146f0 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f20f77ad640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5556f23146f0 0x5556f2316b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.901+0000 7f20f77ad640 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5556f23146f0 0x5556f2316b40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f20f77ad640 1 -- 172.21.15.169:0/348398654 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20e8052a40 con 0x5556f23146f0 2024-04-24T01:24:22.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f210432f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f210432f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5556f20ff6b0 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.902+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34370/0 (socket says 172.21.15.169:34370) 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f20fffae640 1 -- 172.21.15.169:0/3022664850 learned_addr learned my addr 172.21.15.169:0/3022664850 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f20fffae640 1 -- 172.21.15.169:0/3022664850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f2325fb0 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f20fffae640 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f20f004ae10 tx=0x7f20f0045f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f1fe57fa640 1 -- 172.21.15.169:0/3022664850 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0044840 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f1fe57fa640 1 -- 172.21.15.169:0/3022664850 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f003b070 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556f2326a20 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f1fe57fa640 1 -- 172.21.15.169:0/3022664850 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f00165e0 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.903+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f2326a20 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f1fe57fa640 1 -- 172.21.15.169:0/3022664850 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20f0041040 con 0x5556f2325650 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f1fe57fa640 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 0x7f1fd8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f1fe57fa640 1 -- 172.21.15.169:0/3022664850 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f20f0049d50 con 0x5556f2325650 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f20f77ad640 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 0x7f1fd8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f20f77ad640 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 0x7f1fd8038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5556f230ed10 tx=0x7f20e8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.904+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f210432f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f210432f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5556f22ff9e0 con 0x5556f2332670 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34374/0 (socket says 172.21.15.169:34374) 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f20fffae640 1 -- 172.21.15.169:0/3923472402 learned_addr learned my addr 172.21.15.169:0/3923472402 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f20fffae640 1 -- 172.21.15.169:0/3923472402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f2333060 con 0x5556f2332670 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f20fffae640 1 --2- 172.21.15.169:0/3923472402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f20f0046010 tx=0x7f20f002d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f9f96384e0bbed server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f1fdeffd640 1 -- 172.21.15.169:0/3923472402 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0026d60 con 0x5556f2332670 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f1fdeffd640 1 -- 172.21.15.169:0/3923472402 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f004c0c0 con 0x5556f2332670 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.905+0000 7f1fdeffd640 1 -- 172.21.15.169:0/3923472402 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f00363f0 con 0x5556f2332670 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- 172.21.15.169:0/3923472402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 msgr2=0x5556f2332a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 --2- 172.21.15.169:0/3923472402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f20f0046010 tx=0x7f20f002d3f0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- 172.21.15.169:0/3923472402 shutdown_connections 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 --2- 172.21.15.169:0/3923472402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2332a90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- 172.21.15.169:0/3923472402 >> 172.21.15.169:0/3923472402 conn(0x5556f232e940 msgr2=0x5556f232c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- 172.21.15.169:0/3923472402 shutdown_connections 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- 172.21.15.169:0/3923472402 wait complete. 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 Processor -- start 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- start start 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2339a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.906+0000 7f210432f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5556f2333730 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2339a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f20fffae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2339a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34384/0 (socket says 172.21.15.169:34384) 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 learned_addr learned my addr 172.21.15.169:0/2892329289 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f2339fc0 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f20fffae640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2339a80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20f002d430 tx=0x7f20f001cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f1fdd7fa640 1 -- 172.21.15.169:0/2892329289 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0071070 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f1fdd7fa640 1 -- 172.21.15.169:0/2892329289 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f004c5e0 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5556f2339fc0 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f1fdd7fa640 1 -- 172.21.15.169:0/2892329289 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20f0008ad0 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.907+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f2339fc0 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f1fdd7fa640 1 -- 172.21.15.169:0/2892329289 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20f0074070 con 0x5556f2332670 2024-04-24T01:24:22.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f1fdd7fa640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fc8036950 0x7f1fc8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f1fdd7fa640 1 -- 172.21.15.169:0/2892329289 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f20f0077ca0 con 0x5556f2332670 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fc8036950 0x7f1fc8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2345170 0x5556f23475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2347d30 con 0x5556f2345170 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.908+0000 7f21007af640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2345170 0x5556f23475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fc8036950 0x7f1fc8038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20e8052fd0 tx=0x7f20e804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f21007af640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2345170 0x5556f23475e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 realm 2024-04-24T01:24:22.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348190 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348a30 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.909+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2349b30 0x5556f234bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234c4a0 con 0x5556f2349b30 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f20fffae640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2349b30 0x5556f234bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f20fffae640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2349b30 0x5556f234bf20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 20 searching for the correct realm 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5556f234e4f0 0x5556f23509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.910+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2351080 con 0x5556f234e4f0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5556f234e4f0 0x5556f23509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5556f234e4f0 0x5556f23509b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f20f77ad640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f20e8076040 0x7f20e8083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:22.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2351080 con 0x7f20e8076040 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.911+0000 7f21007af640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f20e8076040 0x7f20e8083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f20e8076040 0x7f20e8083410 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2349b30 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2345170 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2345170 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.912+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2349b30 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5556f2348dd0 con 0x5556f2349b30 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x7f20e8076040 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x5556f234e4f0 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.913+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x5556f2345170 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x5556f2349b30 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x5556f2345170 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x7f20e8076040 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.914+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20f0085040 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2349b30 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.915+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2345170 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2345170 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.916+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2349b30 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x7f20e8076040 2024-04-24T01:24:22.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2345170 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.917+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2349b30 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2349b30 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.918+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x7f20e8076040 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f234e4f0 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2349b30 2024-04-24T01:24:22.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x5556f2345170 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.919+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f20e8090040 con 0x7f20e8076040 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234cdf0 con 0x5556f2345170 2024-04-24T01:24:22.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234cdf0 con 0x5556f2345170 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234cdc0 con 0x7f20e8076040 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 zone default found 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 4 Realm: () 2024-04-24T01:24:22.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 zonegroup default 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.920+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234d1e0 con 0x5556f2349b30 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f234cdd0 con 0x5556f234e4f0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2352ee0 con 0x5556f234e4f0 2024-04-24T01:24:22.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 started sync module instance, tier type = 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.921+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2352380 con 0x7f20e8076040 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.922+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.923+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93831919118240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2352380 con 0x7f20e8076040 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.923+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23538a0 con 0x5556f2345170 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.924+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93831919118240] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.924+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.924+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93831919116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23538a0 con 0x5556f2345170 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.924+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23542a0 con 0x5556f234e4f0 2024-04-24T01:24:22.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.925+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.925+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93831919123888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2354b40 con 0x5556f234e4f0 2024-04-24T01:24:22.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.925+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23555c0 con 0x7f20e8076040 2024-04-24T01:24:22.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.925+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93831919116464] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.926+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.926+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93831919128752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23559e0 con 0x7f20e8076040 2024-04-24T01:24:22.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.926+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23563e0 con 0x5556f2345170 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.926+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93831919123888] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.927+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.927+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93831919126160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23563a0 con 0x5556f2345170 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.927+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2356df0 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.927+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93831919128752] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.928+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.928+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93831919135040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23571e0 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.928+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2357ba0 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.928+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93831919126160] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.929+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93831919135040] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.929+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.929+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93831919132400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2357ba0 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.929+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2358440 con 0x5556f2349b30 2024-04-24T01:24:22.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93831919140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2358860 con 0x5556f2349b30 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=0 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=1 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=2 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=3 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=4 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=5 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93831919132400] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.930+0000 7f210432f800 20 add_watcher() i=6 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.931+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93831919140752] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.931+0000 7f210432f800 20 add_watcher() i=7 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.931+0000 7f210432f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.931+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2358860 con 0x5556f2345170 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.932+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.932+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93831919141808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23591c0 con 0x5556f2345170 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93831919141808] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f1fb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 5 note: GC not initialized 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f1fb4fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 20 Filter name: none 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f1f2e7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.933+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f238e630 con 0x5556f2345170 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f238f020 con 0x5556f2345170 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2390030 con 0x7f20e8076040 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.934+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f238d940 con 0x7f20e8076040 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f238fff0 con 0x5556f234e4f0 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 4.39 4:9d52cac0:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f238faf0 con 0x5556f234e4f0 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 4.14 4:28c59c07:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2394b20 con 0x5556f234e4f0 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 4.12 4:4beb7fae:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2397480 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 4.3c 4:3df9a53c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2399cf0 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 4.9 4:913e3abf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2399cf0 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 4.1b 4:d914e85f:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f239eec0 con 0x7f20e8076040 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(69 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f23a1490 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 4.22 4:455fdea3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2395070 con 0x5556f2345170 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 4.b 4:d0af6d59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f2396ef0 con 0x7f20e8076040 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.935+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:76 4.18 4:1bc38953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f23a7a20 con 0x7f20e8076040 2024-04-24T01:24:22.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 4.1f 4:fb61a447:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5556f23aa8e0 con 0x5556f234e4f0 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(71 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(68 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(73 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(74 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(75 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.936+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(76 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.937+0000 7f1fb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.937+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93831919141808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f23a1490 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.938+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93831919141808] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.938+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93831919118240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x7f20e8076040 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.939+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93831919118240] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.939+0000 7f210432f800 20 remove_watcher() i=0 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.939+0000 7f210432f800 2 removed watcher, disabling cache 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.939+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93831919116464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f2345170 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.940+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93831919116464] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.940+0000 7f210432f800 20 remove_watcher() i=1 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.940+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93831919123888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f234e4f0 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.941+0000 7f20f77ad640 1 -- 172.21.15.169:0/2892329289 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93831919123888] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20e8081070 con 0x5556f234e4f0 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.941+0000 7f210432f800 20 remove_watcher() i=2 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.941+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93831919128752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x7f20e8076040 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.942+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93831919128752] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x7f20e8076040 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.942+0000 7f210432f800 20 remove_watcher() i=3 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.942+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93831919126160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f2345170 2024-04-24T01:24:22.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.943+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93831919126160] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f800a4a0 con 0x5556f2345170 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.943+0000 7f210432f800 20 remove_watcher() i=4 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.943+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93831919135040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.944+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93831919135040] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.944+0000 7f210432f800 20 remove_watcher() i=5 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.944+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93831919132400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.945+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93831919132400] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.945+0000 7f210432f800 20 remove_watcher() i=6 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.945+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93831919140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5556f2377300 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f20fffae640 1 -- 172.21.15.169:0/2892329289 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93831919140752] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20f0073030 con 0x5556f2349b30 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 20 remove_watcher() i=7 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2349b30 msgr2=0x5556f234bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2349b30 0x5556f234bf20 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2345170 msgr2=0x5556f23475e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2345170 0x5556f23475e0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f20e8076040 msgr2=0x7f20e8083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f20e8076040 0x7f20e8083410 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5556f234e4f0 msgr2=0x5556f23509b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5556f234e4f0 0x5556f23509b0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fc8036950 msgr2=0x7f1fc8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fc8036950 0x7f1fc8038e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f20e8052fd0 tx=0x7f20e804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 msgr2=0x5556f2339a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 --2- 172.21.15.169:0/2892329289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2332670 0x5556f2339a80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20f002d430 tx=0x7f20f001cf40 comp rx=0 tx=0).stop 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 reap_dead start 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f21007af640 1 -- 172.21.15.169:0/2892329289 reap_dead start 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 shutdown_connections 2024-04-24T01:24:22.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 >> 172.21.15.169:0/2892329289 conn(0x5556f232e940 msgr2=0x5556f232bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 shutdown_connections 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.946+0000 7f210432f800 1 -- 172.21.15.169:0/2892329289 wait complete. 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 msgr2=0x7f1fd8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 0x7f1fd8038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5556f230ed10 tx=0x7f20e8005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 msgr2=0x5556f2325a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f20f004ae10 tx=0x7f20f0045f80 comp rx=0 tx=0).stop 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 shutdown_connections 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fd8036900 0x7f1fd8038dc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/3022664850 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f2325650 0x5556f2325a70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 >> 172.21.15.169:0/3022664850 conn(0x5556f23196f0 msgr2=0x5556f2319af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 shutdown_connections 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/3022664850 wait complete. 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2310760 msgr2=0x5556f2312b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5556f2310760 0x5556f2312b50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2212370 msgr2=0x5556f230ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5556f2212370 0x5556f230ded0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5556f23146f0 msgr2=0x5556f2316b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5556f23146f0 0x5556f2316b40 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fe8036950 msgr2=0x7f1fe8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1fe8036950 0x7f1fe8038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f20e8054000 tx=0x7f20e804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 msgr2=0x5556f2306c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 --2- 172.21.15.169:0/348398654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5556f220c100 0x5556f2306c90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20f000b7c0 tx=0x7f20f0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f21007af640 1 -- 172.21.15.169:0/348398654 reap_dead start 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 shutdown_connections 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 >> 172.21.15.169:0/348398654 conn(0x5556f2207b00 msgr2=0x5556f22f9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 shutdown_connections 2024-04-24T01:24:22.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:22.947+0000 7f210432f800 1 -- 172.21.15.169:0/348398654 wait complete. 2024-04-24T01:24:22.970 INFO:teuthology.orchestra.run.smithi169.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0d63dfd5-2f76-4ac8-9c68-cc94814f72e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:24:22.164484Z","creation_time":"2024-04-24T01:24:22.157363Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-04-24T01:24:22.971 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:24:22.164484Z', 'creation_time': '2024-04-24T01:24:22.157363Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T01:24:22.977 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:24:22.977 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:22.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:22.977 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:24:23.054 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.055 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.053+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.053+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.053+0000 7f094f52d800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559db656d7a0 0x559db656dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.053+0000 7f094f52d800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559db642dd40 con 0x559db656e100 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.053+0000 7f094f52d800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559db64004d0 con 0x559db656d7a0 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f094b2c5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559db656d7a0 0x559db656dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f094b2c5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559db656d7a0 0x559db656dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34396/0 (socket says 172.21.15.169:34396) 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f094b2c5640 1 -- 172.21.15.169:0/3023843079 learned_addr learned my addr 172.21.15.169:0/3023843079 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f0943fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x559db656e100 0x559db656e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34798/0 (socket says 172.21.15.169:34798) 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f094b2c5640 1 -- 172.21.15.169:0/3023843079 >> v1:172.21.15.142:6789/0 conn(0x559db656e100 legacy=0x559db656e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.054+0000 7f094b2c5640 1 -- 172.21.15.169:0/3023843079 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db642c590 con 0x559db656d7a0 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.056+0000 7f094b2c5640 1 --2- 172.21.15.169:0/3023843079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db656dbc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a520 tx=0x7f093c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d1c77be7bbec21 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.056+0000 7f094aac4640 1 -- 172.21.15.169:0/3023843079 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c057070 con 0x559db656d7a0 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.056+0000 7f094aac4640 1 -- 172.21.15.169:0/3023843079 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c052570 con 0x559db656d7a0 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.056+0000 7f094aac4640 1 -- 172.21.15.169:0/3023843079 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c052870 con 0x559db656d7a0 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 -- 172.21.15.169:0/3023843079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 msgr2=0x559db656dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 --2- 172.21.15.169:0/3023843079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db656dbc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f093c00a520 tx=0x7f093c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 -- 172.21.15.169:0/3023843079 shutdown_connections 2024-04-24T01:24:23.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 --2- 172.21.15.169:0/3023843079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db656dbc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 -- 172.21.15.169:0/3023843079 >> 172.21.15.169:0/3023843079 conn(0x559db6569320 msgr2=0x559db656b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 -- 172.21.15.169:0/3023843079 shutdown_connections 2024-04-24T01:24:23.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.057+0000 7f094f52d800 1 -- 172.21.15.169:0/3023843079 wait complete. 2024-04-24T01:24:23.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.068+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.068+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.068+0000 7f094f52d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.068+0000 7f094f52d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559db64ba3c0 con 0x559db656d7a0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34410/0 (socket says 172.21.15.169:34410) 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f094b2c5640 1 -- 172.21.15.169:0/3095349394 learned_addr learned my addr 172.21.15.169:0/3095349394 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f094b2c5640 1 -- 172.21.15.169:0/3095349394 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db66629d0 con 0x559db656d7a0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f094b2c5640 1 --2- 172.21.15.169:0/3095349394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f093c055040 tx=0x7f093c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca431ca0cf39114 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f083960a640 1 -- 172.21.15.169:0/3095349394 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c057040 con 0x559db656d7a0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f083960a640 1 -- 172.21.15.169:0/3095349394 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c052870 con 0x559db656d7a0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.069+0000 7f083960a640 1 -- 172.21.15.169:0/3095349394 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c052b90 con 0x559db656d7a0 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 -- 172.21.15.169:0/3095349394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 msgr2=0x559db6662400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 --2- 172.21.15.169:0/3095349394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f093c055040 tx=0x7f093c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 -- 172.21.15.169:0/3095349394 shutdown_connections 2024-04-24T01:24:23.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 --2- 172.21.15.169:0/3095349394 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6662400 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 -- 172.21.15.169:0/3095349394 >> 172.21.15.169:0/3095349394 conn(0x559db6569320 msgr2=0x559db665dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 -- 172.21.15.169:0/3095349394 shutdown_connections 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 -- 172.21.15.169:0/3095349394 wait complete. 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.070+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094f52d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6669f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094f52d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559db656ef60 con 0x559db656d7a0 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6669f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6669f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34422/0 (socket says 172.21.15.169:34422) 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094b2c5640 1 -- 172.21.15.169:0/1820877825 learned_addr learned my addr 172.21.15.169:0/1820877825 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094b2c5640 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db666a480 con 0x559db656d7a0 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6669f40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f093c052540 tx=0x7f093c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f0837e07640 1 -- 172.21.15.169:0/1820877825 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c073070 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f0837e07640 1 -- 172.21.15.169:0/1820877825 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c05d570 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559db666a710 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f0837e07640 1 -- 172.21.15.169:0/1820877825 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c057070 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.071+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db666d320 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f0837e07640 1 -- 172.21.15.169:0/1820877825 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f093c076070 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f0837e07640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0830036950 0x7f0830038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f0837e07640 1 -- 172.21.15.169:0/1820877825 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f093c08dcc0 con 0x559db656d7a0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f0943fff640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0830036950 0x7f0830038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db656e100 0x559db66710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.072+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db6671620 con 0x559db656e100 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094bac6640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db656e100 0x559db66710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f0943fff640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0830036950 0x7f0830038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0934000f60 tx=0x7f0934001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094bac6640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db656e100 0x559db66710e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094bac6640 1 -- 172.21.15.169:0/1820877825 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db656e100 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db666e6b0 con 0x559db656e100 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094bac6640 1 -- 172.21.15.169:0/1820877825 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f094400a4a0 con 0x559db656e100 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db6673910 0x559db6675d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.073+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66763f0 con 0x559db6673910 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.074+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db6673910 0x559db6675d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.074+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db6673910 0x559db6675d00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.074+0000 7f094b2c5640 1 -- 172.21.15.169:0/1820877825 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f093c075030 con 0x559db6673910 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.074+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66728c0 con 0x559db656e100 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f094bac6640 1 -- 172.21.15.169:0/1820877825 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f094400a4a0 con 0x559db656e100 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559db66778a0 0x559db6679cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db667a450 con 0x559db66778a0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f0943fff640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559db66778a0 0x559db6679cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f0943fff640 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559db66778a0 0x559db6679cf0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.075+0000 7f0943fff640 1 -- 172.21.15.169:0/1820877825 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f093400f690 con 0x559db66778a0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094f52d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094f52d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559db64606b0 con 0x559db66888b0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34438/0 (socket says 172.21.15.169:34438) 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094b2c5640 1 -- 172.21.15.169:0/650336425 learned_addr learned my addr 172.21.15.169:0/650336425 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094b2c5640 1 -- 172.21.15.169:0/650336425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db6689210 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.076+0000 7f094b2c5640 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f093c052fd0 tx=0x7f093c0665a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f0835602640 1 -- 172.21.15.169:0/650336425 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c092070 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f0835602640 1 -- 172.21.15.169:0/650336425 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c007f60 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559db6689c80 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f0835602640 1 -- 172.21.15.169:0/650336425 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c0773b0 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db668a180 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f0835602640 1 -- 172.21.15.169:0/650336425 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f093c077550 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.077+0000 7f0835602640 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 0x7f0824038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f0835602640 1 -- 172.21.15.169:0/650336425 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f093c07f0e0 con 0x559db66888b0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f0943fff640 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 0x7f0824038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f0943fff640 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 0x7f0824038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x559db6671ec0 tx=0x7f093400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094f52d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094f52d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559db6662c90 con 0x559db6695a60 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34454/0 (socket says 172.21.15.169:34454) 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094b2c5640 1 -- 172.21.15.169:0/823113502 learned_addr learned my addr 172.21.15.169:0/823113502 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.078+0000 7f094b2c5640 1 -- 172.21.15.169:0/823113502 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db6696410 con 0x559db6695a60 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094b2c5640 1 --2- 172.21.15.169:0/823113502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f093c079e50 tx=0x7f093c097af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481f74a0f1c76a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f082effd640 1 -- 172.21.15.169:0/823113502 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c0a7070 con 0x559db6695a60 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f082effd640 1 -- 172.21.15.169:0/823113502 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c08da80 con 0x559db6695a60 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f082effd640 1 -- 172.21.15.169:0/823113502 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c08fe10 con 0x559db6695a60 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 -- 172.21.15.169:0/823113502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 msgr2=0x559db6695e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 --2- 172.21.15.169:0/823113502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f093c079e50 tx=0x7f093c097af0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 -- 172.21.15.169:0/823113502 shutdown_connections 2024-04-24T01:24:23.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 --2- 172.21.15.169:0/823113502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db6695e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 -- 172.21.15.169:0/823113502 >> 172.21.15.169:0/823113502 conn(0x559db6691d30 msgr2=0x559db668fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 -- 172.21.15.169:0/823113502 shutdown_connections 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 -- 172.21.15.169:0/823113502 wait complete. 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.079+0000 7f094f52d800 1 Processor -- start 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094f52d800 1 -- start start 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094f52d800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db669cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094f52d800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559db6696b20 con 0x559db6695a60 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db669cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094b2c5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db669cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34464/0 (socket says 172.21.15.169:34464) 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 learned_addr learned my addr 172.21.15.169:0/1320651253 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db669d2c0 con 0x559db6695a60 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.080+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db669cd80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f093c079e50 tx=0x7f093c06eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 -- 172.21.15.169:0/1320651253 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c0766f0 con 0x559db6695a60 2024-04-24T01:24:23.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 -- 172.21.15.169:0/1320651253 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c05cbd0 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559db669d2c0 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 -- 172.21.15.169:0/1320651253 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f093c076890 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db669d2c0 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 -- 172.21.15.169:0/1320651253 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f093c0be060 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0814036950 0x7f0814038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.081+0000 7f082d7fa640 1 -- 172.21.15.169:0/1320651253 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f093c0adcc0 con 0x559db6695a60 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f0943fff640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0814036950 0x7f0814038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db66a84e0 0x559db66aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66ab0f0 con 0x559db66a84e0 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094bac6640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db66a84e0 0x559db66aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f0943fff640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0814036950 0x7f0814038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559db667a850 tx=0x7f0934010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094bac6640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db66a84e0 0x559db66aa9a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 20 realm 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.082+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66ab500 con 0x559db66a84e0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66abdd0 con 0x559db66a84e0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db66acc60 0x559db66af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66af7b0 con 0x559db66acc60 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.083+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db66acc60 0x559db66af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094b2c5640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db66acc60 0x559db66af050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094f52d800 20 searching for the correct realm 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559db66b1860 0x559db66b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66b43f0 con 0x559db66b1860 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f0943fff640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559db66b1860 0x559db66b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.084+0000 7f0943fff640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559db66b1860 0x559db66b3d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f0943fff640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f093400f070 0x7f093402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66b43f0 con 0x7f093400f070 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f094bac6640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f093400f070 0x7f093402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f094bac6640 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f093400f070 0x7f093402e910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.085+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.086+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x7f093400f070 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.087+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.088+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x7f093400f070 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.089+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.090+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x7f093400f070 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.091+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.092+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x7f093400f070 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66b1860 2024-04-24T01:24:23.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66acc60 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x559db66a84e0 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.093+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559db66ac170 con 0x7f093400f070 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b0160 con 0x559db66a84e0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b0160 con 0x559db66a84e0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b0130 con 0x7f093400f070 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 zone default found 2024-04-24T01:24:23.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 4 Realm: () 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 zonegroup default 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.094+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b0550 con 0x559db66acc60 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b6250 con 0x559db66b1860 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66b65f0 con 0x559db66b1860 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.095+0000 7f094f52d800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.096+0000 7f094f52d800 20 started sync module instance, tier type = 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.096+0000 7f094f52d800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.096+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b0dc0 con 0x7f093400f070 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.097+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.097+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135858714432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b6990 con 0x7f093400f070 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.097+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b71e0 con 0x559db66a84e0 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.098+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94135858714432] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.098+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.098+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135858719120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b7260 con 0x559db66a84e0 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.098+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b7ab0 con 0x559db66b1860 2024-04-24T01:24:23.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.099+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.099+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135858721888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b8350 con 0x559db66b1860 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.099+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b8e20 con 0x7f093400f070 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.099+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94135858719120] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.100+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94135858721888] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.100+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.100+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135858724512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b6db0 con 0x7f093400f070 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.100+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b96f0 con 0x559db66a84e0 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.101+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94135858724512] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.101+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.101+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135858727184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66b96a0 con 0x559db66a84e0 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.101+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66ba100 con 0x559db66acc60 2024-04-24T01:24:23.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.102+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.102+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94135858727184] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.102+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135858732112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66ba4f0 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.103+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66baeb0 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.103+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94135858732112] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.104+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.104+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135858729456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66bb750 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.104+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66bc020 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94135858729456] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135858739024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66bbb70 con 0x559db66acc60 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=0 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=1 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=2 2024-04-24T01:24:23.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=3 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=4 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=5 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=6 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94135858739024] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 20 add_watcher() i=7 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.105+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66bb360 con 0x559db66a84e0 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.106+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.106+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135858742288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66bcdc0 con 0x559db66a84e0 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94135858742288] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f0801fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 5 note: GC not initialized 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f0800fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 20 Filter name: none 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f077a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.107+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f2970 con 0x7f093400f070 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f3200 con 0x559db66b1860 2024-04-24T01:24:23.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f2d90 con 0x7f093400f070 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.108+0000 7f094f52d800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f2d90 con 0x559db66b1860 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(65 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 4.39 4:9d52cac0:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f4690 con 0x559db66b1860 2024-04-24T01:24:23.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 4.14 4:28c59c07:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66f94e0 con 0x559db66b1860 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 4.12 4:4beb7fae:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66fc020 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 4.3c 4:3df9a53c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db66fe890 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 4.9 4:913e3abf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db67013f0 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 4.1b 4:d914e85f:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db6704240 con 0x7f093400f070 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db6707010 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 4.22 4:455fdea3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db6709a10 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 4.b 4:d0af6d59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db670c390 con 0x7f093400f070 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 4.18 4:1bc38953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db670eeb0 con 0x7f093400f070 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 4.1f 4:fb61a447:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559db6711990 con 0x559db66b1860 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(66 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.109+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(76 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(68 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(69 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(70 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(73 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(71 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.110+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(75 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.111+0000 7f0801fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.111+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135858742288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db6704240 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.112+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94135858742288] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.112+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135858714432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x7f093400f070 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.113+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94135858714432] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.113+0000 7f094f52d800 20 remove_watcher() i=0 2024-04-24T01:24:23.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.113+0000 7f094f52d800 2 removed watcher, disabling cache 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.113+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135858719120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66a84e0 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.114+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94135858719120] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.114+0000 7f094f52d800 20 remove_watcher() i=1 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.114+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135858721888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66b1860 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.115+0000 7f0943fff640 1 -- 172.21.15.169:0/1320651253 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94135858721888] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0934037040 con 0x559db66b1860 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.115+0000 7f094f52d800 20 remove_watcher() i=2 2024-04-24T01:24:23.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.116+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135858724512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x7f093400f070 2024-04-24T01:24:23.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.116+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94135858724512] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x7f093400f070 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.116+0000 7f094f52d800 20 remove_watcher() i=3 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.116+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135858727184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66a84e0 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.117+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94135858727184] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f094400a4a0 con 0x559db66a84e0 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.117+0000 7f094f52d800 20 remove_watcher() i=4 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.117+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135858732112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66acc60 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.118+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94135858732112] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.118+0000 7f094f52d800 20 remove_watcher() i=5 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.118+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135858729456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66acc60 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.119+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94135858729456] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.119+0000 7f094f52d800 20 remove_watcher() i=6 2024-04-24T01:24:23.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.119+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135858739024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559db66db0b0 con 0x559db66acc60 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094b2c5640 1 -- 172.21.15.169:0/1320651253 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94135858739024] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f093c094070 con 0x559db66acc60 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 20 remove_watcher() i=7 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db66acc60 msgr2=0x559db66af050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db66acc60 0x559db66af050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db66a84e0 msgr2=0x559db66aa9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db66a84e0 0x559db66aa9a0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f093400f070 msgr2=0x7f093402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f093400f070 0x7f093402e910 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559db66b1860 msgr2=0x559db66b3d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559db66b1860 0x559db66b3d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0814036950 msgr2=0x7f0814038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0814036950 0x7f0814038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x559db667a850 tx=0x7f0934010000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 msgr2=0x559db669cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094f52d800 1 --2- 172.21.15.169:0/1320651253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db6695a60 0x559db669cd80 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f093c079e50 tx=0x7f093c06eee0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.120+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 reap_dead start 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094bac6640 1 -- 172.21.15.169:0/1320651253 reap_dead start 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 shutdown_connections 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 >> 172.21.15.169:0/1320651253 conn(0x559db6691d30 msgr2=0x559db668f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 shutdown_connections 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1320651253 wait complete. 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 msgr2=0x7f0824038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 0x7f0824038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x559db6671ec0 tx=0x7f093400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 msgr2=0x559db6688cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f093c052fd0 tx=0x7f093c0665a0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 shutdown_connections 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0824036900 0x7f0824038dc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/650336425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db66888b0 0x559db6688cd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 >> 172.21.15.169:0/650336425 conn(0x559db667c950 msgr2=0x559db667cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 shutdown_connections 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/650336425 wait complete. 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db6673910 msgr2=0x559db6675d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559db6673910 0x559db6675d00 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db656e100 msgr2=0x559db66710e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559db656e100 0x559db66710e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559db66778a0 msgr2=0x559db6679cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559db66778a0 0x559db6679cf0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0830036950 msgr2=0x7f0830038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0830036950 0x7f0830038e10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0934000f60 tx=0x7f0934001370 comp rx=0 tx=0).stop 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 msgr2=0x559db6669f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 --2- 172.21.15.169:0/1820877825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559db656d7a0 0x559db6669f40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f093c052540 tx=0x7f093c003020 comp rx=0 tx=0).stop 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094bac6640 1 -- 172.21.15.169:0/1820877825 reap_dead start 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.121+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 shutdown_connections 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.122+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 >> 172.21.15.169:0/1820877825 conn(0x559db6569320 msgr2=0x559db665c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.122+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 shutdown_connections 2024-04-24T01:24:23.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.122+0000 7f094f52d800 1 -- 172.21.15.169:0/1820877825 wait complete. 2024-04-24T01:24:23.157 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0d63dfd5-2f76-4ac8-9c68-cc94814f72e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:24:22.164484Z","creation_time":"2024-04-24T01:24:22.157363Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:24:23.157 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:24:22.164484Z', 'creation_time': '2024-04-24T01:24:22.157363Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:24:23.157 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T01:24:23.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-04-24T01:24:23.158 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-04-24T01:24:23.241 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.241 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.240+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc208731800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559aa05137c0 0x559aa0513be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc208731800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559aa03d3d40 con 0x559aa0514120 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc208731800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559aa03a64d0 con 0x559aa05137c0 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc20442f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559aa05137c0 0x559aa0513be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc203c2e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x559aa0514120 0x559aa05145d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34812/0 (socket says 172.21.15.169:34812) 2024-04-24T01:24:23.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc203c2e640 1 -- 172.21.15.169:0/710020872 learned_addr learned my addr 172.21.15.169:0/710020872 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:23.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc20442f640 1 -- 172.21.15.169:0/710020872 >> v1:172.21.15.142:6789/0 conn(0x559aa0514120 legacy=0x559aa05145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.241+0000 7fc20442f640 1 -- 172.21.15.169:0/710020872 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa03d2590 con 0x559aa05137c0 2024-04-24T01:24:23.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.243+0000 7fc20442f640 1 --2- 172.21.15.169:0/710020872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0513be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00a470 tx=0x7fc1fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c70f93a684aedb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.243+0000 7fc20342d640 1 -- 172.21.15.169:0/710020872 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc057070 con 0x559aa05137c0 2024-04-24T01:24:23.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.243+0000 7fc20342d640 1 -- 172.21.15.169:0/710020872 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc04adc0 con 0x559aa05137c0 2024-04-24T01:24:23.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.243+0000 7fc20342d640 1 -- 172.21.15.169:0/710020872 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc052590 con 0x559aa05137c0 2024-04-24T01:24:23.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 -- 172.21.15.169:0/710020872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 msgr2=0x559aa0513be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 --2- 172.21.15.169:0/710020872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0513be0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc00a470 tx=0x7fc1fc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 -- 172.21.15.169:0/710020872 shutdown_connections 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 --2- 172.21.15.169:0/710020872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0513be0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 -- 172.21.15.169:0/710020872 >> 172.21.15.169:0/710020872 conn(0x559aa050f340 msgr2=0x559aa0511760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 -- 172.21.15.169:0/710020872 shutdown_connections 2024-04-24T01:24:23.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.244+0000 7fc208731800 1 -- 172.21.15.169:0/710020872 wait complete. 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.255+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.255+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc208731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc208731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559aa04603b0 con 0x559aa05137c0 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34486/0 (socket says 172.21.15.169:34486) 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc20442f640 1 -- 172.21.15.169:0/4288853689 learned_addr learned my addr 172.21.15.169:0/4288853689 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc20442f640 1 -- 172.21.15.169:0/4288853689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa06089f0 con 0x559aa05137c0 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc20442f640 1 --2- 172.21.15.169:0/4288853689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc055040 tx=0x7fc1fc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3f1102e5f033f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.256+0000 7fc0f260c640 1 -- 172.21.15.169:0/4288853689 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc057040 con 0x559aa05137c0 2024-04-24T01:24:23.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc0f260c640 1 -- 172.21.15.169:0/4288853689 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc062070 con 0x559aa05137c0 2024-04-24T01:24:23.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc0f260c640 1 -- 172.21.15.169:0/4288853689 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc05d470 con 0x559aa05137c0 2024-04-24T01:24:23.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 -- 172.21.15.169:0/4288853689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 msgr2=0x559aa0608420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 --2- 172.21.15.169:0/4288853689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc055040 tx=0x7fc1fc04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 -- 172.21.15.169:0/4288853689 shutdown_connections 2024-04-24T01:24:23.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 --2- 172.21.15.169:0/4288853689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa0608420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 -- 172.21.15.169:0/4288853689 >> 172.21.15.169:0/4288853689 conn(0x559aa050f340 msgr2=0x559aa0603d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 -- 172.21.15.169:0/4288853689 shutdown_connections 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.257+0000 7fc208731800 1 -- 172.21.15.169:0/4288853689 wait complete. 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc208731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa060ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc208731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559aa0514f80 con 0x559aa05137c0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa060ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa060ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34500/0 (socket says 172.21.15.169:34500) 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc20442f640 1 -- 172.21.15.169:0/408283894 learned_addr learned my addr 172.21.15.169:0/408283894 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc20442f640 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa06104a0 con 0x559aa05137c0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc20442f640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa060ff60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc01ce60 tx=0x7fc1fc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.258+0000 7fc0f0e09640 1 -- 172.21.15.169:0/408283894 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc06b070 con 0x559aa05137c0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc0f0e09640 1 -- 172.21.15.169:0/408283894 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc05d970 con 0x559aa05137c0 2024-04-24T01:24:23.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa0610730 con 0x559aa05137c0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc0f0e09640 1 -- 172.21.15.169:0/408283894 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc057070 con 0x559aa05137c0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa0613340 con 0x559aa05137c0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc0f0e09640 1 -- 172.21.15.169:0/408283894 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc1fc05dc90 con 0x559aa05137c0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc0f0e09640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0ec036950 0x7fc0ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.259+0000 7fc0f0e09640 1 -- 172.21.15.169:0/408283894 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc1fc08e150 con 0x559aa05137c0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc203c2e640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0ec036950 0x7fc0ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa0514120 0x559aa0617100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0617640 con 0x559aa0514120 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc204c30640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa0514120 0x559aa0617100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc203c2e640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0ec036950 0x7fc0ec038e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8000f60 tx=0x7fc1f80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc204c30640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa0514120 0x559aa0617100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc204c30640 1 -- 172.21.15.169:0/408283894 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa0514120 2024-04-24T01:24:23.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.260+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06146d0 con 0x559aa0514120 2024-04-24T01:24:23.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc204c30640 1 -- 172.21.15.169:0/408283894 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa0514120 2024-04-24T01:24:23.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0619950 0x559aa061bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa061c430 con 0x559aa0619950 2024-04-24T01:24:23.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc20442f640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0619950 0x559aa061bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc20442f640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0619950 0x559aa061bd40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc20442f640 1 -- 172.21.15.169:0/408283894 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc1fc05a040 con 0x559aa0619950 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.261+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0618900 con 0x559aa0514120 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc204c30640 1 -- 172.21.15.169:0/408283894 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa0514120 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559aa061d8e0 0x559aa061fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0620490 con 0x559aa061d8e0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc203c2e640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559aa061d8e0 0x559aa061fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc203c2e640 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559aa061d8e0 0x559aa061fd30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.262+0000 7fc203c2e640 1 -- 172.21.15.169:0/408283894 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa061d8e0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc208731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc208731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559aa04066b0 con 0x559aa062e8f0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34504/0 (socket says 172.21.15.169:34504) 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc20442f640 1 -- 172.21.15.169:0/3735077221 learned_addr learned my addr 172.21.15.169:0/3735077221 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc20442f640 1 -- 172.21.15.169:0/3735077221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa062f250 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc20442f640 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc08c520 tx=0x7fc1fc072da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.263+0000 7fc0e9ffb640 1 -- 172.21.15.169:0/3735077221 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc089070 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc0e9ffb640 1 -- 172.21.15.169:0/3735077221 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc009620 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc0e9ffb640 1 -- 172.21.15.169:0/3735077221 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc009900 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa062fcc0 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa062fcc0 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc0e9ffb640 1 -- 172.21.15.169:0/3735077221 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc1fc08c890 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc0e9ffb640 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 0x7fc0dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc0e9ffb640 1 -- 172.21.15.169:0/3735077221 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc1fc08fc90 con 0x559aa062e8f0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.264+0000 7fc203c2e640 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 0x7fc0dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc203c2e640 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 0x7fc0dc038dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800bf50 tx=0x7fc1f800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc208731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc208731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559aa0608cb0 con 0x559aa063b8d0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34512/0 (socket says 172.21.15.169:34512) 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc20442f640 1 -- 172.21.15.169:0/1948517521 learned_addr learned my addr 172.21.15.169:0/1948517521 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc20442f640 1 -- 172.21.15.169:0/1948517521 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa063c2c0 con 0x559aa063b8d0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.265+0000 7fc20442f640 1 --2- 172.21.15.169:0/1948517521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc094fd0 tx=0x7fc1fc097800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f7cd08958eedca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc0db7fe640 1 -- 172.21.15.169:0/1948517521 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc051c70 con 0x559aa063b8d0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc0db7fe640 1 -- 172.21.15.169:0/1948517521 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc06e7b0 con 0x559aa063b8d0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc0db7fe640 1 -- 172.21.15.169:0/1948517521 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc079850 con 0x559aa063b8d0 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- 172.21.15.169:0/1948517521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 msgr2=0x559aa063bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 --2- 172.21.15.169:0/1948517521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc094fd0 tx=0x7fc1fc097800 comp rx=0 tx=0).stop 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- 172.21.15.169:0/1948517521 shutdown_connections 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 --2- 172.21.15.169:0/1948517521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa063bcf0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- 172.21.15.169:0/1948517521 >> 172.21.15.169:0/1948517521 conn(0x559aa0637ba0 msgr2=0x559aa0635c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- 172.21.15.169:0/1948517521 shutdown_connections 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- 172.21.15.169:0/1948517521 wait complete. 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 Processor -- start 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.266+0000 7fc208731800 1 -- start start 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc208731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc208731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559aa063c920 con 0x559aa063b8d0 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc20442f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34520/0 (socket says 172.21.15.169:34520) 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 learned_addr learned my addr 172.21.15.169:0/1458995914 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa06430f0 con 0x559aa063b8d0 2024-04-24T01:24:23.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc20442f640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc08ff80 tx=0x7fc1fc04fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc0d9ffb640 1 -- 172.21.15.169:0/1458995914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc0b1070 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc0d9ffb640 1 -- 172.21.15.169:0/1458995914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc08cb80 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559aa06430f0 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.267+0000 7fc0d9ffb640 1 -- 172.21.15.169:0/1458995914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1fc051730 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.268+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa06430f0 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.268+0000 7fc0d9ffb640 1 -- 172.21.15.169:0/1458995914 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc1fc0aa040 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.268+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc0d9ffb640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0cc036950 0x7fc0cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc0d9ffb640 1 -- 172.21.15.169:0/1458995914 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fc1fc057210 con 0x559aa063b8d0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc203c2e640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0cc036950 0x7fc0cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa064e370 0x559aa0650810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0650f60 con 0x559aa064e370 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc204c30640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa064e370 0x559aa0650810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc203c2e640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0cc036950 0x7fc0cc038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001b60 tx=0x7fc1f8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc204c30640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa064e370 0x559aa0650810 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 20 realm 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.269+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06513c0 con 0x559aa064e370 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0651c60 con 0x559aa064e370 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0652d60 0x559aa0655150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06556d0 con 0x559aa0652d60 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.270+0000 7fc20442f640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0652d60 0x559aa0655150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc20442f640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0652d60 0x559aa0655150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc208731800 20 searching for the correct realm 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559aa0657720 0x559aa0659be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa065a2b0 con 0x559aa0657720 2024-04-24T01:24:23.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc203c2e640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559aa0657720 0x559aa0659be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.271+0000 7fc203c2e640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559aa0657720 0x559aa0659be0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc203c2e640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc1f8038040 0x7fc1f801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa065a2b0 con 0x7fc1f8038040 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc204c30640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc1f8038040 0x7fc1f801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc204c30640 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc1f8038040 0x7fc1f801bab0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.272+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.273+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x7fc1f8038040 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.274+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x7fc1f8038040 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.275+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.276+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.277+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x7fc1f8038040 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.278+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x7fc1f8038040 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0657720 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa0652d60 2024-04-24T01:24:23.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.279+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x559aa064e370 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559aa0652000 con 0x7fc1f8038040 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0656020 con 0x559aa064e370 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0656020 con 0x559aa064e370 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.280+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0656020 con 0x7fc1f8038040 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 zone default found 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 4 Realm: () 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 zonegroup default 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0656410 con 0x559aa0652d60 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.281+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0656000 con 0x559aa0657720 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa065c110 con 0x559aa0657720 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 20 started sync module instance, tier type = 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.282+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa06568f0 con 0x7fc1f8038040 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.283+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.283+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94122604344656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065c4b0 con 0x7fc1f8038040 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.283+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065cd00 con 0x559aa064e370 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.284+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94122604344656] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.284+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.284+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94122604348592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065cd80 con 0x559aa064e370 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.284+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065d740 con 0x559aa0657720 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.285+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.285+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94122604352144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065df90 con 0x559aa0657720 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.285+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065e9f0 con 0x7fc1f8038040 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.285+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94122604348592] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.286+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94122604352144] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.286+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.286+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94122604354272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065e4d0 con 0x7fc1f8038040 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.286+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065f290 con 0x559aa064e370 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.287+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.287+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94122604354272] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.287+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94122604359056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065f1b0 con 0x559aa064e370 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.287+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065c930 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.288+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.288+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94122604359056] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.288+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94122604362912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0660570 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.288+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa065f680 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.289+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94122604362912] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.290+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.290+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94122604366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0661350 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.290+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0661ba0 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.290+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.290+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94122604369200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0661f80 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=0 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=1 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=2 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=3 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=4 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=5 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94122604366464] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=6 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94122604369200] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 20 add_watcher() i=7 2024-04-24T01:24:23.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.291+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0660ea0 con 0x559aa064e370 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.292+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.292+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94122604370448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0660ea0 con 0x559aa064e370 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94122604370448] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc0ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 5 note: GC not initialized 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc0b97e2640 20 reqs_thread_entry: start 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 20 Filter name: none 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc02affd640 20 reqs_thread_entry: start 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.293+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0697dc0 con 0x559aa064e370 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0699310 con 0x7fc1f8038040 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0699310 con 0x559aa0657720 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.294+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 4.39 4:9d52cac0:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa0698c30 con 0x559aa0657720 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 4.14 4:28c59c07:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa069de70 con 0x559aa0657720 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 4.12 4:4beb7fae:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a0b40 con 0x559aa064e370 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 4.3c 4:3df9a53c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a3480 con 0x559aa064e370 2024-04-24T01:24:23.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 4.9 4:913e3abf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a5d40 con 0x559aa064e370 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 4.1b 4:d914e85f:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a85f0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06ab3a0 con 0x559aa064e370 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 4.22 4:455fdea3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06ae020 con 0x559aa064e370 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 4.b 4:d0af6d59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06ab3a0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 4.18 4:1bc38953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a85f0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 4.1f 4:fb61a447:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06ae020 con 0x559aa0657720 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(65 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(66 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(70 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(75 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(73 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(67 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.295+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(69 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.296+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(71 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.296+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(72 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.296+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a85f0 con 0x7fc1f8038040 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.297+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.297+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a85f0 con 0x7fc1f8038040 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc208731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06a85f0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc208731800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:23.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.298+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559aa06b2ab0 con 0x7fc1f8038040 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.299+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.299+0000 7fc0ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.299+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94122604370448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa06b2ab0 con 0x559aa064e370 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.300+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94122604370448] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.300+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94122604344656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x7fc1f8038040 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.301+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94122604344656] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.301+0000 7fc208731800 20 remove_watcher() i=0 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.301+0000 7fc208731800 2 removed watcher, disabling cache 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.301+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94122604348592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa064e370 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.302+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94122604348592] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.302+0000 7fc208731800 20 remove_watcher() i=1 2024-04-24T01:24:23.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.302+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94122604352144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa0657720 2024-04-24T01:24:23.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.303+0000 7fc203c2e640 1 -- 172.21.15.169:0/1458995914 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94122604352144] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f8009050 con 0x559aa0657720 2024-04-24T01:24:23.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.303+0000 7fc208731800 20 remove_watcher() i=2 2024-04-24T01:24:23.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.303+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94122604354272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x7fc1f8038040 2024-04-24T01:24:23.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.304+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94122604354272] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x7fc1f8038040 2024-04-24T01:24:23.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.304+0000 7fc208731800 20 remove_watcher() i=3 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.304+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94122604359056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa064e370 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.305+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94122604359056] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1f400a4a0 con 0x559aa064e370 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.305+0000 7fc208731800 20 remove_watcher() i=4 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.305+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94122604362912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.306+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94122604362912] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.306+0000 7fc208731800 20 remove_watcher() i=5 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.306+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94122604366464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.307+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94122604366464] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.307+0000 7fc208731800 20 remove_watcher() i=6 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.307+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94122604369200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559aa0680a30 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc20442f640 1 -- 172.21.15.169:0/1458995914 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94122604369200] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1fc094020 con 0x559aa0652d60 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 20 remove_watcher() i=7 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0652d60 msgr2=0x559aa0655150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0652d60 0x559aa0655150 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa064e370 msgr2=0x559aa0650810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa064e370 0x559aa0650810 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc1f8038040 msgr2=0x7fc1f801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc1f8038040 0x7fc1f801bab0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559aa0657720 msgr2=0x559aa0659be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559aa0657720 0x559aa0659be0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0cc036950 msgr2=0x7fc0cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0cc036950 0x7fc0cc038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8001b60 tx=0x7fc1f8010000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 msgr2=0x559aa0642bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc08ff80 tx=0x7fc1fc04fe70 comp rx=0 tx=0).stop 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc204c30640 1 -- 172.21.15.169:0/1458995914 reap_dead start 2024-04-24T01:24:23.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 shutdown_connections 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 --2- 172.21.15.169:0/1458995914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa063b8d0 0x559aa0642bb0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 >> 172.21.15.169:0/1458995914 conn(0x559aa0637ba0 msgr2=0x559aa0635200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.308+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 shutdown_connections 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/1458995914 wait complete. 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 msgr2=0x7fc0dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 0x7fc0dc038dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800bf50 tx=0x7fc1f800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 msgr2=0x559aa062ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc08c520 tx=0x7fc1fc072da0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 shutdown_connections 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0dc036900 0x7fc0dc038dc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/3735077221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa062e8f0 0x559aa062ed10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 >> 172.21.15.169:0/3735077221 conn(0x559aa0622990 msgr2=0x559aa0622d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 shutdown_connections 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/3735077221 wait complete. 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0619950 msgr2=0x559aa061bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559aa0619950 0x559aa061bd40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa0514120 msgr2=0x559aa0617100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559aa0514120 0x559aa0617100 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559aa061d8e0 msgr2=0x559aa061fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559aa061d8e0 0x559aa061fd30 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0ec036950 msgr2=0x7fc0ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc0ec036950 0x7fc0ec038e10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8000f60 tx=0x7fc1f80012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 msgr2=0x559aa060ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 --2- 172.21.15.169:0/408283894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559aa05137c0 0x559aa060ff60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc01ce60 tx=0x7fc1fc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc204c30640 1 -- 172.21.15.169:0/408283894 reap_dead start 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 shutdown_connections 2024-04-24T01:24:23.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 >> 172.21.15.169:0/408283894 conn(0x559aa050f340 msgr2=0x559aa0602540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 shutdown_connections 2024-04-24T01:24:23.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.309+0000 7fc208731800 1 -- 172.21.15.169:0/408283894 wait complete. 2024-04-24T01:24:23.325 INFO:teuthology.orchestra.run.smithi169.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-04-24T01:24:23.299159Z","last_stats_update":"2024-04-24T01:24:23.297902Z"} 2024-04-24T01:24:23.326 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-04-24T01:24:23.299159Z', 'last_stats_update': '2024-04-24T01:24:23.297902Z'} 2024-04-24T01:24:23.331 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:23.331 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T01:24:23.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-04-24T01:24:23.332 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-04-24T01:24:23.376 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.377 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.375+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.375+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.375+0000 7fd88e92b800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558edb9b07a0 0x558edb9b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.375+0000 7fd88e92b800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558edb870d40 con 0x558edb9b1100 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.375+0000 7fd88e92b800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x558edb8434d0 con 0x558edb9b07a0 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd88a575640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558edb9b07a0 0x558edb9b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd88a575640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558edb9b07a0 0x558edb9b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34526/0 (socket says 172.21.15.169:34526) 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd88a575640 1 -- 172.21.15.169:0/2796150350 learned_addr learned my addr 172.21.15.169:0/2796150350 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd881d74640 1 --1- 172.21.15.169:0/2796150350 >> v1:172.21.15.142:6789/0 conn(0x558edb9b1100 0x558edb9b15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34816/0 (socket says 172.21.15.169:34816) 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd88a575640 1 -- 172.21.15.169:0/2796150350 >> v1:172.21.15.142:6789/0 conn(0x558edb9b1100 legacy=0x558edb9b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.376+0000 7fd88a575640 1 -- 172.21.15.169:0/2796150350 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edb86f590 con 0x558edb9b07a0 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88a575640 1 --2- 172.21.15.169:0/2796150350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edb9b0bc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00a520 tx=0x7fd87c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4230c2ec160fcad server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd889d74640 1 -- 172.21.15.169:0/2796150350 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c057070 con 0x558edb9b07a0 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd889d74640 1 -- 172.21.15.169:0/2796150350 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c052570 con 0x558edb9b07a0 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd889d74640 1 -- 172.21.15.169:0/2796150350 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c052870 con 0x558edb9b07a0 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 -- 172.21.15.169:0/2796150350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 msgr2=0x558edb9b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2796150350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edb9b0bc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00a520 tx=0x7fd87c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 -- 172.21.15.169:0/2796150350 shutdown_connections 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2796150350 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edb9b0bc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 -- 172.21.15.169:0/2796150350 >> 172.21.15.169:0/2796150350 conn(0x558edb9ac320 msgr2=0x558edb9ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 -- 172.21.15.169:0/2796150350 shutdown_connections 2024-04-24T01:24:23.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.378+0000 7fd88e92b800 1 -- 172.21.15.169:0/2796150350 wait complete. 2024-04-24T01:24:23.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.390+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.390+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.390+0000 7fd88e92b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.390+0000 7fd88e92b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558edb8fd3b0 con 0x558edb9b07a0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34530/0 (socket says 172.21.15.169:34530) 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd88a575640 1 -- 172.21.15.169:0/1778691281 learned_addr learned my addr 172.21.15.169:0/1778691281 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd88a575640 1 -- 172.21.15.169:0/1778691281 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edbaa5980 con 0x558edb9b07a0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd88a575640 1 --2- 172.21.15.169:0/1778691281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01d050 tx=0x7fd87c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65df357daae65f84 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd778608640 1 -- 172.21.15.169:0/1778691281 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c057040 con 0x558edb9b07a0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd778608640 1 -- 172.21.15.169:0/1778691281 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c052850 con 0x558edb9b07a0 2024-04-24T01:24:23.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.391+0000 7fd778608640 1 -- 172.21.15.169:0/1778691281 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c052b70 con 0x558edb9b07a0 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- 172.21.15.169:0/1778691281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 msgr2=0x558edbaa53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 --2- 172.21.15.169:0/1778691281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01d050 tx=0x7fd87c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- 172.21.15.169:0/1778691281 shutdown_connections 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 --2- 172.21.15.169:0/1778691281 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaa53b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- 172.21.15.169:0/1778691281 >> 172.21.15.169:0/1778691281 conn(0x558edb9ac320 msgr2=0x558edbaa0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- 172.21.15.169:0/1778691281 shutdown_connections 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- 172.21.15.169:0/1778691281 wait complete. 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaacef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.392+0000 7fd88e92b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558edb9b1f60 con 0x558edb9b07a0 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaacef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaacef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34532/0 (socket says 172.21.15.169:34532) 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88a575640 1 -- 172.21.15.169:0/2049323765 learned_addr learned my addr 172.21.15.169:0/2049323765 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88a575640 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edbaad430 con 0x558edb9b07a0 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88a575640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaacef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01cfe0 tx=0x7fd87c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd776e05640 1 -- 172.21.15.169:0/2049323765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c073070 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd776e05640 1 -- 172.21.15.169:0/2049323765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c05d650 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edbaad6c0 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd776e05640 1 -- 172.21.15.169:0/2049323765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c057070 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.393+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edbab02d0 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd776e05640 1 -- 172.21.15.169:0/2049323765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd87c076070 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd776e05640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd770036900 0x7fd770038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd776e05640 1 -- 172.21.15.169:0/2049323765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd87c08def0 con 0x558edb9b07a0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd881d74640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd770036900 0x7fd770038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edb9b1100 0x558edbab4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.394+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbab4660 con 0x558edb9b1100 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edb9b1100 0x558edbab4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd881d74640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd770036900 0x7fd770038dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd874000f60 tx=0x7fd874001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edb9b1100 0x558edbab4090 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88ad76640 1 -- 172.21.15.169:0/2049323765 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edb9b1100 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbab1660 con 0x558edb9b1100 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88ad76640 1 -- 172.21.15.169:0/2049323765 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edb9b1100 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbab6970 0x558edbab8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.395+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbab9400 con 0x558edbab6970 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88a575640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbab6970 0x558edbab8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88a575640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbab6970 0x558edbab8d60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88a575640 1 -- 172.21.15.169:0/2049323765 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd87c075030 con 0x558edbab6970 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbab5920 con 0x558edb9b1100 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88ad76640 1 -- 172.21.15.169:0/2049323765 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edb9b1100 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558edbaba8b0 0x558edbabcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbabd460 con 0x558edbaba8b0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.396+0000 7fd881d74640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558edbaba8b0 0x558edbabcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd881d74640 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558edbaba8b0 0x558edbabcd00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd881d74640 1 -- 172.21.15.169:0/2049323765 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd87400f690 con 0x558edbaba8b0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd88e92b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.397+0000 7fd88e92b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558edb8a36b0 con 0x558edbacb8c0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34546/0 (socket says 172.21.15.169:34546) 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88a575640 1 -- 172.21.15.169:0/383777534 learned_addr learned my addr 172.21.15.169:0/383777534 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88a575640 1 -- 172.21.15.169:0/383777534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edbacc220 con 0x558edbacb8c0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88a575640 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd87c066fd0 tx=0x7fd87c077db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd76ffff640 1 -- 172.21.15.169:0/383777534 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0775c0 con 0x558edbacb8c0 2024-04-24T01:24:23.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd76ffff640 1 -- 172.21.15.169:0/383777534 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c08a020 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edbaccc90 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd76ffff640 1 -- 172.21.15.169:0/383777534 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c05d970 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.398+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edbacd190 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd76ffff640 1 -- 172.21.15.169:0/383777534 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd87c082040 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd76ffff640 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 0x7fd764038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd76ffff640 1 -- 172.21.15.169:0/383777534 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd87c07f040 con 0x558edbacb8c0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd881d74640 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 0x7fd764038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd881d74640 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 0x7fd764038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558edbab1580 tx=0x7fd87400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.399+0000 7fd88e92b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88e92b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558edbaa5c40 con 0x558edbad8ac0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34562/0 (socket says 172.21.15.169:34562) 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88a575640 1 -- 172.21.15.169:0/4118072155 learned_addr learned my addr 172.21.15.169:0/4118072155 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88a575640 1 -- 172.21.15.169:0/4118072155 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edbad9490 con 0x558edbad8ac0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd88a575640 1 --2- 172.21.15.169:0/4118072155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0866f0 tx=0x7fd87c078cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75757f93147ea78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd76dffb640 1 -- 172.21.15.169:0/4118072155 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c097040 con 0x558edbad8ac0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd76dffb640 1 -- 172.21.15.169:0/4118072155 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c079e40 con 0x558edbad8ac0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.400+0000 7fd76dffb640 1 -- 172.21.15.169:0/4118072155 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c078590 con 0x558edbad8ac0 2024-04-24T01:24:23.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- 172.21.15.169:0/4118072155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 msgr2=0x558edbad8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 --2- 172.21.15.169:0/4118072155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0866f0 tx=0x7fd87c078cd0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- 172.21.15.169:0/4118072155 shutdown_connections 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 --2- 172.21.15.169:0/4118072155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbad8ec0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- 172.21.15.169:0/4118072155 >> 172.21.15.169:0/4118072155 conn(0x558edbad4d40 msgr2=0x558edbad2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- 172.21.15.169:0/4118072155 shutdown_connections 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- 172.21.15.169:0/4118072155 wait complete. 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 Processor -- start 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- start start 2024-04-24T01:24:23.454 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88e92b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558edbad9b20 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88a575640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34570/0 (socket says 172.21.15.169:34570) 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.401+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 learned_addr learned my addr 172.21.15.169:0/2506306656 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558edbae0310 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd88a575640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0865d0 tx=0x7fd87c074ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd75bfff640 1 -- 172.21.15.169:0/2506306656 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c0b7070 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd75bfff640 1 -- 172.21.15.169:0/2506306656 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd87c0796b0 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558edbae0310 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd75bfff640 1 -- 172.21.15.169:0/2506306656 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd87c097040 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.402+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558edbae0310 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd75bfff640 1 -- 172.21.15.169:0/2506306656 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd87c0ba070 con 0x558edbad8ac0 2024-04-24T01:24:23.455 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd75bfff640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd754036950 0x7fd754038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd75bfff640 1 -- 172.21.15.169:0/2506306656 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fd87c0a3030 con 0x558edbad8ac0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd881d74640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd754036950 0x7fd754038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd881d74640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd754036950 0x7fd754038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x558edbabd860 tx=0x7fd874010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edbaeb4d0 0x558edbaed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaee0e0 con 0x558edbaeb4d0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.403+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edbaeb4d0 0x558edbaed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edbaeb4d0 0x558edbaed990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 realm 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaee4f0 con 0x558edbaeb4d0 2024-04-24T01:24:23.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaeedc0 con 0x558edbaeb4d0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.404+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbaefec0 0x558edbaf22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.457 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf28c0 con 0x558edbaefec0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88a575640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbaefec0 0x558edbaf22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.405+0000 7fd88a575640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbaefec0 0x558edbaf22b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd88e92b800 20 searching for the correct realm 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558edbaf4870 0x558edbaf6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf7400 con 0x558edbaf4870 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd881d74640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558edbaf4870 0x558edbaf6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd881d74640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558edbaf4870 0x558edbaf6d30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd881d74640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd87400f070 0x7fd87402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.406+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf7400 con 0x7fd87400f070 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd87400f070 0x7fd87402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88ad76640 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd87400f070 0x7fd87402e910 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.407+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.408+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x7fd87400f070 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.409+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x7fd87400f070 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.410+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.411+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.411+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.411+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.411+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.412+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x7fd87400f070 2024-04-24T01:24:23.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.413+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x7fd87400f070 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaf4870 2024-04-24T01:24:23.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.414+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaefec0 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x558edbaeb4d0 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558edbaef160 con 0x7fd87400f070 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf3180 con 0x558edbaeb4d0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.415+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf3180 con 0x558edbaeb4d0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf3180 con 0x7fd87400f070 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 zone default found 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 4 Realm: () 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 zonegroup default 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.416+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf3a20 con 0x558edbaefec0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9260 con 0x558edbaf4870 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9600 con 0x558edbaf4870 2024-04-24T01:24:23.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 started sync module instance, tier type = 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.417+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf8700 con 0x7fd87400f070 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.418+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.418+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072059431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf8700 con 0x7fd87400f070 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.418+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9fc0 con 0x558edbaeb4d0 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.419+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072059431936] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.419+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.419+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072059429936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9fc0 con 0x558edbaeb4d0 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.419+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafa980 con 0x558edbaf4870 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.420+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072059429936] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.420+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.421+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072059435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9f30 con 0x558edbaf4870 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.421+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafb840 con 0x7fd87400f070 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.421+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.421+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072059442544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafbfe0 con 0x7fd87400f070 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.422+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafcb00 con 0x558edbaeb4d0 2024-04-24T01:24:23.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.422+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072059435792] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.422+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.422+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072059446736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafcac0 con 0x558edbaeb4d0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.422+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafd510 con 0x558edbaefec0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.423+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072059442544] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.423+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.423+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072059449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafd900 con 0x558edbaefec0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.423+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafe2c0 con 0x558edbaefec0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.424+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072059446736] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.424+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072059449440] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.425+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.425+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072059452944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafe6b0 con 0x558edbaefec0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.425+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafef00 con 0x558edbaefec0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072059455664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaff300 con 0x558edbaefec0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=0 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=1 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=2 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=3 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=4 2024-04-24T01:24:23.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=5 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072059452944] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=6 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072059455664] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 20 add_watcher() i=7 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.426+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbafad70 con 0x558edbaeb4d0 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.427+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.427+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072059456912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafad70 con 0x558edbaeb4d0 2024-04-24T01:24:23.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072059456912] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88e92b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88e92b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88e92b800 5 note: GC not initialized 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd6bb7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88e92b800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd88e92b800 20 Filter name: none 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.428+0000 7fd6b97fa640 20 reqs_thread_entry: start 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbb355a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbb37680 con 0x7fd87400f070 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.429+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbb38e40 con 0x558edbaf4870 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.430+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbb3aa30 con 0x7fd87400f070 2024-04-24T01:24:23.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbb3a580 con 0x7fd87400f070 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.431+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbb40a20 con 0x7fd87400f070 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.432+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.432+0000 7fd88e92b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.432+0000 7fd88e92b800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.432+0000 7fd88e92b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:23.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.432+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94072059708720 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558edbb3deb0 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== watch-notify(notify (1) cookie 94072059452944 notify 137438953479 ret 0) ==== 380+0+0 (crc 0 0 0) 0x558edbaccc90 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd76dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94072059452944 notifier 4479 bl.length()=338 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(68 notify.6 [notify cookie 94072059708720 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd76dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd76dffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd76dffb640 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd750003ea0 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.433+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== watch-notify(notify_complete (2) cookie 94072059708720 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558edbacc220 con 0x558edbaefec0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.434+0000 7fd740fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.434+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072059456912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbb36010 con 0x558edbaeb4d0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.435+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94072059456912] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.435+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072059431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbb35b10 con 0x7fd87400f070 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.436+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94072059431936] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.436+0000 7fd88e92b800 20 remove_watcher() i=0 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.436+0000 7fd88e92b800 2 removed watcher, disabling cache 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.436+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072059429936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf8c00 con 0x558edbaeb4d0 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.437+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94072059429936] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.437+0000 7fd88e92b800 20 remove_watcher() i=1 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.437+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072059435792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf8430 con 0x558edbaf4870 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.438+0000 7fd881d74640 1 -- 172.21.15.169:0/2506306656 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94072059435792] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd874037040 con 0x558edbaf4870 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.438+0000 7fd88e92b800 20 remove_watcher() i=2 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.438+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072059442544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9b10 con 0x7fd87400f070 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.439+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94072059442544] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x7fd87400f070 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.439+0000 7fd88e92b800 20 remove_watcher() i=3 2024-04-24T01:24:23.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.439+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072059446736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9b10 con 0x558edbaeb4d0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.440+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94072059446736] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd88400a4a0 con 0x558edbaeb4d0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.440+0000 7fd88e92b800 20 remove_watcher() i=4 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.440+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072059449440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafc5d0 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.441+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94072059449440] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.441+0000 7fd88e92b800 20 remove_watcher() i=5 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.441+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072059452944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbaf9b10 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.442+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94072059452944] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.442+0000 7fd88e92b800 20 remove_watcher() i=6 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.442+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072059455664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558edbafd060 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88a575640 1 -- 172.21.15.169:0/2506306656 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94072059455664] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd87c0b9030 con 0x558edbaefec0 2024-04-24T01:24:23.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 20 remove_watcher() i=7 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbaefec0 msgr2=0x558edbaf22b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbaefec0 0x558edbaf22b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edbaeb4d0 msgr2=0x558edbaed990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edbaeb4d0 0x558edbaed990 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd87400f070 msgr2=0x7fd87402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd87400f070 0x7fd87402e910 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558edbaf4870 msgr2=0x558edbaf6d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558edbaf4870 0x558edbaf6d30 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd754036950 msgr2=0x7fd754038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd754036950 0x7fd754038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x558edbabd860 tx=0x7fd874010000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 msgr2=0x558edbadfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88ad76640 1 -- 172.21.15.169:0/2506306656 reap_dead start 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd87c0865d0 tx=0x7fd87c074ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 shutdown_connections 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2506306656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbad8ac0 0x558edbadfdd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.443+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 >> 172.21.15.169:0/2506306656 conn(0x558edbad4d40 msgr2=0x558edbada240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 shutdown_connections 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2506306656 wait complete. 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 msgr2=0x7fd764038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 0x7fd764038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x558edbab1580 tx=0x7fd87400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 msgr2=0x558edbacbce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd87c066fd0 tx=0x7fd87c077db0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 shutdown_connections 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd764036900 0x7fd764038dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/383777534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edbacb8c0 0x558edbacbce0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 >> 172.21.15.169:0/383777534 conn(0x558edbabf960 msgr2=0x558edbabfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 shutdown_connections 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/383777534 wait complete. 2024-04-24T01:24:23.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbab6970 msgr2=0x558edbab8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558edbab6970 0x558edbab8d60 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edb9b1100 msgr2=0x558edbab4090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558edb9b1100 0x558edbab4090 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558edbaba8b0 msgr2=0x558edbabcd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558edbaba8b0 0x558edbabcd00 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd770036900 msgr2=0x7fd770038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd770036900 0x7fd770038dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd874000f60 tx=0x7fd874001370 comp rx=0 tx=0).stop 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 msgr2=0x558edbaacef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 --2- 172.21.15.169:0/2049323765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558edb9b07a0 0x558edbaacef0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd87c01cfe0 tx=0x7fd87c003020 comp rx=0 tx=0).stop 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88ad76640 1 -- 172.21.15.169:0/2049323765 reap_dead start 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 shutdown_connections 2024-04-24T01:24:23.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 >> 172.21.15.169:0/2049323765 conn(0x558edb9ac320 msgr2=0x558edba9f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 shutdown_connections 2024-04-24T01:24:23.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.444+0000 7fd88e92b800 1 -- 172.21.15.169:0/2049323765 wait complete. 2024-04-24T01:24:23.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:24:23.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:24:23.488 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T01:24:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.539 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8f731800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556ae3365310 0x556ae336de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8f731800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ae3223d40 con 0x556ae33637d0 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8f731800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x556ae31f64d0 con 0x556ae3365310 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b82c35640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556ae3365310 0x556ae336de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8b436640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x556ae33637d0 0x556ae3363bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34828/0 (socket says 172.21.15.169:34828) 2024-04-24T01:24:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b8b436640 1 -- 172.21.15.169:0/2629221795 learned_addr learned my addr 172.21.15.169:0/2629221795 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b82c35640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556ae3365310 0x556ae336de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34578/0 (socket says 172.21.15.169:34578) 2024-04-24T01:24:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b82c35640 1 -- 172.21.15.169:0/2629221795 >> v1:172.21.15.142:6789/0 conn(0x556ae33637d0 legacy=0x556ae3363bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.539+0000 7f8b82c35640 1 -- 172.21.15.169:0/2629221795 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae3222590 con 0x556ae3365310 2024-04-24T01:24:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.541+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2629221795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae3365310 0x556ae336de10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400a470 tx=0x7f8b7401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167aa792c3350234 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.541+0000 7f8b8ac35640 1 -- 172.21.15.169:0/2629221795 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b74057070 con 0x556ae3365310 2024-04-24T01:24:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.541+0000 7f8b8ac35640 1 -- 172.21.15.169:0/2629221795 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7404adc0 con 0x556ae3365310 2024-04-24T01:24:23.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.541+0000 7f8b8ac35640 1 -- 172.21.15.169:0/2629221795 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b74052590 con 0x556ae3365310 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 -- 172.21.15.169:0/2629221795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae3365310 msgr2=0x556ae336de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2629221795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae3365310 0x556ae336de10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400a470 tx=0x7f8b7401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 -- 172.21.15.169:0/2629221795 shutdown_connections 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2629221795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae3365310 0x556ae336de10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 -- 172.21.15.169:0/2629221795 >> 172.21.15.169:0/2629221795 conn(0x556ae335f370 msgr2=0x556ae3361790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 -- 172.21.15.169:0/2629221795 shutdown_connections 2024-04-24T01:24:23.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.542+0000 7f8b8f731800 1 -- 172.21.15.169:0/2629221795 wait complete. 2024-04-24T01:24:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8f731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8f731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556ae32b03e0 con 0x556ae33637d0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34580/0 (socket says 172.21.15.169:34580) 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.554+0000 7f8b8b436640 1 -- 172.21.15.169:0/1733606413 learned_addr learned my addr 172.21.15.169:0/1733606413 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.555+0000 7f8b8b436640 1 -- 172.21.15.169:0/1733606413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae3458d00 con 0x556ae33637d0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.555+0000 7f8b8b436640 1 --2- 172.21.15.169:0/1733606413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c001de0 tx=0x7f8b7c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6f009f63682e80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.555+0000 7f8a7960a640 1 -- 172.21.15.169:0/1733606413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c012020 con 0x556ae33637d0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.555+0000 7f8a7960a640 1 -- 172.21.15.169:0/1733606413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00e5a0 con 0x556ae33637d0 2024-04-24T01:24:23.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.555+0000 7f8a7960a640 1 -- 172.21.15.169:0/1733606413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c00e8c0 con 0x556ae33637d0 2024-04-24T01:24:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- 172.21.15.169:0/1733606413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 msgr2=0x556ae3458730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1733606413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c001de0 tx=0x7f8b7c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- 172.21.15.169:0/1733606413 shutdown_connections 2024-04-24T01:24:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1733606413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3458730 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- 172.21.15.169:0/1733606413 >> 172.21.15.169:0/1733606413 conn(0x556ae335f370 msgr2=0x556ae3454050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- 172.21.15.169:0/1733606413 shutdown_connections 2024-04-24T01:24:23.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- 172.21.15.169:0/1733606413 wait complete. 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3460270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8f731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556ae3370630 con 0x556ae33637d0 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3460270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3460270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34592/0 (socket says 172.21.15.169:34592) 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8b436640 1 -- 172.21.15.169:0/1188826490 learned_addr learned my addr 172.21.15.169:0/1188826490 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.556+0000 7f8b8b436640 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae34607b0 con 0x556ae33637d0 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8b8b436640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3460270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c010 tx=0x7f8b7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8a77e07640 1 -- 172.21.15.169:0/1188826490 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c012070 con 0x556ae33637d0 2024-04-24T01:24:23.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8a77e07640 1 -- 172.21.15.169:0/1188826490 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c01a7a0 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8a77e07640 1 -- 172.21.15.169:0/1188826490 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c01aa80 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae3460a40 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.557+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae34636f0 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8a77e07640 1 -- 172.21.15.169:0/1188826490 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b7c015020 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8a77e07640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a70036950 0x7f8a70038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8a77e07640 1 -- 172.21.15.169:0/1188826490 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b7c020070 con 0x556ae33637d0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b82c35640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a70036950 0x7f8a70038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae3365310 0x556ae34674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34679f0 con 0x556ae3365310 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae3365310 0x556ae34674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b82c35640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a70036950 0x7f8a70038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b74054000 tx=0x7f8b7404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.558+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae3365310 0x556ae34674b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8bc37640 1 -- 172.21.15.169:0/1188826490 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae3365310 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae3464a80 con 0x556ae3365310 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8bc37640 1 -- 172.21.15.169:0/1188826490 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae3365310 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae3469d90 0x556ae346c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae346c820 con 0x556ae3469d90 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.559+0000 7f8b8b436640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae3469d90 0x556ae346c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8b436640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae3469d90 0x556ae346c180 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8b436640 1 -- 172.21.15.169:0/1188826490 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae3469d90 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae3468d40 con 0x556ae3365310 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8bc37640 1 -- 172.21.15.169:0/1188826490 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae3365310 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556ae346dcd0 0x556ae3470120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae3470880 con 0x556ae346dcd0 2024-04-24T01:24:23.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.560+0000 7f8b82c35640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556ae346dcd0 0x556ae3470120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b82c35640 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556ae346dcd0 0x556ae3470120 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b82c35640 1 -- 172.21.15.169:0/1188826490 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae346dcd0 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b8f731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b8f731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556ae32566b0 con 0x556ae347ec70 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.561+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34602/0 (socket says 172.21.15.169:34602) 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8b436640 1 -- 172.21.15.169:0/2806629244 learned_addr learned my addr 172.21.15.169:0/2806629244 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8b436640 1 -- 172.21.15.169:0/2806629244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae347f5d0 con 0x556ae347ec70 2024-04-24T01:24:23.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8b436640 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c04aa30 tx=0x7f8b7c04ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8a75602640 1 -- 172.21.15.169:0/2806629244 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c04c3f0 con 0x556ae347ec70 2024-04-24T01:24:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8a75602640 1 -- 172.21.15.169:0/2806629244 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c0490e0 con 0x556ae347ec70 2024-04-24T01:24:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae3480040 con 0x556ae347ec70 2024-04-24T01:24:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8a75602640 1 -- 172.21.15.169:0/2806629244 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c0493c0 con 0x556ae347ec70 2024-04-24T01:24:23.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.562+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae3480040 con 0x556ae347ec70 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8a75602640 1 -- 172.21.15.169:0/2806629244 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b7c044000 con 0x556ae347ec70 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8a75602640 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 0x7f8a64038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8a75602640 1 -- 172.21.15.169:0/2806629244 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b7c00a890 con 0x556ae347ec70 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 0x7f8a64038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 0x7f8a64038e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b74055040 tx=0x7f8b74005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b8f731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.563+0000 7f8b8f731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556ae3459080 con 0x556ae348bca0 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34608/0 (socket says 172.21.15.169:34608) 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8b436640 1 -- 172.21.15.169:0/1848001369 learned_addr learned my addr 172.21.15.169:0/1848001369 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8b436640 1 -- 172.21.15.169:0/1848001369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae348c690 con 0x556ae348bca0 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8b436640 1 --2- 172.21.15.169:0/1848001369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c04efd0 tx=0x7f8b7c00a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1da0e975e9c580 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8a6effd640 1 -- 172.21.15.169:0/1848001369 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c05c070 con 0x556ae348bca0 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8a6effd640 1 -- 172.21.15.169:0/1848001369 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c049560 con 0x556ae348bca0 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8a6effd640 1 -- 172.21.15.169:0/1848001369 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c03d070 con 0x556ae348bca0 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8f731800 1 -- 172.21.15.169:0/1848001369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 msgr2=0x556ae348c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1848001369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c04efd0 tx=0x7f8b7c00a2e0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8f731800 1 -- 172.21.15.169:0/1848001369 shutdown_connections 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1848001369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae348c0c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.564+0000 7f8b8f731800 1 -- 172.21.15.169:0/1848001369 >> 172.21.15.169:0/1848001369 conn(0x556ae3487f20 msgr2=0x556ae3485f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 -- 172.21.15.169:0/1848001369 shutdown_connections 2024-04-24T01:24:23.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 -- 172.21.15.169:0/1848001369 wait complete. 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 Processor -- start 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 -- start start 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8f731800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556ae348cd00 con 0x556ae348bca0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8b436640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34622/0 (socket says 172.21.15.169:34622) 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 learned_addr learned my addr 172.21.15.169:0/2805634902 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.565+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae34935a0 con 0x556ae348bca0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8b8b436640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c022710 tx=0x7f8b7c00a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8a6d7fa640 1 -- 172.21.15.169:0/2805634902 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c067020 con 0x556ae348bca0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8a6d7fa640 1 -- 172.21.15.169:0/2805634902 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7c022760 con 0x556ae348bca0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ae34935a0 con 0x556ae348bca0 2024-04-24T01:24:23.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8a6d7fa640 1 -- 172.21.15.169:0/2805634902 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b7c05c040 con 0x556ae348bca0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae34935a0 con 0x556ae348bca0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.566+0000 7f8a6d7fa640 1 -- 172.21.15.169:0/2805634902 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b7c06a020 con 0x556ae348bca0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8a6d7fa640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a54036950 0x7f8a54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8a6d7fa640 1 -- 172.21.15.169:0/2805634902 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8b7c052030 con 0x556ae348bca0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a54036950 0x7f8a54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a54036950 0x7f8a54038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556ae3470c80 tx=0x7f8b7404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae349e800 0x556ae34a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a1410 con 0x556ae349e800 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae349e800 0x556ae34a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.567+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae349e800 0x556ae34a0cc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 realm 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a1820 con 0x556ae349e800 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a20f0 con 0x556ae349e800 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae34a31f0 0x556ae34a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.568+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a5ba0 con 0x556ae34a31f0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8b436640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae34a31f0 0x556ae34a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8b436640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae34a31f0 0x556ae34a55e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8f731800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8f731800 20 searching for the correct realm 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556ae34a7b50 0x556ae34aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.569+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34aa6e0 con 0x556ae34a7b50 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556ae34a7b50 0x556ae34aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556ae34a7b50 0x556ae34aa010 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b82c35640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8b7405c410 0x7f8b7405c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34aa6e0 con 0x7f8b7405c410 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.570+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8b7405c410 0x7f8b7405c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8b7405c410 0x7f8b7405c850 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.571+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x7f8b7405c410 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.572+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x7f8b7405c410 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.573+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.574+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.575+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x7f8b7405c410 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.576+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x7f8b7405c410 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.577+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a7b50 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae34a31f0 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x556ae349e800 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a2490 con 0x7f8b7405c410 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.578+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a6460 con 0x556ae349e800 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a6460 con 0x556ae349e800 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a6460 con 0x7f8b7405c410 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 zone default found 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 4 Realm: () 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 zonegroup default 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.579+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34a6d00 con 0x556ae34a31f0 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ac540 con 0x556ae34a7b50 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ac8e0 con 0x556ae34a7b50 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 started sync module instance, tier type = 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.580+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab9e0 con 0x7f8b7405c410 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.581+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.581+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917568220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab9e0 con 0x7f8b7405c410 2024-04-24T01:24:23.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.581+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ad130 con 0x556ae349e800 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.582+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917568220624] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.582+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.582+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917568224864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab9e0 con 0x556ae349e800 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.582+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34adb70 con 0x556ae34a7b50 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.584+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917568224864] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.584+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.584+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917568218416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab950 con 0x556ae34a7b50 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.584+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34aea30 con 0x7f8b7405c410 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.585+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917568218416] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.585+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.585+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917568230784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34aee50 con 0x7f8b7405c410 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.585+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34af810 con 0x556ae349e800 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.586+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917568230784] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.586+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.586+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917568232320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34af810 con 0x556ae349e800 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.586+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b01d0 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.587+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.587+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917568236832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b0a20 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.587+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b1460 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.587+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917568232320] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.588+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917568236832] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.588+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.588+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917568241456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b1850 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.588+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b20a0 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917568244304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b24d0 con 0x556ae34a31f0 2024-04-24T01:24:23.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=0 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=1 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=2 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=3 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=4 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=5 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917568241456] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.589+0000 7f8b8f731800 20 add_watcher() i=6 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917568244304] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8f731800 20 add_watcher() i=7 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8f731800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34af360 con 0x556ae349e800 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.590+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917568245520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34af360 con 0x556ae349e800 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.591+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917568245520] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.591+0000 7f8a41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.591+0000 7f8b8f731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.591+0000 7f8b8f731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 5 note: GC not initialized 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8a40fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 20 Filter name: none 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f89ba7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34e8910 con 0x556ae34a31f0 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:23.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.592+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34e70b0 con 0x556ae34a31f0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.593+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34e79a0 con 0x556ae34a31f0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8f731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:24:23.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8f731800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8f731800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93917568464112 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ebf00 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== watch-notify(notify (1) cookie 93917568236832 notify 137438953480 ret 0) ==== 598+0+0 (crc 0 0 0) 0x556ae34e8360 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8a6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 93917568236832 notifier 4486 bl.length()=556 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8a6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8a6effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(65 notify.5 [notify cookie 93917568464112 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.594+0000 7f8a6effd640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8a50003ea0 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.595+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.595+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== watch-notify(notify_complete (2) cookie 93917568464112 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8b7c043070 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.595+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34e7920 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b8f731800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b8f731800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b8f731800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93917568463984 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556ae34e7890 con 0x556ae34a7b50 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 93917568218416 notify 137438953475 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f8b74066070 con 0x556ae34a7b50 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8a6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93917568218416 notifier 4486 bl.length()=177 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8a6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8a6effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8a6effd640 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8a50003ea0 con 0x556ae34a7b50 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [notify cookie 93917568463984 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify_complete (2) cookie 93917568463984 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556ae3222590 con 0x556ae34a7b50 2024-04-24T01:24:23.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.596+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.617 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:24:23.594967Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:23.594954Z","tags":[],"group_ids":[]} 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.597+0000 7f8a41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.597+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917568245520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae3498190 con 0x556ae349e800 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.598+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93917568245520] v32'113 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.598+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917568220624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34b1ed0 con 0x7f8b7405c410 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.599+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93917568220624] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.599+0000 7f8b8f731800 20 remove_watcher() i=0 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.599+0000 7f8b8f731800 2 removed watcher, disabling cache 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.599+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917568224864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34abdd0 con 0x556ae349e800 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.600+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93917568224864] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.600+0000 7f8b8f731800 20 remove_watcher() i=1 2024-04-24T01:24:23.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.600+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917568218416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34abdd0 con 0x556ae34a7b50 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.601+0000 7f8b82c35640 1 -- 172.21.15.169:0/2805634902 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93917568218416] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7405a040 con 0x556ae34a7b50 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.601+0000 7f8b8f731800 20 remove_watcher() i=2 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.601+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917568230784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab530 con 0x7f8b7405c410 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.602+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93917568230784] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x7f8b7405c410 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.602+0000 7f8b8f731800 20 remove_watcher() i=3 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.602+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917568232320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34abdd0 con 0x556ae349e800 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.603+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93917568232320] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b8400a4a0 con 0x556ae349e800 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.603+0000 7f8b8f731800 20 remove_watcher() i=4 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.603+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917568236832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ae580 con 0x556ae34a31f0 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.604+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93917568236832] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.604+0000 7f8b8f731800 20 remove_watcher() i=5 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.604+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917568241456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34ab530 con 0x556ae34a31f0 2024-04-24T01:24:23.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.606+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93917568241456] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.606+0000 7f8b8f731800 20 remove_watcher() i=6 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.606+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917568244304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556ae34aeb80 con 0x556ae34a31f0 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8b436640 1 -- 172.21.15.169:0/2805634902 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93917568244304] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b7c02b070 con 0x556ae34a31f0 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 20 remove_watcher() i=7 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae34a31f0 msgr2=0x556ae34a55e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae34a31f0 0x556ae34a55e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae349e800 msgr2=0x556ae34a0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae349e800 0x556ae34a0cc0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8b7405c410 msgr2=0x7f8b7405c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8b7405c410 0x7f8b7405c850 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556ae34a7b50 msgr2=0x556ae34aa010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556ae34a7b50 0x556ae34aa010 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a54036950 msgr2=0x7f8a54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a54036950 0x7f8a54038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x556ae3470c80 tx=0x7f8b7404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 msgr2=0x556ae3493060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8bc37640 1 -- 172.21.15.169:0/2805634902 reap_dead start 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c022710 tx=0x7f8b7c00a4d0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 shutdown_connections 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2805634902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae348bca0 0x556ae3493060 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 >> 172.21.15.169:0/2805634902 conn(0x556ae3487f20 msgr2=0x556ae3485580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 shutdown_connections 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2805634902 wait complete. 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 msgr2=0x7f8a64038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 0x7f8a64038e30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8b74055040 tx=0x7f8b74005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 msgr2=0x556ae347f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c04aa30 tx=0x7f8b7c04ac30 comp rx=0 tx=0).stop 2024-04-24T01:24:23.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 shutdown_connections 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a64036970 0x7f8a64038e30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 --2- 172.21.15.169:0/2806629244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae347ec70 0x556ae347f090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.607+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 >> 172.21.15.169:0/2806629244 conn(0x556ae3472d10 msgr2=0x556ae3473110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 shutdown_connections 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/2806629244 wait complete. 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae3469d90 msgr2=0x556ae346c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556ae3469d90 0x556ae346c180 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae3365310 msgr2=0x556ae34674b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556ae3365310 0x556ae34674b0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556ae346dcd0 msgr2=0x556ae3470120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556ae346dcd0 0x556ae3470120 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a70036950 msgr2=0x7f8a70038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8a70036950 0x7f8a70038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8b74054000 tx=0x7f8b7404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 msgr2=0x556ae3460270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 --2- 172.21.15.169:0/1188826490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ae33637d0 0x556ae3460270 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00c010 tx=0x7f8b7c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8bc37640 1 -- 172.21.15.169:0/1188826490 reap_dead start 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 shutdown_connections 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 >> 172.21.15.169:0/1188826490 conn(0x556ae335f370 msgr2=0x556ae3452850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 shutdown_connections 2024-04-24T01:24:23.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.608+0000 7f8b8f731800 1 -- 172.21.15.169:0/1188826490 wait complete. 2024-04-24T01:24:23.628 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:24:23.594967Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:23.594954Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:23.634 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:24:23.638 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:23.638 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-04-24T01:24:23.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-04-24T01:24:23.639 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-04-24T01:24:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.680 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.679+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.679+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.679+0000 7f24f8946800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559a0ffb4d20 0x559a0ffb5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.679+0000 7f24f8946800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559a0fe74d40 con 0x559a0ffb5f80 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.679+0000 7f24f8946800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559a0fe474d0 con 0x559a0ffb4d20 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f644c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559a0ffb4d20 0x559a0ffb5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f644c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559a0ffb4d20 0x559a0ffb5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34634/0 (socket says 172.21.15.169:34634) 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f644c640 1 -- 172.21.15.169:0/171859272 learned_addr learned my addr 172.21.15.169:0/171859272 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f5c4b640 1 --1- 172.21.15.169:0/171859272 >> v1:172.21.15.142:6789/0 conn(0x559a0ffb5f80 0x559a0ffb6400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34844/0 (socket says 172.21.15.169:34844) 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f644c640 1 -- 172.21.15.169:0/171859272 >> v1:172.21.15.142:6789/0 conn(0x559a0ffb5f80 legacy=0x559a0ffb6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.680+0000 7f24f644c640 1 -- 172.21.15.169:0/171859272 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a0fe73590 con 0x559a0ffb4d20 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f644c640 1 --2- 172.21.15.169:0/171859272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ffb5140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00a520 tx=0x7f24ec01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92093a94efa78f69 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f544a640 1 -- 172.21.15.169:0/171859272 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec057070 con 0x559a0ffb4d20 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f544a640 1 -- 172.21.15.169:0/171859272 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec052570 con 0x559a0ffb4d20 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f544a640 1 -- 172.21.15.169:0/171859272 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec04ae60 con 0x559a0ffb4d20 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 -- 172.21.15.169:0/171859272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 msgr2=0x559a0ffb5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 --2- 172.21.15.169:0/171859272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ffb5140 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00a520 tx=0x7f24ec01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 -- 172.21.15.169:0/171859272 shutdown_connections 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 --2- 172.21.15.169:0/171859272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ffb5140 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 -- 172.21.15.169:0/171859272 >> 172.21.15.169:0/171859272 conn(0x559a0ffb0380 msgr2=0x559a0ffb27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 -- 172.21.15.169:0/171859272 shutdown_connections 2024-04-24T01:24:23.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.682+0000 7f24f8946800 1 -- 172.21.15.169:0/171859272 wait complete. 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.694+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.694+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.694+0000 7f24f8946800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.694+0000 7f24f8946800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559a0ff013c0 con 0x559a0ffb4d20 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34648/0 (socket says 172.21.15.169:34648) 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f24f644c640 1 -- 172.21.15.169:0/2176022302 learned_addr learned my addr 172.21.15.169:0/2176022302 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f24f644c640 1 -- 172.21.15.169:0/2176022302 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a100a6a40 con 0x559a0ffb4d20 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f24f644c640 1 --2- 172.21.15.169:0/2176022302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f24ec055040 tx=0x7f24ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a87aff27a4af82 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f23e4608640 1 -- 172.21.15.169:0/2176022302 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec057040 con 0x559a0ffb4d20 2024-04-24T01:24:23.697 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f23e4608640 1 -- 172.21.15.169:0/2176022302 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec052720 con 0x559a0ffb4d20 2024-04-24T01:24:23.698 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.695+0000 7f23e4608640 1 -- 172.21.15.169:0/2176022302 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec052a40 con 0x559a0ffb4d20 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- 172.21.15.169:0/2176022302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 msgr2=0x559a100a6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 --2- 172.21.15.169:0/2176022302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f24ec055040 tx=0x7f24ec04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- 172.21.15.169:0/2176022302 shutdown_connections 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 --2- 172.21.15.169:0/2176022302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a100a6470 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- 172.21.15.169:0/2176022302 >> 172.21.15.169:0/2176022302 conn(0x559a0ffb0380 msgr2=0x559a100a1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- 172.21.15.169:0/2176022302 shutdown_connections 2024-04-24T01:24:23.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- 172.21.15.169:0/2176022302 wait complete. 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.696+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f8946800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ff28f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f8946800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559a0ffbe3f0 con 0x559a0ffb4d20 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ff28f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ff28f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34660/0 (socket says 172.21.15.169:34660) 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f644c640 1 -- 172.21.15.169:0/1123927196 learned_addr learned my addr 172.21.15.169:0/1123927196 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f644c640 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a100b1d00 con 0x559a0ffb4d20 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f644c640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ff28f90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f24ec052540 tx=0x7f24ec003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f23e2e05640 1 -- 172.21.15.169:0/1123927196 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec073070 con 0x559a0ffb4d20 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f23e2e05640 1 -- 172.21.15.169:0/1123927196 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec052c90 con 0x559a0ffb4d20 2024-04-24T01:24:23.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a100b1ed0 con 0x559a0ffb4d20 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f23e2e05640 1 -- 172.21.15.169:0/1123927196 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec057070 con 0x559a0ffb4d20 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.697+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a100b2330 con 0x559a0ffb4d20 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f23e2e05640 1 -- 172.21.15.169:0/1123927196 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f24ec076070 con 0x559a0ffb4d20 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f23e2e05640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23dc036950 0x7f23dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f23e2e05640 1 -- 172.21.15.169:0/1123927196 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f24ec08da30 con 0x559a0ffb4d20 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23dc036950 0x7f23dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a0ffb5f80 0x559a100b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.698+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100b6770 con 0x559a0ffb5f80 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a0ffb5f80 0x559a100b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23dc036950 0x7f23dc038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000f60 tx=0x7f24e8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a0ffb5f80 0x559a100b61a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f6c4d640 1 -- 172.21.15.169:0/1123927196 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a0ffb5f80 2024-04-24T01:24:23.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100b3740 con 0x559a0ffb5f80 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f6c4d640 1 -- 172.21.15.169:0/1123927196 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a0ffb5f80 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.699+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100b8a70 0x559a100bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100bb550 con 0x559a100b8a70 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f644c640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100b8a70 0x559a100bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f644c640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100b8a70 0x559a100bae60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f644c640 1 -- 172.21.15.169:0/1123927196 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f24ec075030 con 0x559a100b8a70 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100b7a20 con 0x559a0ffb5f80 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.700+0000 7f24f6c4d640 1 -- 172.21.15.169:0/1123927196 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a0ffb5f80 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559a100bca00 0x559a100bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100bf5b0 con 0x559a100bca00 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559a100bca00 0x559a100bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559a100bca00 0x559a100bee50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f5c4b640 1 -- 172.21.15.169:0/1123927196 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f24e800f690 con 0x559a100bca00 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.701+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f8946800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f8946800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559a0fea76b0 con 0x559a100cda10 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34674/0 (socket says 172.21.15.169:34674) 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f644c640 1 -- 172.21.15.169:0/1732126649 learned_addr learned my addr 172.21.15.169:0/1732126649 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f644c640 1 -- 172.21.15.169:0/1732126649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a100ce370 con 0x559a100cda10 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f644c640 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f24ec08be50 tx=0x7f24ec077df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f23dbfff640 1 -- 172.21.15.169:0/1732126649 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec083040 con 0x559a100cda10 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f23dbfff640 1 -- 172.21.15.169:0/1732126649 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec091070 con 0x559a100cda10 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f23dbfff640 1 -- 172.21.15.169:0/1732126649 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec05d440 con 0x559a100cda10 2024-04-24T01:24:23.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.702+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a100cede0 con 0x559a100cda10 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.703+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a100cf2e0 con 0x559a100cda10 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.703+0000 7f23dbfff640 1 -- 172.21.15.169:0/1732126649 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f24ec086030 con 0x559a100cda10 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.703+0000 7f23dbfff640 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 0x7f23d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f23dbfff640 1 -- 172.21.15.169:0/1732126649 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f24ec097cc0 con 0x559a100cda10 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 0x7f23d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 0x7f23d0038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559a100b3ae0 tx=0x7f24e800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f8946800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f8946800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559a100a6d00 con 0x559a100af2e0 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34680/0 (socket says 172.21.15.169:34680) 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f644c640 1 -- 172.21.15.169:0/2553438774 learned_addr learned my addr 172.21.15.169:0/2553438774 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.704+0000 7f24f644c640 1 -- 172.21.15.169:0/2553438774 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a100adae0 con 0x559a100af2e0 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f644c640 1 --2- 172.21.15.169:0/2553438774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f24ec07ff00 tx=0x7f24ec07ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bb690696eb6de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f23d9ffb640 1 -- 172.21.15.169:0/2553438774 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec05d5e0 con 0x559a100af2e0 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f23d9ffb640 1 -- 172.21.15.169:0/2553438774 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec05d780 con 0x559a100af2e0 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f23d9ffb640 1 -- 172.21.15.169:0/2553438774 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec08d510 con 0x559a100af2e0 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 -- 172.21.15.169:0/2553438774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 msgr2=0x559a100af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 --2- 172.21.15.169:0/2553438774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f24ec07ff00 tx=0x7f24ec07ff30 comp rx=0 tx=0).stop 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 -- 172.21.15.169:0/2553438774 shutdown_connections 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 --2- 172.21.15.169:0/2553438774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100af700 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 -- 172.21.15.169:0/2553438774 >> 172.21.15.169:0/2553438774 conn(0x559a100d6eb0 msgr2=0x559a100d4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 -- 172.21.15.169:0/2553438774 shutdown_connections 2024-04-24T01:24:23.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 -- 172.21.15.169:0/2553438774 wait complete. 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.705+0000 7f24f8946800 1 Processor -- start 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f8946800 1 -- start start 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f8946800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f8946800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559a100adef0 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f644c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34684/0 (socket says 172.21.15.169:34684) 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 learned_addr learned my addr 172.21.15.169:0/524680462 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a100e4640 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f644c640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f24ec07fc40 tx=0x7f24ec090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f23c7fff640 1 -- 172.21.15.169:0/524680462 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec0bd070 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f23c7fff640 1 -- 172.21.15.169:0/524680462 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec07f0e0 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559a100e4640 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f23c7fff640 1 -- 172.21.15.169:0/524680462 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec07f3c0 con 0x559a100af2e0 2024-04-24T01:24:23.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.706+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a100e4640 con 0x559a100af2e0 2024-04-24T01:24:23.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.707+0000 7f23c7fff640 1 -- 172.21.15.169:0/524680462 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f24ec0c0070 con 0x559a100af2e0 2024-04-24T01:24:23.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.707+0000 7f23c7fff640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23c0036950 0x7f23c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f23c7fff640 1 -- 172.21.15.169:0/524680462 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f24ec0a8070 con 0x559a100af2e0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23c0036950 0x7f23c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a100ef7d0 0x559a100f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f23e0 con 0x559a100ef7d0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a100ef7d0 0x559a100f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23c0036950 0x7f23c0038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559a100bf9b0 tx=0x7f24e8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a100ef7d0 0x559a100f1c90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 20 realm 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.708+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f27f0 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f30c0 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100f3f50 0x559a100f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f6a80 con 0x559a100f3f50 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.709+0000 7f24f644c640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100f3f50 0x559a100f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f644c640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100f3f50 0x559a100f6340 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f8946800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f8946800 20 searching for the correct realm 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559a100f8b20 0x559a100fafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100fb6b0 con 0x559a100f8b20 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559a100f8b20 0x559a100fafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.710+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559a100f8b20 0x559a100fafe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f5c4b640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f24e800f070 0x7f24e803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100fb6b0 con 0x7f24e800f070 2024-04-24T01:24:23.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f24e800f070 0x7f24e803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f6c4d640 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f24e800f070 0x7f24e803a3c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.711+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100ef7d0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100ef7d0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.712+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559a100f3460 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x7f24e800f070 2024-04-24T01:24:23.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.713+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x7f24e800f070 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.714+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.715+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.716+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x7f24e800f070 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.717+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x7f24e800f070 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f8b20 2024-04-24T01:24:23.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100f3f50 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.718+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x559a100ef7d0 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f24ec0d1040 con 0x7f24e800f070 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f7420 con 0x559a100ef7d0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f7420 con 0x559a100ef7d0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.719+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f7420 con 0x7f24e800f070 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 zone default found 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 4 Realm: () 2024-04-24T01:24:23.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 zonegroup default 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100f7810 con 0x559a100f3f50 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100fd510 con 0x559a100f8b20 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.720+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a100fd8b0 con 0x559a100f8b20 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.721+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.721+0000 7f24f8946800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.721+0000 7f24f8946800 20 started sync module instance, tier type = 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.721+0000 7f24f8946800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.721+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fc9b0 con 0x7f24e800f070 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.722+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.722+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94120182795680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fc9b0 con 0x7f24e800f070 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.722+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fe100 con 0x559a100ef7d0 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.723+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94120182795680] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.723+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.723+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94120182793952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fe100 con 0x559a100ef7d0 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.723+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100feac0 con 0x559a100f8b20 2024-04-24T01:24:23.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.724+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94120182793952] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.724+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.724+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94120182799440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fe070 con 0x559a100f8b20 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.724+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100ff980 con 0x7f24e800f070 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.725+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94120182799440] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.725+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.725+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94120182805712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100ffda0 con 0x7f24e800f070 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.725+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10100760 con 0x559a100ef7d0 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.726+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94120182805712] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.726+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.726+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94120182807248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10100760 con 0x559a100ef7d0 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.726+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10101120 con 0x559a100f3f50 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.727+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94120182807248] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.727+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.727+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94120182809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a101006d0 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.727+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10101e80 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.728+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94120182809264] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.729+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.729+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94120182813888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a101022a0 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.729+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10102ca0 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94120182818736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10102c10 con 0x559a100f3f50 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=0 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=1 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=2 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=3 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=4 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=5 2024-04-24T01:24:23.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94120182813888] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.730+0000 7f24f8946800 20 add_watcher() i=6 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94120182818736] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f8946800 20 add_watcher() i=7 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f8946800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a101018e0 con 0x559a100ef7d0 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.731+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94120182821008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a101018e0 con 0x559a100ef7d0 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.732+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94120182821008] v32'114 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.732+0000 7f23acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.732+0000 7f24f8946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.732+0000 7f24f8946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.732+0000 7f24f8946800 5 note: GC not initialized 2024-04-24T01:24:23.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f23277fe640 20 reqs_thread_entry: start 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f8946800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f8946800 20 Filter name: none 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f23257fa640 20 reqs_thread_entry: start 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f8946800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559a10138f50 con 0x7f24e800f070 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.733+0000 7f24f8946800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.734+0000 7f23acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.734+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94120182821008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10136e90 con 0x559a100ef7d0 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.735+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94120182821008] v32'115 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.735+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94120182795680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a10103090 con 0x7f24e800f070 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.736+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94120182795680] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.736+0000 7f24f8946800 20 remove_watcher() i=0 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.736+0000 7f24f8946800 2 removed watcher, disabling cache 2024-04-24T01:24:23.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.736+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94120182793952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fcda0 con 0x559a100ef7d0 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.737+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94120182793952] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.737+0000 7f24f8946800 20 remove_watcher() i=1 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.737+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94120182799440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fcda0 con 0x559a100f8b20 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.738+0000 7f24f5c4b640 1 -- 172.21.15.169:0/524680462 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94120182799440] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24e8037040 con 0x559a100f8b20 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.738+0000 7f24f8946800 20 remove_watcher() i=2 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.738+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94120182805712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fdc50 con 0x7f24e800f070 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.739+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94120182805712] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x7f24e800f070 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.739+0000 7f24f8946800 20 remove_watcher() i=3 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.739+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94120182807248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fdc50 con 0x559a100ef7d0 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.740+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94120182807248] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24f000a4a0 con 0x559a100ef7d0 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.740+0000 7f24f8946800 20 remove_watcher() i=4 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.740+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94120182809264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100ffad0 con 0x559a100f3f50 2024-04-24T01:24:23.754 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.741+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94120182809264] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.741+0000 7f24f8946800 20 remove_watcher() i=5 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.741+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94120182813888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a100fdc50 con 0x559a100f3f50 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.742+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94120182813888] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.742+0000 7f24f8946800 20 remove_watcher() i=6 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.742+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94120182818736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559a101002b0 con 0x559a100f3f50 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f644c640 1 -- 172.21.15.169:0/524680462 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94120182818736] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f24ec0bf030 con 0x559a100f3f50 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 20 remove_watcher() i=7 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100f3f50 msgr2=0x559a100f6340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100f3f50 0x559a100f6340 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a100ef7d0 msgr2=0x559a100f1c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a100ef7d0 0x559a100f1c90 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f24e800f070 msgr2=0x7f24e803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f24e800f070 0x7f24e803a3c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559a100f8b20 msgr2=0x559a100fafe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559a100f8b20 0x559a100fafe0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23c0036950 msgr2=0x7f23c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23c0036950 0x7f23c0038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x559a100bf9b0 tx=0x7f24e8010000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 msgr2=0x559a100e4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f6c4d640 1 -- 172.21.15.169:0/524680462 reap_dead start 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f24ec07fc40 tx=0x7f24ec090f00 comp rx=0 tx=0).stop 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 shutdown_connections 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/524680462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100af2e0 0x559a100e4100 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 >> 172.21.15.169:0/524680462 conn(0x559a100d6eb0 msgr2=0x559a100d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 shutdown_connections 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/524680462 wait complete. 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 msgr2=0x7f23d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 0x7f23d0038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x559a100b3ae0 tx=0x7f24e800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 msgr2=0x559a100cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.743+0000 7f24f8946800 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f24ec08be50 tx=0x7f24ec077df0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 shutdown_connections 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23d0036950 0x7f23d0038e10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1732126649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a100cda10 0x559a100cde30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 >> 172.21.15.169:0/1732126649 conn(0x559a100c1ab0 msgr2=0x559a100c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 shutdown_connections 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1732126649 wait complete. 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100b8a70 msgr2=0x559a100bae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559a100b8a70 0x559a100bae60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a0ffb5f80 msgr2=0x559a100b61a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559a0ffb5f80 0x559a100b61a0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559a100bca00 msgr2=0x559a100bee50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559a100bca00 0x559a100bee50 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23dc036950 msgr2=0x7f23dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f23dc036950 0x7f23dc038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24e8000f60 tx=0x7f24e8001370 comp rx=0 tx=0).stop 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 msgr2=0x559a0ff28f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 --2- 172.21.15.169:0/1123927196 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559a0ffb4d20 0x559a0ff28f90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f24ec052540 tx=0x7f24ec003020 comp rx=0 tx=0).stop 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f6c4d640 1 -- 172.21.15.169:0/1123927196 reap_dead start 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 shutdown_connections 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 >> 172.21.15.169:0/1123927196 conn(0x559a0ffb0380 msgr2=0x559a100a0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 shutdown_connections 2024-04-24T01:24:23.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.744+0000 7f24f8946800 1 -- 172.21.15.169:0/1123927196 wait complete. 2024-04-24T01:24:23.759 INFO:teuthology.orchestra.run.smithi169.stdout:{"key":"bucket:myfoo","ver":{"tag":"_vq0vFc757DY-gCdNUGenJpO","ver":2},"mtime":"2024-04-24T01:24:23.433463Z","data":{"bucket":{"name":"myfoo","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","bucket_id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-04-24T01:24:22.157363Z","linked":false,"has_bucket_info":false}} 2024-04-24T01:24:23.759 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_vq0vFc757DY-gCdNUGenJpO', 'ver': 2}, 'mtime': '2024-04-24T01:24:23.433463Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'bucket_id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-04-24T01:24:22.157363Z', 'linked': False, 'has_bucket_info': False}} 2024-04-24T01:24:23.760 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1'] 2024-04-24T01:24:23.760 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1'] 2024-04-24T01:24:23.760 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:23.846 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.846 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8af392f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55807f8d1120 0x55807f8d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8af392f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55807f791d40 con 0x55807f8d4160 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8af392f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55807f7644d0 con 0x55807f8d1120 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8aef5b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55807f8d1120 0x55807f8d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8aef5b5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55807f8d1120 0x55807f8d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34686/0 (socket says 172.21.15.169:34686) 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8aef5b5640 1 -- 172.21.15.169:0/2822624580 learned_addr learned my addr 172.21.15.169:0/2822624580 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.845+0000 7f8aeedb4640 1 --1- 172.21.15.169:0/2822624580 >> v1:172.21.15.142:6789/0 conn(0x55807f8d4160 0x55807f8d4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34846/0 (socket says 172.21.15.169:34846) 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.846+0000 7f8aef5b5640 1 -- 172.21.15.169:0/2822624580 >> v1:172.21.15.142:6789/0 conn(0x55807f8d4160 legacy=0x55807f8d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.846+0000 7f8aee5b3640 1 -- 172.21.15.169:0/2822624580 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795797609 0 0) 0x55807f791d40 con 0x55807f8d4160 2024-04-24T01:24:23.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.846+0000 7f8aef5b5640 1 -- 172.21.15.169:0/2822624580 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f790590 con 0x55807f8d1120 2024-04-24T01:24:23.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/2822624580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f8d1540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005fd0 tx=0x7f8ae001cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78530f2c48c7ec08 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8aee5b3640 1 -- 172.21.15.169:0/2822624580 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae0052540 con 0x55807f8d1120 2024-04-24T01:24:23.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8aee5b3640 1 -- 172.21.15.169:0/2822624580 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae004e070 con 0x55807f8d1120 2024-04-24T01:24:23.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8aee5b3640 1 -- 172.21.15.169:0/2822624580 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae0052850 con 0x55807f8d1120 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 -- 172.21.15.169:0/2822624580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 msgr2=0x55807f8d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 --2- 172.21.15.169:0/2822624580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f8d1540 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005fd0 tx=0x7f8ae001cd40 comp rx=0 tx=0).stop 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 -- 172.21.15.169:0/2822624580 shutdown_connections 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 --2- 172.21.15.169:0/2822624580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f8d1540 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 -- 172.21.15.169:0/2822624580 >> 172.21.15.169:0/2822624580 conn(0x55807f8ccb20 msgr2=0x55807f8cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 -- 172.21.15.169:0/2822624580 shutdown_connections 2024-04-24T01:24:23.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.848+0000 7f8af392f800 1 -- 172.21.15.169:0/2822624580 wait complete. 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.860+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.860+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.860+0000 7f8af392f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.860+0000 7f8af392f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55807f81e3e0 con 0x55807f8d1120 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34688/0 (socket says 172.21.15.169:34688) 2024-04-24T01:24:23.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1215871567 learned_addr learned my addr 172.21.15.169:0/1215871567 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1215871567 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f9c4a80 con 0x55807f8d1120 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/1215871567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0007000 tx=0x7f8ae004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95447f93b3180170 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f89dd60a640 1 -- 172.21.15.169:0/1215871567 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae0052860 con 0x55807f8d1120 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f89dd60a640 1 -- 172.21.15.169:0/1215871567 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae0058040 con 0x55807f8d1120 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.861+0000 7f89dd60a640 1 -- 172.21.15.169:0/1215871567 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae0052b50 con 0x55807f8d1120 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- 172.21.15.169:0/1215871567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 msgr2=0x55807f9c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 --2- 172.21.15.169:0/1215871567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0007000 tx=0x7f8ae004c000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- 172.21.15.169:0/1215871567 shutdown_connections 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 --2- 172.21.15.169:0/1215871567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9c44b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- 172.21.15.169:0/1215871567 >> 172.21.15.169:0/1215871567 conn(0x55807f8ccb20 msgr2=0x55807f9bfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- 172.21.15.169:0/1215871567 shutdown_connections 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- 172.21.15.169:0/1215871567 wait complete. 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.862+0000 7f8af392f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55807f8dc5d0 con 0x55807f8d1120 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34702/0 (socket says 172.21.15.169:34702) 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1186142030 learned_addr learned my addr 172.21.15.169:0/1186142030 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f9cc4e0 con 0x55807f8d1120 2024-04-24T01:24:23.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9cbfa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0007000 tx=0x7f8ae0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f89dbe07640 1 -- 172.21.15.169:0/1186142030 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae005d630 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f89dbe07640 1 -- 172.21.15.169:0/1186142030 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae005d7d0 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55807f9cc770 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f89dbe07640 1 -- 172.21.15.169:0/1186142030 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae005dad0 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.863+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807f9cf3d0 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f89dbe07640 1 -- 172.21.15.169:0/1186142030 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ae0050070 con 0x55807f8d1120 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f89dbe07640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89d4036950 0x7f89d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f89dbe07640 1 -- 172.21.15.169:0/1186142030 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ae0062070 con 0x55807f8d1120 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89d4036950 0x7f89d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807f8d4160 0x55807f9d3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807f9d36d0 con 0x55807f8d4160 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.864+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807f8d4160 0x55807f9d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89d4036950 0x7f89d4038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4000c00 tx=0x7f8ae40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807f8d4160 0x55807f9d3190 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8aefdb6640 1 -- 172.21.15.169:0/1186142030 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807f8d4160 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807f9d0720 con 0x55807f8d4160 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8aefdb6640 1 -- 172.21.15.169:0/1186142030 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807f8d4160 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807f9d59f0 0x55807f9d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.865+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807f9d84b0 con 0x55807f9d59f0 2024-04-24T01:24:23.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807f9d59f0 0x55807f9d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807f9d59f0 0x55807f9d7de0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1186142030 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ae0078070 con 0x55807f9d59f0 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807f9d49a0 con 0x55807f8d4160 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8aefdb6640 1 -- 172.21.15.169:0/1186142030 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807f8d4160 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55807f9d98f0 0x55807f9dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.866+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807f9dc4d0 con 0x55807f9d98f0 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.867+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55807f9d98f0 0x55807f9dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.867+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55807f9d98f0 0x55807f9dbd40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.867+0000 7f8aeedb4640 1 -- 172.21.15.169:0/1186142030 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ae400f670 con 0x55807f9d98f0 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.867+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.867+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8af392f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8af392f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55807f7c46b0 con 0x55807f9ea930 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34712/0 (socket says 172.21.15.169:34712) 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1985029906 learned_addr learned my addr 172.21.15.169:0/1985029906 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8aef5b5640 1 -- 172.21.15.169:0/1985029906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f9eb290 con 0x55807f9ea930 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8ae008c990 tx=0x7f8ae0068bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f89d9602640 1 -- 172.21.15.169:0/1985029906 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae008e390 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f89d9602640 1 -- 172.21.15.169:0/1985029906 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae008b1c0 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55807f9ebd00 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f89d9602640 1 -- 172.21.15.169:0/1985029906 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae008b4a0 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.868+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807f9ec200 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.869+0000 7f89d9602640 1 -- 172.21.15.169:0/1985029906 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ae005c5b0 con 0x55807f9ea930 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.869+0000 7f89d9602640 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 0x7f89c8038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.869+0000 7f89d9602640 1 -- 172.21.15.169:0/1985029906 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ae0088070 con 0x55807f9ea930 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.869+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 0x7f89c8038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.869+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 0x7f89c8038f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55807f9d3fa0 tx=0x7f8ae4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8af392f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8af392f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55807f9c4d40 con 0x55807f9f7ab0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34716/0 (socket says 172.21.15.169:34716) 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4105730853 learned_addr learned my addr 172.21.15.169:0/4105730853 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4105730853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f9f84a0 con 0x55807f9f7ab0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/4105730853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0052c10 tx=0x7f8ae005cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b2547150c2d63e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f89d2ffd640 1 -- 172.21.15.169:0/4105730853 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae00a8070 con 0x55807f9f7ab0 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f89d2ffd640 1 -- 172.21.15.169:0/4105730853 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae0073d90 con 0x55807f9f7ab0 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.870+0000 7f89d2ffd640 1 -- 172.21.15.169:0/4105730853 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae007ccb0 con 0x55807f9f7ab0 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- 172.21.15.169:0/4105730853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 msgr2=0x55807f9f7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 --2- 172.21.15.169:0/4105730853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0052c10 tx=0x7f8ae005cc70 comp rx=0 tx=0).stop 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- 172.21.15.169:0/4105730853 shutdown_connections 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 --2- 172.21.15.169:0/4105730853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9f7ed0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- 172.21.15.169:0/4105730853 >> 172.21.15.169:0/4105730853 conn(0x55807f9f3d80 msgr2=0x55807f9f1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- 172.21.15.169:0/4105730853 shutdown_connections 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- 172.21.15.169:0/4105730853 wait complete. 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 Processor -- start 2024-04-24T01:24:23.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- start start 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9fedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8af392f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55807f9f8b00 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.871+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9fedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8aef5b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9fedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34728/0 (socket says 172.21.15.169:34728) 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 learned_addr learned my addr 172.21.15.169:0/4208831170 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55807f9ff310 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9fedd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0068980 tx=0x7f8ae0092ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f89d17fa640 1 -- 172.21.15.169:0/4208831170 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae00b3020 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f89d17fa640 1 -- 172.21.15.169:0/4208831170 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae00a9040 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55807f9ff310 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f89d17fa640 1 -- 172.21.15.169:0/4208831170 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ae00a8070 con 0x55807f9f7ab0 2024-04-24T01:24:23.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.872+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55807f9ff310 con 0x55807f9f7ab0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.873+0000 7f89d17fa640 1 -- 172.21.15.169:0/4208831170 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ae00b6020 con 0x55807f9f7ab0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.873+0000 7f89d17fa640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89b8036950 0x7f89b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.873+0000 7f89d17fa640 1 -- 172.21.15.169:0/4208831170 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f8ae00b9c60 con 0x55807f9f7ab0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.873+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89b8036950 0x7f89b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.873+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89b8036950 0x7f89b8038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55807f9dc8d0 tx=0x7f8ae4023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807fa0a400 0x55807fa0c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0d010 con 0x55807fa0a400 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807fa0a400 0x55807fa0c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807fa0a400 0x55807fa0c8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807fa0a400 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 realm 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0d420 con 0x55807fa0a400 2024-04-24T01:24:23.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807fa0a400 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.874+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807fa0a400 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0e090 con 0x55807fa0a400 2024-04-24T01:24:23.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807fa0a400 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807fa0ea50 0x55807fa10e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa11450 con 0x55807fa0ea50 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807fa0ea50 0x55807fa10e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.875+0000 7f8aef5b5640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807fa0ea50 0x55807fa10e40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8af392f800 20 searching for the correct realm 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55807fa13400 0x55807fa158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa15f90 con 0x55807fa13400 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55807fa13400 0x55807fa158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55807fa13400 0x55807fa158c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aeedb4640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8ae403a3c0 0x7f8ae403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.876+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa15f90 con 0x7f8ae403a3c0 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8ae403a3c0 0x7f8ae403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aefdb6640 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8ae403a3c0 0x7f8ae403a810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae80083e0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.877+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae80083e0 con 0x55807fa0a400 2024-04-24T01:24:23.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.878+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.879+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.880+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.881+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.882+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.883+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa13400 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0ea50 2024-04-24T01:24:23.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.884+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x55807fa0a400 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55807fa0dcf0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:23.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa11d10 con 0x55807fa0a400 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa11d10 con 0x55807fa0a400 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.885+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa11d10 con 0x7f8ae403a3c0 2024-04-24T01:24:23.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 zone default found 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 4 Realm: () 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 zonegroup default 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa12600 con 0x55807fa0ea50 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17df0 con 0x55807fa13400 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.886+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa18190 con 0x55807fa13400 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.887+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.887+0000 7f8af392f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.887+0000 7f8af392f800 20 started sync module instance, tier type = 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.887+0000 7f8af392f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:23.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.887+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17290 con 0x7f8ae403a3c0 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.888+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.888+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010385463184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17290 con 0x7f8ae403a3c0 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.888+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa18b50 con 0x55807fa0a400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.889+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010385463184] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.889+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.889+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010385467520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17290 con 0x55807fa0a400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.889+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa195c0 con 0x55807fa13400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.890+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010385467520] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.890+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.890+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010385460704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17200 con 0x55807fa13400 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.890+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1a4b0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.891+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010385460704] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.891+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.891+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010385473536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1a8d0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.891+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1b290 con 0x55807fa0a400 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.892+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.892+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010385477088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1b6b0 con 0x55807fa0a400 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.892+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1c190 con 0x55807fa0ea50 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.892+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010385473536] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.893+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.893+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010385480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1c580 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.893+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1cf40 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.894+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010385477088] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.894+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010385480864] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.894+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010385474592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1ca90 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1d7e0 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010385474592] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010385486640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1ca90 con 0x55807fa0ea50 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=0 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=1 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=2 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=3 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=4 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=5 2024-04-24T01:24:23.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.895+0000 7f8af392f800 20 add_watcher() i=6 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.896+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010385486640] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.896+0000 7f8af392f800 20 add_watcher() i=7 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.896+0000 7f8af392f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.896+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1b290 con 0x55807fa0a400 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.897+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.897+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010385487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1b290 con 0x55807fa0a400 2024-04-24T01:24:23.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010385487696] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f89a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8af392f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8af392f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8af392f800 5 note: GC not initialized 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f89a4fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8af392f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.898+0000 7f8af392f800 20 Filter name: none 2024-04-24T01:24:23.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f891e7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa53b90 con 0x55807fa0ea50 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.899+0000 7f8af392f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:23.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa55c70 con 0x7f8ae403a3c0 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa576c0 con 0x55807fa13400 2024-04-24T01:24:23.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.900+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa5c140 con 0x7f8ae403a3c0 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.901+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.902+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa62000 con 0x55807fa13400 2024-04-24T01:24:23.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94010385726816 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa5ca20 con 0x55807fa13400 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify (1) cookie 94010385460704 notify 137438953476 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55807fa57ab0 con 0x55807fa13400 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f89d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94010385460704 notifier 4500 bl.length()=752 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 notify.2 [notify cookie 94010385726816 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f89d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f89d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:23.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f89d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f89d2ffd640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f89b4003ea0 con 0x55807fa13400 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== watch-notify(notify_complete (2) cookie 94010385726816 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55807fa56c30 con 0x55807fa13400 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.903+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa60e50 con 0x55807fa0ea50 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.904+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 fud.buckets [call] v32'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.904+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa619b0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8af392f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8af392f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8af392f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94010385713072 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55807fa619b0 con 0x55807fa0ea50 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify (1) cookie 94010385474592 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55807f9eb290 con 0x55807fa0ea50 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f89d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94010385474592 notifier 4500 bl.length()=314 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(71 notify.6 [notify cookie 94010385713072 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f89d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f89d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f89d2ffd640 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f89b4003ea0 con 0x55807fa0ea50 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== watch-notify(notify_complete (2) cookie 94010385713072 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55807f9cf3d0 con 0x55807fa0ea50 2024-04-24T01:24:23.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.906+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.907+0000 7f89a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.907+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010385487696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa58ac0 con 0x55807fa0a400 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.908+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94010385487696] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.908+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010385463184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1d750 con 0x7f8ae403a3c0 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.909+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94010385463184] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.909+0000 7f8af392f800 20 remove_watcher() i=0 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.909+0000 7f8af392f800 2 removed watcher, disabling cache 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.909+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010385467520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17790 con 0x55807fa0a400 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.910+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94010385467520] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.910+0000 7f8af392f800 20 remove_watcher() i=1 2024-04-24T01:24:23.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.910+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010385460704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17790 con 0x55807fa13400 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.911+0000 7f8aeedb4640 1 -- 172.21.15.169:0/4208831170 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94010385460704] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae4037040 con 0x55807fa13400 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.911+0000 7f8af392f800 20 remove_watcher() i=2 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.911+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010385473536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa16de0 con 0x7f8ae403a3c0 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.912+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94010385473536] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x7f8ae403a3c0 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.912+0000 7f8af392f800 20 remove_watcher() i=3 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.912+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010385477088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17790 con 0x55807fa0a400 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.913+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94010385477088] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae8026040 con 0x55807fa0a400 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.913+0000 7f8af392f800 20 remove_watcher() i=4 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.913+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010385480864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa1a000 con 0x55807fa0ea50 2024-04-24T01:24:23.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.914+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94010385480864] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.914+0000 7f8af392f800 20 remove_watcher() i=5 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.914+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010385474592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa16de0 con 0x55807fa0ea50 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.915+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94010385474592] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.915+0000 7f8af392f800 20 remove_watcher() i=6 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.915+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010385486640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55807fa17790 con 0x55807fa0ea50 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8aef5b5640 1 -- 172.21.15.169:0/4208831170 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94010385486640] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ae0078070 con 0x55807fa0ea50 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 20 remove_watcher() i=7 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807fa0ea50 msgr2=0x55807fa10e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807fa0ea50 0x55807fa10e40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807fa0a400 msgr2=0x55807fa0c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807fa0a400 0x55807fa0c8c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8ae403a3c0 msgr2=0x7f8ae403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f8ae403a3c0 0x7f8ae403a810 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55807fa13400 msgr2=0x55807fa158c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55807fa13400 0x55807fa158c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89b8036950 msgr2=0x7f89b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89b8036950 0x7f89b8038e10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55807f9dc8d0 tx=0x7f8ae4023040 comp rx=0 tx=0).stop 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 msgr2=0x55807f9fedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 --2- 172.21.15.169:0/4208831170 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9f7ab0 0x55807f9fedd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0068980 tx=0x7f8ae0092ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 reap_dead start 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8aefdb6640 1 -- 172.21.15.169:0/4208831170 reap_dead start 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 shutdown_connections 2024-04-24T01:24:23.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 >> 172.21.15.169:0/4208831170 conn(0x55807f9f3d80 msgr2=0x55807f9f13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 shutdown_connections 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.916+0000 7f8af392f800 1 -- 172.21.15.169:0/4208831170 wait complete. 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 msgr2=0x7f89c8038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 0x7f89c8038f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55807f9d3fa0 tx=0x7f8ae4006000 comp rx=0 tx=0).stop 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 msgr2=0x55807f9ead50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8ae008c990 tx=0x7f8ae0068bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 shutdown_connections 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89c8036aa0 0x7f89c8038f60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1985029906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f9ea930 0x55807f9ead50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 >> 172.21.15.169:0/1985029906 conn(0x55807f9de9d0 msgr2=0x55807f9dedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 shutdown_connections 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1985029906 wait complete. 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807f9d59f0 msgr2=0x55807f9d7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55807f9d59f0 0x55807f9d7de0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807f8d4160 msgr2=0x55807f9d3190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55807f8d4160 0x55807f9d3190 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55807f9d98f0 msgr2=0x55807f9dbd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55807f9d98f0 0x55807f9dbd40 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89d4036950 msgr2=0x7f89d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89d4036950 0x7f89d4038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4000c00 tx=0x7f8ae40013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 msgr2=0x55807f9cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 --2- 172.21.15.169:0/1186142030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55807f8d1120 0x55807f9cbfa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0007000 tx=0x7f8ae0003330 comp rx=0 tx=0).stop 2024-04-24T01:24:23.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8aefdb6640 1 -- 172.21.15.169:0/1186142030 reap_dead start 2024-04-24T01:24:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 shutdown_connections 2024-04-24T01:24:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 >> 172.21.15.169:0/1186142030 conn(0x55807f8ccb20 msgr2=0x55807f9be630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 shutdown_connections 2024-04-24T01:24:23.949 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.917+0000 7f8af392f800 1 -- 172.21.15.169:0/1186142030 wait complete. 2024-04-24T01:24:23.950 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:23.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:23.950 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:24:23.993 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:23.993 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.992+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.992+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c905a2800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558ec716c330 0x558ec716e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c905a2800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ec7026d40 con 0x558ec7167f90 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c905a2800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x558ec6ff94d0 con 0x558ec716c330 2024-04-24T01:24:23.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c8d8a7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x558ec716c330 0x558ec716e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:23.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c8e0a8640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x558ec7167f90 0x558ec71683b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34862/0 (socket says 172.21.15.169:34862) 2024-04-24T01:24:23.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2404360687 learned_addr learned my addr 172.21.15.169:0/2404360687 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:23.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2404360687 >> v1:172.21.15.142:6789/0 conn(0x558ec7167f90 legacy=0x558ec71683b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.993+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2404360687 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec7025590 con 0x558ec716c330 2024-04-24T01:24:23.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.995+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2404360687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec716c330 0x558ec716e720 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a470 tx=0x7f6c8401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1637c454f5969803 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.995+0000 7f6c8d0a6640 1 -- 172.21.15.169:0/2404360687 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c84057070 con 0x558ec716c330 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.995+0000 7f6c8d0a6640 1 -- 172.21.15.169:0/2404360687 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84052570 con 0x558ec716c330 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.995+0000 7f6c8d0a6640 1 -- 172.21.15.169:0/2404360687 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c84052870 con 0x558ec716c330 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 -- 172.21.15.169:0/2404360687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec716c330 msgr2=0x558ec716e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2404360687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec716c330 0x558ec716e720 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400a470 tx=0x7f6c8401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 -- 172.21.15.169:0/2404360687 shutdown_connections 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2404360687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec716c330 0x558ec716e720 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 -- 172.21.15.169:0/2404360687 >> 172.21.15.169:0/2404360687 conn(0x558ec7163530 msgr2=0x558ec7165950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:23.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 -- 172.21.15.169:0/2404360687 shutdown_connections 2024-04-24T01:24:23.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:23.996+0000 7f6c905a2800 1 -- 172.21.15.169:0/2404360687 wait complete. 2024-04-24T01:24:24.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.007+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:24.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.007+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:24.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c905a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c905a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558ec70b33c0 con 0x558ec7167f90 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34748/0 (socket says 172.21.15.169:34748) 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2233543002 learned_addr learned my addr 172.21.15.169:0/2233543002 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2233543002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec70dbf60 con 0x558ec7167f90 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.008+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2233543002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c80001e10 tx=0x7f6c8000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed39abcb15be018 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6b7c608640 1 -- 172.21.15.169:0/2233543002 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80012020 con 0x558ec7167f90 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6b7c608640 1 -- 172.21.15.169:0/2233543002 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8000e5a0 con 0x558ec7167f90 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6b7c608640 1 -- 172.21.15.169:0/2233543002 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8000e8e0 con 0x558ec7167f90 2024-04-24T01:24:24.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 -- 172.21.15.169:0/2233543002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 msgr2=0x558ec70dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2233543002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6c80001e10 tx=0x7f6c8000b780 comp rx=0 tx=0).stop 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 -- 172.21.15.169:0/2233543002 shutdown_connections 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2233543002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec70dd9a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 -- 172.21.15.169:0/2233543002 >> 172.21.15.169:0/2233543002 conn(0x558ec7163530 msgr2=0x558ec7254a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 -- 172.21.15.169:0/2233543002 shutdown_connections 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.009+0000 7f6c905a2800 1 -- 172.21.15.169:0/2233543002 wait complete. 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:24.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c905a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec7262ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c905a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558ec716eff0 con 0x558ec7167f90 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec7262ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec7262ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34764/0 (socket says 172.21.15.169:34764) 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2901278765 learned_addr learned my addr 172.21.15.169:0/2901278765 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec72633e0 con 0x558ec7167f90 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.010+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec7262ea0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b7c0 tx=0x7f6c80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 -- 172.21.15.169:0/2901278765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80012030 con 0x558ec7167f90 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 -- 172.21.15.169:0/2901278765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80001470 con 0x558ec7167f90 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ec7263670 con 0x558ec7167f90 2024-04-24T01:24:24.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 -- 172.21.15.169:0/2901278765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8001a8d0 con 0x558ec7167f90 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec72662d0 con 0x558ec7167f90 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 -- 172.21.15.169:0/2901278765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c80015020 con 0x558ec7167f90 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b74036950 0x7f6b74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.011+0000 7f6b7ae05640 1 -- 172.21.15.169:0/2901278765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6c80020030 con 0x558ec7167f90 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b74036950 0x7f6b74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec716c330 0x558ec726a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec726a610 con 0x558ec716c330 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec716c330 0x558ec726a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b74036950 0x7f6b74038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c84054000 tx=0x7f6c8404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec716c330 0x558ec726a090 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2901278765 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec716c330 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.012+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec7267660 con 0x558ec716c330 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.013+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2901278765 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec716c330 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.013+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec726c920 0x558ec726ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.013+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec726f400 con 0x558ec726c920 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.013+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec726c920 0x558ec726ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.013+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec726c920 0x558ec726ed10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2901278765 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6c80018430 con 0x558ec726c920 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec726b8d0 con 0x558ec716c330 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2901278765 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec716c330 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558ec72708b0 0x558ec7272d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec7273460 con 0x558ec72708b0 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558ec72708b0 0x558ec7272d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558ec72708b0 0x558ec7272d00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.014+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2901278765 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6c84052a40 con 0x558ec72708b0 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:24.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c905a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c905a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558ec70596b0 con 0x558ec7281880 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34768/0 (socket says 172.21.15.169:34768) 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2573615849 learned_addr learned my addr 172.21.15.169:0/2573615849 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.015+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2573615849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec72821e0 con 0x558ec7281880 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c8004ae10 tx=0x7f6c80045f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6b73fff640 1 -- 172.21.15.169:0/2573615849 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80044840 con 0x558ec7281880 2024-04-24T01:24:24.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6b73fff640 1 -- 172.21.15.169:0/2573615849 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8003b070 con 0x558ec7281880 2024-04-24T01:24:24.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ec7282c50 con 0x558ec7281880 2024-04-24T01:24:24.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6b73fff640 1 -- 172.21.15.169:0/2573615849 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c800165e0 con 0x558ec7281880 2024-04-24T01:24:24.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.016+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec7282c50 con 0x558ec7281880 2024-04-24T01:24:24.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6b73fff640 1 -- 172.21.15.169:0/2573615849 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c80041040 con 0x558ec7281880 2024-04-24T01:24:24.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6b73fff640 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 0x7f6b68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6b73fff640 1 -- 172.21.15.169:0/2573615849 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6c80049d50 con 0x558ec7281880 2024-04-24T01:24:24.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 0x7f6b68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 0x7f6b68038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558ec726aed0 tx=0x7f6c84005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c905a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c905a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558ec70dc2e0 con 0x558ec728e8a0 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.017+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34772/0 (socket says 172.21.15.169:34772) 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2601492774 learned_addr learned my addr 172.21.15.169:0/2601492774 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2601492774 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec728f290 con 0x558ec728e8a0 2024-04-24T01:24:24.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2601492774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c80003f00 tx=0x7f6c800082b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d44c38d65f3b824 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6b71ffb640 1 -- 172.21.15.169:0/2601492774 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80026d60 con 0x558ec728e8a0 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6b71ffb640 1 -- 172.21.15.169:0/2601492774 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8005c020 con 0x558ec728e8a0 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6b71ffb640 1 -- 172.21.15.169:0/2601492774 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c8004c230 con 0x558ec728e8a0 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c905a2800 1 -- 172.21.15.169:0/2601492774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 msgr2=0x558ec728ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.018+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2601492774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c80003f00 tx=0x7f6c800082b0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- 172.21.15.169:0/2601492774 shutdown_connections 2024-04-24T01:24:24.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2601492774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec728ecc0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- 172.21.15.169:0/2601492774 >> 172.21.15.169:0/2601492774 conn(0x558ec728ab70 msgr2=0x558ec7288bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- 172.21.15.169:0/2601492774 shutdown_connections 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- 172.21.15.169:0/2601492774 wait complete. 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 Processor -- start 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- start start 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c905a2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558ec728f960 con 0x558ec728e8a0 2024-04-24T01:24:24.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c8e0a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34782/0 (socket says 172.21.15.169:34782) 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 learned_addr learned my addr 172.21.15.169:0/2475380418 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.019+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ec72961b0 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c800082f0 tx=0x7f6c80004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6b5ffff640 1 -- 172.21.15.169:0/2475380418 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80036570 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6b5ffff640 1 -- 172.21.15.169:0/2475380418 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80016980 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ec72961b0 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6b5ffff640 1 -- 172.21.15.169:0/2475380418 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6c80036750 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ec72961b0 con 0x558ec728e8a0 2024-04-24T01:24:24.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.020+0000 7f6b5ffff640 1 -- 172.21.15.169:0/2475380418 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6c800368f0 con 0x558ec728e8a0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6b5ffff640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b58036900 0x7f6b58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6b5ffff640 1 -- 172.21.15.169:0/2475380418 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6c8006a070 con 0x558ec728e8a0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b58036900 0x7f6b58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b58036900 0x7f6b58038dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c84052fd0 tx=0x7f6c8404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec72a13c0 0x558ec72a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a3fd0 con 0x558ec72a13c0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.021+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec72a13c0 0x558ec72a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec72a13c0 0x558ec72a3880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.056 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 realm 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a43e0 con 0x558ec72a13c0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a4cb0 con 0x558ec72a13c0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.057 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.022+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a13c0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c905a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec72a5db0 0x558ec72a81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a87b0 con 0x558ec72a5db0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec72a5db0 0x558ec72a81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.023+0000 7f6c8e0a8640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec72a5db0 0x558ec72a81a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.058 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c905a2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c905a2800 20 searching for the correct realm 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558ec72aa740 0x558ec72acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ad2d0 con 0x558ec72aa740 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558ec72aa740 0x558ec72acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558ec72aa740 0x558ec72acc00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8d8a7640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6c84076040 0x7f6c84083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.024+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ad2d0 con 0x7f6c84076040 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.025+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6c84076040 0x7f6c84083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.025+0000 7f6c8e8a9640 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6c84076040 0x7f6c84083410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.059 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.025+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.025+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a13c0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a13c0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.026+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.060 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x7f6c84076040 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72aa740 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a13c0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.027+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a5db0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72a13c0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x7f6c84076040 2024-04-24T01:24:24.061 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a5050 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.028+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a5db0 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.029+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a13c0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a13c0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a5db0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.030+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x7f6c84076040 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a13c0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a5db0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.031+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a5db0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x7f6c84076040 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72aa740 2024-04-24T01:24:24.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a5db0 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.032+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x558ec72a13c0 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f6c84090040 con 0x7f6c84076040 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a9070 con 0x558ec72a13c0 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a9070 con 0x558ec72a13c0 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.033+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a9070 con 0x7f6c84076040 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 zone default found 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 4 Realm: () 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 zonegroup default 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72a9910 con 0x558ec72a5db0 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72af130 con 0x558ec72aa740 2024-04-24T01:24:24.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.034+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72af4d0 con 0x558ec72aa740 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.035+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.035+0000 7f6c905a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.035+0000 7f6c905a2800 20 started sync module instance, tier type = 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.035+0000 7f6c905a2800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.035+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae5d0 con 0x7f6c84076040 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.036+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.036+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94071715195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae5d0 con 0x7f6c84076040 2024-04-24T01:24:24.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.036+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72afd60 con 0x558ec72a13c0 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.037+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94071715195328] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.037+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.037+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94071715199088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae5d0 con 0x558ec72a13c0 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.037+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b07f0 con 0x558ec72aa740 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.038+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.038+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94071715201728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b1090 con 0x558ec72aa740 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.038+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b1b50 con 0x7f6c84076040 2024-04-24T01:24:24.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.038+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94071715199088] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.039+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.039+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94071715206688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b1f40 con 0x7f6c84076040 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.039+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b2900 con 0x558ec72a13c0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.039+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94071715201728] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.040+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.040+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94071715204064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b2900 con 0x558ec72a13c0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.040+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b3310 con 0x558ec72a5db0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.040+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94071715206688] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.041+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94071715204064] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.041+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.041+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94071715193120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b2900 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.041+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b3bb0 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.042+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94071715193120] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.042+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.042+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94071715215104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b3fd0 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.042+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b4990 con 0x558ec72a5db0 2024-04-24T01:24:24.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94071715218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b4db0 con 0x558ec72a5db0 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=0 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=1 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=2 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=3 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=4 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=5 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94071715215104] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.043+0000 7f6c905a2800 20 add_watcher() i=6 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94071715218656] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c905a2800 20 add_watcher() i=7 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c905a2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b3b20 con 0x558ec72a13c0 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.044+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94071715219712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b3b20 con 0x558ec72a13c0 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.045+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94071715219712] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.045+0000 7f6b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.046+0000 7f6c905a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.046+0000 7f6c905a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.046+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c0770 con 0x558ec72a13c0 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.047+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'46 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.047+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c0e40 con 0x558ec72a5db0 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.048+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.048+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c0e40 con 0x558ec72aa740 2024-04-24T01:24:24.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.049+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.049+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c18e0 con 0x558ec72a13c0 2024-04-24T01:24:24.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.050+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'119 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.050+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72be610 con 0x7f6c84076040 2024-04-24T01:24:24.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.051+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'39 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.051+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72be5b0 con 0x558ec72aa740 2024-04-24T01:24:24.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.052+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.052+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c2610 con 0x558ec72a13c0 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.053+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.053+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c2ac0 con 0x558ec72a5db0 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.054+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.054+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c2ac0 con 0x7f6c84076040 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.055+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.055+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c2ac0 con 0x558ec72aa740 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.056+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.056+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x7f6c84076040 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.057+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'40 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.057+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a5db0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.058+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.058+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x7f6c84076040 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.059+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.059+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a5db0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.060+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'39 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.060+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a13c0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.061+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'120 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.061+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.062+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.062+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x7f6c84076040 2024-04-24T01:24:24.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.063+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'41 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.063+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.064+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.064+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a13c0 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.065+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.066+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a13c0 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.066+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'121 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.066+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.068+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.068+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x7f6c84076040 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.069+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.069+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.070+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.070+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.070+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.070+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.072+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.072+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.073+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'34 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.073+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a5db0 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.074+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.074+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.075+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.075+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a5db0 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.076+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.076+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72aa740 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.077+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.077+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x558ec72a5db0 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.078+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'40 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.078+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72bd5a0 con 0x7f6c84076040 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6abf7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:24.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c905a2800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c905a2800 20 Filter name: none 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6abd7fa640 20 reqs_thread_entry: start 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c905a2800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c905a2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.080+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ee030 con 0x558ec72a5db0 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c905a2800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c905a2800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:24:24.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c905a2800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c905a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ec72f0930 con 0x558ec72a5db0 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.081+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.082+0000 7f6b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.082+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94071715219712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72c2ac0 con 0x558ec72a13c0 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.083+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94071715219712] v32'122 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.083+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94071715195328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b4900 con 0x7f6c84076040 2024-04-24T01:24:24.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.084+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94071715195328] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.084+0000 7f6c905a2800 20 remove_watcher() i=0 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.084+0000 7f6c905a2800 2 removed watcher, disabling cache 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.084+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94071715199088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae9c0 con 0x558ec72a13c0 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.085+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94071715199088] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.085+0000 7f6c905a2800 20 remove_watcher() i=1 2024-04-24T01:24:24.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.085+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94071715201728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae9c0 con 0x558ec72aa740 2024-04-24T01:24:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.086+0000 7f6c8d8a7640 1 -- 172.21.15.169:0/2475380418 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94071715201728] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c84081070 con 0x558ec72aa740 2024-04-24T01:24:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.086+0000 7f6c905a2800 20 remove_watcher() i=2 2024-04-24T01:24:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.086+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94071715206688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b02c0 con 0x7f6c84076040 2024-04-24T01:24:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.087+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94071715206688] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x7f6c84076040 2024-04-24T01:24:24.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.087+0000 7f6c905a2800 20 remove_watcher() i=3 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.087+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94071715204064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b1620 con 0x558ec72a13c0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.088+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94071715204064] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c8800a4a0 con 0x558ec72a13c0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.088+0000 7f6c905a2800 20 remove_watcher() i=4 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.088+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94071715193120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b02c0 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.089+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94071715193120] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.089+0000 7f6c905a2800 20 remove_watcher() i=5 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.089+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94071715215104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72b0be0 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.090+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94071715215104] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.090+0000 7f6c905a2800 20 remove_watcher() i=6 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.090+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94071715218656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ec72ae120 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c8e0a8640 1 -- 172.21.15.169:0/2475380418 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94071715218656] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6c80074020 con 0x558ec72a5db0 2024-04-24T01:24:24.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 20 remove_watcher() i=7 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec72a5db0 msgr2=0x558ec72a81a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec72a5db0 0x558ec72a81a0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec72a13c0 msgr2=0x558ec72a3880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec72a13c0 0x558ec72a3880 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6c84076040 msgr2=0x7f6c84083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6c84076040 0x7f6c84083410 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558ec72aa740 msgr2=0x558ec72acc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x558ec72aa740 0x558ec72acc00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b58036900 msgr2=0x7f6b58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b58036900 0x7f6b58038dc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c84052fd0 tx=0x7f6c8404f000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2475380418 reap_dead start 2024-04-24T01:24:24.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 msgr2=0x558ec7295c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.091+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c800082f0 tx=0x7f6c80004ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 shutdown_connections 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2475380418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec728e8a0 0x558ec7295c70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 >> 172.21.15.169:0/2475380418 conn(0x558ec728ab70 msgr2=0x558ec72881d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 shutdown_connections 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2475380418 wait complete. 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 msgr2=0x7f6b68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 0x7f6b68038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x558ec726aed0 tx=0x7f6c84005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 msgr2=0x558ec7281ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c8004ae10 tx=0x7f6c80045f80 comp rx=0 tx=0).stop 2024-04-24T01:24:24.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 shutdown_connections 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b68036900 0x7f6b68038dc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2573615849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7281880 0x558ec7281ca0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 >> 172.21.15.169:0/2573615849 conn(0x558ec7275920 msgr2=0x558ec7275d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 shutdown_connections 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2573615849 wait complete. 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec726c920 msgr2=0x558ec726ed10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558ec726c920 0x558ec726ed10 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec716c330 msgr2=0x558ec726a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558ec716c330 0x558ec726a090 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558ec72708b0 msgr2=0x558ec7272d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x558ec72708b0 0x558ec7272d00 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b74036950 msgr2=0x7f6b74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6b74036950 0x7f6b74038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6c84054000 tx=0x7f6c8404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 msgr2=0x558ec7262ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 --2- 172.21.15.169:0/2901278765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ec7167f90 0x558ec7262ea0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b7c0 tx=0x7f6c80000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c8e8a9640 1 -- 172.21.15.169:0/2901278765 reap_dead start 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 shutdown_connections 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.092+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 >> 172.21.15.169:0/2901278765 conn(0x558ec7163530 msgr2=0x558ec70dc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.093+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 shutdown_connections 2024-04-24T01:24:24.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.093+0000 7f6c905a2800 1 -- 172.21.15.169:0/2901278765 wait complete. 2024-04-24T01:24:24.105 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:24:24.105 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T01:24:24.105 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-04-24T01:24:24.106 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-04-24T01:24:24.191 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.192 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a913f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55840eac8310 0x55840eac8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a913f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55840e986d40 con 0x55840eac6fd0 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a913f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55840e9594d0 con 0x55840eac8310 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a4e9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55840eac8310 0x55840eac8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a469a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55840eac6fd0 0x55840eac7480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34868/0 (socket says 172.21.15.169:34868) 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a4e9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55840eac8310 0x55840eac8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34784/0 (socket says 172.21.15.169:34784) 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a469a640 1 -- 172.21.15.169:0/2161527867 learned_addr learned my addr 172.21.15.169:0/2161527867 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2161527867 >> v1:172.21.15.142:6789/0 conn(0x55840eac6fd0 legacy=0x55840eac7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2161527867 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840e985590 con 0x55840eac8310 2024-04-24T01:24:24.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.191+0000 7fa7a3e99640 1 -- 172.21.15.169:0/2161527867 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186183024 0 0) 0x55840e986d40 con 0x55840eac6fd0 2024-04-24T01:24:24.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.193+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2161527867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac8310 0x55840eac8730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa79400a470 tx=0x7fa79401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4273625240e6245 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.193+0000 7fa7a3e99640 1 -- 172.21.15.169:0/2161527867 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794057070 con 0x55840eac8310 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.193+0000 7fa7a3e99640 1 -- 172.21.15.169:0/2161527867 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794052570 con 0x55840eac8310 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.193+0000 7fa7a3e99640 1 -- 172.21.15.169:0/2161527867 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794052870 con 0x55840eac8310 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 -- 172.21.15.169:0/2161527867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac8310 msgr2=0x55840eac8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2161527867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac8310 0x55840eac8730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa79400a470 tx=0x7fa79401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 -- 172.21.15.169:0/2161527867 shutdown_connections 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2161527867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac8310 0x55840eac8730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 -- 172.21.15.169:0/2161527867 >> 172.21.15.169:0/2161527867 conn(0x55840eac1b20 msgr2=0x55840eac3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 -- 172.21.15.169:0/2161527867 shutdown_connections 2024-04-24T01:24:24.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.194+0000 7fa7a913f800 1 -- 172.21.15.169:0/2161527867 wait complete. 2024-04-24T01:24:24.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.205+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a913f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a913f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55840ea133b0 con 0x55840eac6fd0 2024-04-24T01:24:24.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34796/0 (socket says 172.21.15.169:34796) 2024-04-24T01:24:24.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2290118201 learned_addr learned my addr 172.21.15.169:0/2290118201 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.206+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2290118201 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840ebbc060 con 0x55840eac6fd0 2024-04-24T01:24:24.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2290118201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa79404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c337292e2807ca07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa692e0d640 1 -- 172.21.15.169:0/2290118201 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794057070 con 0x55840eac6fd0 2024-04-24T01:24:24.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa692e0d640 1 -- 172.21.15.169:0/2290118201 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794063070 con 0x55840eac6fd0 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa692e0d640 1 -- 172.21.15.169:0/2290118201 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794052720 con 0x55840eac6fd0 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 -- 172.21.15.169:0/2290118201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 msgr2=0x55840eac6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2290118201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa79404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 -- 172.21.15.169:0/2290118201 shutdown_connections 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2290118201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840eac6a00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 -- 172.21.15.169:0/2290118201 >> 172.21.15.169:0/2290118201 conn(0x55840eac1b20 msgr2=0x55840ebb3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.207+0000 7fa7a913f800 1 -- 172.21.15.169:0/2290118201 shutdown_connections 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a913f800 1 -- 172.21.15.169:0/2290118201 wait complete. 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a913f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840ebc0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a913f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55840ead0450 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840ebc0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840ebc0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34808/0 (socket says 172.21.15.169:34808) 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.208+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/1235364974 learned_addr learned my addr 172.21.15.169:0/1235364974 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840ebc1390 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840ebc0e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa69160a640 1 -- 172.21.15.169:0/1235364974 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794052c70 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa69160a640 1 -- 172.21.15.169:0/1235364974 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79406c070 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa69160a640 1 -- 172.21.15.169:0/1235364974 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79405e480 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840ebc1620 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.209+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840ebc42d0 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa69160a640 1 -- 172.21.15.169:0/1235364974 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa79406e030 con 0x55840eac6fd0 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa69160a640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa68c036900 0x7fa68c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa69160a640 1 -- 172.21.15.169:0/1235364974 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa79408e230 con 0x55840eac6fd0 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa68c036900 0x7fa68c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840eac8310 0x55840ebc8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ebc8660 con 0x55840eac8310 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a569c640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840eac8310 0x55840ebc8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa68c036900 0x7fa68c038dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa798000c00 tx=0x7fa7980013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.210+0000 7fa7a569c640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840eac8310 0x55840ebc8090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a569c640 1 -- 172.21.15.169:0/1235364974 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840eac8310 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ebc5640 con 0x55840eac8310 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a569c640 1 -- 172.21.15.169:0/1235364974 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840eac8310 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ebca930 0x55840ebccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ebcd3c0 con 0x55840ebca930 2024-04-24T01:24:24.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.211+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ebca930 0x55840ebccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ebca930 0x55840ebccd20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/1235364974 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x55840eac7da0 con 0x55840ebca930 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ebc98b0 con 0x55840eac8310 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a569c640 1 -- 172.21.15.169:0/1235364974 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840eac8310 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55840ebce820 0x55840ebd0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.212+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ebd13f0 con 0x55840ebce820 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.213+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55840ebce820 0x55840ebd0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.213+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55840ebce820 0x55840ebd0c90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.213+0000 7fa7a469a640 1 -- 172.21.15.169:0/1235364974 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa79800f670 con 0x55840ebce820 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.213+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a913f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a913f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55840e9b96b0 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34810/0 (socket says 172.21.15.169:34810) 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/1495761453 learned_addr learned my addr 172.21.15.169:0/1495761453 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/1495761453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840ebe0140 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa79408c680 tx=0x7fa7940706b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa68a7fc640 1 -- 172.21.15.169:0/1495761453 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794084040 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa68a7fc640 1 -- 172.21.15.169:0/1495761453 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa794058040 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa68a7fc640 1 -- 172.21.15.169:0/1495761453 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794067950 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840ebe0bb0 con 0x55840ebdf7e0 2024-04-24T01:24:24.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.214+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840ebe10b0 con 0x55840ebdf7e0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.215+0000 7fa68a7fc640 1 -- 172.21.15.169:0/1495761453 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa794009af0 con 0x55840ebdf7e0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.215+0000 7fa68a7fc640 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 0x7fa67c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.215+0000 7fa68a7fc640 1 -- 172.21.15.169:0/1495761453 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa79409ca00 con 0x55840ebdf7e0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.215+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 0x7fa67c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a469a640 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 0x7fa67c038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55840ebc5580 tx=0x7fa798006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a913f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a913f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55840ebbc2f0 con 0x55840ebec900 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34820/0 (socket says 172.21.15.169:34820) 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2335053711 learned_addr learned my addr 172.21.15.169:0/2335053711 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2335053711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840ebed2f0 con 0x55840ebec900 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2335053711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa79408efd0 tx=0x7fa7940794b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f128c9fb9534a3f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa67bfff640 1 -- 172.21.15.169:0/2335053711 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79408ecd0 con 0x55840ebec900 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.216+0000 7fa67bfff640 1 -- 172.21.15.169:0/2335053711 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7940ac070 con 0x55840ebec900 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa67bfff640 1 -- 172.21.15.169:0/2335053711 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa794071160 con 0x55840ebec900 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- 172.21.15.169:0/2335053711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 msgr2=0x55840ebecd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2335053711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa79408efd0 tx=0x7fa7940794b0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- 172.21.15.169:0/2335053711 shutdown_connections 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2335053711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebecd20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- 172.21.15.169:0/2335053711 >> 172.21.15.169:0/2335053711 conn(0x55840ebe8c10 msgr2=0x55840ebe6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- 172.21.15.169:0/2335053711 shutdown_connections 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- 172.21.15.169:0/2335053711 wait complete. 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 Processor -- start 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- start start 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.217+0000 7fa7a913f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55840ebed980 con 0x55840ebec900 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a4e9b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34828/0 (socket says 172.21.15.169:34828) 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 learned_addr learned my addr 172.21.15.169:0/2955038510 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55840ebf41e0 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa794090f60 tx=0x7fa794090ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa67a7fc640 1 -- 172.21.15.169:0/2955038510 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79409ce00 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa67a7fc640 1 -- 172.21.15.169:0/2955038510 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79404f620 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55840ebf41e0 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa67a7fc640 1 -- 172.21.15.169:0/2955038510 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa79404f900 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.218+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55840ebf41e0 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.219+0000 7fa67a7fc640 1 -- 172.21.15.169:0/2955038510 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa7940a5040 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.219+0000 7fa67a7fc640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa670036900 0x7fa670038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.219+0000 7fa67a7fc640 1 -- 172.21.15.169:0/2955038510 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa7940a2040 con 0x55840ebec900 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.219+0000 7fa7a469a640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa670036900 0x7fa670038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a469a640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa670036900 0x7fa670038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa79800ffd0 tx=0x7fa798023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840ebff2a0 0x55840ec01760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec01eb0 con 0x55840ebff2a0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a569c640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840ebff2a0 0x55840ec01760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a569c640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840ebff2a0 0x55840ec01760 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 20 realm 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.220+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec022c0 con 0x55840ebff2a0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02b90 con 0x55840ebff2a0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ec03c90 0x55840ec06080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec06690 con 0x55840ec03c90 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.221+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ec03c90 0x55840ec06080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a4e9b640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ec03c90 0x55840ec06080 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a913f800 20 searching for the correct realm 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55840ec08640 0x55840ec0ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0b1d0 con 0x55840ec08640 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.222+0000 7fa7a469a640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55840ec08640 0x55840ec0ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a469a640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55840ec08640 0x55840ec0ab00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a469a640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa79802e910 0x7fa79803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0b1d0 con 0x7fa79802e910 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a569c640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa79802e910 0x7fa79803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a569c640 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa79802e910 0x7fa79803a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.223+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.224+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x7fa79802e910 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.225+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x7fa79802e910 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.226+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.227+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.227+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.227+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.227+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.228+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x7fa79802e910 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.229+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.230+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x7fa79802e910 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec08640 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x55840ebff2a0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.231+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55840ec02f30 con 0x7fa79802e910 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec06f50 con 0x55840ebff2a0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec06f50 con 0x55840ebff2a0 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec06f50 con 0x7fa79802e910 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.232+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 zone default found 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 4 Realm: () 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 zonegroup default 2024-04-24T01:24:24.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec077f0 con 0x55840ec03c90 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0d030 con 0x55840ec08640 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0d3d0 con 0x55840ec08640 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.233+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.234+0000 7fa7a913f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.234+0000 7fa7a913f800 20 started sync module instance, tier type = 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.234+0000 7fa7a913f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.234+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0c4d0 con 0x7fa79802e910 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.235+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.235+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025671559664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0c4d0 con 0x7fa79802e910 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.235+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0dd90 con 0x55840ebff2a0 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.236+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025671559664] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.236+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.236+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025671557632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0dd90 con 0x55840ebff2a0 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.236+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0e750 con 0x55840ec08640 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.237+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.237+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025671557632] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.237+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025671565984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0f020 con 0x55840ec08640 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.237+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0d8e0 con 0x7fa79802e910 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.238+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025671565984] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.238+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.238+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025671568240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0fa40 con 0x7fa79802e910 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.238+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec10400 con 0x55840ebff2a0 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.239+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025671568240] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.239+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.239+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025671571312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec10400 con 0x55840ebff2a0 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.239+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec10dc0 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.240+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.240+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025671575824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec11610 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.240+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec12010 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.240+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025671571312] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.241+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025671575824] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.242+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.242+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025671573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec123b0 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.242+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec12c00 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025671584080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec133c0 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=0 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=1 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=2 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=3 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=4 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=5 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025671573328] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.243+0000 7fa7a913f800 20 add_watcher() i=6 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025671584080] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a913f800 20 add_watcher() i=7 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a913f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec11b20 con 0x55840ebff2a0 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.244+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025671585360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec11b20 con 0x55840ebff2a0 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025671585360] v32'123 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa65afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa7a913f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa7a913f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa7a913f800 5 note: GC not initialized 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.245+0000 7fa659fe3640 20 reqs_thread_entry: start 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 20 Filter name: none 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa5cb7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec49700 con 0x55840ec03c90 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.246+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec4b7e0 con 0x7fa79802e910 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec4d220 con 0x55840ec08640 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:24.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.247+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec4ec20 con 0x55840ec03c90 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.248+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(65 fud.buckets [call] v32'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.248+0000 7fa7a913f800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.248+0000 7fa7a913f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.248+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec4f020 con 0x7fa79802e910 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a913f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a913f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a913f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a913f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.249+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec54bd0 con 0x7fa79802e910 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a913f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a913f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a913f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94025671837408 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55840ec52040 con 0x55840ec03c90 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify (1) cookie 94025671573328 notify 137438953482 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55840ebe0bb0 con 0x55840ec03c90 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa67bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94025671573328 notifier 4514 bl.length()=338 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(68 notify.6 [notify cookie 94025671837408 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa67bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa67bfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa67bfff640 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa668003ea0 con 0x55840ec03c90 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.250+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.251+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== watch-notify(notify_complete (2) cookie 94025671837408 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55840ebe0140 con 0x55840ec03c90 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.251+0000 7fa65afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.251+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025671585360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ebfc8c0 con 0x55840ebff2a0 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.252+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94025671585360] v32'124 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.252+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025671559664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ebfc410 con 0x7fa79802e910 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.253+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94025671559664] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.253+0000 7fa7a913f800 20 remove_watcher() i=0 2024-04-24T01:24:24.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.253+0000 7fa7a913f800 2 removed watcher, disabling cache 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.253+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025671557632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0c9d0 con 0x55840ebff2a0 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.254+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94025671557632] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.254+0000 7fa7a913f800 20 remove_watcher() i=1 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.254+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025671565984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0c200 con 0x55840ec08640 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.255+0000 7fa7a469a640 1 -- 172.21.15.169:0/2955038510 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94025671565984] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa798037040 con 0x55840ec08640 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.255+0000 7fa7a913f800 20 remove_watcher() i=2 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.255+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025671568240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0e2a0 con 0x7fa79802e910 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.256+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94025671568240] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x7fa79802e910 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.257+0000 7fa7a913f800 20 remove_watcher() i=3 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.257+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025671571312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0e2a0 con 0x55840ebff2a0 2024-04-24T01:24:24.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.258+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94025671571312] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa79c00a4a0 con 0x55840ebff2a0 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.258+0000 7fa7a913f800 20 remove_watcher() i=4 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.258+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025671575824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0f770 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.259+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94025671575824] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.259+0000 7fa7a913f800 20 remove_watcher() i=5 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.259+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025671573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0e2a0 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.260+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94025671573328] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.260+0000 7fa7a913f800 20 remove_watcher() i=6 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.260+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025671584080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55840ec0f770 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a4e9b640 1 -- 172.21.15.169:0/2955038510 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94025671584080] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa7940c2020 con 0x55840ec03c90 2024-04-24T01:24:24.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 20 remove_watcher() i=7 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ec03c90 msgr2=0x55840ec06080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ec03c90 0x55840ec06080 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840ebff2a0 msgr2=0x55840ec01760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840ebff2a0 0x55840ec01760 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa79802e910 msgr2=0x7fa79803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa79802e910 0x7fa79803a3c0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55840ec08640 msgr2=0x55840ec0ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55840ec08640 0x55840ec0ab00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa670036900 msgr2=0x7fa670038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa670036900 0x7fa670038dc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa79800ffd0 tx=0x7fa798023040 comp rx=0 tx=0).stop 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 msgr2=0x55840ebf3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a569c640 1 -- 172.21.15.169:0/2955038510 reap_dead start 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa794090f60 tx=0x7fa794090ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 shutdown_connections 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/2955038510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebec900 0x55840ebf3ca0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 >> 172.21.15.169:0/2955038510 conn(0x55840ebe8c10 msgr2=0x55840ebe6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 shutdown_connections 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/2955038510 wait complete. 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 msgr2=0x7fa67c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 0x7fa67c038dc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x55840ebc5580 tx=0x7fa798006000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 msgr2=0x55840ebdfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.261+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa79408c680 tx=0x7fa7940706b0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 shutdown_connections 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa67c036900 0x7fa67c038dc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1495761453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840ebdf7e0 0x55840ebdfc00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 >> 172.21.15.169:0/1495761453 conn(0x55840ebd3880 msgr2=0x55840ebd3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 shutdown_connections 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1495761453 wait complete. 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ebca930 msgr2=0x55840ebccd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55840ebca930 0x55840ebccd20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840eac8310 msgr2=0x55840ebc8090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55840eac8310 0x55840ebc8090 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55840ebce820 msgr2=0x55840ebd0c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55840ebce820 0x55840ebd0c90 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa68c036900 msgr2=0x7fa68c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa68c036900 0x7fa68c038dc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa798000c00 tx=0x7fa7980013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 msgr2=0x55840ebc0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 --2- 172.21.15.169:0/1235364974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55840eac6fd0 0x55840ebc0e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa794000c00 tx=0x7fa794002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a569c640 1 -- 172.21.15.169:0/1235364974 reap_dead start 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 shutdown_connections 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 >> 172.21.15.169:0/1235364974 conn(0x55840eac1b20 msgr2=0x55840ebb2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 shutdown_connections 2024-04-24T01:24:24.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.262+0000 7fa7a913f800 1 -- 172.21.15.169:0/1235364974 wait complete. 2024-04-24T01:24:24.311 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1'] 2024-04-24T01:24:24.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1'] 2024-04-24T01:24:24.311 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:24.358 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.358 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.357+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.357+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740453f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632c14218d0 0x5632c1423cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740453f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5632c12dfd40 con 0x5632c1424200 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740453f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5632c12b24d0 con 0x5632c14218d0 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740029b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632c14218d0 0x5632c1423cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740029b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5632c14218d0 0x5632c1423cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34842/0 (socket says 172.21.15.169:34842) 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f73ffa9a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5632c1424200 0x5632c14265f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:34882/0 (socket says 172.21.15.169:34882) 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740029b640 1 -- 172.21.15.169:0/820082186 learned_addr learned my addr 172.21.15.169:0/820082186 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740029b640 1 -- 172.21.15.169:0/820082186 >> v1:172.21.15.142:6789/0 conn(0x5632c1424200 legacy=0x5632c14265f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.358+0000 7f740029b640 1 -- 172.21.15.169:0/820082186 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c12de590 con 0x5632c14218d0 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.360+0000 7f740029b640 1 --2- 172.21.15.169:0/820082186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1423cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f73f000a520 tx=0x7f73f001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38061a6d514a68eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.360+0000 7f73ff299640 1 -- 172.21.15.169:0/820082186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0057070 con 0x5632c14218d0 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.360+0000 7f73ff299640 1 -- 172.21.15.169:0/820082186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f0052570 con 0x5632c14218d0 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.360+0000 7f73ff299640 1 -- 172.21.15.169:0/820082186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f004ae60 con 0x5632c14218d0 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 -- 172.21.15.169:0/820082186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 msgr2=0x5632c1423cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 --2- 172.21.15.169:0/820082186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1423cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f73f000a520 tx=0x7f73f001d010 comp rx=0 tx=0).stop 2024-04-24T01:24:24.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 -- 172.21.15.169:0/820082186 shutdown_connections 2024-04-24T01:24:24.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 --2- 172.21.15.169:0/820082186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1423cc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 -- 172.21.15.169:0/820082186 >> 172.21.15.169:0/820082186 conn(0x5632c141b3a0 msgr2=0x5632c141d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 -- 172.21.15.169:0/820082186 shutdown_connections 2024-04-24T01:24:24.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.361+0000 7f740453f800 1 -- 172.21.15.169:0/820082186 wait complete. 2024-04-24T01:24:24.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.372+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.372+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.372+0000 7f740453f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.372+0000 7f740453f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632c136c3e0 con 0x5632c14218d0 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34850/0 (socket says 172.21.15.169:34850) 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f740029b640 1 -- 172.21.15.169:0/1194146900 learned_addr learned my addr 172.21.15.169:0/1194146900 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f740029b640 1 -- 172.21.15.169:0/1194146900 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c1512770 con 0x5632c14218d0 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f740029b640 1 --2- 172.21.15.169:0/1194146900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73f0055040 tx=0x7f73f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78221523aaad4be1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f72ee60c640 1 -- 172.21.15.169:0/1194146900 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0057040 con 0x5632c14218d0 2024-04-24T01:24:24.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f72ee60c640 1 -- 172.21.15.169:0/1194146900 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f0052720 con 0x5632c14218d0 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.373+0000 7f72ee60c640 1 -- 172.21.15.169:0/1194146900 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0052a40 con 0x5632c14218d0 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 -- 172.21.15.169:0/1194146900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 msgr2=0x5632c15121a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 --2- 172.21.15.169:0/1194146900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f73f0055040 tx=0x7f73f004c000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 -- 172.21.15.169:0/1194146900 shutdown_connections 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 --2- 172.21.15.169:0/1194146900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c15121a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 -- 172.21.15.169:0/1194146900 >> 172.21.15.169:0/1194146900 conn(0x5632c141b3a0 msgr2=0x5632c150dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 -- 172.21.15.169:0/1194146900 shutdown_connections 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 -- 172.21.15.169:0/1194146900 wait complete. 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.374+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740453f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1421170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740453f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632c1427fb0 con 0x5632c14218d0 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1421170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1421170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34866/0 (socket says 172.21.15.169:34866) 2024-04-24T01:24:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740029b640 1 -- 172.21.15.169:0/692031391 learned_addr learned my addr 172.21.15.169:0/692031391 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740029b640 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c14216b0 con 0x5632c14218d0 2024-04-24T01:24:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740029b640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1421170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73f0052540 tx=0x7f73f0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f72ece09640 1 -- 172.21.15.169:0/692031391 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0073070 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f72ece09640 1 -- 172.21.15.169:0/692031391 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f005d440 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f72ece09640 1 -- 172.21.15.169:0/692031391 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0057070 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.375+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632c141f900 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.376+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c141fe20 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.376+0000 7f72ece09640 1 -- 172.21.15.169:0/692031391 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f73f0076070 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.376+0000 7f72ece09640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72e8036900 0x7f72e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.376+0000 7f72ece09640 1 -- 172.21.15.169:0/692031391 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73f008dbe0 con 0x5632c14218d0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.376+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72e8036900 0x7f72e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c1424200 0x5632c15230d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1523610 con 0x5632c1424200 2024-04-24T01:24:24.402 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f7400a9c640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c1424200 0x5632c15230d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72e8036900 0x7f72e8038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000f60 tx=0x7f73f4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f7400a9c640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c1424200 0x5632c15230d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f7400a9c640 1 -- 172.21.15.169:0/692031391 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c1424200 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.377+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c14202d0 con 0x5632c1424200 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f7400a9c640 1 -- 172.21.15.169:0/692031391 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c1424200 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c1525920 0x5632c1527d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15283b0 con 0x5632c1525920 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740029b640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c1525920 0x5632c1527d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740029b640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c1525920 0x5632c1527d10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740029b640 1 -- 172.21.15.169:0/692031391 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f73f0075030 con 0x5632c1525920 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.378+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15248d0 con 0x5632c1424200 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f7400a9c640 1 -- 172.21.15.169:0/692031391 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c1424200 2024-04-24T01:24:24.403 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632c1529860 0x5632c152bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c152c410 con 0x5632c1529860 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632c1529860 0x5632c152bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632c1529860 0x5632c152bcb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.379+0000 7f73ffa9a640 1 -- 172.21.15.169:0/692031391 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f73f400f690 con 0x5632c1529860 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740453f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740453f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632c13126b0 con 0x5632c153a870 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34880/0 (socket says 172.21.15.169:34880) 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740029b640 1 -- 172.21.15.169:0/124335730 learned_addr learned my addr 172.21.15.169:0/124335730 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740029b640 1 -- 172.21.15.169:0/124335730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c153b1d0 con 0x5632c153a870 2024-04-24T01:24:24.404 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740029b640 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f73f0076450 tx=0x7f73f0077ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f72e5ffb640 1 -- 172.21.15.169:0/124335730 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f0083040 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f72e5ffb640 1 -- 172.21.15.169:0/124335730 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f0091070 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.380+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632c153bc40 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f72e5ffb640 1 -- 172.21.15.169:0/124335730 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f005cde0 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c153c140 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f72e5ffb640 1 -- 172.21.15.169:0/124335730 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f73f0093020 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f72e5ffb640 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 0x7f72d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f72e5ffb640 1 -- 172.21.15.169:0/124335730 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73f0060110 con 0x5632c153a870 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.381+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 0x7f72d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.405 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 0x7f72d8038dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5632c14201f0 tx=0x7f73f400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740453f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740453f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632c1512a30 con 0x5632c1547a30 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34894/0 (socket says 172.21.15.169:34894) 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740029b640 1 -- 172.21.15.169:0/1130772034 learned_addr learned my addr 172.21.15.169:0/1130772034 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.382+0000 7f740029b640 1 -- 172.21.15.169:0/1130772034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c1548420 con 0x5632c1547a30 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740029b640 1 --2- 172.21.15.169:0/1130772034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f73f006e710 tx=0x7f73f0080c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8093d74251e54e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f72df7fe640 1 -- 172.21.15.169:0/1130772034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f00af070 con 0x5632c1547a30 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f72df7fe640 1 -- 172.21.15.169:0/1130772034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f005d720 con 0x5632c1547a30 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f72df7fe640 1 -- 172.21.15.169:0/1130772034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f005c3e0 con 0x5632c1547a30 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 -- 172.21.15.169:0/1130772034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 msgr2=0x5632c1547e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 --2- 172.21.15.169:0/1130772034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f73f006e710 tx=0x7f73f0080c80 comp rx=0 tx=0).stop 2024-04-24T01:24:24.406 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 -- 172.21.15.169:0/1130772034 shutdown_connections 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 --2- 172.21.15.169:0/1130772034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c1547e50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 -- 172.21.15.169:0/1130772034 >> 172.21.15.169:0/1130772034 conn(0x5632c1543d40 msgr2=0x5632c1541da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 -- 172.21.15.169:0/1130772034 shutdown_connections 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.383+0000 7f740453f800 1 -- 172.21.15.169:0/1130772034 wait complete. 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740453f800 1 Processor -- start 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740453f800 1 -- start start 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740453f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c154ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740453f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5632c1548ab0 con 0x5632c1547a30 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c154ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740029b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c154ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:34910/0 (socket says 172.21.15.169:34910) 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 learned_addr learned my addr 172.21.15.169:0/2795328914 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632c154f350 con 0x5632c1547a30 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.384+0000 7f740029b640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c154ee10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f73f008fd90 tx=0x7f73f004fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.407 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f72ddffb640 1 -- 172.21.15.169:0/2795328914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f00b9020 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f72ddffb640 1 -- 172.21.15.169:0/2795328914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f00b0040 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632c154f350 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f72ddffb640 1 -- 172.21.15.169:0/2795328914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73f00af070 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632c154f350 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.385+0000 7f72ddffb640 1 -- 172.21.15.169:0/2795328914 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f73f00bc020 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f72ddffb640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d0036900 0x7f72d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f72ddffb640 1 -- 172.21.15.169:0/2795328914 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f73f00bfc60 con 0x5632c1547a30 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d0036900 0x7f72d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d0036900 0x7f72d0038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5632c152c810 tx=0x7f73f4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.408 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c155a460 0x5632c155c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c155d070 con 0x5632c155a460 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.386+0000 7f7400a9c640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c155a460 0x5632c155c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f7400a9c640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c155a460 0x5632c155c920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 realm 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c155d480 con 0x5632c155a460 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.409 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c155dd50 con 0x5632c155a460 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.387+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c155ee50 0x5632c1561240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1561850 con 0x5632c155ee50 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740029b640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c155ee50 0x5632c1561240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740029b640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c155ee50 0x5632c1561240 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.410 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 20 searching for the correct realm 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632c1563800 0x5632c1565cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c1566390 con 0x5632c1563800 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.388+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632c1563800 0x5632c1565cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632c1563800 0x5632c1565cc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f73ffa9a640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f73f400f070 0x7f73f402e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c1566390 con 0x7f73f400f070 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f7400a9c640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f73f400f070 0x7f73f402e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.389+0000 7f7400a9c640 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f73f400f070 0x7f73f402e910 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.390+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x7f73f400f070 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.391+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.392+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x7f73f400f070 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.393+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.394+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.395+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.395+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.395+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.395+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x7f73f400f070 2024-04-24T01:24:24.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.396+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x7f73f400f070 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c1563800 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.397+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155ee50 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x5632c155a460 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5632c155e0f0 con 0x7f73f400f070 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.433 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1562110 con 0x5632c155a460 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.398+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1562110 con 0x5632c155a460 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.434 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1562110 con 0x7f73f400f070 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 zone default found 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 4 Realm: () 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 zonegroup default 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15629b0 con 0x5632c155ee50 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.435 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.399+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15681f0 con 0x5632c1563800 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c1568590 con 0x5632c1563800 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 20 started sync module instance, tier type = 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.400+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567690 con 0x7f73f400f070 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.401+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.401+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94775992024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567690 con 0x7f73f400f070 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.401+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1568f50 con 0x5632c155a460 2024-04-24T01:24:24.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.402+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94775992024000] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.402+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.402+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94775992021952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1568f50 con 0x5632c155a460 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.402+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1569910 con 0x5632c1563800 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.403+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94775992021952] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.403+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.403+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94775992027808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1568ec0 con 0x5632c1563800 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.403+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156a7d0 con 0x7f73f400f070 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.404+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94775992027808] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.404+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.404+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94775992034080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156abf0 con 0x7f73f400f070 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.404+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156b5b0 con 0x5632c155a460 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.405+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94775992034080] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.405+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.405+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94775992038112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156abf0 con 0x5632c155a460 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.406+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156bfc0 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.406+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.407+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94775992040208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156c860 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.407+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156d2c0 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.407+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94775992038112] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.407+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94775992040208] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.408+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.408+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94775992042416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156cde0 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.408+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156db20 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94775992047120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156df90 con 0x5632c155ee50 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=0 2024-04-24T01:24:24.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=1 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=2 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=3 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=4 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=5 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94775992042416] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=6 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94775992047120] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 20 add_watcher() i=7 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.409+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c156a740 con 0x5632c155a460 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.410+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.410+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94775992048352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156a740 con 0x5632c155a460 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94775992048352] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f72b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 5 note: GC not initialized 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f72b57e2640 20 reqs_thread_entry: start 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 20 Filter name: none 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f7226ffd640 20 reqs_thread_entry: start 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.411+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15a4310 con 0x5632c155a460 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:24.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15a63f0 con 0x7f73f400f070 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.412+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15a7c00 con 0x5632c1563800 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:24.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.413+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c15ac8c0 con 0x5632c155ee50 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.414+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(65 fud.buckets [call] v32'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.414+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c15b2730 con 0x5632c1563800 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f740453f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f740453f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f740453f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:24.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f740453f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94775992288112 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15ad1a0 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify (1) cookie 94775992027808 notify 137438953477 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5632c15a7ff0 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f72df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94775992027808 notifier 4521 bl.length()=752 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 notify.2 [notify cookie 94775992288112 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f72df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f72df7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f72df7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f72df7fe640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f72c4003ea0 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.415+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== watch-notify(notify_complete (2) cookie 94775992288112 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632c15a7120 con 0x5632c1563800 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f740453f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f740453f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:24.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f740453f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f740453f800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.416+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c15b15d0 con 0x7f73f400f070 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.417+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.417+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c15b2130 con 0x7f73f400f070 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740453f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740453f800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740453f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94775992274736 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5632c15a5800 con 0x5632c155ee50 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== watch-notify(notify (1) cookie 94775992042416 notify 137438953483 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5632c153b1d0 con 0x5632c155ee50 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f72df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94775992042416 notifier 4521 bl.length()=314 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f72df7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f72df7fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.6 [notify cookie 94775992274736 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f72df7fe640 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f72c4003ea0 con 0x5632c155ee50 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== watch-notify(notify_complete (2) cookie 94775992274736 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5632c141fe20 con 0x5632c155ee50 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.418+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.419+0000 7f72b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.419+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94775992048352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c15a96b0 con 0x5632c155a460 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.420+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94775992048352] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.420+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94775992024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156dae0 con 0x7f73f400f070 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.421+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94775992024000] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.421+0000 7f740453f800 20 remove_watcher() i=0 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.421+0000 7f740453f800 2 removed watcher, disabling cache 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.421+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94775992021952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567bc0 con 0x5632c155a460 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.422+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94775992021952] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.422+0000 7f740453f800 20 remove_watcher() i=1 2024-04-24T01:24:24.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.422+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94775992027808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567bc0 con 0x5632c1563800 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.423+0000 7f73ffa9a640 1 -- 172.21.15.169:0/2795328914 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94775992027808] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f4037040 con 0x5632c1563800 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.423+0000 7f740453f800 20 remove_watcher() i=2 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.423+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94775992034080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567bc0 con 0x7f73f400f070 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.424+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94775992034080] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x7f73f400f070 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.424+0000 7f740453f800 20 remove_watcher() i=3 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.424+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94775992038112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156a320 con 0x5632c155a460 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.425+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94775992038112] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f800a4a0 con 0x5632c155a460 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.425+0000 7f740453f800 20 remove_watcher() i=4 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.425+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94775992040208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c1567bc0 con 0x5632c155ee50 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.426+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94775992040208] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.426+0000 7f740453f800 20 remove_watcher() i=5 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.426+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94775992042416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156b2e0 con 0x5632c155ee50 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.427+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94775992042416] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.427+0000 7f740453f800 20 remove_watcher() i=6 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.427+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94775992047120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5632c156a320 con 0x5632c155ee50 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740029b640 1 -- 172.21.15.169:0/2795328914 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94775992047120] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73f0075030 con 0x5632c155ee50 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 20 remove_watcher() i=7 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c155ee50 msgr2=0x5632c1561240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c155ee50 0x5632c1561240 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c155a460 msgr2=0x5632c155c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c155a460 0x5632c155c920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f73f400f070 msgr2=0x7f73f402e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f73f400f070 0x7f73f402e910 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632c1563800 msgr2=0x5632c1565cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5632c1563800 0x5632c1565cc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d0036900 msgr2=0x7f72d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d0036900 0x7f72d0038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5632c152c810 tx=0x7f73f4010000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 msgr2=0x5632c154ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 --2- 172.21.15.169:0/2795328914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c1547a30 0x5632c154ee10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f73f008fd90 tx=0x7f73f004fee0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 reap_dead start 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f7400a9c640 1 -- 172.21.15.169:0/2795328914 reap_dead start 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 shutdown_connections 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 >> 172.21.15.169:0/2795328914 conn(0x5632c1543d40 msgr2=0x5632c15413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 shutdown_connections 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.428+0000 7f740453f800 1 -- 172.21.15.169:0/2795328914 wait complete. 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 msgr2=0x7f72d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 0x7f72d8038dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x5632c14201f0 tx=0x7f73f400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 msgr2=0x5632c153ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f73f0076450 tx=0x7f73f0077ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 shutdown_connections 2024-04-24T01:24:24.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72d8036900 0x7f72d8038dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/124335730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c153a870 0x5632c153ac90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 >> 172.21.15.169:0/124335730 conn(0x5632c152e910 msgr2=0x5632c152ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 shutdown_connections 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/124335730 wait complete. 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c1525920 msgr2=0x5632c1527d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5632c1525920 0x5632c1527d10 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c1424200 msgr2=0x5632c15230d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5632c1424200 0x5632c15230d0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632c1529860 msgr2=0x5632c152bcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5632c1529860 0x5632c152bcb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72e8036900 msgr2=0x7f72e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f72e8036900 0x7f72e8038dc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000f60 tx=0x7f73f4001370 comp rx=0 tx=0).stop 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 msgr2=0x5632c1421170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 --2- 172.21.15.169:0/692031391 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5632c14218d0 0x5632c1421170 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f73f0052540 tx=0x7f73f0003020 comp rx=0 tx=0).stop 2024-04-24T01:24:24.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f7400a9c640 1 -- 172.21.15.169:0/692031391 reap_dead start 2024-04-24T01:24:24.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 shutdown_connections 2024-04-24T01:24:24.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 >> 172.21.15.169:0/692031391 conn(0x5632c141b3a0 msgr2=0x5632c150c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 shutdown_connections 2024-04-24T01:24:24.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.429+0000 7f740453f800 1 -- 172.21.15.169:0/692031391 wait complete. 2024-04-24T01:24:24.451 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:24.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-04-24T01:24:24.451 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-04-24T01:24:24.496 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.496 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.495+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.495+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.495+0000 7ff1b5925800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f877013d20 0x55f877014140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.495+0000 7ff1b5925800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f876ed3d40 con 0x55f877014f80 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.495+0000 7ff1b5925800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55f876ea64d0 con 0x55f877013d20 2024-04-24T01:24:24.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1b16b7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f877013d20 0x55f877014140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1b16b7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f877013d20 0x55f877014140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58684/0 (socket says 172.21.15.169:58684) 2024-04-24T01:24:24.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1992983054 learned_addr learned my addr 172.21.15.169:0/1992983054 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1992983054 >> v1:172.21.15.142:6789/0 conn(0x55f877014f80 legacy=0x55f877015400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1992983054 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f876ed2590 con 0x55f877013d20 2024-04-24T01:24:24.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.496+0000 7ff1a3fff640 1 -- 172.21.15.169:0/1992983054 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 788432410 0 0) 0x55f876ed3d40 con 0x55f877014f80 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/1992983054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877014140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a520 tx=0x7ff1a401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80e7e4dded5daa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1a3fff640 1 -- 172.21.15.169:0/1992983054 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4057070 con 0x55f877013d20 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1a3fff640 1 -- 172.21.15.169:0/1992983054 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4052570 con 0x55f877013d20 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1a3fff640 1 -- 172.21.15.169:0/1992983054 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a404ae60 con 0x55f877013d20 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 -- 172.21.15.169:0/1992983054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 msgr2=0x55f877014140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1992983054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877014140 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400a520 tx=0x7ff1a401d010 comp rx=0 tx=0).stop 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 -- 172.21.15.169:0/1992983054 shutdown_connections 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1992983054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877014140 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 -- 172.21.15.169:0/1992983054 >> 172.21.15.169:0/1992983054 conn(0x55f87700f380 msgr2=0x55f8770117a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 -- 172.21.15.169:0/1992983054 shutdown_connections 2024-04-24T01:24:24.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.498+0000 7ff1b5925800 1 -- 172.21.15.169:0/1992983054 wait complete. 2024-04-24T01:24:24.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.510+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.510+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.510+0000 7ff1b5925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.510+0000 7ff1b5925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f876f603c0 con 0x55f877013d20 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58694/0 (socket says 172.21.15.169:58694) 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff1b16b7640 1 -- 172.21.15.169:0/243265604 learned_addr learned my addr 172.21.15.169:0/243265604 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff1b16b7640 1 -- 172.21.15.169:0/243265604 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f877100690 con 0x55f877013d20 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/243265604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4055040 tx=0x7ff1a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c261c71a392ed7b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff09f606640 1 -- 172.21.15.169:0/243265604 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4057040 con 0x55f877013d20 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff09f606640 1 -- 172.21.15.169:0/243265604 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4052720 con 0x55f877013d20 2024-04-24T01:24:24.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.511+0000 7ff09f606640 1 -- 172.21.15.169:0/243265604 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4052a40 con 0x55f877013d20 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- 172.21.15.169:0/243265604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 msgr2=0x55f8771020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 --2- 172.21.15.169:0/243265604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4055040 tx=0x7ff1a404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- 172.21.15.169:0/243265604 shutdown_connections 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 --2- 172.21.15.169:0/243265604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f8771020d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- 172.21.15.169:0/243265604 >> 172.21.15.169:0/243265604 conn(0x55f87700f380 msgr2=0x55f877104740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- 172.21.15.169:0/243265604 shutdown_connections 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- 172.21.15.169:0/243265604 wait complete. 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.512+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b5925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877110040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b5925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f87701d420 con 0x55f877013d20 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877110040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877110040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58700/0 (socket says 172.21.15.169:58700) 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1193480009 learned_addr learned my addr 172.21.15.169:0/1193480009 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f877110580 con 0x55f877013d20 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877110040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4052540 tx=0x7ff1a4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff09de03640 1 -- 172.21.15.169:0/1193480009 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4073070 con 0x55f877013d20 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff09de03640 1 -- 172.21.15.169:0/1193480009 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4052c90 con 0x55f877013d20 2024-04-24T01:24:24.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f877110810 con 0x55f877013d20 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff09de03640 1 -- 172.21.15.169:0/1193480009 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4057070 con 0x55f877013d20 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.513+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8771134c0 con 0x55f877013d20 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff09de03640 1 -- 172.21.15.169:0/1193480009 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff1a4076070 con 0x55f877013d20 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff09de03640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff098036950 0x7ff098038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff09de03640 1 -- 172.21.15.169:0/1193480009 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1a408da30 con 0x55f877013d20 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff098036950 0x7ff098038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f877014f80 0x55f877117280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.514+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8771177c0 con 0x55f877014f80 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f877014f80 0x55f877117280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff098036950 0x7ff098038e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f60 tx=0x7ff1a80013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f877014f80 0x55f877117280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/1193480009 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f877014f80 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877114800 con 0x55f877014f80 2024-04-24T01:24:24.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.515+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/1193480009 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f877014f80 2024-04-24T01:24:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877119a80 0x55f87711be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87711c560 con 0x55f877119a80 2024-04-24T01:24:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877119a80 0x55f87711be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877119a80 0x55f87711be70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b16b7640 1 -- 172.21.15.169:0/1193480009 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1a4075030 con 0x55f877119a80 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.516+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877118a60 con 0x55f877014f80 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/1193480009 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f877014f80 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f87711d9c0 0x55f87711fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877120590 con 0x55f87711d9c0 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f87711d9c0 0x55f87711fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f87711d9c0 0x55f87711fe30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.517+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/1193480009 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1a8010590 con 0x55f87711d9c0 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b5925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b5925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f876f066b0 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58716/0 (socket says 172.21.15.169:58716) 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b16b7640 1 -- 172.21.15.169:0/3005824975 learned_addr learned my addr 172.21.15.169:0/3005824975 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b16b7640 1 -- 172.21.15.169:0/3005824975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87712f2b0 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.518+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4055040 tx=0x7ff1a4077df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff096ffd640 1 -- 172.21.15.169:0/3005824975 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4083040 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff096ffd640 1 -- 172.21.15.169:0/3005824975 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4091070 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f87712fd20 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff096ffd640 1 -- 172.21.15.169:0/3005824975 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a405d440 con 0x55f87712e950 2024-04-24T01:24:24.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f877130220 con 0x55f87712e950 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.519+0000 7ff096ffd640 1 -- 172.21.15.169:0/3005824975 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff1a4086030 con 0x55f87712e950 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff096ffd640 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 0x7ff088038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff096ffd640 1 -- 172.21.15.169:0/3005824975 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1a4097cc0 con 0x55f87712e950 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 0x7ff088038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 0x7ff088038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f877114bc0 tx=0x7ff1a8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b5925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b5925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f877100950 con 0x55f87713ba90 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58724/0 (socket says 172.21.15.169:58724) 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.520+0000 7ff1b16b7640 1 -- 172.21.15.169:0/826983406 learned_addr learned my addr 172.21.15.169:0/826983406 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.542 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b16b7640 1 -- 172.21.15.169:0/826983406 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f87713c480 con 0x55f87713ba90 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/826983406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4080180 tx=0x7ff1a4076950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4231f3a8b62480 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff094ff9640 1 -- 172.21.15.169:0/826983406 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a407fcc0 con 0x55f87713ba90 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff094ff9640 1 -- 172.21.15.169:0/826983406 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4078c40 con 0x55f87713ba90 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff094ff9640 1 -- 172.21.15.169:0/826983406 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a407fe60 con 0x55f87713ba90 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 -- 172.21.15.169:0/826983406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 msgr2=0x55f87713beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 --2- 172.21.15.169:0/826983406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4080180 tx=0x7ff1a4076950 comp rx=0 tx=0).stop 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 -- 172.21.15.169:0/826983406 shutdown_connections 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 --2- 172.21.15.169:0/826983406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f87713beb0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 -- 172.21.15.169:0/826983406 >> 172.21.15.169:0/826983406 conn(0x55f877137df0 msgr2=0x55f877135e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 -- 172.21.15.169:0/826983406 shutdown_connections 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.521+0000 7ff1b5925800 1 -- 172.21.15.169:0/826983406 wait complete. 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b5925800 1 Processor -- start 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b5925800 1 -- start start 2024-04-24T01:24:24.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b5925800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f877142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b5925800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f87713cb30 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f877142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b16b7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f877142eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58740/0 (socket says 172.21.15.169:58740) 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 learned_addr learned my addr 172.21.15.169:0/777606974 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8771433f0 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f877142eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4080180 tx=0x7ff1a4090f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.522+0000 7ff086ffd640 1 -- 172.21.15.169:0/777606974 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a40bb070 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff086ffd640 1 -- 172.21.15.169:0/777606974 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4080890 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff086ffd640 1 -- 172.21.15.169:0/777606974 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1a4080b70 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8771433f0 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8771433f0 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff086ffd640 1 -- 172.21.15.169:0/777606974 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff1a40be070 con 0x55f87713ba90 2024-04-24T01:24:24.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.523+0000 7ff086ffd640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff07c036950 0x7ff07c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff086ffd640 1 -- 172.21.15.169:0/777606974 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff1a40a7070 con 0x55f87713ba90 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff07c036950 0x7ff07c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff07c036950 0x7ff07c038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55f87711c900 tx=0x7ff1a8022040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f87714e610 0x55f877150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877151220 con 0x55f87714e610 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f87714e610 0x55f877150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.524+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f87714e610 0x55f877150ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 realm 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877151630 con 0x55f87714e610 2024-04-24T01:24:24.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877151f00 con 0x55f87714e610 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877153000 0x55f8771553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.525+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877155a00 con 0x55f877153000 2024-04-24T01:24:24.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877153000 0x55f8771553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b16b7640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877153000 0x55f8771553f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b5925800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b5925800 20 searching for the correct realm 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8771579b0 0x55f877159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f87715a540 con 0x55f8771579b0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.526+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8771579b0 0x55f877159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8771579b0 0x55f877159e70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b0eb6640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff1a8003a70 0x7ff1a80393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f87715a540 con 0x7ff1a8003a70 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff1a8003a70 0x7ff1a80393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.527+0000 7ff1b1eb8640 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff1a8003a70 0x7ff1a80393c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.528+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.529+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.530+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.531+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.532+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.533+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f8771579b0 2024-04-24T01:24:24.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.534+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f877153000 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x55f87714e610 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8771522a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8771562c0 con 0x55f87714e610 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.535+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8771562c0 con 0x55f87714e610 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8771562c0 con 0x7ff1a8003a70 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 zone default found 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 4 Realm: () 2024-04-24T01:24:24.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 zonegroup default 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877156bb0 con 0x55f877153000 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.536+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87715c3a0 con 0x55f8771579b0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87715c740 con 0x55f8771579b0 2024-04-24T01:24:24.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 20 started sync module instance, tier type = 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.537+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715b840 con 0x7ff1a8003a70 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.538+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.538+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94525638163856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715b840 con 0x7ff1a8003a70 2024-04-24T01:24:24.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.538+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715d100 con 0x55f87714e610 2024-04-24T01:24:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.539+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94525638163856] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.539+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.561 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.539+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94525638161776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715d100 con 0x55f87714e610 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.539+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715db00 con 0x55f8771579b0 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.540+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.540+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94525638170128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715e3a0 con 0x55f8771579b0 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.540+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715ee10 con 0x7ff1a8003a70 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.541+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94525638161776] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.541+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.541+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94525638170128] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.541+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94525638174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715cc50 con 0x7ff1a8003a70 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.541+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715f6f0 con 0x55f87714e610 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.542+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94525638174944] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.542+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.542+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94525638172400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715f630 con 0x55f87714e610 2024-04-24T01:24:24.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.543+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877160100 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.544+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94525638172400] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.544+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.544+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94525638177152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715f5a0 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.544+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877160e00 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.545+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94525638177152] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.545+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.545+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94525638182528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877161650 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.545+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877162010 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94525638182528] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94525638185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877162010 con 0x55f877153000 2024-04-24T01:24:24.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=0 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=1 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=2 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=3 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=4 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=5 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.546+0000 7ff1b5925800 20 add_watcher() i=6 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94525638185856] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b5925800 20 add_watcher() i=7 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b5925800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f877165370 con 0x55f87714e610 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.547+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94525638200688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877162180 con 0x55f87714e610 2024-04-24T01:24:24.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.548+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94525638200688] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.548+0000 7ff0677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.548+0000 7ff1b5925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.548+0000 7ff1b5925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.549+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877164670 con 0x55f87714e610 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.550+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'47 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.550+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716e430 con 0x55f877153000 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.551+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.551+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716e430 con 0x55f8771579b0 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.552+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.552+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716ee50 con 0x55f87714e610 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.552+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'128 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.552+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716daa0 con 0x7ff1a8003a70 2024-04-24T01:24:24.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.553+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.553+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716daa0 con 0x55f8771579b0 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.554+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.554+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716fb80 con 0x55f87714e610 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.556+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.556+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87716da20 con 0x55f877153000 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.557+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.557+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170220 con 0x7ff1a8003a70 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.558+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.558+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170220 con 0x55f8771579b0 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.559+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.559+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x7ff1a8003a70 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.560+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'43 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.560+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x55f877153000 2024-04-24T01:24:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.561+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.561+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x7ff1a8003a70 2024-04-24T01:24:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.562+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.562+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x55f877153000 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.563+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'41 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.563+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x55f87714e610 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.564+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'129 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.564+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8771706d0 con 0x55f8771579b0 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.565+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.565+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x7ff1a8003a70 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.566+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'44 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.566+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.567+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.567+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f87714e610 2024-04-24T01:24:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.568+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.568+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f87714e610 2024-04-24T01:24:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.569+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'130 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.569+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.570+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.570+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x7ff1a8003a70 2024-04-24T01:24:24.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.571+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'31 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.571+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.572+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.572+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.574+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.574+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.574+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.575+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.575+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'36 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.575+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f877153000 2024-04-24T01:24:24.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.577+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'23 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.577+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.577+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.579 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.578+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f877153000 2024-04-24T01:24:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.579+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'30 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.579+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f8771579b0 2024-04-24T01:24:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.580+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.580+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x55f877153000 2024-04-24T01:24:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.581+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'42 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.581+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877170ad0 con 0x7ff1a8003a70 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.582+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.582+0000 7ff0667e4640 20 reqs_thread_entry: start 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.582+0000 7ff1b5925800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.582+0000 7ff1b5925800 20 Filter name: none 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.582+0000 7fefd7fff640 20 reqs_thread_entry: start 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87719b860 con 0x55f877153000 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.583+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87719e2f0 con 0x55f877153000 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.584+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.584+0000 7ff1b5925800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:24:24.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.584+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87719c2d0 con 0x55f877153000 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b5925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94525638430176 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87719e920 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== watch-notify(notify (1) cookie 94525638170128 notify 137438953478 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55f87716fd50 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff094ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94525638170128 notifier 4528 bl.length()=170 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(97 notify.2 [notify cookie 94525638430176 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff094ff9640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff074003d60 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== watch-notify(notify_complete (2) cookie 94525638430176 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f87716dab0 con 0x55f8771579b0 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b5925800 10 removing email index: 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b5925800 10 removing user buckets index 2024-04-24T01:24:24.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.585+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87719e820 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(99 fud.buckets [delete] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b5925800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94525638435696 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87719ddf0 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== watch-notify(notify (1) cookie 94525638182528 notify 137438953484 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55f87716fb80 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff094ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94525638182528 notifier 4528 bl.length()=160 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(100 notify.6 [notify cookie 94525638435696 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff094ff9640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff074003d60 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== watch-notify(notify_complete (2) cookie 94525638435696 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f87712f2b0 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b5925800 10 removing user index: fud 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.587+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87719e820 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b5925800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b5925800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94525638435696 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f87719cde0 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== watch-notify(notify (1) cookie 94525638177152 notify 137438953485 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55f87712f2b0 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff087fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94525638177152 notifier 4528 bl.length()=152 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(103 notify.5 [notify cookie 94525638435696 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.588+0000 7ff087fff640 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fefe40032c0 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.589+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== watch-notify(notify_complete (2) cookie 94525638435696 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f8771134c0 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.589+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.589+0000 7ff0677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.589+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94525638200688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87719e370 con 0x55f87714e610 2024-04-24T01:24:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.590+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94525638200688] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.590+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94525638163856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f877164d70 con 0x7ff1a8003a70 2024-04-24T01:24:24.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.591+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94525638163856] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.592+0000 7ff1b5925800 20 remove_watcher() i=0 2024-04-24T01:24:24.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.592+0000 7ff1b5925800 2 removed watcher, disabling cache 2024-04-24T01:24:24.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.592+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94525638161776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x55f87714e610 2024-04-24T01:24:24.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.593+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94525638161776] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.593+0000 7ff1b5925800 20 remove_watcher() i=1 2024-04-24T01:24:24.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.593+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94525638170128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x55f8771579b0 2024-04-24T01:24:24.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.594+0000 7ff1b0eb6640 1 -- 172.21.15.169:0/777606974 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94525638170128] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a8036040 con 0x55f8771579b0 2024-04-24T01:24:24.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.594+0000 7ff1b5925800 20 remove_watcher() i=2 2024-04-24T01:24:24.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.594+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94525638174944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x7ff1a8003a70 2024-04-24T01:24:24.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.595+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94525638174944] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x7ff1a8003a70 2024-04-24T01:24:24.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.595+0000 7ff1b5925800 20 remove_watcher() i=3 2024-04-24T01:24:24.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.595+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94525638172400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x55f87714e610 2024-04-24T01:24:24.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.596+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94525638172400] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ac00a4a0 con 0x55f87714e610 2024-04-24T01:24:24.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.596+0000 7ff1b5925800 20 remove_watcher() i=4 2024-04-24T01:24:24.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.596+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94525638177152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x55f877153000 2024-04-24T01:24:24.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.597+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94525638177152] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.597+0000 7ff1b5925800 20 remove_watcher() i=5 2024-04-24T01:24:24.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.597+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94525638182528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715f180 con 0x55f877153000 2024-04-24T01:24:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.598+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94525638182528] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.598+0000 7ff1b5925800 20 remove_watcher() i=6 2024-04-24T01:24:24.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.598+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94525638185856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f87715bd90 con 0x55f877153000 2024-04-24T01:24:24.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b16b7640 1 -- 172.21.15.169:0/777606974 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94525638185856] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1a40bd030 con 0x55f877153000 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 20 remove_watcher() i=7 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877153000 msgr2=0x55f8771553f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877153000 0x55f8771553f0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f87714e610 msgr2=0x55f877150ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f87714e610 0x55f877150ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff1a8003a70 msgr2=0x7ff1a80393c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff1a8003a70 0x7ff1a80393c0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8771579b0 msgr2=0x55f877159e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f8771579b0 0x55f877159e70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff07c036950 msgr2=0x7ff07c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff07c036950 0x7ff07c038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55f87711c900 tx=0x7ff1a8022040 comp rx=0 tx=0).stop 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 msgr2=0x55f877142eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/777606974 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87713ba90 0x55f877142eb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4080180 tx=0x7ff1a4090f00 comp rx=0 tx=0).stop 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/777606974 reap_dead start 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 shutdown_connections 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 >> 172.21.15.169:0/777606974 conn(0x55f877137df0 msgr2=0x55f877135450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 shutdown_connections 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/777606974 wait complete. 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 msgr2=0x7ff088038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 0x7ff088038dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x55f877114bc0 tx=0x7ff1a8006000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 msgr2=0x55f87712ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4055040 tx=0x7ff1a4077df0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 shutdown_connections 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff088036900 0x7ff088038dc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 --2- 172.21.15.169:0/3005824975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f87712e950 0x55f87712ed70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 >> 172.21.15.169:0/3005824975 conn(0x55f8771229f0 msgr2=0x55f877122df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 shutdown_connections 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.599+0000 7ff1b5925800 1 -- 172.21.15.169:0/3005824975 wait complete. 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877119a80 msgr2=0x55f87711be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f877119a80 0x55f87711be70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f877014f80 msgr2=0x55f877117280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f877014f80 0x55f877117280 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f87711d9c0 msgr2=0x55f87711fe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f87711d9c0 0x55f87711fe30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff098036950 msgr2=0x7ff098038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff098036950 0x7ff098038e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8000f60 tx=0x7ff1a80013f0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 msgr2=0x55f877110040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 --2- 172.21.15.169:0/1193480009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f877013d20 0x55f877110040 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4052540 tx=0x7ff1a4003020 comp rx=0 tx=0).stop 2024-04-24T01:24:24.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b1eb8640 1 -- 172.21.15.169:0/1193480009 reap_dead start 2024-04-24T01:24:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 shutdown_connections 2024-04-24T01:24:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 >> 172.21.15.169:0/1193480009 conn(0x55f87700f380 msgr2=0x55f8770ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 shutdown_connections 2024-04-24T01:24:24.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.600+0000 7ff1b5925800 1 -- 172.21.15.169:0/1193480009 wait complete. 2024-04-24T01:24:24.609 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:24:24.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-04-24T01:24:24.610 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-04-24T01:24:24.661 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.662 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.661+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.661+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.661+0000 7f0300336800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5561f2bd3950 0x5561f2bd5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.661+0000 7f0300336800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561f2a91d40 con 0x5561f2bd6280 2024-04-24T01:24:24.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.661+0000 7f0300336800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5561f2a644d0 con 0x5561f2bd3950 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02fc0cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5561f2bd3950 0x5561f2bd5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02f38cb640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5561f2bd6280 0x5561f2bd8670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43630/0 (socket says 172.21.15.169:43630) 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02fc0cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5561f2bd3950 0x5561f2bd5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58742/0 (socket says 172.21.15.169:58742) 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02f38cb640 1 -- 172.21.15.169:0/3613927381 learned_addr learned my addr 172.21.15.169:0/3613927381 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3613927381 >> v1:172.21.15.142:6789/0 conn(0x5561f2bd6280 legacy=0x5561f2bd8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.662+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3613927381 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2a90590 con 0x5561f2bd3950 2024-04-24T01:24:24.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/3613927381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd5d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00a470 tx=0x7f02ec01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4872d51bb478a9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f02fb8cb640 1 -- 172.21.15.169:0/3613927381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec057070 con 0x5561f2bd3950 2024-04-24T01:24:24.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f02fb8cb640 1 -- 172.21.15.169:0/3613927381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec052570 con 0x5561f2bd3950 2024-04-24T01:24:24.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f02fb8cb640 1 -- 172.21.15.169:0/3613927381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec052870 con 0x5561f2bd3950 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 -- 172.21.15.169:0/3613927381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 msgr2=0x5561f2bd5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 --2- 172.21.15.169:0/3613927381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd5d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00a470 tx=0x7f02ec01ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 -- 172.21.15.169:0/3613927381 shutdown_connections 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 --2- 172.21.15.169:0/3613927381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd5d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 -- 172.21.15.169:0/3613927381 >> 172.21.15.169:0/3613927381 conn(0x5561f2bcd2c0 msgr2=0x5561f2bcf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 -- 172.21.15.169:0/3613927381 shutdown_connections 2024-04-24T01:24:24.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.664+0000 7f0300336800 1 -- 172.21.15.169:0/3613927381 wait complete. 2024-04-24T01:24:24.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.676+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.676+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.676+0000 7f0300336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.676+0000 7f0300336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5561f2b1e360 con 0x5561f2bd3950 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58752/0 (socket says 172.21.15.169:58752) 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3958116536 learned_addr learned my addr 172.21.15.169:0/3958116536 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3958116536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2bd1850 con 0x5561f2bd3950 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/3958116536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f02ec055040 tx=0x7f02ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22adc976f454869f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f01ea60c640 1 -- 172.21.15.169:0/3958116536 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec057070 con 0x5561f2bd3950 2024-04-24T01:24:24.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f01ea60c640 1 -- 172.21.15.169:0/3958116536 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec063070 con 0x5561f2bd3950 2024-04-24T01:24:24.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.677+0000 7f01ea60c640 1 -- 172.21.15.169:0/3958116536 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec052720 con 0x5561f2bd3950 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- 172.21.15.169:0/3958116536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 msgr2=0x5561f2bd3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 --2- 172.21.15.169:0/3958116536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f02ec055040 tx=0x7f02ec04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- 172.21.15.169:0/3958116536 shutdown_connections 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 --2- 172.21.15.169:0/3958116536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2bd3290 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- 172.21.15.169:0/3958116536 >> 172.21.15.169:0/3958116536 conn(0x5561f2bcd2c0 msgr2=0x5561f2cbfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- 172.21.15.169:0/3958116536 shutdown_connections 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- 172.21.15.169:0/3958116536 wait complete. 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.678+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f0300336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2ccde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f0300336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5561f2bdc0a0 con 0x5561f2bd3950 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2ccde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2ccde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58762/0 (socket says 172.21.15.169:58762) 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f02fc0cc640 1 -- 172.21.15.169:0/533942347 learned_addr learned my addr 172.21.15.169:0/533942347 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f02fc0cc640 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2cce340 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2ccde00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f02ec060040 tx=0x7f02ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f01e8e09640 1 -- 172.21.15.169:0/533942347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec052e30 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f01e8e09640 1 -- 172.21.15.169:0/533942347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec06c070 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f2cce5d0 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f01e8e09640 1 -- 172.21.15.169:0/533942347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec05e5d0 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.679+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f2cd1280 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f01e8e09640 1 -- 172.21.15.169:0/533942347 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f02ec05e770 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f01e8e09640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01e4036950 0x7f01e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f01e8e09640 1 -- 172.21.15.169:0/533942347 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f02ec08e8c0 con 0x5561f2bd3950 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f02f38cb640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01e4036950 0x7f01e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2bd6280 0x5561f2cd5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.680+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2cd55c0 con 0x5561f2bd6280 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2bd6280 0x5561f2cd5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f02f38cb640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01e4036950 0x7f01e4038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f02e4000f60 tx=0x7f02e40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2bd6280 0x5561f2cd5040 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f02fc8cd640 1 -- 172.21.15.169:0/533942347 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2bd6280 2024-04-24T01:24:24.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2cd2610 con 0x5561f2bd6280 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f02fc8cd640 1 -- 172.21.15.169:0/533942347 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2bd6280 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2cd7940 0x5561f2cd9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.681+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2cda420 con 0x5561f2cd7940 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.682+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2cd7940 0x5561f2cd9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.682+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2cd7940 0x5561f2cd9d30 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.682+0000 7f02fc0cc640 1 -- 172.21.15.169:0/533942347 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2cd7940 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.682+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2cd68f0 con 0x5561f2bd6280 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.682+0000 7f02fc8cd640 1 -- 172.21.15.169:0/533942347 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2bd6280 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5561f2cdb880 0x5561f2cddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2cde450 con 0x5561f2cdb880 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f02f38cb640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5561f2cdb880 0x5561f2cddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f02f38cb640 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5561f2cdb880 0x5561f2cddcf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f02f38cb640 1 -- 172.21.15.169:0/533942347 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2cdb880 2024-04-24T01:24:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.683+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f0300336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f0300336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5561f2ac46b0 con 0x5561f2cec8b0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58766/0 (socket says 172.21.15.169:58766) 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f02fc0cc640 1 -- 172.21.15.169:0/2921609899 learned_addr learned my addr 172.21.15.169:0/2921609899 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f02fc0cc640 1 -- 172.21.15.169:0/2921609899 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2ced210 con 0x5561f2cec8b0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f02ec08cc60 tx=0x7f02ec068400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f01e1ffb640 1 -- 172.21.15.169:0/2921609899 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec05ec40 con 0x5561f2cec8b0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f01e1ffb640 1 -- 172.21.15.169:0/2921609899 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec093070 con 0x5561f2cec8b0 2024-04-24T01:24:24.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f2cedc80 con 0x5561f2cec8b0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.684+0000 7f01e1ffb640 1 -- 172.21.15.169:0/2921609899 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec08eb60 con 0x5561f2cec8b0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.685+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f2cee180 con 0x5561f2cec8b0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.685+0000 7f01e1ffb640 1 -- 172.21.15.169:0/2921609899 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f02ec08ed00 con 0x5561f2cec8b0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.685+0000 7f01e1ffb640 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 0x7f01d4038de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.685+0000 7f01e1ffb640 1 -- 172.21.15.169:0/2921609899 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f02ec08b050 con 0x5561f2cec8b0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.685+0000 7f02f38cb640 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 0x7f01d4038de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02f38cb640 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 0x7f01d4038de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f02e400bf50 tx=0x7f02e400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f0300336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f0300336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5561f2bd1b10 con 0x5561f2cf9aa0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58774/0 (socket says 172.21.15.169:58774) 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02fc0cc640 1 -- 172.21.15.169:0/1611546769 learned_addr learned my addr 172.21.15.169:0/1611546769 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02fc0cc640 1 -- 172.21.15.169:0/1611546769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2cfa470 con 0x5561f2cf9aa0 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.686+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/1611546769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f02ec068c30 tx=0x7f02ec066820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20b9d60c8e79965 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f01db7fe640 1 -- 172.21.15.169:0/1611546769 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec098460 con 0x5561f2cf9aa0 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f01db7fe640 1 -- 172.21.15.169:0/1611546769 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec058040 con 0x5561f2cf9aa0 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f01db7fe640 1 -- 172.21.15.169:0/1611546769 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec067420 con 0x5561f2cf9aa0 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- 172.21.15.169:0/1611546769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 msgr2=0x5561f2cf9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 --2- 172.21.15.169:0/1611546769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f02ec068c30 tx=0x7f02ec066820 comp rx=0 tx=0).stop 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- 172.21.15.169:0/1611546769 shutdown_connections 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 --2- 172.21.15.169:0/1611546769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2cf9ea0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- 172.21.15.169:0/1611546769 >> 172.21.15.169:0/1611546769 conn(0x5561f2cf5d70 msgr2=0x5561f2cf3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- 172.21.15.169:0/1611546769 shutdown_connections 2024-04-24T01:24:24.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- 172.21.15.169:0/1611546769 wait complete. 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 Processor -- start 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.687+0000 7f0300336800 1 -- start start 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f0300336800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f0300336800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5561f2cfab60 con 0x5561f2cf9aa0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f02fc0cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58784/0 (socket says 172.21.15.169:58784) 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 learned_addr learned my addr 172.21.15.169:0/3961212206 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f2d01320 con 0x5561f2cf9aa0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02ec08e440 tx=0x7f02ec098e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f01d9ffb640 1 -- 172.21.15.169:0/3961212206 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec0b2040 con 0x5561f2cf9aa0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.688+0000 7f01d9ffb640 1 -- 172.21.15.169:0/3961212206 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec0020c0 con 0x5561f2cf9aa0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561f2d01320 con 0x5561f2cf9aa0 2024-04-24T01:24:24.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f01d9ffb640 1 -- 172.21.15.169:0/3961212206 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ec067550 con 0x5561f2cf9aa0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f2d01320 con 0x5561f2cf9aa0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f01d9ffb640 1 -- 172.21.15.169:0/3961212206 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f02ec0bd020 con 0x5561f2cf9aa0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f01d9ffb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01cc0368b0 0x7f01cc038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.689+0000 7f01d9ffb640 1 -- 172.21.15.169:0/3961212206 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f02ec0bb020 con 0x5561f2cf9aa0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f02f38cb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01cc0368b0 0x7f01cc038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2d0c530 0x5561f2d0e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d0f140 con 0x5561f2d0c530 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f02f38cb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01cc0368b0 0x7f01cc038d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f02e4001b60 tx=0x7f02e4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2d0c530 0x5561f2d0e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2d0c530 0x5561f2d0e9f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.690+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 realm 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d0f550 con 0x5561f2d0c530 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d0fe20 con 0x5561f2d0c530 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2d10f20 0x5561f2d13310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d138d0 con 0x5561f2d10f20 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.691+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2d10f20 0x5561f2d13310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f02fc0cc640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2d10f20 0x5561f2d13310 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f0300336800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f0300336800 20 searching for the correct realm 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5561f2d15880 0x5561f2d17d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d18410 con 0x5561f2d15880 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f02f38cb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5561f2d15880 0x5561f2d17d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.692+0000 7f02f38cb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5561f2d15880 0x5561f2d17d40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02f38cb640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f02e4037040 0x7f02e4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d18410 con 0x7f02e4037040 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f02e4037040 0x7f02e4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02fc8cd640 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f02e4037040 0x7f02e4036410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.693+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.694+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x7f02e4037040 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.695+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x7f02e4037040 2024-04-24T01:24:24.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.696+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.697+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.698+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x7f02e4037040 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.699+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.719 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x7f02e4037040 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d15880 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.700+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d10f20 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x5561f2d0c530 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d101c0 con 0x7f02e4037040 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d14190 con 0x5561f2d0c530 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.701+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d14190 con 0x5561f2d0c530 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d14190 con 0x7f02e4037040 2024-04-24T01:24:24.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 zone default found 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 4 Realm: () 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 zonegroup default 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d14a80 con 0x5561f2d10f20 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.702+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1a270 con 0x5561f2d15880 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1a610 con 0x5561f2d15880 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 20 started sync module instance, tier type = 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.703+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d19710 con 0x7f02e4037040 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.704+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.704+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879174011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d19710 con 0x7f02e4037040 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.704+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1afd0 con 0x5561f2d0c530 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.705+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879174011952] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.705+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.705+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879174016256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d19710 con 0x5561f2d0c530 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.705+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1ba20 con 0x5561f2d15880 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.706+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879174016256] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.706+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.707+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879174009440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d19680 con 0x5561f2d15880 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.707+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1c7b0 con 0x7f02e4037040 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.707+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879174009440] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.708+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.708+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879174020624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1cba0 con 0x7f02e4037040 2024-04-24T01:24:24.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.708+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1d560 con 0x5561f2d0c530 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.709+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.709+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879174025392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1d4d0 con 0x5561f2d0c530 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.709+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1e4c0 con 0x5561f2d10f20 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.709+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879174020624] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.710+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.710+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879174021680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1e8e0 con 0x5561f2d10f20 2024-04-24T01:24:24.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.710+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1f2e0 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.710+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879174025392] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.711+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879174021680] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.711+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.711+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879174027648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1edf0 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.711+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1fb80 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879174035152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1edf0 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=0 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=1 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879174027648] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=2 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=3 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=4 2024-04-24T01:24:24.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=5 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f0300336800 20 add_watcher() i=6 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.712+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879174035152] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.713+0000 7f0300336800 20 add_watcher() i=7 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.713+0000 7f0300336800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.713+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1e000 con 0x5561f2d0c530 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.713+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.713+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879174036208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1e000 con 0x5561f2d0c530 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879174036208] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f01b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f0300336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f0300336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f0300336800 5 note: GC not initialized 2024-04-24T01:24:24.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f01b17e2640 20 reqs_thread_entry: start 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f0300336800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.714+0000 7f0300336800 20 Filter name: none 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f012affd640 20 reqs_thread_entry: start 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d56120 con 0x5561f2d10f20 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.715+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d54810 con 0x5561f2d10f20 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.716+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d58ea0 con 0x5561f2d10f20 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f0300336800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f0300336800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f0300336800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93879174268960 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d59970 con 0x7f02e4037040 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== watch-notify(notify (1) cookie 93879174020624 notify 137438953484 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f02f4018ad0 con 0x7f02e4037040 2024-04-24T01:24:24.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f01db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 93879174020624 notifier 4535 bl.length()=610 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 notify.3 [notify cookie 93879174268960 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f01db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f01db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f01db7fe640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f01c0003ea0 con 0x7f02e4037040 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== watch-notify(notify_complete (2) cookie 93879174268960 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f02f4018d70 con 0x7f02e4037040 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.717+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d587f0 con 0x5561f2d10f20 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f0300336800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f0300336800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f0300336800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93879174268864 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d59970 con 0x5561f2d15880 2024-04-24T01:24:24.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 93879174009440 notify 137438953479 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7f02e4041040 con 0x5561f2d15880 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f01daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 93879174009440 notifier 4535 bl.length()=192 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f01daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f01daffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f01daffd640 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0130003400 con 0x5561f2d15880 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [notify cookie 93879174268864 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify_complete (2) cookie 93879174268864 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561f2a91d40 con 0x5561f2d15880 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.719+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.737 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:24:24.717868Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:24.717851Z","tags":[],"group_ids":[]} 2024-04-24T01:24:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.720+0000 7f01b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.720+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879174036208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d54fe0 con 0x5561f2d0c530 2024-04-24T01:24:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.721+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93879174036208] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.721+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879174011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1faf0 con 0x7f02e4037040 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.722+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93879174011952] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.722+0000 7f0300336800 20 remove_watcher() i=0 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.722+0000 7f0300336800 2 removed watcher, disabling cache 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.722+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879174016256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1faf0 con 0x5561f2d0c530 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.723+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93879174016256] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.723+0000 7f0300336800 20 remove_watcher() i=1 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.723+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879174009440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1faf0 con 0x5561f2d15880 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.724+0000 7f02f38cb640 1 -- 172.21.15.169:0/3961212206 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93879174009440] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02e4009050 con 0x5561f2d15880 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.724+0000 7f0300336800 20 remove_watcher() i=2 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.724+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879174020624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1faf0 con 0x7f02e4037040 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.725+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93879174020624] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x7f02e4037040 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.725+0000 7f0300336800 20 remove_watcher() i=3 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.725+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879174025392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1be10 con 0x5561f2d0c530 2024-04-24T01:24:24.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.727+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93879174025392] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02f400a4a0 con 0x5561f2d0c530 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.727+0000 7f0300336800 20 remove_watcher() i=4 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.727+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879174021680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1faf0 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.728+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93879174021680] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.728+0000 7f0300336800 20 remove_watcher() i=5 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.728+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879174027648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1c2c0 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.729+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93879174027648] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.729+0000 7f0300336800 20 remove_watcher() i=6 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.729+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879174035152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5561f2d1c2c0 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f02fc0cc640 1 -- 172.21.15.169:0/3961212206 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93879174035152] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ec009d10 con 0x5561f2d10f20 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 20 remove_watcher() i=7 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2d10f20 msgr2=0x5561f2d13310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2d10f20 0x5561f2d13310 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2d0c530 msgr2=0x5561f2d0e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2d0c530 0x5561f2d0e9f0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f02e4037040 msgr2=0x7f02e4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f02e4037040 0x7f02e4036410 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5561f2d15880 msgr2=0x5561f2d17d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5561f2d15880 0x5561f2d17d40 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01cc0368b0 msgr2=0x7f01cc038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01cc0368b0 0x7f01cc038d70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f02e4001b60 tx=0x7f02e4010000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f02fc8cd640 1 -- 172.21.15.169:0/3961212206 reap_dead start 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 msgr2=0x5561f2d00de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f02ec08e440 tx=0x7f02ec098e90 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 shutdown_connections 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 --2- 172.21.15.169:0/3961212206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cf9aa0 0x5561f2d00de0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 >> 172.21.15.169:0/3961212206 conn(0x5561f2cf5d70 msgr2=0x5561f2cf33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 shutdown_connections 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.730+0000 7f0300336800 1 -- 172.21.15.169:0/3961212206 wait complete. 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 msgr2=0x7f01d4038de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 0x7f01d4038de0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f02e400bf50 tx=0x7f02e400f000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 msgr2=0x5561f2ceccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f02ec08cc60 tx=0x7f02ec068400 comp rx=0 tx=0).stop 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 shutdown_connections 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01d4036920 0x7f01d4038de0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/2921609899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2cec8b0 0x5561f2ceccd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 >> 172.21.15.169:0/2921609899 conn(0x5561f2ce0950 msgr2=0x5561f2ce0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 shutdown_connections 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/2921609899 wait complete. 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2cd7940 msgr2=0x5561f2cd9d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5561f2cd7940 0x5561f2cd9d30 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2bd6280 msgr2=0x5561f2cd5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5561f2bd6280 0x5561f2cd5040 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5561f2cdb880 msgr2=0x5561f2cddcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5561f2cdb880 0x5561f2cddcf0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01e4036950 msgr2=0x7f01e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f01e4036950 0x7f01e4038e10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f02e4000f60 tx=0x7f02e40012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 msgr2=0x5561f2ccde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 --2- 172.21.15.169:0/533942347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561f2bd3950 0x5561f2ccde00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f02ec060040 tx=0x7f02ec002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f02fc8cd640 1 -- 172.21.15.169:0/533942347 reap_dead start 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 shutdown_connections 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 >> 172.21.15.169:0/533942347 conn(0x5561f2bcd2c0 msgr2=0x5561f2cbf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 shutdown_connections 2024-04-24T01:24:24.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.731+0000 7f0300336800 1 -- 172.21.15.169:0/533942347 wait complete. 2024-04-24T01:24:24.749 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:24:24.717868Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:24.717851Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:24.749 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:24:24.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:24:24.749 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-04-24T01:24:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.799 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11ab70c800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bc0fb19990 0x55bc0fb1bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11ab70c800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc0f9d7d40 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11ab70c800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55bc0f9aa4d0 con 0x55bc0fb19990 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11a9212640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bc0fb19990 0x55bc0fb1bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11a8a11640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55bc0fb1c2c0 0x55bc0fb1e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43632/0 (socket says 172.21.15.169:43632) 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.796+0000 7f11a8a11640 1 -- 172.21.15.169:0/20252773 learned_addr learned my addr 172.21.15.169:0/20252773 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.797+0000 7f119bfff640 1 -- 172.21.15.169:0/20252773 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096535828 0 0) 0x55bc0f9d7d40 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.797+0000 7f119bfff640 1 -- 172.21.15.169:0/20252773 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1194001e10 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.797+0000 7f11a9212640 1 -- 172.21.15.169:0/20252773 >> v1:172.21.15.142:6789/0 conn(0x55bc0fb1c2c0 legacy=0x55bc0fb1e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.797+0000 7f11a9212640 1 -- 172.21.15.169:0/20252773 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0f9d6590 con 0x55bc0fb19990 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11a9212640 1 --2- 172.21.15.169:0/20252773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fb1bd80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a470 tx=0x7f119c01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7320ba7709b5f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f119bfff640 1 -- 172.21.15.169:0/20252773 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c057070 con 0x55bc0fb19990 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f119bfff640 1 -- 172.21.15.169:0/20252773 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c052570 con 0x55bc0fb19990 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f119bfff640 1 -- 172.21.15.169:0/20252773 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c052870 con 0x55bc0fb19990 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 -- 172.21.15.169:0/20252773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 msgr2=0x55bc0fb1bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 --2- 172.21.15.169:0/20252773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fb1bd80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f119c00a470 tx=0x7f119c01cdb0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 -- 172.21.15.169:0/20252773 shutdown_connections 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 --2- 172.21.15.169:0/20252773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fb1bd80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 -- 172.21.15.169:0/20252773 >> 172.21.15.169:0/20252773 conn(0x55bc0fb13340 msgr2=0x55bc0fb15760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 -- 172.21.15.169:0/20252773 shutdown_connections 2024-04-24T01:24:24.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.799+0000 7f11ab70c800 1 -- 172.21.15.169:0/20252773 wait complete. 2024-04-24T01:24:24.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11ab70c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11ab70c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bc0fa643e0 con 0x55bc0fb19990 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58800/0 (socket says 172.21.15.169:58800) 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.811+0000 7f11a9212640 1 -- 172.21.15.169:0/1051264889 learned_addr learned my addr 172.21.15.169:0/1051264889 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.812+0000 7f11a9212640 1 -- 172.21.15.169:0/1051264889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0fc0a4f0 con 0x55bc0fb19990 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.812+0000 7f11a9212640 1 --2- 172.21.15.169:0/1051264889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f119c055040 tx=0x7f119c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fe2fe881fe2cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.812+0000 7f1097606640 1 -- 172.21.15.169:0/1051264889 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c057070 con 0x55bc0fb19990 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.812+0000 7f1097606640 1 -- 172.21.15.169:0/1051264889 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c063070 con 0x55bc0fb19990 2024-04-24T01:24:24.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.812+0000 7f1097606640 1 -- 172.21.15.169:0/1051264889 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c052720 con 0x55bc0fb19990 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- 172.21.15.169:0/1051264889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 msgr2=0x55bc0fc09f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1051264889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f119c055040 tx=0x7f119c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- 172.21.15.169:0/1051264889 shutdown_connections 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1051264889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc09f20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- 172.21.15.169:0/1051264889 >> 172.21.15.169:0/1051264889 conn(0x55bc0fb13340 msgr2=0x55bc0fc05840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- 172.21.15.169:0/1051264889 shutdown_connections 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- 172.21.15.169:0/1051264889 wait complete. 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc119d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11ab70c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bc0fb220e0 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc119d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc119d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58806/0 (socket says 172.21.15.169:58806) 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.813+0000 7f11a9212640 1 -- 172.21.15.169:0/3230539751 learned_addr learned my addr 172.21.15.169:0/3230539751 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f11a9212640 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0fc11f10 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f11a9212640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc119d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f119c060040 tx=0x7f119c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f1095e03640 1 -- 172.21.15.169:0/3230539751 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c052e30 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f1095e03640 1 -- 172.21.15.169:0/3230539751 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c06c070 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0fc121a0 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f1095e03640 1 -- 172.21.15.169:0/3230539751 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c05e5f0 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.814+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0fc14e50 con 0x55bc0fb19990 2024-04-24T01:24:24.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f1095e03640 1 -- 172.21.15.169:0/3230539751 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f119c05e790 con 0x55bc0fb19990 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f1095e03640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1090036900 0x7f1090038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f1095e03640 1 -- 172.21.15.169:0/3230539751 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f119c08e9b0 con 0x55bc0fb19990 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1090036900 0x7f1090038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fb1c2c0 0x55bc0fc18c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc19190 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.815+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fb1c2c0 0x55bc0fc18c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1090036900 0x7f1090038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000f60 tx=0x7f11a00010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fb1c2c0 0x55bc0fc18c10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11a9a13640 1 -- 172.21.15.169:0/3230539751 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc161c0 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11a9a13640 1 -- 172.21.15.169:0/3230539751 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc1b4f0 0x55bc0fc1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.816+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc1df80 con 0x55bc0fc1b4f0 2024-04-24T01:24:24.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11a9212640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc1b4f0 0x55bc0fc1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11a9212640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc1b4f0 0x55bc0fc1d8e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11a9212640 1 -- 172.21.15.169:0/3230539751 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc1b4f0 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc1a4a0 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11a9a13640 1 -- 172.21.15.169:0/3230539751 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fb1c2c0 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bc0fc1f430 0x55bc0fc21880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc21fe0 con 0x55bc0fc1f430 2024-04-24T01:24:24.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.817+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bc0fc1f430 0x55bc0fc21880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bc0fc1f430 0x55bc0fc21880 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11a8a11640 1 -- 172.21.15.169:0/3230539751 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc1f430 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11ab70c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.818+0000 7f11ab70c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bc0fa0a6b0 con 0x55bc0fb19550 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58814/0 (socket says 172.21.15.169:58814) 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11a9212640 1 -- 172.21.15.169:0/1915910454 learned_addr learned my addr 172.21.15.169:0/1915910454 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11a9212640 1 -- 172.21.15.169:0/1915910454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0fb17f00 con 0x55bc0fb19550 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11a9212640 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f119c08cd80 tx=0x7f119c0716a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f108effd640 1 -- 172.21.15.169:0/1915910454 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c067420 con 0x55bc0fb19550 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f108effd640 1 -- 172.21.15.169:0/1915910454 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c092070 con 0x55bc0fb19550 2024-04-24T01:24:24.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0fb18190 con 0x55bc0fb19550 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f108effd640 1 -- 172.21.15.169:0/1915910454 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c05edd0 con 0x55bc0fb19550 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.819+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0fb18690 con 0x55bc0fb19550 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.820+0000 7f108effd640 1 -- 172.21.15.169:0/1915910454 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f119c08ed10 con 0x55bc0fb19550 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.820+0000 7f108effd640 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 0x7f1080038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.820+0000 7f108effd640 1 -- 172.21.15.169:0/1915910454 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f119c0890d0 con 0x55bc0fb19550 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.820+0000 7f11a8a11640 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 0x7f1080038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.820+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a8a11640 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 0x7f1080038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11a000bf90 tx=0x7f11a000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11ab70c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11ab70c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bc0fc0a7b0 con 0x55bc0fc3f730 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58826/0 (socket says 172.21.15.169:58826) 2024-04-24T01:24:24.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a9212640 1 -- 172.21.15.169:0/2916004605 learned_addr learned my addr 172.21.15.169:0/2916004605 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a9212640 1 -- 172.21.15.169:0/2916004605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0fc40120 con 0x55bc0fc3f730 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f11a9212640 1 --2- 172.21.15.169:0/2916004605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f119c005260 tx=0x7f119c08e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b96a016ed775fc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.821+0000 7f108cff9640 1 -- 172.21.15.169:0/2916004605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c002a30 con 0x55bc0fc3f730 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f108cff9640 1 -- 172.21.15.169:0/2916004605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c058040 con 0x55bc0fc3f730 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f108cff9640 1 -- 172.21.15.169:0/2916004605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c002d00 con 0x55bc0fc3f730 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- 172.21.15.169:0/2916004605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 msgr2=0x55bc0fc3fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 --2- 172.21.15.169:0/2916004605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f119c005260 tx=0x7f119c08e220 comp rx=0 tx=0).stop 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- 172.21.15.169:0/2916004605 shutdown_connections 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 --2- 172.21.15.169:0/2916004605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc3fb50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- 172.21.15.169:0/2916004605 >> 172.21.15.169:0/2916004605 conn(0x55bc0fc3ba90 msgr2=0x55bc0fc39af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- 172.21.15.169:0/2916004605 shutdown_connections 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- 172.21.15.169:0/2916004605 wait complete. 2024-04-24T01:24:24.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 Processor -- start 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- start start 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc46b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.822+0000 7f11ab70c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bc0fc407d0 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc46b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11a9212640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc46b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58840/0 (socket says 172.21.15.169:58840) 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 learned_addr learned my addr 172.21.15.169:0/3922538052 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0fc47060 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11a9212640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc46b20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f119c0529c0 tx=0x7f119c006ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f107effd640 1 -- 172.21.15.169:0/3922538052 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c0bb020 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f107effd640 1 -- 172.21.15.169:0/3922538052 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f119c004a40 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc0fc47060 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f107effd640 1 -- 172.21.15.169:0/3922538052 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f119c066840 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.823+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0fc47060 con 0x55bc0fc3f730 2024-04-24T01:24:24.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.824+0000 7f107effd640 1 -- 172.21.15.169:0/3922538052 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f119c0be020 con 0x55bc0fc3f730 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.824+0000 7f107effd640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1074036950 0x7f1074038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.824+0000 7f107effd640 1 -- 172.21.15.169:0/3922538052 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f119c0a8040 con 0x55bc0fc3f730 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.824+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1074036950 0x7f1074038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1074036950 0x7f1074038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55bc0fc16100 tx=0x7f11a0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fc522e0 0x55bc0fc547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc54ef0 con 0x55bc0fc522e0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fc522e0 0x55bc0fc547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.825+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fc522e0 0x55bc0fc547a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 realm 2024-04-24T01:24:24.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55300 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55bd0 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc56cd0 0x55bc0fc590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.826+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc596d0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11a9212640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc56cd0 0x55bc0fc590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11a9212640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc56cd0 0x55bc0fc590c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11ab70c800 20 searching for the correct realm 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bc0fc5b680 0x55bc0fc5db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc5e210 con 0x55bc0fc5b680 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.827+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bc0fc5b680 0x55bc0fc5db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bc0fc5b680 0x55bc0fc5db40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a8a11640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f11a0037040 0x7f11a0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc5e210 con 0x7f11a0037040 2024-04-24T01:24:24.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f11a0037040 0x7f11a0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.828+0000 7f11a9a13640 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f11a0037040 0x7f11a0036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.829+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x7f11a0037040 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.830+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x7f11a0037040 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.831+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.832+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.833+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x7f11a0037040 2024-04-24T01:24:24.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.834+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x7f11a0037040 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc5b680 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.858 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.835+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc56cd0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x55bc0fc522e0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc55f70 con 0x7f11a0037040 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.836+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc59f90 con 0x55bc0fc522e0 2024-04-24T01:24:24.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc59f90 con 0x55bc0fc522e0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc59f90 con 0x7f11a0037040 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 zone default found 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 4 Realm: () 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 zonegroup default 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc5a830 con 0x55bc0fc56cd0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.837+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc60070 con 0x55bc0fc5b680 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc60410 con 0x55bc0fc5b680 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 20 started sync module instance, tier type = 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.838+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc5f510 con 0x7f11a0037040 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.839+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.839+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266206845536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc5f510 con 0x7f11a0037040 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.839+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc60dd0 con 0x55bc0fc522e0 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.840+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266206845536] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.841+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.841+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266206843456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc60dd0 con 0x55bc0fc522e0 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.841+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc61790 con 0x55bc0fc5b680 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.842+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266206843456] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.842+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.842+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266206849312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc60d40 con 0x55bc0fc5b680 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.842+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc62500 con 0x7f11a0037040 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.843+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266206849312] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.843+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.843+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266206854016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc628f0 con 0x7f11a0037040 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.843+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc63310 con 0x55bc0fc522e0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.844+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.844+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266206858752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc632d0 con 0x55bc0fc522e0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.844+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266206854016] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.844+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc61fe0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.845+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.845+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266206862672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc64620 con 0x55bc0fc56cd0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.845+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc65020 con 0x55bc0fc56cd0 2024-04-24T01:24:24.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.845+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266206858752] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.846+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.846+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266206861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc658c0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.846+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc66280 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.846+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266206862672] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266206861104] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266206868496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc65830 con 0x55bc0fc56cd0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=0 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=1 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=2 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=3 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=4 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=5 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.847+0000 7f11ab70c800 20 add_watcher() i=6 2024-04-24T01:24:24.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266206868496] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11ab70c800 20 add_watcher() i=7 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11ab70c800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc692b0 con 0x55bc0fc522e0 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.848+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266206870992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc666a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266206870992] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f105f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 5 note: GC not initialized 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f105e7e4640 20 reqs_thread_entry: start 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 20 Filter name: none 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f0fcffff640 20 reqs_thread_entry: start 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.850+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc9c5e0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc9c030 con 0x7f11a0037040 2024-04-24T01:24:24.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.851+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc9fdb0 con 0x55bc0fc5b680 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:24.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.852+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca4980 con 0x7f11a0037040 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:66 8.1e 8:7bd2270a:root::.bucket.meta.testx%3amyfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca8290 con 0x55bc0fc56cd0 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [create,call,writefull 0~412,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x7 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.854+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 94266207133456 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca7b70 con 0x55bc0fc522e0 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== watch-notify(notify (1) cookie 94266206843456 notify 137438953483 ret 0) ==== 889+0+0 (crc 0 0 0) 0x7f11a4026410 con 0x55bc0fc522e0 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f108cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94266206843456 notifier 4542 bl.length()=847 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(67 notify.1 [notify cookie 94266207133456 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f108cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x7 2024-04-24T01:24:24.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f108cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f108cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f108cff9640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f106c003ea0 con 0x55bc0fc522e0 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== watch-notify(notify_complete (2) cookie 94266207133456 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f11a40265e0 con 0x55bc0fc522e0 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11ab70c800 20 handle_bi_update(): bucket=testx:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11ab70c800 20 handle_bi_update(): bucket=testx:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11ab70c800 20 handle_bi_update(): bucket=testx:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11ab70c800 20 handle_bi_update(): bucket=testx:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.855+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca3bb0 con 0x55bc0fc522e0 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.856+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.856+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca6f20 con 0x55bc0fc522e0 2024-04-24T01:24:24.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11ab70c800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11ab70c800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11ab70c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94266207123520 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca4110 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify (1) cookie 94266206858752 notify 137438953484 ret 0) ==== 390+0+0 (crc 0 0 0) 0x55bc0fca8620 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f108cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94266206858752 notifier 4542 bl.length()=348 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f108cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f108cff9640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [notify cookie 94266207123520 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.857+0000 7f108cff9640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f106c003ea0 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.858+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== watch-notify(notify_complete (2) cookie 94266207123520 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f11a404a040 con 0x55bc0fc522e0 2024-04-24T01:24:24.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.858+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.858+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca3cf0 con 0x7f11a0037040 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.859+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.859+0000 7f11ab70c800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.859+0000 7f11ab70c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.859+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94266207123520 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca4110 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify (1) cookie 94266206861104 notify 137438953486 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55bc0fca47d0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.6 [notify cookie 94266207123520 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f107ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94266206861104 notifier 4542 bl.length()=149 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f107ffff640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0fdc0032c0 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== watch-notify(notify_complete (2) cookie 94266207123520 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc0fb17f00 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.860+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca3cf0 con 0x55bc0fc5b680 2024-04-24T01:24:24.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(76 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11ab70c800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 from cache 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11ab70c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 94266207125648 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fca04b0 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify (1) cookie 94266206849312 notify 137438953480 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55bc0fca01a0 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f107ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94266206849312 notifier 4542 bl.length()=206 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 notify.2 [notify cookie 94266207125648 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f107ffff640 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0fdc0032c0 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.861+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.862+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== watch-notify(notify_complete (2) cookie 94266207125648 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc0fc9f380 con 0x55bc0fc5b680 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.862+0000 7f105f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.862+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266206870992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc522e0 2024-04-24T01:24:24.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.863+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94266206870992] v32'135 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.863+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266206845536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x7f11a0037040 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.864+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94266206845536] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.864+0000 7f11ab70c800 20 remove_watcher() i=0 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.864+0000 7f11ab70c800 2 removed watcher, disabling cache 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.864+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266206843456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc522e0 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.865+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94266206843456] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.865+0000 7f11ab70c800 20 remove_watcher() i=1 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.865+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266206849312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc5b680 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.866+0000 7f11a8a11640 1 -- 172.21.15.169:0/3922538052 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94266206849312] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a0009050 con 0x55bc0fc5b680 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.866+0000 7f11ab70c800 20 remove_watcher() i=2 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.866+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266206854016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x7f11a0037040 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.867+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94266206854016] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x7f11a0037040 2024-04-24T01:24:24.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.867+0000 7f11ab70c800 20 remove_watcher() i=3 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.867+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266206858752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc522e0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.868+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94266206858752] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f11a400a4a0 con 0x55bc0fc522e0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.868+0000 7f11ab70c800 20 remove_watcher() i=4 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.868+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266206862672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.869+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94266206862672] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.869+0000 7f11ab70c800 20 remove_watcher() i=5 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.869+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266206861104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.870+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94266206861104] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.870+0000 7f11ab70c800 20 remove_watcher() i=6 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.870+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266206868496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc0fc84f20 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.871+0000 7f11a9212640 1 -- 172.21.15.169:0/3922538052 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94266206868496] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f119c071990 con 0x55bc0fc56cd0 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.871+0000 7f11ab70c800 20 remove_watcher() i=7 2024-04-24T01:24:24.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc56cd0 msgr2=0x55bc0fc590c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc56cd0 0x55bc0fc590c0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fc522e0 msgr2=0x55bc0fc547a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fc522e0 0x55bc0fc547a0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f11a0037040 msgr2=0x7f11a0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f11a0037040 0x7f11a0036410 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bc0fc5b680 msgr2=0x55bc0fc5db40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bc0fc5b680 0x55bc0fc5db40 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1074036950 msgr2=0x7f1074038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1074036950 0x7f1074038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55bc0fc16100 tx=0x7f11a0010000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 msgr2=0x55bc0fc46b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3922538052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fc3f730 0x55bc0fc46b20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f119c0529c0 tx=0x7f119c006ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 reap_dead start 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11a9a13640 1 -- 172.21.15.169:0/3922538052 reap_dead start 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 shutdown_connections 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 >> 172.21.15.169:0/3922538052 conn(0x55bc0fc3ba90 msgr2=0x55bc0fc390f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 shutdown_connections 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/3922538052 wait complete. 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 msgr2=0x7f1080038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 0x7f1080038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f11a000bf90 tx=0x7f11a000f000 comp rx=0 tx=0).stop 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 msgr2=0x55bc0fb179c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f119c08cd80 tx=0x7f119c0716a0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 shutdown_connections 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1080036950 0x7f1080038e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 --2- 172.21.15.169:0/1915910454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19550 0x55bc0fb179c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 >> 172.21.15.169:0/1915910454 conn(0x55bc0fc244e0 msgr2=0x55bc0fc248e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 shutdown_connections 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.872+0000 7f11ab70c800 1 -- 172.21.15.169:0/1915910454 wait complete. 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc1b4f0 msgr2=0x55bc0fc1d8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bc0fc1b4f0 0x55bc0fc1d8e0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fb1c2c0 msgr2=0x55bc0fc18c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bc0fb1c2c0 0x55bc0fc18c10 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bc0fc1f430 msgr2=0x55bc0fc21880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bc0fc1f430 0x55bc0fc21880 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1090036900 msgr2=0x7f1090038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1090036900 0x7f1090038dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f11a0000f60 tx=0x7f11a00010a0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 msgr2=0x55bc0fc119d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 --2- 172.21.15.169:0/3230539751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bc0fb19990 0x55bc0fc119d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f119c060040 tx=0x7f119c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11a9a13640 1 -- 172.21.15.169:0/3230539751 reap_dead start 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 shutdown_connections 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 >> 172.21.15.169:0/3230539751 conn(0x55bc0fb13340 msgr2=0x55bc0fc04040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 shutdown_connections 2024-04-24T01:24:24.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.873+0000 7f11ab70c800 1 -- 172.21.15.169:0/3230539751 wait complete. 2024-04-24T01:24:24.887 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T01:24:24.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-04-24T01:24:24.887 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-04-24T01:24:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fb200e800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55df992be2c0 0x55df992c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fb200e800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df9917cd40 con 0x55df992bc780 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fb200e800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55df9914f4d0 con 0x55df992be2c0 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4faf30c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55df992be2c0 0x55df992c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fafb0d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55df992bc780 0x55df992bcba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43642/0 (socket says 172.21.15.169:43642) 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4fafb0d640 1 -- 172.21.15.169:0/1593292863 learned_addr learned my addr 172.21.15.169:0/1593292863 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4faeb0b640 1 -- 172.21.15.169:0/1593292863 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272889007 0 0) 0x55df9917cd40 con 0x55df992bc780 2024-04-24T01:24:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.928+0000 7f4faeb0b640 1 -- 172.21.15.169:0/1593292863 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f98001e10 con 0x55df992bc780 2024-04-24T01:24:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.929+0000 7f4faf30c640 1 -- 172.21.15.169:0/1593292863 >> v1:172.21.15.142:6789/0 conn(0x55df992bc780 legacy=0x55df992bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.929+0000 7f4faf30c640 1 -- 172.21.15.169:0/1593292863 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9917b590 con 0x55df992be2c0 2024-04-24T01:24:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.930+0000 7f4faf30c640 1 --2- 172.21.15.169:0/1593292863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992be2c0 0x55df992c6dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a470 tx=0x7f4fa401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe230a2ee6eee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4faeb0b640 1 -- 172.21.15.169:0/1593292863 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4057070 con 0x55df992be2c0 2024-04-24T01:24:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4faeb0b640 1 -- 172.21.15.169:0/1593292863 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa404acd0 con 0x55df992be2c0 2024-04-24T01:24:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4faeb0b640 1 -- 172.21.15.169:0/1593292863 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa4052440 con 0x55df992be2c0 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 -- 172.21.15.169:0/1593292863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992be2c0 msgr2=0x55df992c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 --2- 172.21.15.169:0/1593292863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992be2c0 0x55df992c6dc0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a470 tx=0x7f4fa401cdb0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 -- 172.21.15.169:0/1593292863 shutdown_connections 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 --2- 172.21.15.169:0/1593292863 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992be2c0 0x55df992c6dc0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 -- 172.21.15.169:0/1593292863 >> 172.21.15.169:0/1593292863 conn(0x55df992b8300 msgr2=0x55df992ba720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 -- 172.21.15.169:0/1593292863 shutdown_connections 2024-04-24T01:24:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.931+0000 7f4fb200e800 1 -- 172.21.15.169:0/1593292863 wait complete. 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fb200e800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fb200e800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55df992093c0 con 0x55df992bc780 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58860/0 (socket says 172.21.15.169:58860) 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.943+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3407951957 learned_addr learned my addr 172.21.15.169:0/3407951957 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.944+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3407951957 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df993b1a70 con 0x55df992bc780 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.944+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/3407951957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0001de0 tx=0x7f4fa000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a386ef3ad16ecb56 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.944+0000 7f4e9de0b640 1 -- 172.21.15.169:0/3407951957 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0012020 con 0x55df992bc780 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.944+0000 7f4e9de0b640 1 -- 172.21.15.169:0/3407951957 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa000e5a0 con 0x55df992bc780 2024-04-24T01:24:24.946 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.944+0000 7f4e9de0b640 1 -- 172.21.15.169:0/3407951957 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa000e900 con 0x55df992bc780 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- 172.21.15.169:0/3407951957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 msgr2=0x55df993b14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3407951957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0001de0 tx=0x7f4fa000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- 172.21.15.169:0/3407951957 shutdown_connections 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3407951957 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b14a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- 172.21.15.169:0/3407951957 >> 172.21.15.169:0/3407951957 conn(0x55df992b8300 msgr2=0x55df993acdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- 172.21.15.169:0/3407951957 shutdown_connections 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- 172.21.15.169:0/3407951957 wait complete. 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fb200e800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55df992c95e0 con 0x55df992bc780 2024-04-24T01:24:24.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58866/0 (socket says 172.21.15.169:58866) 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.945+0000 7f4fafb0d640 1 -- 172.21.15.169:0/916793322 learned_addr learned my addr 172.21.15.169:0/916793322 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4fafb0d640 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df993b9500 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b8fc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c010 tx=0x7f4fa0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4e97fff640 1 -- 172.21.15.169:0/916793322 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0012030 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4e97fff640 1 -- 172.21.15.169:0/916793322 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa001a7a0 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4e97fff640 1 -- 172.21.15.169:0/916793322 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa001a950 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df993b9790 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.946+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df993bc440 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4e97fff640 1 -- 172.21.15.169:0/916793322 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fa0015020 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4e97fff640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e98036900 0x7f4e98038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4e97fff640 1 -- 172.21.15.169:0/916793322 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4fa0020030 con 0x55df992bc780 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4faf30c640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e98036900 0x7f4e98038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df992be2c0 0x55df993c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993c07d0 con 0x55df992be2c0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4fb030e640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df992be2c0 0x55df993c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.947+0000 7f4faf30c640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e98036900 0x7f4e98038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4054000 tx=0x7f4fa404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb030e640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df992be2c0 0x55df993c0200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb030e640 1 -- 172.21.15.169:0/916793322 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df992be2c0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993bd7d0 con 0x55df992be2c0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb030e640 1 -- 172.21.15.169:0/916793322 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df992be2c0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993c2ae0 0x55df993c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993c5570 con 0x55df993c2ae0 2024-04-24T01:24:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.948+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993c2ae0 0x55df993c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993c2ae0 0x55df993c4ed0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fafb0d640 1 -- 172.21.15.169:0/916793322 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4fa000dcd0 con 0x55df993c2ae0 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993c1a90 con 0x55df992be2c0 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fb030e640 1 -- 172.21.15.169:0/916793322 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df992be2c0 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55df993c6a20 0x55df993c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.949+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993c95d0 con 0x55df993c6a20 2024-04-24T01:24:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.950+0000 7f4faf30c640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55df993c6a20 0x55df993c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.950+0000 7f4faf30c640 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55df993c6a20 0x55df993c8e70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.950+0000 7f4faf30c640 1 -- 172.21.15.169:0/916793322 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4fa405a040 con 0x55df993c6a20 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.950+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.950+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fb200e800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fb200e800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55df991af6b0 con 0x55df993d7a30 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58868/0 (socket says 172.21.15.169:58868) 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fafb0d640 1 -- 172.21.15.169:0/4128393249 learned_addr learned my addr 172.21.15.169:0/4128393249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fafb0d640 1 -- 172.21.15.169:0/4128393249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df993d8390 con 0x55df993d7a30 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4fa004ad30 tx=0x7f4fa0016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4e957fa640 1 -- 172.21.15.169:0/4128393249 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa002d520 con 0x55df993d7a30 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4e957fa640 1 -- 172.21.15.169:0/4128393249 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa002d6c0 con 0x55df993d7a30 2024-04-24T01:24:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df993d8e00 con 0x55df993d7a30 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4e957fa640 1 -- 172.21.15.169:0/4128393249 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0044360 con 0x55df993d7a30 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.951+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df993d9300 con 0x55df993d7a30 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.952+0000 7f4e957fa640 1 -- 172.21.15.169:0/4128393249 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fa0043040 con 0x55df993d7a30 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.952+0000 7f4e957fa640 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 0x7f4e88038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.952+0000 7f4e957fa640 1 -- 172.21.15.169:0/4128393249 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4fa0040040 con 0x55df993d7a30 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.952+0000 7f4faf30c640 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 0x7f4e88038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.952+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4faf30c640 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 0x7f4e88038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55df993bd6f0 tx=0x7f4fa4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fb200e800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fb200e800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55df993b1df0 con 0x55df993e4be0 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58884/0 (socket says 172.21.15.169:58884) 2024-04-24T01:24:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fafb0d640 1 -- 172.21.15.169:0/1078878212 learned_addr learned my addr 172.21.15.169:0/1078878212 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fafb0d640 1 -- 172.21.15.169:0/1078878212 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df993e55b0 con 0x55df993e4be0 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/1078878212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0011fd0 tx=0x7f4fa00353f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efe15c9fa990bd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4e8effd640 1 -- 172.21.15.169:0/1078878212 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa004c440 con 0x55df993e4be0 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4e8effd640 1 -- 172.21.15.169:0/1078878212 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa005e070 con 0x55df993e4be0 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.953+0000 7f4e8effd640 1 -- 172.21.15.169:0/1078878212 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0024420 con 0x55df993e4be0 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- 172.21.15.169:0/1078878212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 msgr2=0x55df993e4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 --2- 172.21.15.169:0/1078878212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0011fd0 tx=0x7f4fa00353f0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- 172.21.15.169:0/1078878212 shutdown_connections 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 --2- 172.21.15.169:0/1078878212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993e4fe0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- 172.21.15.169:0/1078878212 >> 172.21.15.169:0/1078878212 conn(0x55df993e0eb0 msgr2=0x55df993def10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- 172.21.15.169:0/1078878212 shutdown_connections 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- 172.21.15.169:0/1078878212 wait complete. 2024-04-24T01:24:24.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 Processor -- start 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- start start 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fb200e800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55df993e5ca0 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fafb0d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58886/0 (socket says 172.21.15.169:58886) 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.954+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 learned_addr learned my addr 172.21.15.169:0/3122074934 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df993ec580 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00498b0 tx=0x7f4fa0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4e8d7fa640 1 -- 172.21.15.169:0/3122074934 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0040bc0 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4e8d7fa640 1 -- 172.21.15.169:0/3122074934 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0040d60 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df993ec580 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4e8d7fa640 1 -- 172.21.15.169:0/3122074934 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa00247a0 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.955+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df993ec580 con 0x55df993e4be0 2024-04-24T01:24:24.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4e8d7fa640 1 -- 172.21.15.169:0/3122074934 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fa0058070 con 0x55df993e4be0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4e8d7fa640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e78036950 0x7f4e78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4e8d7fa640 1 -- 172.21.15.169:0/3122074934 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f4fa0068070 con 0x55df993e4be0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4faf30c640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e78036950 0x7f4e78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df993f7720 0x55df993f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.956+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993fa330 con 0x55df993f7720 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb030e640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df993f7720 0x55df993f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4faf30c640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e78036950 0x7f4e78038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a340 tx=0x7f4fa4060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb030e640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df993f7720 0x55df993f9be0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 20 realm 2024-04-24T01:24:24.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993fa740 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993fafe0 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.957+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993fc0e0 0x55df993fe4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993fea10 con 0x55df993fc0e0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993fc0e0 0x55df993fe4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.958+0000 7f4fafb0d640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993fc0e0 0x55df993fe4d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fb200e800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fb200e800 20 searching for the correct realm 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55df99400a80 0x55df99402f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df99403610 con 0x55df99400a80 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4faf30c640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55df99400a80 0x55df99402f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4faf30c640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55df99400a80 0x55df99402f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4faf30c640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4fa4083040 0x7f4fa4084940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df99403610 con 0x7f4fa4083040 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.959+0000 7f4fb030e640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4fa4083040 0x7f4fa4084940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fb030e640 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4fa4083040 0x7f4fa4084940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.960+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x7f4fa4083040 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.961+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.962+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x7f4fa4083040 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.963+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.964+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x7f4fa4083040 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.965+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.966+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.966+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.966+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.966+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x7f4fa4083040 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df99400a80 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.967+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993fc0e0 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x55df993f7720 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55df993fb380 con 0x7f4fa4083040 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993ff380 con 0x55df993f7720 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.968+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993ff380 con 0x55df993f7720 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993ff380 con 0x7f4fa4083040 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 zone default found 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 4 Realm: () 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 zonegroup default 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993ff770 con 0x55df993fc0e0 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.969+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df99405470 con 0x55df99400a80 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df993ff360 con 0x55df99400a80 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 20 started sync module instance, tier type = 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.970+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404910 con 0x7f4fa4083040 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.971+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.971+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94418837196384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404910 con 0x7f4fa4083040 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.971+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99405f30 con 0x55df993f7720 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.972+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94418837196384] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.972+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.972+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94418837199360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404910 con 0x55df993f7720 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.972+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994069c0 con 0x55df99400a80 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.973+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.973+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94418837202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99407260 con 0x55df99400a80 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.973+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99407d50 con 0x7f4fa4083040 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.974+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94418837199360] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.974+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94418837202064] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.974+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.974+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94418837204400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404460 con 0x7f4fa4083040 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.974+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994085f0 con 0x55df993f7720 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.975+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.975+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94418837209280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994089e0 con 0x55df993f7720 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.975+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99409500 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.975+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94418837204400] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.976+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.976+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94418837209280] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.976+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94418837213136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994098f0 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.976+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994084e0 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.977+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.977+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94418837217040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9940a920 con 0x55df993fc0e0 2024-04-24T01:24:24.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.977+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9940b410 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.977+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94418837213136] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94418837217040] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94418837221088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9940a3b0 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=1 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=2 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=3 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=4 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=5 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.978+0000 7f4fb200e800 20 add_watcher() i=6 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.979+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94418837221088] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.979+0000 7f4fb200e800 20 add_watcher() i=7 2024-04-24T01:24:24.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.979+0000 7f4fb200e800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.979+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df9940e680 con 0x55df993f7720 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.979+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.980+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94418837207072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9940bba0 con 0x55df993f7720 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.980+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94418837207072] v32'136 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 5 note: GC not initialized 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4e64fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 20 Filter name: none 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4dde7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 20 rados->read ofs=0 len=0 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.981+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55df99441460 con 0x55df993f7720 2024-04-24T01:24:24.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.982+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.982+0000 7f4fb200e800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.982+0000 7f4e65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.982+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94418837207072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9940dfe0 con 0x55df993f7720 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.983+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94418837207072] v32'137 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.983+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94418837196384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9943f4e0 con 0x7f4fa4083040 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.984+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94418837196384] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.984+0000 7f4fb200e800 20 remove_watcher() i=0 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.984+0000 7f4fb200e800 2 removed watcher, disabling cache 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.984+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94418837199360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9943f4e0 con 0x55df993f7720 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.985+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94418837199360] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.985+0000 7f4fb200e800 20 remove_watcher() i=1 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.985+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94418837202064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df9943f4e0 con 0x55df99400a80 2024-04-24T01:24:24.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.986+0000 7f4faf30c640 1 -- 172.21.15.169:0/3122074934 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94418837202064] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa4070030 con 0x55df99400a80 2024-04-24T01:24:24.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.986+0000 7f4fb200e800 20 remove_watcher() i=2 2024-04-24T01:24:24.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.986+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94418837204400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404e60 con 0x7f4fa4083040 2024-04-24T01:24:24.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.987+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94418837204400] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x7f4fa4083040 2024-04-24T01:24:24.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.987+0000 7f4fb200e800 20 remove_watcher() i=3 2024-04-24T01:24:24.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.987+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94418837209280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404e60 con 0x55df993f7720 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.988+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94418837209280] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa800a4a0 con 0x55df993f7720 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.988+0000 7f4fb200e800 20 remove_watcher() i=4 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.988+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94418837213136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df994080c0 con 0x55df993fc0e0 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.989+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94418837213136] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.989+0000 7f4fb200e800 20 remove_watcher() i=5 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.989+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94418837217040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99404e60 con 0x55df993fc0e0 2024-04-24T01:24:25.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.990+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94418837217040] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.990+0000 7f4fb200e800 20 remove_watcher() i=6 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.990+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94418837221088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55df99408fd0 con 0x55df993fc0e0 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fafb0d640 1 -- 172.21.15.169:0/3122074934 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94418837221088] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4fa0057030 con 0x55df993fc0e0 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 20 remove_watcher() i=7 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993fc0e0 msgr2=0x55df993fe4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993fc0e0 0x55df993fe4d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df993f7720 msgr2=0x55df993f9be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df993f7720 0x55df993f9be0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4fa4083040 msgr2=0x7f4fa4084940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f4fa4083040 0x7f4fa4084940 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55df99400a80 msgr2=0x55df99402f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55df99400a80 0x55df99402f40 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e78036950 msgr2=0x7f4e78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e78036950 0x7f4e78038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400a340 tx=0x7f4fa4060040 comp rx=0 tx=0).stop 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 msgr2=0x55df993ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb030e640 1 -- 172.21.15.169:0/3122074934 reap_dead start 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4fa00498b0 tx=0x7f4fa0011e70 comp rx=0 tx=0).stop 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 shutdown_connections 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 --2- 172.21.15.169:0/3122074934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993e4be0 0x55df993ec040 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 >> 172.21.15.169:0/3122074934 conn(0x55df993e0eb0 msgr2=0x55df993de510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 shutdown_connections 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.991+0000 7f4fb200e800 1 -- 172.21.15.169:0/3122074934 wait complete. 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 msgr2=0x7f4e88038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 0x7f4e88038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x55df993bd6f0 tx=0x7f4fa4005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 msgr2=0x55df993d7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4fa004ad30 tx=0x7f4fa0016b00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 shutdown_connections 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e88036950 0x7f4e88038e10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/4128393249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df993d7a30 0x55df993d7e50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 >> 172.21.15.169:0/4128393249 conn(0x55df993cbad0 msgr2=0x55df993cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 shutdown_connections 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/4128393249 wait complete. 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993c2ae0 msgr2=0x55df993c4ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55df993c2ae0 0x55df993c4ed0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df992be2c0 msgr2=0x55df993c0200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55df992be2c0 0x55df993c0200 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55df993c6a20 msgr2=0x55df993c8e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55df993c6a20 0x55df993c8e70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e98036900 msgr2=0x7f4e98038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4e98036900 0x7f4e98038dc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4054000 tx=0x7f4fa404e000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 msgr2=0x55df993b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 --2- 172.21.15.169:0/916793322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df992bc780 0x55df993b8fc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4fa000c010 tx=0x7f4fa0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb030e640 1 -- 172.21.15.169:0/916793322 reap_dead start 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 shutdown_connections 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 >> 172.21.15.169:0/916793322 conn(0x55df992b8300 msgr2=0x55df993ab5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 shutdown_connections 2024-04-24T01:24:25.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:24.992+0000 7f4fb200e800 1 -- 172.21.15.169:0/916793322 wait complete. 2024-04-24T01:24:25.009 INFO:teuthology.orchestra.run.smithi169.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"b2MIEj7/5eaC9DXBllRlClMp","ver":2},"mtime":"2024-04-24T01:24:24.858322Z","data":{"bucket":{"name":"myfoo","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","bucket_id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-04-24T01:24:22.157363Z","linked":true,"has_bucket_info":false}} 2024-04-24T01:24:25.009 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'b2MIEj7/5eaC9DXBllRlClMp', 'ver': 2}, 'mtime': '2024-04-24T01:24:24.858322Z', 'data': {'bucket': {'name': 'myfoo', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'bucket_id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-04-24T01:24:22.157363Z', 'linked': True, 'has_bucket_info': False}} 2024-04-24T01:24:25.009 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T01:24:25.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-04-24T01:24:25.010 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-04-24T01:24:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.094 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9f8a36800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x561c1161c460 0x561c1161e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9f8a36800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561c114d6d40 con 0x561c11618950 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9f8a36800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x561c114a94d0 con 0x561c1161c460 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.093+0000 7fb9edd34640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x561c1161c460 0x561c1161e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.094+0000 7fb9f6535640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x561c11618950 0x561c1161ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43656/0 (socket says 172.21.15.169:43656) 2024-04-24T01:24:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.094+0000 7fb9f6535640 1 -- 172.21.15.169:0/3014260261 learned_addr learned my addr 172.21.15.169:0/3014260261 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.094+0000 7fb9edd34640 1 -- 172.21.15.169:0/3014260261 >> v1:172.21.15.142:6789/0 conn(0x561c11618950 legacy=0x561c1161ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.096 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.094+0000 7fb9edd34640 1 -- 172.21.15.169:0/3014260261 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c114d5590 con 0x561c1161c460 2024-04-24T01:24:25.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9edd34640 1 --2- 172.21.15.169:0/3014260261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1161c460 0x561c1161e850 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000a470 tx=0x7fb9e001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb90eda901858f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f5d34640 1 -- 172.21.15.169:0/3014260261 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e0057070 con 0x561c1161c460 2024-04-24T01:24:25.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f5d34640 1 -- 172.21.15.169:0/3014260261 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0052570 con 0x561c1161c460 2024-04-24T01:24:25.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f5d34640 1 -- 172.21.15.169:0/3014260261 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e0052870 con 0x561c1161c460 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 -- 172.21.15.169:0/3014260261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1161c460 msgr2=0x561c1161e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/3014260261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1161c460 0x561c1161e850 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000a470 tx=0x7fb9e001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 -- 172.21.15.169:0/3014260261 shutdown_connections 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/3014260261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1161c460 0x561c1161e850 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 -- 172.21.15.169:0/3014260261 >> 172.21.15.169:0/3014260261 conn(0x561c116123a0 msgr2=0x561c116147c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 -- 172.21.15.169:0/3014260261 shutdown_connections 2024-04-24T01:24:25.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.096+0000 7fb9f8a36800 1 -- 172.21.15.169:0/3014260261 wait complete. 2024-04-24T01:24:25.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.108+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.108+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.108+0000 7fb9f8a36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.108+0000 7fb9f8a36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561c115633b0 con 0x561c11618950 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58896/0 (socket says 172.21.15.169:58896) 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb9f6535640 1 -- 172.21.15.169:0/4075173933 learned_addr learned my addr 172.21.15.169:0/4075173933 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb9f6535640 1 -- 172.21.15.169:0/4075173933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c117096d0 con 0x561c11618950 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb9f6535640 1 --2- 172.21.15.169:0/4075173933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001de0 tx=0x7fb9e800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285fc8622f3abf0a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb8e4608640 1 -- 172.21.15.169:0/4075173933 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e8012020 con 0x561c11618950 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb8e4608640 1 -- 172.21.15.169:0/4075173933 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e800e5a0 con 0x561c11618950 2024-04-24T01:24:25.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.109+0000 7fb8e4608640 1 -- 172.21.15.169:0/4075173933 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e800e8c0 con 0x561c11618950 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- 172.21.15.169:0/4075173933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 msgr2=0x561c11709100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/4075173933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001de0 tx=0x7fb9e800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- 172.21.15.169:0/4075173933 shutdown_connections 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/4075173933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11709100 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- 172.21.15.169:0/4075173933 >> 172.21.15.169:0/4075173933 conn(0x561c116123a0 msgr2=0x561c11704a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- 172.21.15.169:0/4075173933 shutdown_connections 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- 172.21.15.169:0/4075173933 wait complete. 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11710c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.110+0000 7fb9f8a36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561c116210a0 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11710c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11710c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58910/0 (socket says 172.21.15.169:58910) 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f6535640 1 -- 172.21.15.169:0/259260559 learned_addr learned my addr 172.21.15.169:0/259260559 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f6535640 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c11711190 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f6535640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11710c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001de0 tx=0x7fb9e8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb8e2e05640 1 -- 172.21.15.169:0/259260559 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e8012030 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb8e2e05640 1 -- 172.21.15.169:0/259260559 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e801a7a0 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c11711420 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb8e2e05640 1 -- 172.21.15.169:0/259260559 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e801aac0 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.111+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c117140d0 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb8e2e05640 1 -- 172.21.15.169:0/259260559 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9e8015020 con 0x561c11618950 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb8e2e05640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8dc036900 0x7fb8dc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb8e2e05640 1 -- 172.21.15.169:0/259260559 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb9e8020070 con 0x561c11618950 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb9edd34640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8dc036900 0x7fb8dc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1161c460 0x561c11717e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117183d0 con 0x561c1161c460 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.112+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1161c460 0x561c11717e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9edd34640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8dc036900 0x7fb8dc038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0054000 tx=0x7fb9e004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1161c460 0x561c11717e90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f6d36640 1 -- 172.21.15.169:0/259260559 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1161c460 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11715460 con 0x561c1161c460 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f6d36640 1 -- 172.21.15.169:0/259260559 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1161c460 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c1171a770 0x561c1171cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.113+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1171d200 con 0x561c1171a770 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f6535640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c1171a770 0x561c1171cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f6535640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c1171a770 0x561c1171cb60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f6535640 1 -- 172.21.15.169:0/259260559 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb9e802dcf0 con 0x561c1171a770 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11719720 con 0x561c1161c460 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f6d36640 1 -- 172.21.15.169:0/259260559 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1161c460 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561c1171e6b0 0x561c11720b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.114+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11721260 con 0x561c1171e6b0 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.115+0000 7fb9edd34640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561c1171e6b0 0x561c11720b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.115+0000 7fb9edd34640 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561c1171e6b0 0x561c11720b00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.115+0000 7fb9edd34640 1 -- 172.21.15.169:0/259260559 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb9e0052940 con 0x561c1171e6b0 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.115+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.115+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f8a36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f8a36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561c115096b0 con 0x561c1172f670 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58912/0 (socket says 172.21.15.169:58912) 2024-04-24T01:24:25.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f6535640 1 -- 172.21.15.169:0/1464642889 learned_addr learned my addr 172.21.15.169:0/1464642889 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f6535640 1 -- 172.21.15.169:0/1464642889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1172ffd0 con 0x561c1172f670 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f6535640 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8024fd0 tx=0x7fb9e800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb8dbfff640 1 -- 172.21.15.169:0/1464642889 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e80440b0 con 0x561c1172f670 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb8dbfff640 1 -- 172.21.15.169:0/1464642889 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e8044250 con 0x561c1172f670 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c11730a40 con 0x561c1172f670 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb8dbfff640 1 -- 172.21.15.169:0/1464642889 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e8044670 con 0x561c1172f670 2024-04-24T01:24:25.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.116+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c11730f40 con 0x561c1172f670 2024-04-24T01:24:25.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.117+0000 7fb8dbfff640 1 -- 172.21.15.169:0/1464642889 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9e8044810 con 0x561c1172f670 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.117+0000 7fb8dbfff640 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 0x7fb8d0038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.117+0000 7fb8dbfff640 1 -- 172.21.15.169:0/1464642889 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb9e8039ce0 con 0x561c1172f670 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.117+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 0x7fb8d0038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.117+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 0x7fb8d0038e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561c11715380 tx=0x7fb9e0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f8a36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f8a36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561c11709a50 con 0x561c1173c720 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58918/0 (socket says 172.21.15.169:58918) 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f6535640 1 -- 172.21.15.169:0/1948774417 learned_addr learned my addr 172.21.15.169:0/1948774417 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f6535640 1 -- 172.21.15.169:0/1948774417 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c1173d110 con 0x561c1173c720 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb9f6535640 1 --2- 172.21.15.169:0/1948774417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb9e801af70 tx=0x7fb9e8044bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc47b6279ef4f47a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1948774417 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e8052040 con 0x561c1173c720 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1948774417 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e8022c60 con 0x561c1173c720 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.118+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1948774417 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e802d520 con 0x561c1173c720 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1948774417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 msgr2=0x561c1173cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1948774417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb9e801af70 tx=0x7fb9e8044bf0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1948774417 shutdown_connections 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1948774417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c1173cb40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1948774417 >> 172.21.15.169:0/1948774417 conn(0x561c11738a40 msgr2=0x561c11736aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1948774417 shutdown_connections 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1948774417 wait complete. 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 Processor -- start 2024-04-24T01:24:25.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- start start 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c11743b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.119+0000 7fb9f8a36800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561c1173d830 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c11743b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f6535640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c11743b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58932/0 (socket says 172.21.15.169:58932) 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 learned_addr learned my addr 172.21.15.169:0/1474612202 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c117440b0 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f6535640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c11743b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8034fd0 tx=0x7fb9e8008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb8c7fff640 1 -- 172.21.15.169:0/1474612202 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e802d3f0 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb8c7fff640 1 -- 172.21.15.169:0/1474612202 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e804c6e0 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561c117440b0 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb8c7fff640 1 -- 172.21.15.169:0/1474612202 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb9e802d590 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.120+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c117440b0 con 0x561c1173c720 2024-04-24T01:24:25.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.121+0000 7fb8c7fff640 1 -- 172.21.15.169:0/1474612202 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb9e805e030 con 0x561c1173c720 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.121+0000 7fb8c7fff640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8c0036900 0x7fb8c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.121+0000 7fb8c7fff640 1 -- 172.21.15.169:0/1474612202 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fb9e805c020 con 0x561c1173c720 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.121+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8c0036900 0x7fb8c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.121+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8c0036900 0x7fb8c0038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0052fd0 tx=0x7fb9e004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1174f1d0 0x561c11751690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11751de0 con 0x561c1174f1d0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1174f1d0 0x561c11751690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1174f1d0 0x561c11751690 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 20 realm 2024-04-24T01:24:25.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117521f0 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.122+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11752ac0 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c11753bc0 0x561c11755fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117565c0 con 0x561c11753bc0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.123+0000 7fb9f6535640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c11753bc0 0x561c11755fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f6535640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c11753bc0 0x561c11755fb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f8a36800 20 searching for the correct realm 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561c11758570 0x561c1175aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1175b100 con 0x561c11758570 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561c11758570 0x561c1175aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.124+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561c11758570 0x561c1175aa30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9edd34640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb9e0076040 0x7fb9e0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c1175b100 con 0x7fb9e0076040 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb9e0076040 0x7fb9e0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6d36640 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb9e0076040 0x7fb9e0083410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11753bc0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.125+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c1174f1d0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c1174f1d0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11753bc0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.126+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11753bc0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x7fb9e0076040 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11758570 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c1174f1d0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.127+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11753bc0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c1174f1d0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x7fb9e0076040 2024-04-24T01:24:25.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561c11752e60 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.128+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11753bc0 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.129+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c1174f1d0 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c1174f1d0 2024-04-24T01:24:25.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11753bc0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.130+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x7fb9e0076040 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c1174f1d0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11753bc0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.131+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11753bc0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x7fb9e0076040 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11758570 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.132+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c11753bc0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x561c1174f1d0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb9e0090040 con 0x7fb9e0076040 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.133+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11756e80 con 0x561c1174f1d0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11756e80 con 0x561c1174f1d0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11756e80 con 0x7fb9e0076040 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 zone default found 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 4 Realm: () 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 zonegroup default 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.134+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11757720 con 0x561c11753bc0 2024-04-24T01:24:25.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1175cf60 con 0x561c11758570 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1175d300 con 0x561c11758570 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 started sync module instance, tier type = 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.135+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175c400 con 0x7fb9e0076040 2024-04-24T01:24:25.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.136+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.137+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94678552004592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175c400 con 0x7fb9e0076040 2024-04-24T01:24:25.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.137+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175db90 con 0x561c1174f1d0 2024-04-24T01:24:25.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.138+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94678552004592] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.138+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.138+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94678552008352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175c400 con 0x561c1174f1d0 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.138+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175e5a0 con 0x561c11758570 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.139+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94678552008352] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.139+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.139+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94678552002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175c370 con 0x561c11758570 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.139+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175f490 con 0x7fb9e0076040 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.140+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94678552002384] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.140+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.140+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94678552014816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175f8b0 con 0x7fb9e0076040 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.140+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11760270 con 0x561c1174f1d0 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.141+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94678552014816] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.141+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.141+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94678552018880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175f8b0 con 0x561c1174f1d0 2024-04-24T01:24:25.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.141+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11760c80 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.142+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.142+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94678552020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11761520 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.142+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11761f40 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.143+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94678552018880] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.143+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94678552020944] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.144+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.144+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94678552025648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11762330 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.144+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11762b80 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94678552028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c11762f90 con 0x561c11753bc0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=0 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=1 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=2 2024-04-24T01:24:25.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=3 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=4 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.145+0000 7fb9f8a36800 20 add_watcher() i=5 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94678552025648] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f8a36800 20 add_watcher() i=6 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94678552028480] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f8a36800 20 add_watcher() i=7 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f8a36800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.146+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1175f400 con 0x561c1174f1d0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.147+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.147+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94678552029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c1175f400 con 0x561c1174f1d0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94678552029728] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb8acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 5 note: GC not initialized 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb8277fe640 20 reqs_thread_entry: start 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 20 Filter name: none 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb8257fa640 20 reqs_thread_entry: start 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.148+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11799340 con 0x561c1174f1d0 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:25.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c11798e60 con 0x561c1174f1d0 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv3 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=193 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.149+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.1e 8:7bd2270a:root::.bucket.meta.testx%3amyfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c1179cc50 con 0x561c11753bc0 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 20 rados_obj.operate() r=0 bl.length=412 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.150+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a0ee0 con 0x561c1174f1d0 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.151+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x561c1174f1d0 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.151+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a47f0 con 0x561c11758570 2024-04-24T01:24:25.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [create,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9f8a36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x7 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9f8a36800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9f8a36800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9f8a36800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94678552290608 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117a4290 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== watch-notify(notify (1) cookie 94678552002384 notify 137438953481 ret 0) ==== 770+0+0 (crc 0 0 0) 0x561c117a4b90 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb8d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94678552002384 notifier 4556 bl.length()=728 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 notify.2 [notify cookie 94678552290608 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb8d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x7 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb8d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb8d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.152+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8bc003ea0 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== watch-notify(notify_complete (2) cookie 94678552290608 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c117a0910 con 0x561c11758570 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9f8a36800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9f8a36800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9f8a36800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9f8a36800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.153+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a4370 con 0x7fb9e0076040 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.154+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.154+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a4370 con 0x7fb9e0076040 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fb9f000a4a0 con 0x7fb9e0076040 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f8a36800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f8a36800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f8a36800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94678552297472 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117a4420 con 0x561c11753bc0 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== watch-notify(notify (1) cookie 94678552025648 notify 137438953487 ret 0) ==== 356+0+0 (crc 0 0 0) 0x561c1172ffd0 con 0x561c11753bc0 2024-04-24T01:24:25.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb8d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94678552025648 notifier 4556 bl.length()=314 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb8d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb8d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(71 notify.6 [notify cookie 94678552297472 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.155+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8bc003ea0 con 0x561c11753bc0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.156+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.156+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== watch-notify(notify_complete (2) cookie 94678552297472 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c117140d0 con 0x561c11753bc0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.156+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a2530 con 0x561c1174f1d0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f8a36800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f8a36800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94678552297472 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117a4420 con 0x561c1174f1d0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify (1) cookie 94678552018880 notify 137438953485 ret 0) ==== 197+0+0 (crc 0 0 0) 0x561c117a3710 con 0x561c1174f1d0 2024-04-24T01:24:25.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb8d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94678552018880 notifier 4556 bl.length()=155 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(74 notify.4 [notify cookie 94678552297472 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb8d97fa640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb82c0032c0 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify_complete (2) cookie 94678552297472 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561c117a3540 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.157+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 8.1e 8:7bd2270a:root::.bucket.meta.testx%3amyfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c11753bc0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.158+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call,delete] v32'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.158+0000 7fb9f8a36800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 from cache 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.158+0000 7fb9f8a36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.158+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94678552267712 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== watch-notify(notify (1) cookie 94678552008352 notify 137438953486 ret 0) ==== 254+0+0 (crc 0 0 0) 0x561c117a3540 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb8d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94678552008352 notifier 4556 bl.length()=212 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb8d9ffb640 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb8bc003ea0 con 0x561c1174f1d0 2024-04-24T01:24:25.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(77 notify.1 [notify cookie 94678552267712 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== watch-notify(notify_complete (2) cookie 94678552267712 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb9f0018c20 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.159+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.160+0000 7fb8acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.160+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94678552029728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.161+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94678552029728] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.161+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94678552004592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x7fb9e0076040 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.162+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94678552004592] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x7fb9e0076040 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.162+0000 7fb9f8a36800 20 remove_watcher() i=0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.162+0000 7fb9f8a36800 2 removed watcher, disabling cache 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.162+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94678552008352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.163+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94678552008352] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.163+0000 7fb9f8a36800 20 remove_watcher() i=1 2024-04-24T01:24:25.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.163+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94678552002384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c11758570 2024-04-24T01:24:25.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.164+0000 7fb9edd34640 1 -- 172.21.15.169:0/1474612202 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94678552002384] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e0081070 con 0x561c11758570 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.164+0000 7fb9f8a36800 20 remove_watcher() i=2 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.164+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94678552014816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x7fb9e0076040 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.165+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94678552014816] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x7fb9e0076040 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.165+0000 7fb9f8a36800 20 remove_watcher() i=3 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.165+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94678552018880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c1174f1d0 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.166+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94678552018880] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9f004a040 con 0x561c1174f1d0 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.166+0000 7fb9f8a36800 20 remove_watcher() i=4 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.166+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94678552020944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c11753bc0 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.167+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94678552020944] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.167+0000 7fb9f8a36800 20 remove_watcher() i=5 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.167+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94678552025648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c11753bc0 2024-04-24T01:24:25.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.168+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94678552025648] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.168+0000 7fb9f8a36800 20 remove_watcher() i=6 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.168+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94678552028480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561c117a1520 con 0x561c11753bc0 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f6535640 1 -- 172.21.15.169:0/1474612202 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94678552028480] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb9e8055040 con 0x561c11753bc0 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 20 remove_watcher() i=7 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c11753bc0 msgr2=0x561c11755fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c11753bc0 0x561c11755fb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1174f1d0 msgr2=0x561c11751690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1174f1d0 0x561c11751690 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb9e0076040 msgr2=0x7fb9e0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb9e0076040 0x7fb9e0083410 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561c11758570 msgr2=0x561c1175aa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561c11758570 0x561c1175aa30 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8c0036900 msgr2=0x7fb8c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8c0036900 0x7fb8c0038dc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0052fd0 tx=0x7fb9e004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 msgr2=0x561c11743b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1474612202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1173c720 0x561c11743b70 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8034fd0 tx=0x7fb9e8008e70 comp rx=0 tx=0).stop 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 reap_dead start 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f6d36640 1 -- 172.21.15.169:0/1474612202 reap_dead start 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 shutdown_connections 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 >> 172.21.15.169:0/1474612202 conn(0x561c11738a40 msgr2=0x561c117360a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 shutdown_connections 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.169+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1474612202 wait complete. 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 msgr2=0x7fb8d0038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 0x7fb8d0038e80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561c11715380 tx=0x7fb9e0005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 msgr2=0x561c1172fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8024fd0 tx=0x7fb9e800db20 comp rx=0 tx=0).stop 2024-04-24T01:24:25.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 shutdown_connections 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8d00369c0 0x7fb8d0038e80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/1464642889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c1172f670 0x561c1172fa90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 >> 172.21.15.169:0/1464642889 conn(0x561c11723710 msgr2=0x561c11723b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 shutdown_connections 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/1464642889 wait complete. 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c1171a770 msgr2=0x561c1171cb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561c1171a770 0x561c1171cb60 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1161c460 msgr2=0x561c11717e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x561c1161c460 0x561c11717e90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561c1171e6b0 msgr2=0x561c11720b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x561c1171e6b0 0x561c11720b00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8dc036900 msgr2=0x7fb8dc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8dc036900 0x7fb8dc038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0054000 tx=0x7fb9e004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 msgr2=0x561c11710c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 --2- 172.21.15.169:0/259260559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561c11618950 0x561c11710c50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8001de0 tx=0x7fb9e8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f6d36640 1 -- 172.21.15.169:0/259260559 reap_dead start 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 shutdown_connections 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 >> 172.21.15.169:0/259260559 conn(0x561c116123a0 msgr2=0x561c117032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 shutdown_connections 2024-04-24T01:24:25.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.170+0000 7fb9f8a36800 1 -- 172.21.15.169:0/259260559 wait complete. 2024-04-24T01:24:25.185 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:24:25.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-04-24T01:24:25.186 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-04-24T01:24:25.230 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.230 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.229+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c6e98800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f1ae40e210 0x55f1ae410600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c6e98800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1ae2c9d40 con 0x55f1ae409d80 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c6e98800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55f1ae29c4d0 con 0x55f1ae40e210 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0bffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f1ae40e210 0x55f1ae410600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c499e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55f1ae409d80 0x55f1ae40a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43666/0 (socket says 172.21.15.169:43666) 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0bffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f1ae40e210 0x55f1ae410600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58940/0 (socket says 172.21.15.169:58940) 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0c499e640 1 -- 172.21.15.169:0/4143015678 learned_addr learned my addr 172.21.15.169:0/4143015678 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0bffff640 1 -- 172.21.15.169:0/4143015678 >> v1:172.21.15.142:6789/0 conn(0x55f1ae409d80 legacy=0x55f1ae40a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.230+0000 7ff0bffff640 1 -- 172.21.15.169:0/4143015678 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae2c8590 con 0x55f1ae40e210 2024-04-24T01:24:25.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.232+0000 7ff0bffff640 1 --2- 172.21.15.169:0/4143015678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae40e210 0x55f1ae410600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000a470 tx=0x7ff0b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0868674bdb32d06 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.232+0000 7ff0bf7fe640 1 -- 172.21.15.169:0/4143015678 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b0057070 con 0x55f1ae40e210 2024-04-24T01:24:25.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.232+0000 7ff0bf7fe640 1 -- 172.21.15.169:0/4143015678 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b0052570 con 0x55f1ae40e210 2024-04-24T01:24:25.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.232+0000 7ff0bf7fe640 1 -- 172.21.15.169:0/4143015678 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b0052870 con 0x55f1ae40e210 2024-04-24T01:24:25.234 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4143015678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae40e210 msgr2=0x55f1ae410600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4143015678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae40e210 0x55f1ae410600 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000a470 tx=0x7ff0b001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4143015678 shutdown_connections 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4143015678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae40e210 0x55f1ae410600 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4143015678 >> 172.21.15.169:0/4143015678 conn(0x55f1ae405320 msgr2=0x55f1ae407740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4143015678 shutdown_connections 2024-04-24T01:24:25.235 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.233+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4143015678 wait complete. 2024-04-24T01:24:25.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.244+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c6e98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c6e98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1ae3563b0 con 0x55f1ae409d80 2024-04-24T01:24:25.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58956/0 (socket says 172.21.15.169:58956) 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c499e640 1 -- 172.21.15.169:0/3555780938 learned_addr learned my addr 172.21.15.169:0/3555780938 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c499e640 1 -- 172.21.15.169:0/3555780938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae411d40 con 0x55f1ae409d80 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.245+0000 7ff0c499e640 1 --2- 172.21.15.169:0/3555780938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8001d80 tx=0x7ff0b8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307d608eaca789ba server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7fefb2e05640 1 -- 172.21.15.169:0/3555780938 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8013030 con 0x55f1ae409d80 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7fefb2e05640 1 -- 172.21.15.169:0/3555780938 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b800e470 con 0x55f1ae409d80 2024-04-24T01:24:25.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7fefb2e05640 1 -- 172.21.15.169:0/3555780938 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b800e810 con 0x55f1ae409d80 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3555780938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 msgr2=0x55f1ae413780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/3555780938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8001d80 tx=0x7ff0b8001e70 comp rx=0 tx=0).stop 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3555780938 shutdown_connections 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/3555780938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae413780 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3555780938 >> 172.21.15.169:0/3555780938 conn(0x55f1ae405320 msgr2=0x55f1ae4f79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3555780938 shutdown_connections 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.246+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3555780938 wait complete. 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c6e98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae505eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.253 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c6e98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1ae410ed0 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae505eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae505eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58958/0 (socket says 172.21.15.169:58958) 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c499e640 1 -- 172.21.15.169:0/1576194928 learned_addr learned my addr 172.21.15.169:0/1576194928 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c499e640 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae5063f0 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.247+0000 7ff0c499e640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae505eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8004000 tx=0x7ff0b8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7fefb1602640 1 -- 172.21.15.169:0/1576194928 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8027070 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7fefb1602640 1 -- 172.21.15.169:0/1576194928 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8019900 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1ae506680 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7fefb1602640 1 -- 172.21.15.169:0/1576194928 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8019c60 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ae509330 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.248+0000 7fefb1602640 1 -- 172.21.15.169:0/1576194928 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff0b802a070 con 0x55f1ae409d80 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7fefb1602640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fefac036900 0x7fefac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.254 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7fefb1602640 1 -- 172.21.15.169:0/1576194928 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0b801f070 con 0x55f1ae409d80 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0bffff640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fefac036900 0x7fefac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae40e210 0x55f1ae50d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae50d680 con 0x55f1ae40e210 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c519f640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae40e210 0x55f1ae50d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0bffff640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fefac036900 0x7fefac038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0054000 tx=0x7ff0b004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c519f640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae40e210 0x55f1ae50d0f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c519f640 1 -- 172.21.15.169:0/1576194928 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae40e210 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.249+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae50a6c0 con 0x55f1ae40e210 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c519f640 1 -- 172.21.15.169:0/1576194928 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae40e210 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae50f9d0 0x55f1ae511dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae512460 con 0x55f1ae50f9d0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c499e640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae50f9d0 0x55f1ae511dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c499e640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae50f9d0 0x55f1ae511dc0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.250+0000 7ff0c499e640 1 -- 172.21.15.169:0/1576194928 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae50f9d0 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae50e980 con 0x55f1ae40e210 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0c519f640 1 -- 172.21.15.169:0/1576194928 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae40e210 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f1ae513910 0x55f1ae515d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5164c0 con 0x55f1ae513910 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0bffff640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f1ae513910 0x55f1ae515d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.251+0000 7ff0bffff640 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f1ae513910 0x55f1ae515d60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0bffff640 1 -- 172.21.15.169:0/1576194928 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff0b0052980 con 0x55f1ae513910 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c6e98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c6e98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1ae2fc6b0 con 0x55f1ae5248b0 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58968/0 (socket says 172.21.15.169:58968) 2024-04-24T01:24:25.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c499e640 1 -- 172.21.15.169:0/4037237631 learned_addr learned my addr 172.21.15.169:0/4037237631 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.252+0000 7ff0c499e640 1 -- 172.21.15.169:0/4037237631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae525210 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7ff0c499e640 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8016fd0 tx=0x7ff0b80167a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7fefaa7fc640 1 -- 172.21.15.169:0/4037237631 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b80448e0 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7fefaa7fc640 1 -- 172.21.15.169:0/4037237631 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8044a80 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1ae525c80 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7fefaa7fc640 1 -- 172.21.15.169:0/4037237631 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8044d60 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ae526180 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.253+0000 7fefaa7fc640 1 -- 172.21.15.169:0/4037237631 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff0b803b020 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7fefaa7fc640 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 0x7fef9c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7fefaa7fc640 1 -- 172.21.15.169:0/4037237631 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0b8039020 con 0x55f1ae5248b0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0bffff640 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 0x7fef9c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0bffff640 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 0x7fef9c038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55f1ae50a5e0 tx=0x7ff0b0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c6e98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c6e98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1ae4120c0 con 0x55f1ae5319d0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58972/0 (socket says 172.21.15.169:58972) 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.254+0000 7ff0c499e640 1 -- 172.21.15.169:0/3469448463 learned_addr learned my addr 172.21.15.169:0/3469448463 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c499e640 1 -- 172.21.15.169:0/3469448463 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae5323c0 con 0x55f1ae5319d0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c499e640 1 --2- 172.21.15.169:0/3469448463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8019640 tx=0x7ff0b804c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b79688111939cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7fef9bfff640 1 -- 172.21.15.169:0/3469448463 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b805a070 con 0x55f1ae5319d0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7fef9bfff640 1 -- 172.21.15.169:0/3469448463 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8044500 con 0x55f1ae5319d0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7fef9bfff640 1 -- 172.21.15.169:0/3469448463 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b803d410 con 0x55f1ae5319d0 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3469448463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 msgr2=0x55f1ae531df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/3469448463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8019640 tx=0x7ff0b804c8e0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3469448463 shutdown_connections 2024-04-24T01:24:25.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/3469448463 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae531df0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3469448463 >> 172.21.15.169:0/3469448463 conn(0x55f1ae52dd30 msgr2=0x55f1ae52bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3469448463 shutdown_connections 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.255+0000 7ff0c6e98800 1 -- 172.21.15.169:0/3469448463 wait complete. 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c6e98800 1 Processor -- start 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c6e98800 1 -- start start 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c6e98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c6e98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f1ae532a70 con 0x55f1ae5319d0 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c499e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58980/0 (socket says 172.21.15.169:58980) 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 learned_addr learned my addr 172.21.15.169:0/885878405 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1ae539310 con 0x55f1ae5319d0 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.256+0000 7ff0c499e640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80225b0 tx=0x7ff0b8023800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 -- 172.21.15.169:0/885878405 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8022620 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 -- 172.21.15.169:0/885878405 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0b8065040 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1ae539310 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 -- 172.21.15.169:0/885878405 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b804cac0 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1ae539310 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 -- 172.21.15.169:0/885878405 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff0b8033070 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef90036950 0x7fef90038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.257+0000 7fef9a7fc640 1 -- 172.21.15.169:0/885878405 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7ff0b8014070 con 0x55f1ae5319d0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0bffff640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef90036950 0x7fef90038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0bffff640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef90036950 0x7fef90038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0b001ced0 tx=0x7ff0b004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae544510 0x55f1ae5469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae547120 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0c519f640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae544510 0x55f1ae5469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.258+0000 7ff0c519f640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae544510 0x55f1ae5469d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 realm 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae547530 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae547e00 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae544510 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae548f00 0x55f1ae54b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.259+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae54b900 con 0x55f1ae548f00 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c499e640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae548f00 0x55f1ae54b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c499e640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae548f00 0x55f1ae54b2f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c6e98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c6e98800 20 searching for the correct realm 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f1ae54d8b0 0x55f1ae54fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae550440 con 0x55f1ae54d8b0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.260+0000 7ff0bffff640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f1ae54d8b0 0x55f1ae54fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0bffff640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f1ae54d8b0 0x55f1ae54fd70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0bffff640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff0b0076040 0x7ff0b0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae550440 con 0x7ff0b0076040 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0c519f640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff0b0076040 0x7ff0b0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.261+0000 7ff0c519f640 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff0b0076040 0x7ff0b0083410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae548f00 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae544510 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae544510 2024-04-24T01:24:25.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.262+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x7ff0b0076040 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.263+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae544510 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae544510 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.264+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x7ff0b0076040 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5481a0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae548f00 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.265+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.266+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae548f00 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x7ff0b0076040 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.267+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae548f00 2024-04-24T01:24:25.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae548f00 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.268+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x7ff0b0076040 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae54d8b0 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae548f00 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x55f1ae544510 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.269+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7ff0b0090040 con 0x7ff0b0076040 2024-04-24T01:24:25.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae54c1c0 con 0x55f1ae544510 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae54c1c0 con 0x55f1ae544510 2024-04-24T01:24:25.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae54c1c0 con 0x7ff0b0076040 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 20 zone default found 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 4 Realm: () 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.270+0000 7ff0c6e98800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 zonegroup default 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae54ca60 con 0x55f1ae548f00 2024-04-24T01:24:25.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5522a0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae552640 con 0x55f1ae54d8b0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 started sync module instance, tier type = 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.271+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae551740 con 0x7ff0b0076040 2024-04-24T01:24:25.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.272+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.272+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94496500292672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae551740 con 0x7ff0b0076040 2024-04-24T01:24:25.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.272+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae552ed0 con 0x55f1ae544510 2024-04-24T01:24:25.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.273+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94496500292672] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.274+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.274+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94496500296160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae551740 con 0x55f1ae544510 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.274+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae553940 con 0x55f1ae54d8b0 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.275+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94496500296160] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.275+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.275+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94496500290192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5516b0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.275+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae554800 con 0x7ff0b0076040 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.276+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94496500290192] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.276+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.276+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94496500302672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae554c20 con 0x7ff0b0076040 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.276+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5555e0 con 0x55f1ae544510 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.277+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94496500302672] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.277+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.277+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94496500304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5555e0 con 0x55f1ae544510 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.277+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae555fa0 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.280+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.280+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94496500308720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae556840 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.280+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae557270 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.280+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94496500304208] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.281+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94496500308720] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.281+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.281+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94496500313472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae556340 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.281+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae557b40 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94496500313472] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94496500306224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae557b40 con 0x55f1ae548f00 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=0 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=1 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=2 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=3 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=4 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=5 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.282+0000 7ff0c6e98800 20 add_watcher() i=6 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.283+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94496500306224] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.283+0000 7ff0c6e98800 20 add_watcher() i=7 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.283+0000 7ff0c6e98800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.283+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae55af40 con 0x55f1ae544510 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.284+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.284+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94496500316256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae558460 con 0x55f1ae544510 2024-04-24T01:24:25.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.285+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94496500316256] v32'140 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.285+0000 7fef7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.285+0000 7ff0c6e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.285+0000 7ff0c6e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.285+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae55ac50 con 0x55f1ae544510 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.286+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'48 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.286+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae563fb0 con 0x55f1ae548f00 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.287+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.287+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae563fb0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.288+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.288+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae564900 con 0x55f1ae544510 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.289+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'141 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.289+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5636c0 con 0x7ff0b0076040 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.290+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'45 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.290+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5636c0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.291+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.291+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae565660 con 0x55f1ae544510 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.292+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.292+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae565b10 con 0x55f1ae548f00 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.293+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.293+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae565b10 con 0x7ff0b0076040 2024-04-24T01:24:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.294+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.294+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae565b10 con 0x55f1ae54d8b0 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.295+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.295+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566080 con 0x7ff0b0076040 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.296+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'46 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.296+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566080 con 0x55f1ae548f00 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.297+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.297+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566080 con 0x7ff0b0076040 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.298+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.298+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566080 con 0x55f1ae548f00 2024-04-24T01:24:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.300+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.300+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566110 con 0x55f1ae544510 2024-04-24T01:24:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.301+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'142 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.301+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566110 con 0x55f1ae54d8b0 2024-04-24T01:24:25.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.303+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.303+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5665c0 con 0x7ff0b0076040 2024-04-24T01:24:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.304+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'47 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.304+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5665c0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.305+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.305+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566530 con 0x55f1ae544510 2024-04-24T01:24:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.306+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.306+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae544510 2024-04-24T01:24:25.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.307+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'143 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.307+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.308+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.308+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x7ff0b0076040 2024-04-24T01:24:25.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.309+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.309+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.310+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.310+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.311+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.311+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.312+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.312+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.313+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.313+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae548f00 2024-04-24T01:24:25.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.314+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.314+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.315+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'29 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.315+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae548f00 2024-04-24T01:24:25.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.316+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'32 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.316+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae54d8b0 2024-04-24T01:24:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.317+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.317+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x55f1ae548f00 2024-04-24T01:24:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.318+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.318+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae566360 con 0x7ff0b0076040 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.319+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.319+0000 7fef79fe3640 20 reqs_thread_entry: start 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 20 Filter name: none 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7feeeb7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:25.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae591370 con 0x55f1ae548f00 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 20 rados_obj.operate() r=0 bl.length=419 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.320+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae590e70 con 0x55f1ae544510 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.321+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.321+0000 7ff0c6e98800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.321+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae590e70 con 0x55f1ae548f00 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c6e98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94496500551280 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae594080 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== watch-notify(notify (1) cookie 94496500290192 notify 137438953482 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55f1ae565830 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7fef9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94496500290192 notifier 4563 bl.length()=170 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(97 notify.2 [notify cookie 94496500551280 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7fef9bfff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fef88003d60 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== watch-notify(notify_complete (2) cookie 94496500551280 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1ae563710 con 0x55f1ae54d8b0 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c6e98800 10 removing email index: 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c6e98800 10 removing user buckets index 2024-04-24T01:24:25.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.322+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae590e70 con 0x55f1ae544510 2024-04-24T01:24:25.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.323+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.323+0000 7ff0c6e98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.323+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94496500563936 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae590e70 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== watch-notify(notify (1) cookie 94496500304208 notify 137438953487 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55f1ae563170 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7fef9bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94496500304208 notifier 4563 bl.length()=175 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(100 notify.4 [notify cookie 94496500563936 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7fef9bfff640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fef88003d60 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== watch-notify(notify_complete (2) cookie 94496500563936 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1ae563a60 con 0x55f1ae544510 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c6e98800 10 removing user index: testx$tenanteduser 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.324+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae593fe0 con 0x55f1ae548f00 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.325+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.325+0000 7ff0c6e98800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.325+0000 7ff0c6e98800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-04-24T01:24:25.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.325+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94496500563936 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5928f0 con 0x7ff0b0076040 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== watch-notify(notify (1) cookie 94496500302672 notify 137438953485 ret 0) ==== 209+0+0 (crc 0 0 0) 0x55f1ae563a60 con 0x7ff0b0076040 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7fef9b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94496500302672 notifier 4563 bl.length()=167 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(103 notify.3 [notify cookie 94496500563936 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7fef9b7fe640 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feef80032c0 con 0x7ff0b0076040 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== watch-notify(notify_complete (2) cookie 94496500563936 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f1ae562fa0 con 0x7ff0b0076040 2024-04-24T01:24:25.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.326+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.327+0000 7fef7afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.327+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94496500316256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae593fe0 con 0x55f1ae544510 2024-04-24T01:24:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.328+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94496500316256] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.328+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94496500292672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae593fe0 con 0x7ff0b0076040 2024-04-24T01:24:25.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.329+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94496500292672] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.329+0000 7ff0c6e98800 20 remove_watcher() i=0 2024-04-24T01:24:25.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.329+0000 7ff0c6e98800 2 removed watcher, disabling cache 2024-04-24T01:24:25.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.329+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94496500296160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae593fe0 con 0x55f1ae544510 2024-04-24T01:24:25.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.330+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94496500296160] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.330+0000 7ff0c6e98800 20 remove_watcher() i=1 2024-04-24T01:24:25.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.330+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94496500290192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5529e0 con 0x55f1ae54d8b0 2024-04-24T01:24:25.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.331+0000 7ff0bffff640 1 -- 172.21.15.169:0/885878405 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94496500290192] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b0081070 con 0x55f1ae54d8b0 2024-04-24T01:24:25.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.331+0000 7ff0c6e98800 20 remove_watcher() i=2 2024-04-24T01:24:25.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.331+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94496500302672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae551290 con 0x7ff0b0076040 2024-04-24T01:24:25.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.332+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94496500302672] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x7ff0b0076040 2024-04-24T01:24:25.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.332+0000 7ff0c6e98800 20 remove_watcher() i=3 2024-04-24T01:24:25.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.332+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94496500304208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae5529e0 con 0x55f1ae544510 2024-04-24T01:24:25.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.333+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94496500304208] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0c000a4a0 con 0x55f1ae544510 2024-04-24T01:24:25.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.333+0000 7ff0c6e98800 20 remove_watcher() i=4 2024-04-24T01:24:25.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.333+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94496500308720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae554350 con 0x55f1ae548f00 2024-04-24T01:24:25.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.334+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94496500308720] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.334+0000 7ff0c6e98800 20 remove_watcher() i=5 2024-04-24T01:24:25.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.334+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94496500313472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae551290 con 0x55f1ae548f00 2024-04-24T01:24:25.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.335+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94496500313472] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.335+0000 7ff0c6e98800 20 remove_watcher() i=6 2024-04-24T01:24:25.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.335+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94496500306224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1ae554950 con 0x55f1ae548f00 2024-04-24T01:24:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.336+0000 7ff0c499e640 1 -- 172.21.15.169:0/885878405 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94496500306224] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff0b8029030 con 0x55f1ae548f00 2024-04-24T01:24:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.336+0000 7ff0c6e98800 20 remove_watcher() i=7 2024-04-24T01:24:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae548f00 msgr2=0x55f1ae54b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae548f00 0x55f1ae54b2f0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae544510 msgr2=0x55f1ae5469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae544510 0x55f1ae5469d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff0b0076040 msgr2=0x7ff0b0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff0b0076040 0x7ff0b0083410 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f1ae54d8b0 msgr2=0x55f1ae54fd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f1ae54d8b0 0x55f1ae54fd70 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef90036950 msgr2=0x7fef90038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef90036950 0x7fef90038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff0b001ced0 tx=0x7ff0b004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c519f640 1 -- 172.21.15.169:0/885878405 reap_dead start 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 msgr2=0x55f1ae538dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80225b0 tx=0x7ff0b8023800 comp rx=0 tx=0).stop 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 shutdown_connections 2024-04-24T01:24:25.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/885878405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5319d0 0x55f1ae538dd0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 >> 172.21.15.169:0/885878405 conn(0x55f1ae52dd30 msgr2=0x55f1ae52b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 shutdown_connections 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/885878405 wait complete. 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 msgr2=0x7fef9c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 0x7fef9c038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55f1ae50a5e0 tx=0x7ff0b0005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 msgr2=0x55f1ae524cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8016fd0 tx=0x7ff0b80167a0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 shutdown_connections 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fef9c036950 0x7fef9c038e10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/4037237631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae5248b0 0x55f1ae524cd0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 >> 172.21.15.169:0/4037237631 conn(0x55f1ae518950 msgr2=0x55f1ae518d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 shutdown_connections 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.337+0000 7ff0c6e98800 1 -- 172.21.15.169:0/4037237631 wait complete. 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae50f9d0 msgr2=0x55f1ae511dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f1ae50f9d0 0x55f1ae511dc0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae40e210 msgr2=0x55f1ae50d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f1ae40e210 0x55f1ae50d0f0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f1ae513910 msgr2=0x55f1ae515d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f1ae513910 0x55f1ae515d60 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fefac036900 msgr2=0x7fefac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fefac036900 0x7fefac038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0054000 tx=0x7ff0b004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 msgr2=0x55f1ae505eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 --2- 172.21.15.169:0/1576194928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f1ae409d80 0x55f1ae505eb0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8004000 tx=0x7ff0b8000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c519f640 1 -- 172.21.15.169:0/1576194928 reap_dead start 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 shutdown_connections 2024-04-24T01:24:25.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 >> 172.21.15.169:0/1576194928 conn(0x55f1ae405320 msgr2=0x55f1ae412620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 shutdown_connections 2024-04-24T01:24:25.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.338+0000 7ff0c6e98800 1 -- 172.21.15.169:0/1576194928 wait complete. 2024-04-24T01:24:25.354 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T01:24:25.359 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-04-24T01:24:25.403 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:25.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T01:24:25.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-04-24T01:24:25.403 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-04-24T01:24:25.448 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.448 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe550a91800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555a55b66990 0x555a55b68d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe550a91800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a55a24d40 con 0x555a55b692c0 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe550a91800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x555a559f74d0 con 0x555a55b66990 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe54e590640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555a55b66990 0x555a55b68d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe54e590640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555a55b66990 0x555a55b68d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:58996/0 (socket says 172.21.15.169:58996) 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe545d8f640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x555a55b692c0 0x555a55b6b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43682/0 (socket says 172.21.15.169:43682) 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe54e590640 1 -- 172.21.15.169:0/1078605024 learned_addr learned my addr 172.21.15.169:0/1078605024 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.448+0000 7fe54e590640 1 -- 172.21.15.169:0/1078605024 >> v1:172.21.15.142:6789/0 conn(0x555a55b692c0 legacy=0x555a55b6b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.449+0000 7fe54e590640 1 -- 172.21.15.169:0/1078605024 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55a23590 con 0x555a55b66990 2024-04-24T01:24:25.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.450+0000 7fe54e590640 1 --2- 172.21.15.169:0/1078605024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66990 0x555a55b68d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe54000a520 tx=0x7fe54001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725e8caa7151a658 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.450+0000 7fe54dd8f640 1 -- 172.21.15.169:0/1078605024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540057070 con 0x555a55b66990 2024-04-24T01:24:25.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe54dd8f640 1 -- 172.21.15.169:0/1078605024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe540052570 con 0x555a55b66990 2024-04-24T01:24:25.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe54dd8f640 1 -- 172.21.15.169:0/1078605024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe54004ae60 con 0x555a55b66990 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 -- 172.21.15.169:0/1078605024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66990 msgr2=0x555a55b68d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 --2- 172.21.15.169:0/1078605024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66990 0x555a55b68d80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe54000a520 tx=0x7fe54001d010 comp rx=0 tx=0).stop 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 -- 172.21.15.169:0/1078605024 shutdown_connections 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 --2- 172.21.15.169:0/1078605024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66990 0x555a55b68d80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 -- 172.21.15.169:0/1078605024 >> 172.21.15.169:0/1078605024 conn(0x555a55b60340 msgr2=0x555a55b62760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 -- 172.21.15.169:0/1078605024 shutdown_connections 2024-04-24T01:24:25.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.451+0000 7fe550a91800 1 -- 172.21.15.169:0/1078605024 wait complete. 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe550a91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe550a91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555a55ab13b0 con 0x555a55b692c0 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59000/0 (socket says 172.21.15.169:59000) 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe54e590640 1 -- 172.21.15.169:0/2511462602 learned_addr learned my addr 172.21.15.169:0/2511462602 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.463+0000 7fe54e590640 1 -- 172.21.15.169:0/2511462602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55c57860 con 0x555a55b692c0 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe54e590640 1 --2- 172.21.15.169:0/2511462602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe540044940 tx=0x7fe54004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec207d6ce19fc69 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe43c608640 1 -- 172.21.15.169:0/2511462602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540057040 con 0x555a55b692c0 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe43c608640 1 -- 172.21.15.169:0/2511462602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe540052720 con 0x555a55b692c0 2024-04-24T01:24:25.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe43c608640 1 -- 172.21.15.169:0/2511462602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540052a00 con 0x555a55b692c0 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 -- 172.21.15.169:0/2511462602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 msgr2=0x555a55c57290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 --2- 172.21.15.169:0/2511462602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe540044940 tx=0x7fe54004c000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 -- 172.21.15.169:0/2511462602 shutdown_connections 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 --2- 172.21.15.169:0/2511462602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c57290 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 -- 172.21.15.169:0/2511462602 >> 172.21.15.169:0/2511462602 conn(0x555a55b60340 msgr2=0x555a55c52b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 -- 172.21.15.169:0/2511462602 shutdown_connections 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.464+0000 7fe550a91800 1 -- 172.21.15.169:0/2511462602 wait complete. 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe550a91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c5ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe550a91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555a55b6f0e0 con 0x555a55b692c0 2024-04-24T01:24:25.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c5ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c5ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59014/0 (socket says 172.21.15.169:59014) 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe54e590640 1 -- 172.21.15.169:0/1874274195 learned_addr learned my addr 172.21.15.169:0/1874274195 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe54e590640 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55c5f250 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.465+0000 7fe54e590640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c5ed10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe54001cfe0 tx=0x7fe540003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe43ae05640 1 -- 172.21.15.169:0/1874274195 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540073070 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe43ae05640 1 -- 172.21.15.169:0/1874274195 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54005d440 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a55c5f4e0 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe43ae05640 1 -- 172.21.15.169:0/1874274195 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540057070 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55c620f0 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.466+0000 7fe43ae05640 1 -- 172.21.15.169:0/1874274195 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe540076070 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe43ae05640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe434036900 0x7fe434038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe43ae05640 1 -- 172.21.15.169:0/1874274195 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe54008dd60 con 0x555a55b692c0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe545d8f640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe434036900 0x7fe434038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c63ea0 0x555a55c66290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55c66860 con 0x555a55c63ea0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe54ed91640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c63ea0 0x555a55c66290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe545d8f640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe434036900 0x7fe434038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f60 tx=0x7fe538001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe54ed91640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c63ea0 0x555a55c66290 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.467+0000 7fe54ed91640 1 -- 172.21.15.169:0/1874274195 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c63ea0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55c63480 con 0x555a55c63ea0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe54ed91640 1 -- 172.21.15.169:0/1874274195 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c63ea0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55c68bc0 0x555a55c6afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55c6b6a0 con 0x555a55c68bc0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe54e590640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55c68bc0 0x555a55c6afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.468+0000 7fe54e590640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55c68bc0 0x555a55c6afb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe54e590640 1 -- 172.21.15.169:0/1874274195 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe540075030 con 0x555a55c68bc0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55c67b70 con 0x555a55c63ea0 2024-04-24T01:24:25.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe54ed91640 1 -- 172.21.15.169:0/1874274195 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c63ea0 2024-04-24T01:24:25.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555a55c6cb50 0x555a55c6efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55c6f700 con 0x555a55c6cb50 2024-04-24T01:24:25.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe545d8f640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555a55c6cb50 0x555a55c6efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.469+0000 7fe545d8f640 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555a55c6cb50 0x555a55c6efa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe545d8f640 1 -- 172.21.15.169:0/1874274195 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe53800f690 con 0x555a55c6cb50 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe550a91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe550a91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555a55a576b0 con 0x555a55c7db60 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59020/0 (socket says 172.21.15.169:59020) 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.470+0000 7fe54e590640 1 -- 172.21.15.169:0/3059660922 learned_addr learned my addr 172.21.15.169:0/3059660922 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe54e590640 1 -- 172.21.15.169:0/3059660922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55c7e4c0 con 0x555a55c7db60 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe54e590640 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe54004ae50 tx=0x7fe540076eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe433fff640 1 -- 172.21.15.169:0/3059660922 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540076820 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe433fff640 1 -- 172.21.15.169:0/3059660922 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5400769c0 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe433fff640 1 -- 172.21.15.169:0/3059660922 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540077ba0 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a55c7ef30 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.471+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55c7f430 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe433fff640 1 -- 172.21.15.169:0/3059660922 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe54009a060 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe433fff640 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 0x7fe428038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe433fff640 1 -- 172.21.15.169:0/3059660922 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe540083420 con 0x555a55c7db60 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe545d8f640 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 0x7fe428038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe545d8f640 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 0x7fe428038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555a55c67170 tx=0x7fe53800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe550a91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.472+0000 7fe550a91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555a55c57b20 con 0x555a55b66000 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59024/0 (socket says 172.21.15.169:59024) 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe54e590640 1 -- 172.21.15.169:0/1472480736 learned_addr learned my addr 172.21.15.169:0/1472480736 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe54e590640 1 -- 172.21.15.169:0/1472480736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55b64810 con 0x555a55b66000 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe54e590640 1 --2- 172.21.15.169:0/1472480736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe540078790 tx=0x7fe540078500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552ca8c27945adb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe431ffb640 1 -- 172.21.15.169:0/1472480736 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5400ac070 con 0x555a55b66000 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe431ffb640 1 -- 172.21.15.169:0/1472480736 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54005d720 con 0x555a55b66000 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe431ffb640 1 -- 172.21.15.169:0/1472480736 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe540094e60 con 0x555a55b66000 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe550a91800 1 -- 172.21.15.169:0/1472480736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 msgr2=0x555a55b66420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe550a91800 1 --2- 172.21.15.169:0/1472480736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe540078790 tx=0x7fe540078500 comp rx=0 tx=0).stop 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe550a91800 1 -- 172.21.15.169:0/1472480736 shutdown_connections 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe550a91800 1 --2- 172.21.15.169:0/1472480736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55b66420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.473+0000 7fe550a91800 1 -- 172.21.15.169:0/1472480736 >> 172.21.15.169:0/1472480736 conn(0x555a55c86f90 msgr2=0x555a55c84ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 -- 172.21.15.169:0/1472480736 shutdown_connections 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 -- 172.21.15.169:0/1472480736 wait complete. 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 Processor -- start 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 -- start start 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe550a91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555a55b64c20 con 0x555a55b66000 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe54e590640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59038/0 (socket says 172.21.15.169:59038) 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 learned_addr learned my addr 172.21.15.169:0/896848727 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.474+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a55c94750 con 0x555a55b66000 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe54e590640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5400065b0 tx=0x7fe540069f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe41ffff640 1 -- 172.21.15.169:0/896848727 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5400b7020 con 0x555a55b66000 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe41ffff640 1 -- 172.21.15.169:0/896848727 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe54008db50 con 0x555a55b66000 2024-04-24T01:24:25.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a55c94750 con 0x555a55b66000 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe41ffff640 1 -- 172.21.15.169:0/896848727 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5400ac030 con 0x555a55b66000 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a55c94c50 con 0x555a55b66000 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.475+0000 7fe41ffff640 1 -- 172.21.15.169:0/896848727 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe5400ba020 con 0x555a55b66000 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe41ffff640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe418036950 0x7fe418038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe41ffff640 1 -- 172.21.15.169:0/896848727 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fe5400ad070 con 0x555a55b66000 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe545d8f640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe418036950 0x7fe418038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe545d8f640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe418036950 0x7fe418038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555a55c6fb00 tx=0x7fe538010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c9f9b0 0x555a55ca1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca25c0 con 0x555a55c9f9b0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.476+0000 7fe54ed91640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c9f9b0 0x555a55ca1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe54ed91640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c9f9b0 0x555a55ca1e70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 realm 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca29d0 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca32a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.477+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55ca43a0 0x555a55ca6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca6da0 con 0x555a55ca43a0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe54e590640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55ca43a0 0x555a55ca6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe54e590640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55ca43a0 0x555a55ca6790 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 20 searching for the correct realm 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555a55ca8d50 0x555a55cab210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.478+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55cab8e0 con 0x555a55ca8d50 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe545d8f640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555a55ca8d50 0x555a55cab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe545d8f640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555a55ca8d50 0x555a55cab210 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe545d8f640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe53800f070 0x7fe53802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55cab8e0 con 0x7fe53800f070 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.479+0000 7fe54ed91640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe53800f070 0x7fe53802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe53800f070 0x7fe53802e910 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.480+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x7fe53800f070 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.481+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x7fe53800f070 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.482+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.483+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.484+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x7fe53800f070 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.485+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x7fe53800f070 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca8d50 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.486+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x555a55c9f9b0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca3640 con 0x7fe53800f070 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca7660 con 0x555a55c9f9b0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca7660 con 0x555a55c9f9b0 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.487+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca7660 con 0x7fe53800f070 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 zone default found 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 4 Realm: () 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:25.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 zonegroup default 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ca7f50 con 0x555a55ca43a0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55cad740 con 0x555a55ca8d50 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.488+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55cadae0 con 0x555a55ca8d50 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.489+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.489+0000 7fe550a91800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.489+0000 7fe550a91800 20 started sync module instance, tier type = 2024-04-24T01:24:25.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.489+0000 7fe550a91800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.489+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cacbe0 con 0x7fe53800f070 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.490+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.490+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93846474772752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cacbe0 con 0x7fe53800f070 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.490+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cae4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.491+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93846474772752] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.491+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.491+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93846474777040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cacbe0 con 0x555a55c9f9b0 2024-04-24T01:24:25.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.491+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55caef10 con 0x555a55ca8d50 2024-04-24T01:24:25.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.492+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93846474777040] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.492+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.492+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93846474770224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cacb50 con 0x555a55ca8d50 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.492+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cafcd0 con 0x7fe53800f070 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.493+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.493+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93846474782640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb0570 con 0x7fe53800f070 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.493+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb1010 con 0x555a55c9f9b0 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.493+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93846474770224] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.494+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.494+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93846474787552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb0fd0 con 0x555a55c9f9b0 2024-04-24T01:24:25.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.494+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb1a20 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.494+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93846474782640] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.495+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.495+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93846474790256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb1e10 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.495+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb27d0 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.495+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93846474787552] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.496+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93846474790256] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.496+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.496+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93846474793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb2b70 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb33c0 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93846474793760] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93846474796816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb37e0 con 0x555a55ca43a0 2024-04-24T01:24:25.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=1 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=2 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=3 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=4 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=5 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.497+0000 7fe550a91800 20 add_watcher() i=6 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.498+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93846474796816] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.499+0000 7fe550a91800 20 add_watcher() i=7 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.499+0000 7fe550a91800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.499+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb6b00 con 0x555a55c9f9b0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.499+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.499+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93846474798240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb3d70 con 0x555a55c9f9b0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.500+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93846474798240] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.500+0000 7fe404fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.500+0000 7fe550a91800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.500+0000 7fe550a91800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.500+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb62d0 con 0x555a55c9f9b0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.501+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'49 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.501+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cbfc10 con 0x555a55ca43a0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.503+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.503+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cbfc10 con 0x555a55ca8d50 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.503+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.504+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc06b0 con 0x555a55c9f9b0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.504+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'146 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.504+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cbf230 con 0x7fe53800f070 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.505+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'48 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.505+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cbf230 con 0x555a55ca8d50 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.506+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.506+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc1890 con 0x555a55c9f9b0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.508+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.508+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc1920 con 0x555a55ca43a0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.509+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'33 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.509+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc19b0 con 0x7fe53800f070 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.510+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.510+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc1a60 con 0x555a55ca8d50 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.511+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.511+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc1f80 con 0x7fe53800f070 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.512+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'49 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.512+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc1f80 con 0x555a55ca43a0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.513+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.513+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x7fe53800f070 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.514+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.514+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca43a0 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.515+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.515+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55c9f9b0 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.516+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'147 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.516+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.517+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.517+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x7fe53800f070 2024-04-24T01:24:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.518+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'50 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.518+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.519+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.520+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55c9f9b0 2024-04-24T01:24:25.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.520+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.521+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55c9f9b0 2024-04-24T01:24:25.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.521+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'148 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.522+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.523+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.523+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x7fe53800f070 2024-04-24T01:24:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.524+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.524+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.525+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.525+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.526+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.526+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.527+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.527+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.527+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.527+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca43a0 2024-04-24T01:24:25.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.529+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.529+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.530+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.530+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca43a0 2024-04-24T01:24:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.531+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'34 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.531+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca8d50 2024-04-24T01:24:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.532+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.533+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x555a55ca43a0 2024-04-24T01:24:25.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.534+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.534+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cc2430 con 0x7fe53800f070 2024-04-24T01:24:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.535+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.535+0000 7fe37f7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.535+0000 7fe550a91800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 Filter name: none 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe37d7fa640 20 reqs_thread_entry: start 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:25.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ced020 con 0x7fe53800f070 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:95 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55ceea70 con 0x555a55ca8d50 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(95 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:25.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 20 get_obj_state: octx=0x7fe5400b3aa0 obj=myfoo:four state=0x555a55cefd58 s->prefetch_data=0 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.536+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:96 3.32s0 3:4ed1453d:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf0b80 con 0x555a55ca8d50 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(96 f341815c-ea59-4c61-b01b-010b058e6023.4227.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 10 manifest: total_size = 4 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.1388589014478066030 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 20 get_obj_state: octx=0x7fe5400b3aa0 obj=myfoo:four state=0x555a55cefd58 s->prefetch_data=0 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 20 prepare_atomic_modification: state is not atomic. state=0x555a55cefd58 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.537+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf5580 con 0x555a55c9f9b0 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.538+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(97 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.541 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.538+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 3.32s0 3:4ed1453d:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf5580 con 0x555a55ca8d50 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.539+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(98 f341815c-ea59-4c61-b01b-010b058e6023.4227.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.539+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf6010 con 0x555a55c9f9b0 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.540+0000 7fe404fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.540+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93846474798240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf6010 con 0x555a55c9f9b0 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.541+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(99 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.541+0000 7fe431ffb640 20 handle_completion(): completion ok for obj=four 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.541+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 93846474798240] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.541+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93846474772752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cf6010 con 0x7fe53800f070 2024-04-24T01:24:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.542+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 93846474772752] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.542+0000 7fe550a91800 20 remove_watcher() i=0 2024-04-24T01:24:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.542+0000 7fe550a91800 2 removed watcher, disabling cache 2024-04-24T01:24:25.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.543+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93846474777040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cad110 con 0x555a55c9f9b0 2024-04-24T01:24:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.544+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 93846474777040] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.544+0000 7fe550a91800 20 remove_watcher() i=1 2024-04-24T01:24:25.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.544+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93846474770224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cad110 con 0x555a55ca8d50 2024-04-24T01:24:25.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.545+0000 7fe545d8f640 1 -- 172.21.15.169:0/896848727 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 93846474770224] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe538037040 con 0x555a55ca8d50 2024-04-24T01:24:25.546 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.545+0000 7fe550a91800 20 remove_watcher() i=2 2024-04-24T01:24:25.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.545+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93846474782640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cac730 con 0x7fe53800f070 2024-04-24T01:24:25.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.546+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 93846474782640] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x7fe53800f070 2024-04-24T01:24:25.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.546+0000 7fe550a91800 20 remove_watcher() i=3 2024-04-24T01:24:25.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.546+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93846474787552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cad110 con 0x555a55c9f9b0 2024-04-24T01:24:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.547+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 93846474787552] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe54800a4a0 con 0x555a55c9f9b0 2024-04-24T01:24:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.547+0000 7fe550a91800 20 remove_watcher() i=4 2024-04-24T01:24:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.547+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93846474790256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cac730 con 0x555a55ca43a0 2024-04-24T01:24:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.548+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 93846474790256] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.548+0000 7fe550a91800 20 remove_watcher() i=5 2024-04-24T01:24:25.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.548+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93846474793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cad110 con 0x555a55ca43a0 2024-04-24T01:24:25.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.550+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 93846474793760] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.550+0000 7fe550a91800 20 remove_watcher() i=6 2024-04-24T01:24:25.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.550+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93846474796816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a55cb1570 con 0x555a55ca43a0 2024-04-24T01:24:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.550+0000 7fe54e590640 1 -- 172.21.15.169:0/896848727 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 93846474796816] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe540075030 con 0x555a55ca43a0 2024-04-24T01:24:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.550+0000 7fe550a91800 20 remove_watcher() i=7 2024-04-24T01:24:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55ca43a0 msgr2=0x555a55ca6790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55ca43a0 0x555a55ca6790 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c9f9b0 msgr2=0x555a55ca1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c9f9b0 0x555a55ca1e70 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe53800f070 msgr2=0x7fe53802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe53800f070 0x7fe53802e910 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555a55ca8d50 msgr2=0x555a55cab210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555a55ca8d50 0x555a55cab210 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe418036950 msgr2=0x7fe418038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe418036950 0x7fe418038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x555a55c6fb00 tx=0x7fe538010000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe54ed91640 1 -- 172.21.15.169:0/896848727 reap_dead start 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 msgr2=0x555a55c94210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe5400065b0 tx=0x7fe540069f30 comp rx=0 tx=0).stop 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 shutdown_connections 2024-04-24T01:24:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/896848727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b66000 0x555a55c94210 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 >> 172.21.15.169:0/896848727 conn(0x555a55c86f90 msgr2=0x555a55c845f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 shutdown_connections 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/896848727 wait complete. 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 msgr2=0x7fe428038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 0x7fe428038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x555a55c67170 tx=0x7fe53800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 msgr2=0x555a55c7df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe54004ae50 tx=0x7fe540076eb0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 shutdown_connections 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe428036950 0x7fe428038e10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 --2- 172.21.15.169:0/3059660922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55c7db60 0x555a55c7df80 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 >> 172.21.15.169:0/3059660922 conn(0x555a55c71c00 msgr2=0x555a55c72000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 shutdown_connections 2024-04-24T01:24:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.551+0000 7fe550a91800 1 -- 172.21.15.169:0/3059660922 wait complete. 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55c68bc0 msgr2=0x555a55c6afb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555a55c68bc0 0x555a55c6afb0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c63ea0 msgr2=0x555a55c66290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555a55c63ea0 0x555a55c66290 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555a55c6cb50 msgr2=0x555a55c6efa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555a55c6cb50 0x555a55c6efa0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe434036900 msgr2=0x7fe434038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe434036900 0x7fe434038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe538000f60 tx=0x7fe538001370 comp rx=0 tx=0).stop 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 msgr2=0x555a55c5ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 --2- 172.21.15.169:0/1874274195 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a55b692c0 0x555a55c5ed10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe54001cfe0 tx=0x7fe540003020 comp rx=0 tx=0).stop 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe54ed91640 1 -- 172.21.15.169:0/1874274195 reap_dead start 2024-04-24T01:24:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 shutdown_connections 2024-04-24T01:24:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 >> 172.21.15.169:0/1874274195 conn(0x555a55b60340 msgr2=0x555a55c51310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 shutdown_connections 2024-04-24T01:24:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.552+0000 7fe550a91800 1 -- 172.21.15.169:0/1874274195 wait complete. 2024-04-24T01:24:25.561 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:25.561 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-04-24T01:24:25.562 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-04-24T01:24:25.604 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.604 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.603+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.603+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.603+0000 7f536552b800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a15b2b31b0 0x55a15b2b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.603+0000 7f536552b800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a15b16ed40 con 0x55a15b2aed20 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.603+0000 7f536552b800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55a15b1414d0 con 0x55a15b2b31b0 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5360951640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a15b2b31b0 0x55a15b2b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5361152640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55a15b2aed20 0x55a15b2af140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43696/0 (socket says 172.21.15.169:43696) 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5360951640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a15b2b31b0 0x55a15b2b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59046/0 (socket says 172.21.15.169:59046) 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5361152640 1 -- 172.21.15.169:0/2470392430 learned_addr learned my addr 172.21.15.169:0/2470392430 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5360951640 1 -- 172.21.15.169:0/2470392430 >> v1:172.21.15.142:6789/0 conn(0x55a15b2aed20 legacy=0x55a15b2af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.604+0000 7f5360951640 1 -- 172.21.15.169:0/2470392430 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b16d590 con 0x55a15b2b31b0 2024-04-24T01:24:25.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f5360951640 1 --2- 172.21.15.169:0/2470392430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2b31b0 0x55a15b2b55a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f535800a470 tx=0x7f535801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ece3f4bf2029138 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f5353fff640 1 -- 172.21.15.169:0/2470392430 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5358057070 con 0x55a15b2b31b0 2024-04-24T01:24:25.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f5353fff640 1 -- 172.21.15.169:0/2470392430 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5358052570 con 0x55a15b2b31b0 2024-04-24T01:24:25.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f5353fff640 1 -- 172.21.15.169:0/2470392430 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5358052870 con 0x55a15b2b31b0 2024-04-24T01:24:25.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f536552b800 1 -- 172.21.15.169:0/2470392430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2b31b0 msgr2=0x55a15b2b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.606+0000 7f536552b800 1 --2- 172.21.15.169:0/2470392430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2b31b0 0x55a15b2b55a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f535800a470 tx=0x7f535801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:25.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.607+0000 7f536552b800 1 -- 172.21.15.169:0/2470392430 shutdown_connections 2024-04-24T01:24:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.607+0000 7f536552b800 1 --2- 172.21.15.169:0/2470392430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2b31b0 0x55a15b2b55a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.607+0000 7f536552b800 1 -- 172.21.15.169:0/2470392430 >> 172.21.15.169:0/2470392430 conn(0x55a15b2aa380 msgr2=0x55a15b2ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.607+0000 7f536552b800 1 -- 172.21.15.169:0/2470392430 shutdown_connections 2024-04-24T01:24:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.607+0000 7f536552b800 1 -- 172.21.15.169:0/2470392430 wait complete. 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f536552b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f536552b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a15b1fb3c0 con 0x55a15b2aed20 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59058/0 (socket says 172.21.15.169:59058) 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f5361152640 1 -- 172.21.15.169:0/3092046951 learned_addr learned my addr 172.21.15.169:0/3092046951 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f5361152640 1 -- 172.21.15.169:0/3092046951 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b3a16a0 con 0x55a15b2aed20 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f5361152640 1 --2- 172.21.15.169:0/3092046951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5354001e10 tx=0x7f535400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d834e9c9937116 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f524f606640 1 -- 172.21.15.169:0/3092046951 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5354012020 con 0x55a15b2aed20 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f524f606640 1 -- 172.21.15.169:0/3092046951 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535400e5a0 con 0x55a15b2aed20 2024-04-24T01:24:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.619+0000 7f524f606640 1 -- 172.21.15.169:0/3092046951 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535400e8e0 con 0x55a15b2aed20 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- 172.21.15.169:0/3092046951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 msgr2=0x55a15b3a10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 --2- 172.21.15.169:0/3092046951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5354001e10 tx=0x7f535400b780 comp rx=0 tx=0).stop 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- 172.21.15.169:0/3092046951 shutdown_connections 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 --2- 172.21.15.169:0/3092046951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a10d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- 172.21.15.169:0/3092046951 >> 172.21.15.169:0/3092046951 conn(0x55a15b2aa380 msgr2=0x55a15b39f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- 172.21.15.169:0/3092046951 shutdown_connections 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- 172.21.15.169:0/3092046951 wait complete. 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.620+0000 7f536552b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a15b2b5e70 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59072/0 (socket says 172.21.15.169:59072) 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f5361152640 1 -- 172.21.15.169:0/2831339695 learned_addr learned my addr 172.21.15.169:0/2831339695 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f5361152640 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b3a9160 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f5361152640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a8c20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5354001e10 tx=0x7f5354000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f524de03640 1 -- 172.21.15.169:0/2831339695 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5354012030 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f524de03640 1 -- 172.21.15.169:0/2831339695 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535401a7a0 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15b3a93f0 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.621+0000 7f524de03640 1 -- 172.21.15.169:0/2831339695 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535401aac0 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.622+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15b3ac0a0 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.622+0000 7f524de03640 1 -- 172.21.15.169:0/2831339695 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5354015020 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.622+0000 7f524de03640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5248036900 0x7f5248038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.622+0000 7f524de03640 1 -- 172.21.15.169:0/2831339695 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5354020030 con 0x55a15b2aed20 2024-04-24T01:24:25.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f5360951640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5248036900 0x7f5248038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b2b31b0 0x55a15b3afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3b03a0 con 0x55a15b2b31b0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f5361953640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b2b31b0 0x55a15b3afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f5360951640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5248036900 0x7f5248038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5358054000 tx=0x7f535804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f5361953640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b2b31b0 0x55a15b3afe60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f5361953640 1 -- 172.21.15.169:0/2831339695 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b2b31b0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.623+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3ad430 con 0x55a15b2b31b0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.624+0000 7f5361953640 1 -- 172.21.15.169:0/2831339695 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b2b31b0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.624+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3b26b0 0x55a15b3b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.624+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3b5190 con 0x55a15b3b26b0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.624+0000 7f5361152640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3b26b0 0x55a15b3b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.624+0000 7f5361152640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3b26b0 0x55a15b3b4aa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f5361152640 1 -- 172.21.15.169:0/2831339695 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f535400dcd0 con 0x55a15b3b26b0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3b1660 con 0x55a15b2b31b0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f5361953640 1 -- 172.21.15.169:0/2831339695 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b2b31b0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a15b3b65f0 0x55a15b3b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3b91e0 con 0x55a15b3b65f0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f5360951640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a15b3b65f0 0x55a15b3b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.625+0000 7f5360951640 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a15b3b65f0 0x55a15b3b8a80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f5360951640 1 -- 172.21.15.169:0/2831339695 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5358052940 con 0x55a15b3b65f0 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f536552b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f536552b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a15b1a16b0 con 0x55a15b3c7620 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59082/0 (socket says 172.21.15.169:59082) 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f5361152640 1 -- 172.21.15.169:0/418383191 learned_addr learned my addr 172.21.15.169:0/418383191 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.626+0000 7f5361152640 1 -- 172.21.15.169:0/418383191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b3c7f80 con 0x55a15b3c7620 2024-04-24T01:24:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f5361152640 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5354001750 tx=0x7f5354016470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f5246ffd640 1 -- 172.21.15.169:0/418383191 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5354017e40 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f5246ffd640 1 -- 172.21.15.169:0/418383191 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354045a90 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f5246ffd640 1 -- 172.21.15.169:0/418383191 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5354045d70 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15b3c89f0 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15b3c8ef0 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.627+0000 7f5246ffd640 1 -- 172.21.15.169:0/418383191 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f535404ca80 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5246ffd640 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 0x7f5238038e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5246ffd640 1 -- 172.21.15.169:0/418383191 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f5354036020 con 0x55a15b3c7620 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5360951640 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 0x7f5238038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5360951640 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 0x7f5238038e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a15b3b1630 tx=0x7f5358005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f536552b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f536552b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a15b3a1a20 con 0x55a15b3d47d0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59092/0 (socket says 172.21.15.169:59092) 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.628+0000 7f5361152640 1 -- 172.21.15.169:0/650492551 learned_addr learned my addr 172.21.15.169:0/650492551 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f5361152640 1 -- 172.21.15.169:0/650492551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b3d51c0 con 0x55a15b3d47d0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f5361152640 1 --2- 172.21.15.169:0/650492551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5354049010 tx=0x7f535404a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5769e21874421e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f5244ff9640 1 -- 172.21.15.169:0/650492551 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535400da80 con 0x55a15b3d47d0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f5244ff9640 1 -- 172.21.15.169:0/650492551 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535405d070 con 0x55a15b3d47d0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f5244ff9640 1 -- 172.21.15.169:0/650492551 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535402d520 con 0x55a15b3d47d0 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 -- 172.21.15.169:0/650492551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 msgr2=0x55a15b3d4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 --2- 172.21.15.169:0/650492551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5354049010 tx=0x7f535404a000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 -- 172.21.15.169:0/650492551 shutdown_connections 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 --2- 172.21.15.169:0/650492551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3d4bf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 -- 172.21.15.169:0/650492551 >> 172.21.15.169:0/650492551 conn(0x55a15b3d0a50 msgr2=0x55a15b3ceab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 -- 172.21.15.169:0/650492551 shutdown_connections 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.629+0000 7f536552b800 1 -- 172.21.15.169:0/650492551 wait complete. 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f536552b800 1 Processor -- start 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f536552b800 1 -- start start 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f536552b800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f536552b800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a15b3d5830 con 0x55a15b3d47d0 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f5361152640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3dbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59102/0 (socket says 172.21.15.169:59102) 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 learned_addr learned my addr 172.21.15.169:0/3065512534 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.630+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a15b3dc000 con 0x55a15b3d47d0 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f5361152640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3dbac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f535404a220 tx=0x7f535401fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f5236ffd640 1 -- 172.21.15.169:0/3065512534 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535402ca90 con 0x55a15b3d47d0 2024-04-24T01:24:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f5236ffd640 1 -- 172.21.15.169:0/3065512534 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5354051070 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a15b3dc000 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f5236ffd640 1 -- 172.21.15.169:0/3065512534 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f535400d3d0 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.631+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a15b3dc000 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5236ffd640 1 -- 172.21.15.169:0/3065512534 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f535400d570 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5236ffd640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f522c036950 0x7f522c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5236ffd640 1 -- 172.21.15.169:0/3065512534 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f535406eca0 con 0x55a15b3d47d0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5360951640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f522c036950 0x7f522c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b3e71e0 0x55a15b3e96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3e9df0 con 0x55a15b3e71e0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5361953640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b3e71e0 0x55a15b3e96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5360951640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f522c036950 0x7f522c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5358052fd0 tx=0x7f535804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.632+0000 7f5361953640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b3e71e0 0x55a15b3e96a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 realm 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3ea200 con 0x55a15b3e71e0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eaaa0 con 0x55a15b3e71e0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3e71e0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3ebba0 0x55a15b3edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.633+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3ee510 con 0x55a15b3ebba0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f5361152640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3ebba0 0x55a15b3edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f5361152640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3ebba0 0x55a15b3edf90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f536552b800 20 searching for the correct realm 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a15b3f0560 0x55a15b3f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f30f0 con 0x55a15b3f0560 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.634+0000 7f5360951640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a15b3f0560 0x55a15b3f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5360951640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a15b3f0560 0x55a15b3f2a20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5360951640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5358076040 0x7f5358083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f30f0 con 0x7f5358076040 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5361953640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5358076040 0x7f5358083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.635+0000 7f5361953640 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5358076040 0x7f5358083410 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3ebba0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3e71e0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3e71e0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.636+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3ebba0 2024-04-24T01:24:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3ebba0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x7f5358076040 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3f0560 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.637+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3e71e0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3ebba0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3e71e0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x7f5358076040 2024-04-24T01:24:25.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.638+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eae40 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3ebba0 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.639+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3e71e0 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3e71e0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.640+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3ebba0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x7f5358076040 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3e71e0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.641+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3ebba0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3ebba0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.642+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x7f5358076040 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3f0560 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3ebba0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.643+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x55a15b3e71e0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f5358090040 con 0x7f5358076040 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:25.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eee60 con 0x55a15b3e71e0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eee60 con 0x55a15b3e71e0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.644+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eee60 con 0x7f5358076040 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 zone default found 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 4 Realm: () 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 zonegroup default 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3ef250 con 0x55a15b3ebba0 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3eee60 con 0x55a15b3f0560 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.645+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f4f50 con 0x55a15b3f0560 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.646+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.646+0000 7f536552b800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.646+0000 7f536552b800 20 started sync module instance, tier type = 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.646+0000 7f536552b800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.646+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f43f0 con 0x7f5358076040 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.647+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.647+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94151508967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f4a60 con 0x7f5358076040 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.647+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f5950 con 0x55a15b3e71e0 2024-04-24T01:24:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.648+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94151508967232] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.648+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.648+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94151508968624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f5910 con 0x55a15b3e71e0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.648+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f63a0 con 0x55a15b3f0560 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.649+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94151508968624] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.649+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.649+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94151508972640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f5880 con 0x55a15b3f0560 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.649+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f7260 con 0x7f5358076040 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.650+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94151508972640] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.650+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.650+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94151508979120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f7680 con 0x7f5358076040 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.650+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f8040 con 0x55a15b3e71e0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.651+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.651+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94151508982672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f8460 con 0x55a15b3e71e0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.651+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f8ee0 con 0x55a15b3ebba0 2024-04-24T01:24:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.651+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94151508979120] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.652+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94151508982672] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.652+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.652+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94151508980176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f8460 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.652+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f9780 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.653+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94151508980176] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.653+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.653+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94151508983728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3f9fd0 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.653+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3fa860 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94151508983728] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94151508990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3faae0 con 0x55a15b3ebba0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=0 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=1 2024-04-24T01:24:25.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=2 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=3 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=4 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=5 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.654+0000 7f536552b800 20 add_watcher() i=6 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.655+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94151508990752] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.655+0000 7f536552b800 20 add_watcher() i=7 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.655+0000 7f536552b800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.655+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3fe150 con 0x55a15b3e71e0 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.656+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.656+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94151508992880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b3fb4d0 con 0x55a15b3e71e0 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94151508992880] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f52177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 5 note: GC not initialized 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f52167e4640 20 reqs_thread_entry: start 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 20 Filter name: none 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f5187fff640 20 reqs_thread_entry: start 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.657+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b431400 con 0x7f5358076040 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b431c90 con 0x55a15b3f0560 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b431860 con 0x7f5358076040 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.658+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b4318f0 con 0x55a15b3f0560 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(65 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 4.39 4:9d52cac0:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b432e50 con 0x55a15b3f0560 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 4.14 4:28c59c07:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b437f20 con 0x55a15b3f0560 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 4.12 4:4beb7fae:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b43a930 con 0x55a15b3e71e0 2024-04-24T01:24:25.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 4.3c 4:3df9a53c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b437f20 con 0x55a15b3e71e0 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 4.9 4:913e3abf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b43fc50 con 0x55a15b3e71e0 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 4.1b 4:d914e85f:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b4428e0 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 4.2 4:4239ecc7:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b43fc50 con 0x55a15b3e71e0 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 4.22 4:455fdea3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b4478c0 con 0x55a15b3e71e0 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 4.b 4:d0af6d59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b4478c0 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 4.18 4:1bc38953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b44c640 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:76 4.1f 4:fb61a447:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a15b44f490 con 0x55a15b3f0560 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(71 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.659+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(75 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(66 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(68 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(69 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(70 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(76 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.660+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(73 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.661+0000 7f52177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.661+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94151508992880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b44f490 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.662+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94151508992880] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.662+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94151508967232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b44f490 con 0x7f5358076040 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.663+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94151508967232] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.663+0000 7f536552b800 20 remove_watcher() i=0 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.663+0000 7f536552b800 2 removed watcher, disabling cache 2024-04-24T01:24:25.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.663+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94151508968624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b44f490 con 0x55a15b3e71e0 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.664+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94151508968624] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.664+0000 7f536552b800 20 remove_watcher() i=1 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.664+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94151508972640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x55a15b3f0560 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.665+0000 7f5360951640 1 -- 172.21.15.169:0/3065512534 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94151508972640] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5358081070 con 0x55a15b3f0560 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.665+0000 7f536552b800 20 remove_watcher() i=2 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.665+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94151508979120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x7f5358076040 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.666+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94151508979120] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x7f5358076040 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.666+0000 7f536552b800 20 remove_watcher() i=3 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.666+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94151508982672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x55a15b3e71e0 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.667+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94151508982672] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f535c00a4a0 con 0x55a15b3e71e0 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.667+0000 7f536552b800 20 remove_watcher() i=4 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.667+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94151508980176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x55a15b3ebba0 2024-04-24T01:24:25.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.668+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94151508980176] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.668+0000 7f536552b800 20 remove_watcher() i=5 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.668+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94151508983728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x55a15b3ebba0 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.669+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94151508983728] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.669+0000 7f536552b800 20 remove_watcher() i=6 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.669+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94151508990752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a15b419b60 con 0x55a15b3ebba0 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.669+0000 7f5361152640 1 -- 172.21.15.169:0/3065512534 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94151508990752] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5354073020 con 0x55a15b3ebba0 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 20 remove_watcher() i=7 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3ebba0 msgr2=0x55a15b3edf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3ebba0 0x55a15b3edf90 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b3e71e0 msgr2=0x55a15b3e96a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b3e71e0 0x55a15b3e96a0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5358076040 msgr2=0x7f5358083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f5358076040 0x7f5358083410 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a15b3f0560 msgr2=0x55a15b3f2a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a15b3f0560 0x55a15b3f2a20 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f522c036950 msgr2=0x7f522c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f522c036950 0x7f522c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5358052fd0 tx=0x7f535804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 msgr2=0x55a15b3dbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/3065512534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3d47d0 0x55a15b3dbac0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f535404a220 tx=0x7f535401fec0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 reap_dead start 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f5361953640 1 -- 172.21.15.169:0/3065512534 reap_dead start 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 shutdown_connections 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 >> 172.21.15.169:0/3065512534 conn(0x55a15b3d0a50 msgr2=0x55a15b3ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 shutdown_connections 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/3065512534 wait complete. 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 msgr2=0x7f5238038e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 0x7f5238038e80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55a15b3b1630 tx=0x7f5358005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 msgr2=0x55a15b3c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5354001750 tx=0x7f5354016470 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 shutdown_connections 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f52380369c0 0x7f5238038e80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 --2- 172.21.15.169:0/418383191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b3c7620 0x55a15b3c7a40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 >> 172.21.15.169:0/418383191 conn(0x55a15b3bb6c0 msgr2=0x55a15b3bbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 shutdown_connections 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.670+0000 7f536552b800 1 -- 172.21.15.169:0/418383191 wait complete. 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3b26b0 msgr2=0x55a15b3b4aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a15b3b26b0 0x55a15b3b4aa0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b2b31b0 msgr2=0x55a15b3afe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a15b2b31b0 0x55a15b3afe60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a15b3b65f0 msgr2=0x55a15b3b8a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55a15b3b65f0 0x55a15b3b8a80 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5248036900 msgr2=0x7f5248038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5248036900 0x7f5248038dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5358054000 tx=0x7f535804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 msgr2=0x55a15b3a8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 --2- 172.21.15.169:0/2831339695 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a15b2aed20 0x55a15b3a8c20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5354001e10 tx=0x7f5354000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f5361953640 1 -- 172.21.15.169:0/2831339695 reap_dead start 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 shutdown_connections 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 >> 172.21.15.169:0/2831339695 conn(0x55a15b2aa380 msgr2=0x55a15b39d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 shutdown_connections 2024-04-24T01:24:25.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.671+0000 7f536552b800 1 -- 172.21.15.169:0/2831339695 wait complete. 2024-04-24T01:24:25.689 INFO:teuthology.orchestra.run.smithi169.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"0d63dfd5-2f76-4ac8-9c68-cc94814f72e9","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","marker":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-04-24T01:24:25.153321Z","creation_time":"2024-04-24T01:24:22.157363Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-04-24T01:24:25.690 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:24:25.153321Z', 'creation_time': '2024-04-24T01:24:22.157363Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:24:25.690 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-04-24T01:24:25.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-04-24T01:24:25.690 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-04-24T01:24:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.773 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.773+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.773+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.773+0000 7f0b00630800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b53bac31a0 0x55b53bac5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.773+0000 7f0b00630800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b53b97ed40 con 0x55b53babed10 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.773+0000 7f0b00630800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b53b9514d0 con 0x55b53bac31a0 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.774+0000 7f0afb054640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b53bac31a0 0x55b53bac5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.774+0000 7f0afb855640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b53babed10 0x55b53babf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43700/0 (socket says 172.21.15.169:43700) 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.774+0000 7f0afb855640 1 -- 172.21.15.169:0/2610989955 learned_addr learned my addr 172.21.15.169:0/2610989955 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.774+0000 7f0afb054640 1 -- 172.21.15.169:0/2610989955 >> v1:172.21.15.142:6789/0 conn(0x55b53babed10 legacy=0x55b53babf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.774+0000 7f0afb054640 1 -- 172.21.15.169:0/2610989955 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53b97d590 con 0x55b53bac31a0 2024-04-24T01:24:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0afb054640 1 --2- 172.21.15.169:0/2610989955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bac31a0 0x55b53bac5590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0af000a470 tx=0x7f0af001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed42aa17b252f6cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0afa853640 1 -- 172.21.15.169:0/2610989955 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0057070 con 0x55b53bac31a0 2024-04-24T01:24:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0afa853640 1 -- 172.21.15.169:0/2610989955 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af0052570 con 0x55b53bac31a0 2024-04-24T01:24:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0afa853640 1 -- 172.21.15.169:0/2610989955 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af0052870 con 0x55b53bac31a0 2024-04-24T01:24:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 -- 172.21.15.169:0/2610989955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bac31a0 msgr2=0x55b53bac5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 --2- 172.21.15.169:0/2610989955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bac31a0 0x55b53bac5590 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0af000a470 tx=0x7f0af001ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 -- 172.21.15.169:0/2610989955 shutdown_connections 2024-04-24T01:24:25.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 --2- 172.21.15.169:0/2610989955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bac31a0 0x55b53bac5590 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 -- 172.21.15.169:0/2610989955 >> 172.21.15.169:0/2610989955 conn(0x55b53baba370 msgr2=0x55b53babc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 -- 172.21.15.169:0/2610989955 shutdown_connections 2024-04-24T01:24:25.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.776+0000 7f0b00630800 1 -- 172.21.15.169:0/2610989955 wait complete. 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.788+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.788+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0b00630800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0b00630800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b53ba0b3b0 con 0x55b53babed10 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59120/0 (socket says 172.21.15.169:59120) 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0afb855640 1 -- 172.21.15.169:0/4046099208 learned_addr learned my addr 172.21.15.169:0/4046099208 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0afb855640 1 -- 172.21.15.169:0/4046099208 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bbb0590 con 0x55b53babed10 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f0afb855640 1 --2- 172.21.15.169:0/4046099208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001e10 tx=0x7f0af400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201247991feca16c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f09e9e0b640 1 -- 172.21.15.169:0/4046099208 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af4012020 con 0x55b53babed10 2024-04-24T01:24:25.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f09e9e0b640 1 -- 172.21.15.169:0/4046099208 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af400e5a0 con 0x55b53babed10 2024-04-24T01:24:25.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.789+0000 7f09e9e0b640 1 -- 172.21.15.169:0/4046099208 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af400e8e0 con 0x55b53babed10 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 -- 172.21.15.169:0/4046099208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 msgr2=0x55b53bbaffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 --2- 172.21.15.169:0/4046099208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001e10 tx=0x7f0af400b780 comp rx=0 tx=0).stop 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 -- 172.21.15.169:0/4046099208 shutdown_connections 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 --2- 172.21.15.169:0/4046099208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbaffc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 -- 172.21.15.169:0/4046099208 >> 172.21.15.169:0/4046099208 conn(0x55b53baba370 msgr2=0x55b53bbab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 -- 172.21.15.169:0/4046099208 shutdown_connections 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 -- 172.21.15.169:0/4046099208 wait complete. 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.790+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0b00630800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbb7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0b00630800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b53bac5e60 con 0x55b53babed10 2024-04-24T01:24:25.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbb7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbb7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59128/0 (socket says 172.21.15.169:59128) 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0afb855640 1 -- 172.21.15.169:0/1393859024 learned_addr learned my addr 172.21.15.169:0/1393859024 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0afb855640 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bbb80e0 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0afb855640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbb7ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001e10 tx=0x7f0af4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f09e3fff640 1 -- 172.21.15.169:0/1393859024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af4012030 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f09e3fff640 1 -- 172.21.15.169:0/1393859024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af401c320 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f09e3fff640 1 -- 172.21.15.169:0/1393859024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af401c9b0 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b53bbb8370 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.791+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b53ba324a0 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.792+0000 7f09e3fff640 1 -- 172.21.15.169:0/1393859024 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0af4015020 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.792+0000 7f09e3fff640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09e4036900 0x7f09e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.792+0000 7f09e3fff640 1 -- 172.21.15.169:0/1393859024 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0af4022030 con 0x55b53babed10 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.792+0000 7f0afb054640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09e4036900 0x7f09e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bac31a0 0x55b53bbbdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbbe4b0 con 0x55b53bac31a0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0afc056640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bac31a0 0x55b53bbbdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0afb054640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09e4036900 0x7f09e4038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0af0054000 tx=0x7f0af004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0afc056640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bac31a0 0x55b53bbbdf70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0afc056640 1 -- 172.21.15.169:0/1393859024 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bac31a0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbbe850 con 0x55b53bac31a0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.793+0000 7f0afc056640 1 -- 172.21.15.169:0/1393859024 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bac31a0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.794+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbc05c0 0x55b53bbc29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.794+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbc3050 con 0x55b53bbc05c0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.794+0000 7f0afb855640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbc05c0 0x55b53bbc29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.794+0000 7f0afb855640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbc05c0 0x55b53bbc29b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0afb855640 1 -- 172.21.15.169:0/1393859024 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbc05c0 2024-04-24T01:24:25.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbbf5a0 con 0x55b53bac31a0 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0afc056640 1 -- 172.21.15.169:0/1393859024 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bac31a0 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b53bbc4490 0x55b53bbc6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbc7050 con 0x55b53bbc4490 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0afb054640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b53bbc4490 0x55b53bbc6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.795+0000 7f0afb054640 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b53bbc4490 0x55b53bbc6900 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0afb054640 1 -- 172.21.15.169:0/1393859024 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0af0052940 con 0x55b53bbc4490 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0b00630800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0b00630800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b53b9b16b0 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59144/0 (socket says 172.21.15.169:59144) 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0afb855640 1 -- 172.21.15.169:0/3928030673 learned_addr learned my addr 172.21.15.169:0/3928030673 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.796+0000 7f0afb855640 1 -- 172.21.15.169:0/3928030673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bbd5d40 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f0afb855640 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0af404cfd0 tx=0x7f0af4046390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f09e17fa640 1 -- 172.21.15.169:0/3928030673 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af4033070 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f09e17fa640 1 -- 172.21.15.169:0/3928030673 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402c2a0 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b53bbd67b0 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f09e17fa640 1 -- 172.21.15.169:0/3928030673 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af402c580 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b53bbd6cb0 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.797+0000 7f09e17fa640 1 -- 172.21.15.169:0/3928030673 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0af4046520 con 0x55b53bbd53e0 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f09e17fa640 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 0x7f09d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f09e17fa640 1 -- 172.21.15.169:0/3928030673 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0af4039cc0 con 0x55b53bbd53e0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0afb054640 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 0x7f09d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0afb054640 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 0x7f09d4038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55b53ba33410 tx=0x7f0af0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0b00630800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0b00630800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b53bbb0910 con 0x55b53bbe68c0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59160/0 (socket says 172.21.15.169:59160) 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.798+0000 7f0afb855640 1 -- 172.21.15.169:0/4144768798 learned_addr learned my addr 172.21.15.169:0/4144768798 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0afb855640 1 -- 172.21.15.169:0/4144768798 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bbe72b0 con 0x55b53bbe68c0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0afb855640 1 --2- 172.21.15.169:0/4144768798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0af401c900 tx=0x7f0af4042a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621a6bdde0d73366 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f09daffd640 1 -- 172.21.15.169:0/4144768798 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af4047c90 con 0x55b53bbe68c0 2024-04-24T01:24:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f09daffd640 1 -- 172.21.15.169:0/4144768798 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af402cd60 con 0x55b53bbe68c0 2024-04-24T01:24:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f09daffd640 1 -- 172.21.15.169:0/4144768798 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af402c890 con 0x55b53bbe68c0 2024-04-24T01:24:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 -- 172.21.15.169:0/4144768798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 msgr2=0x55b53bbe6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 --2- 172.21.15.169:0/4144768798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f0af401c900 tx=0x7f0af4042a80 comp rx=0 tx=0).stop 2024-04-24T01:24:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 -- 172.21.15.169:0/4144768798 shutdown_connections 2024-04-24T01:24:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 --2- 172.21.15.169:0/4144768798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbe6ce0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 -- 172.21.15.169:0/4144768798 >> 172.21.15.169:0/4144768798 conn(0x55b53bbde810 msgr2=0x55b53bbdc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 -- 172.21.15.169:0/4144768798 shutdown_connections 2024-04-24T01:24:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.799+0000 7f0b00630800 1 -- 172.21.15.169:0/4144768798 wait complete. 2024-04-24T01:24:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0b00630800 1 Processor -- start 2024-04-24T01:24:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0b00630800 1 -- start start 2024-04-24T01:24:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0b00630800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbedcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0b00630800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b53bbe7960 con 0x55b53bbe68c0 2024-04-24T01:24:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbedcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0afb855640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbedcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59176/0 (socket says 172.21.15.169:59176) 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 learned_addr learned my addr 172.21.15.169:0/3206722645 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b53bbee1f0 con 0x55b53bbe68c0 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.800+0000 7f0afb855640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbedcb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0af4043fd0 tx=0x7f0af4021e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 -- 172.21.15.169:0/3206722645 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af4069020 con 0x55b53bbe68c0 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 -- 172.21.15.169:0/3206722645 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af4047c90 con 0x55b53bbe68c0 2024-04-24T01:24:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 -- 172.21.15.169:0/3206722645 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0af404b1c0 con 0x55b53bbe68c0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b53bbee1f0 con 0x55b53bbe68c0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b53bbee1f0 con 0x55b53bbe68c0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 -- 172.21.15.169:0/3206722645 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0af406c020 con 0x55b53bbe68c0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09c4036900 0x7f09c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.801+0000 7f09d97fa640 1 -- 172.21.15.169:0/3206722645 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f0af406fc60 con 0x55b53bbe68c0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0afb054640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09c4036900 0x7f09c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bbf93e0 0x55b53bbfb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfbff0 con 0x55b53bbf93e0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0afc056640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bbf93e0 0x55b53bbfb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0afb054640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09c4036900 0x7f09c4038dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0af0052fd0 tx=0x7f0af004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0afc056640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bbf93e0 0x55b53bbfb8a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 20 realm 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.802+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfc400 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfccd0 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbfdba0 0x55b53bbfff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc006d0 con 0x55b53bbfdba0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.803+0000 7f0afb855640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbfdba0 0x55b53bbfff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0afb855640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbfdba0 0x55b53bbfff90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0b00630800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0b00630800 20 searching for the correct realm 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b53bc02730 0x55b53bc04bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc052a0 con 0x55b53bc02730 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0afb054640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b53bc02730 0x55b53bc04bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.804+0000 7f0afb054640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b53bc02730 0x55b53bc04bd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afb054640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0af0076040 0x7f0af0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc052a0 con 0x7f0af0076040 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afc056640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0af0076040 0x7f0af0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afc056640 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0af0076040 0x7f0af0083410 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbfdba0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.805+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbf93e0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbf93e0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbfdba0 2024-04-24T01:24:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbfdba0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.806+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x7f0af0076040 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bc02730 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbf93e0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbfdba0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.807+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bbf93e0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x7f0af0076040 2024-04-24T01:24:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bbfd070 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.808+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbfdba0 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.809+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbfdba0 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.810+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.811+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.812+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc01050 con 0x55b53bbf93e0 2024-04-24T01:24:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc01050 con 0x55b53bbf93e0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.813+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc01050 con 0x7f0af0076040 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 zone default found 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 4 Realm: () 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 zonegroup default 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc01440 con 0x55b53bbfdba0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc07100 con 0x55b53bc02730 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.814+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc01040 con 0x55b53bc02730 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.815+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.815+0000 7f0b00630800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.815+0000 7f0b00630800 20 started sync module instance, tier type = 2024-04-24T01:24:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.815+0000 7f0b00630800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.815+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc065a0 con 0x7f0af0076040 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.816+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.816+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94236879907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc065a0 con 0x7f0af0076040 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.816+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc07b20 con 0x55b53bbf93e0 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.817+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94236879907520] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.817+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.817+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94236879910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc065a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.817+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc08590 con 0x55b53bc02730 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.818+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94236879910416] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.818+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.818+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94236879905008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc06510 con 0x55b53bc02730 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.818+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc09480 con 0x7f0af0076040 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.819+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94236879905008] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.819+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.819+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94236879917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc098a0 con 0x7f0af0076040 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.819+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0a260 con 0x55b53bbf93e0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.820+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.820+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94236879920560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0a680 con 0x55b53bbf93e0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.820+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0b180 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.820+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94236879917008] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.821+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94236879920560] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.821+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.821+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94236879918064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0a680 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.821+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0ba20 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.822+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.822+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94236879928768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c690 con 0x55b53bbfdba0 2024-04-24T01:24:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.822+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0d090 con 0x55b53bbfdba0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.822+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94236879918064] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.823+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94236879928768] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94236879921616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0d050 con 0x55b53bbfdba0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=0 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=1 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=2 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=3 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=4 2024-04-24T01:24:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=5 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.824+0000 7f0b00630800 20 add_watcher() i=6 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94236879921616] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0b00630800 20 add_watcher() i=7 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0b00630800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc10240 con 0x55b53bbf93e0 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.825+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94236879932320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0d470 con 0x55b53bbf93e0 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.826+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94236879932320] v32'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.826+0000 7f09b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.826+0000 7f0b00630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.826+0000 7f0b00630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f0b00630800 5 note: GC not initialized 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f09b0fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f0b00630800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f0b00630800 20 Filter name: none 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f092a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.827+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc42bf0 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'46 uv30 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c690 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'5 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c690 con 0x55b53bc02730 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'35 uv27 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.828+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c690 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c690 con 0x55b53bbf93e0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'152 uv29 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7f0aec00a4a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'23 uv23 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.829+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'16 uv16 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0aec00a4a0 con 0x7f0af0076040 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x7f0af0076040 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'33 uv25 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.830+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'30 uv21 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'29 uv21 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.831+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'16 uv16 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af0090040 con 0x55b53bbf93e0 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'22 uv22 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0aec04f040 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'40 uv24 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.832+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbf93e0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'49 uv41 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.833+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbf93e0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbfdba0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'34 uv18 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'50 uv25 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.834+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbfdba0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'23 uv15 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'19 uv11 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'43 uv19 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.835+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbf93e0 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.836+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'12 uv12 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.836+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x7f0af0076040 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.836+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.836+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f0af00900e0 con 0x55b53bbfdba0 2024-04-24T01:24:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.836+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'25 uv17 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.854 INFO:teuthology.orchestra.run.smithi169.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.838+0000 7f09b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.838+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94236879932320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc410a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.839+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94236879932320] v32'153 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.839+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94236879907520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc410a0 con 0x7f0af0076040 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.840+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94236879907520] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.840+0000 7f0b00630800 20 remove_watcher() i=0 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.840+0000 7f0b00630800 2 removed watcher, disabling cache 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.840+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94236879910416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc410a0 con 0x55b53bbf93e0 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.841+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94236879910416] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.841+0000 7f0b00630800 20 remove_watcher() i=1 2024-04-24T01:24:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.841+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94236879905008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc410a0 con 0x55b53bc02730 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.842+0000 7f0afb054640 1 -- 172.21.15.169:0/3206722645 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94236879905008] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af0081070 con 0x55b53bc02730 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.842+0000 7f0b00630800 20 remove_watcher() i=2 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.843+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94236879917008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c670 con 0x7f0af0076040 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.843+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94236879917008] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec04a160 con 0x7f0af0076040 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.843+0000 7f0b00630800 20 remove_watcher() i=3 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.843+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94236879920560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c670 con 0x55b53bbf93e0 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.844+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94236879920560] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0aec04a160 con 0x55b53bbf93e0 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.844+0000 7f0b00630800 20 remove_watcher() i=4 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.844+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94236879918064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c670 con 0x55b53bbfdba0 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94236879918064] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0b00630800 20 remove_watcher() i=5 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94236879928768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c670 con 0x55b53bbfdba0 2024-04-24T01:24:25.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94236879928768] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0b00630800 20 remove_watcher() i=6 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.846+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94236879921616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b53bc0c670 con 0x55b53bbfdba0 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0afb855640 1 -- 172.21.15.169:0/3206722645 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94236879921616] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0af401cd30 con 0x55b53bbfdba0 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 20 remove_watcher() i=7 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbfdba0 msgr2=0x55b53bbfff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbfdba0 0x55b53bbfff90 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bbf93e0 msgr2=0x55b53bbfb8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bbf93e0 0x55b53bbfb8a0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0af0076040 msgr2=0x7f0af0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0af0076040 0x7f0af0083410 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b53bc02730 msgr2=0x55b53bc04bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b53bc02730 0x55b53bc04bd0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09c4036900 msgr2=0x7f09c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09c4036900 0x7f09c4038dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0af0052fd0 tx=0x7f0af004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 msgr2=0x55b53bbedcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3206722645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbe68c0 0x55b53bbedcb0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f0af4043fd0 tx=0x7f0af4021e70 comp rx=0 tx=0).stop 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 reap_dead start 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0afc056640 1 -- 172.21.15.169:0/3206722645 reap_dead start 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 shutdown_connections 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 >> 172.21.15.169:0/3206722645 conn(0x55b53bbde810 msgr2=0x55b53bbdbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 shutdown_connections 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3206722645 wait complete. 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 msgr2=0x7f09d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 0x7f09d4038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x55b53ba33410 tx=0x7f0af0005a00 comp rx=0 tx=0).stop 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 msgr2=0x55b53bbd5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0af404cfd0 tx=0x7f0af4046390 comp rx=0 tx=0).stop 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 shutdown_connections 2024-04-24T01:24:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09d4036950 0x7f09d4038e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 --2- 172.21.15.169:0/3928030673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53bbd53e0 0x55b53bbd5800 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 >> 172.21.15.169:0/3928030673 conn(0x55b53bbc9480 msgr2=0x55b53bbc9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 shutdown_connections 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.848+0000 7f0b00630800 1 -- 172.21.15.169:0/3928030673 wait complete. 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbc05c0 msgr2=0x55b53bbc29b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b53bbc05c0 0x55b53bbc29b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bac31a0 msgr2=0x55b53bbbdf70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b53bac31a0 0x55b53bbbdf70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b53bbc4490 msgr2=0x55b53bbc6900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b53bbc4490 0x55b53bbc6900 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09e4036900 msgr2=0x7f09e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f09e4036900 0x7f09e4038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0af0054000 tx=0x7f0af004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 msgr2=0x55b53bbb7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 --2- 172.21.15.169:0/1393859024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b53babed10 0x55b53bbb7ba0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0af4001e10 tx=0x7f0af4000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0afc056640 1 -- 172.21.15.169:0/1393859024 reap_dead start 2024-04-24T01:24:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 shutdown_connections 2024-04-24T01:24:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 >> 172.21.15.169:0/1393859024 conn(0x55b53baba370 msgr2=0x55b53bbaa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 shutdown_connections 2024-04-24T01:24:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.849+0000 7f0b00630800 1 -- 172.21.15.169:0/1393859024 wait complete. 2024-04-24T01:24:25.865 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-04-24T01:24:25.865 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-04-24T01:24:25.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-04-24T01:24:25.866 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-04-24T01:24:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:25.943 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.943+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.943+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.943+0000 7f6062728800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562d0fd003c0 0x562d0fd027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.943+0000 7f6062728800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562d0fbbad40 con 0x562d0fcfc8b0 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.943+0000 7f6062728800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x562d0fb8d4d0 con 0x562d0fd003c0 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.944+0000 7f6055c5f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562d0fd003c0 0x562d0fd027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.944+0000 7f6055c5f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562d0fd003c0 0x562d0fd027b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59190/0 (socket says 172.21.15.169:59190) 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.944+0000 7f6055c5f640 1 -- 172.21.15.169:0/646969119 learned_addr learned my addr 172.21.15.169:0/646969119 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.944+0000 7f6055c5f640 1 -- 172.21.15.169:0/646969119 >> v1:172.21.15.142:6789/0 conn(0x562d0fcfc8b0 legacy=0x562d0fcfeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.944+0000 7f6055c5f640 1 -- 172.21.15.169:0/646969119 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fbb9590 con 0x562d0fd003c0 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6055c5f640 1 --2- 172.21.15.169:0/646969119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fd003c0 0x562d0fd027b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f604800a520 tx=0x7f604801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549b5e5bf634bea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f605dc5f640 1 -- 172.21.15.169:0/646969119 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6048057070 con 0x562d0fd003c0 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f605dc5f640 1 -- 172.21.15.169:0/646969119 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6048052570 con 0x562d0fd003c0 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f605dc5f640 1 -- 172.21.15.169:0/646969119 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f604804ae60 con 0x562d0fd003c0 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 -- 172.21.15.169:0/646969119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fd003c0 msgr2=0x562d0fd027b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 --2- 172.21.15.169:0/646969119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fd003c0 0x562d0fd027b0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f604800a520 tx=0x7f604801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 -- 172.21.15.169:0/646969119 shutdown_connections 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 --2- 172.21.15.169:0/646969119 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fd003c0 0x562d0fd027b0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 -- 172.21.15.169:0/646969119 >> 172.21.15.169:0/646969119 conn(0x562d0fcf6380 msgr2=0x562d0fcf87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.946+0000 7f6062728800 1 -- 172.21.15.169:0/646969119 shutdown_connections 2024-04-24T01:24:25.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.947+0000 7f6062728800 1 -- 172.21.15.169:0/646969119 wait complete. 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.958+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.958+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.958+0000 7f6062728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.958+0000 7f6062728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562d0fc473c0 con 0x562d0fcfc8b0 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59196/0 (socket says 172.21.15.169:59196) 2024-04-24T01:24:25.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f605e460640 1 -- 172.21.15.169:0/1917579605 learned_addr learned my addr 172.21.15.169:0/1917579605 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f605e460640 1 -- 172.21.15.169:0/1917579605 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fded640 con 0x562d0fcfc8b0 2024-04-24T01:24:25.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f605e460640 1 --2- 172.21.15.169:0/1917579605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6050001cd0 tx=0x7f605000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1193191dda5ff05a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.959+0000 7f5f4c608640 1 -- 172.21.15.169:0/1917579605 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000be10 con 0x562d0fcfc8b0 2024-04-24T01:24:25.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f5f4c608640 1 -- 172.21.15.169:0/1917579605 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605000f400 con 0x562d0fcfc8b0 2024-04-24T01:24:25.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f5f4c608640 1 -- 172.21.15.169:0/1917579605 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605000f720 con 0x562d0fcfc8b0 2024-04-24T01:24:25.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 -- 172.21.15.169:0/1917579605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 msgr2=0x562d0fded070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 --2- 172.21.15.169:0/1917579605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6050001cd0 tx=0x7f605000b5b0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 -- 172.21.15.169:0/1917579605 shutdown_connections 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 --2- 172.21.15.169:0/1917579605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fded070 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 -- 172.21.15.169:0/1917579605 >> 172.21.15.169:0/1917579605 conn(0x562d0fcf6380 msgr2=0x562d0fde8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 -- 172.21.15.169:0/1917579605 shutdown_connections 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.960+0000 7f6062728800 1 -- 172.21.15.169:0/1917579605 wait complete. 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f6062728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fdf4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f6062728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562d0fd02ff0 con 0x562d0fcfc8b0 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fdf4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fdf4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59200/0 (socket says 172.21.15.169:59200) 2024-04-24T01:24:25.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f605e460640 1 -- 172.21.15.169:0/8232569 learned_addr learned my addr 172.21.15.169:0/8232569 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f605e460640 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fdf5160 con 0x562d0fcfc8b0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.961+0000 7f605e460640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fdf4c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6050000fb0 tx=0x7f6050000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f5f4ae05640 1 -- 172.21.15.169:0/8232569 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001a690 con 0x562d0fcfc8b0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f5f4ae05640 1 -- 172.21.15.169:0/8232569 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605001a830 con 0x562d0fcfc8b0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d0fdf53f0 con 0x562d0fcfc8b0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f5f4ae05640 1 -- 172.21.15.169:0/8232569 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001ab50 con 0x562d0fcfc8b0 2024-04-24T01:24:25.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d0fdf80a0 con 0x562d0fcfc8b0 2024-04-24T01:24:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.962+0000 7f5f4ae05640 1 -- 172.21.15.169:0/8232569 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6050017070 con 0x562d0fcfc8b0 2024-04-24T01:24:25.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f5f4ae05640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f44036900 0x7f5f44038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f5f4ae05640 1 -- 172.21.15.169:0/8232569 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6050015020 con 0x562d0fcfc8b0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f6055c5f640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f44036900 0x7f5f44038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fd003c0 0x562d0fdfbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fdfc3a0 con 0x562d0fd003c0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f605ec61640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fd003c0 0x562d0fdfbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f6055c5f640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f44036900 0x7f5f44038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6048054000 tx=0x7f604804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f605ec61640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fd003c0 0x562d0fdfbe60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f605ec61640 1 -- 172.21.15.169:0/8232569 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fd003c0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.963+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fdf9430 con 0x562d0fd003c0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.964+0000 7f605ec61640 1 -- 172.21.15.169:0/8232569 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fd003c0 2024-04-24T01:24:25.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.964+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fdfe6d0 0x562d0fe00ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.964+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe011b0 con 0x562d0fdfe6d0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.964+0000 7f605e460640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fdfe6d0 0x562d0fe00ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.964+0000 7f605e460640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fdfe6d0 0x562d0fe00ac0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f605e460640 1 -- 172.21.15.169:0/8232569 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f605002e070 con 0x562d0fdfe6d0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fdfd680 con 0x562d0fd003c0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f605ec61640 1 -- 172.21.15.169:0/8232569 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fd003c0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562d0fe02660 0x562d0fe04ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe05210 con 0x562d0fe02660 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f6055c5f640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562d0fe02660 0x562d0fe04ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.965+0000 7f6055c5f640 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562d0fe02660 0x562d0fe04ab0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f6055c5f640 1 -- 172.21.15.169:0/8232569 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f604805a040 con 0x562d0fe02660 2024-04-24T01:24:25.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f6062728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f6062728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562d0fbed6b0 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59202/0 (socket says 172.21.15.169:59202) 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.966+0000 7f605e460640 1 -- 172.21.15.169:0/2949060555 learned_addr learned my addr 172.21.15.169:0/2949060555 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f605e460640 1 -- 172.21.15.169:0/2949060555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fe13f60 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f605e460640 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6050019fd0 tx=0x7f6050017ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f5f43fff640 1 -- 172.21.15.169:0/2949060555 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605004c040 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f5f43fff640 1 -- 172.21.15.169:0/2949060555 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f605004c310 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d0fe149d0 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f5f43fff640 1 -- 172.21.15.169:0/2949060555 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605004c5f0 con 0x562d0fe13600 2024-04-24T01:24:25.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.967+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d0fe149d0 con 0x562d0fe13600 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f5f43fff640 1 -- 172.21.15.169:0/2949060555 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f605000e070 con 0x562d0fe13600 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f5f43fff640 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 0x7f5f38038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f5f43fff640 1 -- 172.21.15.169:0/2949060555 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6050038070 con 0x562d0fe13600 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6055c5f640 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 0x7f5f38038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6055c5f640 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 0x7f5f38038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x562d0fdfcc80 tx=0x7f6048005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6062728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.968+0000 7f6062728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562d0fded9c0 con 0x562d0fcfbea0 2024-04-24T01:24:25.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59210/0 (socket says 172.21.15.169:59210) 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f605e460640 1 -- 172.21.15.169:0/1168663292 learned_addr learned my addr 172.21.15.169:0/1168663292 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f605e460640 1 -- 172.21.15.169:0/1168663292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fcfa6a0 con 0x562d0fcfbea0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f605e460640 1 --2- 172.21.15.169:0/1168663292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f605001de20 tx=0x7f6050027610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a164dc0544605d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f5f41ffb640 1 -- 172.21.15.169:0/1168663292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605001b880 con 0x562d0fcfbea0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f5f41ffb640 1 -- 172.21.15.169:0/1168663292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6050031480 con 0x562d0fcfbea0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f5f41ffb640 1 -- 172.21.15.169:0/1168663292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f605004cb90 con 0x562d0fcfbea0 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f6062728800 1 -- 172.21.15.169:0/1168663292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 msgr2=0x562d0fcfc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f6062728800 1 --2- 172.21.15.169:0/1168663292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f605001de20 tx=0x7f6050027610 comp rx=0 tx=0).stop 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f6062728800 1 -- 172.21.15.169:0/1168663292 shutdown_connections 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f6062728800 1 --2- 172.21.15.169:0/1168663292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fcfc2c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.969+0000 7f6062728800 1 -- 172.21.15.169:0/1168663292 >> 172.21.15.169:0/1168663292 conn(0x562d0fe1c8d0 msgr2=0x562d0fe1a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:25.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 -- 172.21.15.169:0/1168663292 shutdown_connections 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 -- 172.21.15.169:0/1168663292 wait complete. 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 Processor -- start 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 -- start start 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fe29b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f6062728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562d0fcfaab0 con 0x562d0fcfbea0 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fe29b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f605e460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fe29b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59218/0 (socket says 172.21.15.169:59218) 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 learned_addr learned my addr 172.21.15.169:0/4112354062 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.970+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d0fe2a070 con 0x562d0fcfbea0 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f605e460640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fe29b30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6050036ef0 tx=0x7f605002ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f5f2ffff640 1 -- 172.21.15.169:0/4112354062 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6050031b50 con 0x562d0fcfbea0 2024-04-24T01:24:25.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f5f2ffff640 1 -- 172.21.15.169:0/4112354062 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6050019840 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f5f2ffff640 1 -- 172.21.15.169:0/4112354062 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6050019b40 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562d0fe2a070 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d0fe2a510 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.971+0000 7f5f2ffff640 1 -- 172.21.15.169:0/4112354062 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6050002650 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f5f2ffff640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f28036950 0x7f5f28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f5f2ffff640 1 -- 172.21.15.169:0/4112354062 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7f6050060c60 con 0x562d0fcfbea0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f6055c5f640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f28036950 0x7f5f28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f6055c5f640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f28036950 0x7f5f28038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6048055040 tx=0x7f604804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fe352f0 0x562d0fe377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe37f00 con 0x562d0fe352f0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.972+0000 7f605ec61640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fe352f0 0x562d0fe377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f605ec61640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fe352f0 0x562d0fe377b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 realm 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38310 con 0x562d0fe352f0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38be0 con 0x562d0fe352f0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:25.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe352f0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.973+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fe39ce0 0x562d0fe3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe3c6e0 con 0x562d0fe39ce0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f605e460640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fe39ce0 0x562d0fe3c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f605e460640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fe39ce0 0x562d0fe3c0d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 20 searching for the correct realm 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562d0fe3e690 0x562d0fe40b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe41220 con 0x562d0fe3e690 2024-04-24T01:24:25.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.974+0000 7f6055c5f640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562d0fe3e690 0x562d0fe40b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.975+0000 7f6055c5f640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562d0fe3e690 0x562d0fe40b50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.975+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.975+0000 7f6055c5f640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6048074040 0x7f6048081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.975+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe41220 con 0x7f6048074040 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.975+0000 7f605ec61640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6048074040 0x7f6048081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605ec61640 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6048074040 0x7f6048081410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe39ce0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe352f0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.976+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe352f0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x7f6048074040 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.977+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe3e690 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe352f0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe352f0 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.978+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x7f6048074040 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe38f80 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe39ce0 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.979+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:25.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe352f0 2024-04-24T01:24:25.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe352f0 2024-04-24T01:24:25.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:25.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.980+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe39ce0 2024-04-24T01:24:26.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x7f6048074040 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe352f0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.981+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe39ce0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.982+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.982+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.982+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.982+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe39ce0 2024-04-24T01:24:26.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x7f6048074040 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe3e690 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe39ce0 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.983+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x562d0fe352f0 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f604808e040 con 0x7f6048074040 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:26.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe3cfa0 con 0x562d0fe352f0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe3cfa0 con 0x562d0fe352f0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.984+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe3cfa0 con 0x7f6048074040 2024-04-24T01:24:26.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 zone default found 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 4 Realm: () 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 zonegroup default 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe3d840 con 0x562d0fe39ce0 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe43080 con 0x562d0fe3e690 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.985+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe43420 con 0x562d0fe3e690 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.986+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.986+0000 7f6062728800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.986+0000 7f6062728800 20 started sync module instance, tier type = 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.986+0000 7f6062728800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.986+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42520 con 0x7f6048074040 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.987+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.987+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94751540128368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42520 con 0x7f6048074040 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.987+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe43cb0 con 0x562d0fe352f0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.988+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.988+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94751540131776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe43c80 con 0x562d0fe352f0 2024-04-24T01:24:26.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.988+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94751540128368] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.988+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe44a50 con 0x562d0fe3e690 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.989+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94751540131776] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.989+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.989+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94751540135328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe43c40 con 0x562d0fe3e690 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.989+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe45500 con 0x7f6048074040 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.990+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.990+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94751540137952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe45da0 con 0x7f6048074040 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.990+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe46860 con 0x562d0fe352f0 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.990+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94751540135328] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.991+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.991+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94751540142896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe46820 con 0x562d0fe352f0 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.991+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe47310 con 0x562d0fe39ce0 2024-04-24T01:24:26.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.991+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94751540137952] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.992+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.992+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94751540140272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe47700 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.992+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe480c0 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.992+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94751540142896] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.994+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94751540140272] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.994+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.994+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94751540149264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe484b0 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.994+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe48d00 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94751540151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe490e0 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94751540149264] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=0 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=1 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=2 2024-04-24T01:24:26.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=3 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=4 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=5 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.995+0000 7f6062728800 20 add_watcher() i=6 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94751540151952] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f6062728800 20 add_watcher() i=7 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f6062728800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe44160 con 0x562d0fe352f0 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.997+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94751540153200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe44160 con 0x562d0fe352f0 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94751540153200] v32'154 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f5f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f6062728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:26.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f6062728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f6062728800 5 note: GC not initialized 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f5e8f7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f6062728800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.998+0000 7f6062728800 20 Filter name: none 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f5e8d7fa640 20 reqs_thread_entry: start 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe7f490 con 0x562d0fe352f0 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:26.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe7ef70 con 0x7f6048074040 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 20 disabling bucket name=myfoo 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:25.999+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe7ff00 con 0x7f6048074040 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe82740 con 0x562d0fe3e690 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(65 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:26.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.000+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe8a6c0 con 0x562d0fe3e690 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6062728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6062728800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6062728800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6062728800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:26.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94751540391360 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe85d20 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify (1) cookie 94751540135328 notify 137438953483 ret 0) ==== 794+0+0 (crc 0 0 0) 0x562d0fe82b30 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f5f41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94751540135328 notifier 4591 bl.length()=752 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f5f41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.001+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 notify.2 [notify cookie 94751540391360 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f5f41ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f5f41ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f5f41ffb640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5f24003ea0 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== watch-notify(notify_complete (2) cookie 94751540391360 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562d0fe81bd0 con 0x562d0fe3e690 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6062728800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6062728800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:26.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6062728800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6062728800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.002+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe85830 con 0x562d0fe352f0 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f6062728800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f6062728800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f6062728800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94751540397968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe85830 con 0x562d0fe352f0 2024-04-24T01:24:26.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94751540142896 notify 137438953488 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f6058044700 con 0x562d0fe352f0 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f5f41ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94751540142896 notifier 4591 bl.length()=567 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 notify.4 [notify cookie 94751540397968 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f5f41ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f5f41ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.003+0000 7f5f41ffb640 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5f24003ea0 con 0x562d0fe352f0 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.004+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94751540397968 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6058018db0 con 0x562d0fe352f0 2024-04-24T01:24:26.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.004+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.022 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:26.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.004+0000 7f5f14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.004+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94751540153200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe81320 con 0x562d0fe352f0 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.005+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94751540153200] v32'155 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.005+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94751540128368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe80e70 con 0x7f6048074040 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.006+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94751540128368] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.006+0000 7f6062728800 20 remove_watcher() i=0 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.006+0000 7f6062728800 2 removed watcher, disabling cache 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.006+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94751540131776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42a50 con 0x562d0fe352f0 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.008+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94751540131776] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.008+0000 7f6062728800 20 remove_watcher() i=1 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.008+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94751540135328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42a50 con 0x562d0fe3e690 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.009+0000 7f6055c5f640 1 -- 172.21.15.169:0/4112354062 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94751540135328] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f604807f070 con 0x562d0fe3e690 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.009+0000 7f6062728800 20 remove_watcher() i=2 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.009+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94751540137952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe445a0 con 0x7f6048074040 2024-04-24T01:24:26.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.010+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94751540137952] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x7f6048074040 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.010+0000 7f6062728800 20 remove_watcher() i=3 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.010+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94751540142896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42a50 con 0x562d0fe352f0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.011+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94751540142896] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605800a4a0 con 0x562d0fe352f0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.011+0000 7f6062728800 20 remove_watcher() i=4 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.011+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94751540140272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42a50 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.012+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94751540140272] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.012+0000 7f6062728800 20 remove_watcher() i=5 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.012+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94751540149264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe42a50 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.013+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94751540149264] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.013+0000 7f6062728800 20 remove_watcher() i=6 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.013+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94751540151952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562d0fe47c10 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f605e460640 1 -- 172.21.15.169:0/4112354062 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94751540151952] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f605002e070 con 0x562d0fe39ce0 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 20 remove_watcher() i=7 2024-04-24T01:24:26.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fe39ce0 msgr2=0x562d0fe3c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fe39ce0 0x562d0fe3c0d0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fe352f0 msgr2=0x562d0fe377b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fe352f0 0x562d0fe377b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6048074040 msgr2=0x7f6048081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6048074040 0x7f6048081410 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562d0fe3e690 msgr2=0x562d0fe40b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562d0fe3e690 0x562d0fe40b50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f28036950 msgr2=0x7f5f28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f28036950 0x7f5f28038e10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6048055040 tx=0x7f604804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 msgr2=0x562d0fe29b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/4112354062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfbea0 0x562d0fe29b30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f6050036ef0 tx=0x7f605002ff90 comp rx=0 tx=0).stop 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f605ec61640 1 -- 172.21.15.169:0/4112354062 reap_dead start 2024-04-24T01:24:26.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 shutdown_connections 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 >> 172.21.15.169:0/4112354062 conn(0x562d0fe1c8d0 msgr2=0x562d0fe19f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 shutdown_connections 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/4112354062 wait complete. 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 msgr2=0x7f5f38038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 0x7f5f38038e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x562d0fdfcc80 tx=0x7f6048005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 msgr2=0x562d0fe13a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6050019fd0 tx=0x7f6050017ab0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 shutdown_connections 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f38036950 0x7f5f38038e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 --2- 172.21.15.169:0/2949060555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fe13600 0x562d0fe13a20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 >> 172.21.15.169:0/2949060555 conn(0x562d0fe076a0 msgr2=0x562d0fe07aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.014+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 shutdown_connections 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/2949060555 wait complete. 2024-04-24T01:24:26.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fdfe6d0 msgr2=0x562d0fe00ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562d0fdfe6d0 0x562d0fe00ac0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fd003c0 msgr2=0x562d0fdfbe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562d0fd003c0 0x562d0fdfbe60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562d0fe02660 msgr2=0x562d0fe04ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562d0fe02660 0x562d0fe04ab0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f44036900 msgr2=0x7f5f44038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5f44036900 0x7f5f44038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6048054000 tx=0x7f604804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 msgr2=0x562d0fdf4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 --2- 172.21.15.169:0/8232569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d0fcfc8b0 0x562d0fdf4c20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6050000fb0 tx=0x7f6050000bc0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f605ec61640 1 -- 172.21.15.169:0/8232569 reap_dead start 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 shutdown_connections 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 >> 172.21.15.169:0/8232569 conn(0x562d0fcf6380 msgr2=0x562d0fde71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 shutdown_connections 2024-04-24T01:24:26.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.015+0000 7f6062728800 1 -- 172.21.15.169:0/8232569 wait complete. 2024-04-24T01:24:26.033 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:26.035 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-04-24T01:24:26.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-04-24T01:24:26.035 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-04-24T01:24:26.110 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:26.111 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:26.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa458f46800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560f172f4780 0x560f172f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa458f46800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f171b4d40 con 0x560f172f50e0 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa458f46800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x560f171874d0 con 0x560f172f4780 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.111+0000 7fa456a45640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560f172f4780 0x560f172f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.112+0000 7fa44e244640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x560f172f50e0 0x560f172f5590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:43718/0 (socket says 172.21.15.169:43718) 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.112+0000 7fa44e244640 1 -- 172.21.15.169:0/2138324727 learned_addr learned my addr 172.21.15.169:0/2138324727 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.112+0000 7fa456a45640 1 -- 172.21.15.169:0/2138324727 >> v1:172.21.15.142:6789/0 conn(0x560f172f50e0 legacy=0x560f172f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.112+0000 7fa456a45640 1 -- 172.21.15.169:0/2138324727 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f171b3590 con 0x560f172f4780 2024-04-24T01:24:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa456a45640 1 --2- 172.21.15.169:0/2138324727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f172f4ba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa44800a470 tx=0x7fa44801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b784d07805d10c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa456244640 1 -- 172.21.15.169:0/2138324727 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448057070 con 0x560f172f4780 2024-04-24T01:24:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa456244640 1 -- 172.21.15.169:0/2138324727 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44804adc0 con 0x560f172f4780 2024-04-24T01:24:26.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa456244640 1 -- 172.21.15.169:0/2138324727 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448052590 con 0x560f172f4780 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 -- 172.21.15.169:0/2138324727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 msgr2=0x560f172f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 --2- 172.21.15.169:0/2138324727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f172f4ba0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa44800a470 tx=0x7fa44801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 -- 172.21.15.169:0/2138324727 shutdown_connections 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 --2- 172.21.15.169:0/2138324727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f172f4ba0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 -- 172.21.15.169:0/2138324727 >> 172.21.15.169:0/2138324727 conn(0x560f172f0300 msgr2=0x560f172f2720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 -- 172.21.15.169:0/2138324727 shutdown_connections 2024-04-24T01:24:26.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.114+0000 7fa458f46800 1 -- 172.21.15.169:0/2138324727 wait complete. 2024-04-24T01:24:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa458f46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa458f46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560f172413c0 con 0x560f172f4780 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59230/0 (socket says 172.21.15.169:59230) 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.126+0000 7fa456a45640 1 -- 172.21.15.169:0/1699155257 learned_addr learned my addr 172.21.15.169:0/1699155257 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.127+0000 7fa456a45640 1 -- 172.21.15.169:0/1699155257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f173e9960 con 0x560f172f4780 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.127+0000 7fa456a45640 1 --2- 172.21.15.169:0/1699155257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa448055040 tx=0x7fa44804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea0f6bfb8ccfb2a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.127+0000 7fa344e09640 1 -- 172.21.15.169:0/1699155257 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448057040 con 0x560f172f4780 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.127+0000 7fa344e09640 1 -- 172.21.15.169:0/1699155257 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448062070 con 0x560f172f4780 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.127+0000 7fa344e09640 1 -- 172.21.15.169:0/1699155257 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44805d470 con 0x560f172f4780 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- 172.21.15.169:0/1699155257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 msgr2=0x560f173e9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 --2- 172.21.15.169:0/1699155257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa448055040 tx=0x7fa44804c000 comp rx=0 tx=0).stop 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- 172.21.15.169:0/1699155257 shutdown_connections 2024-04-24T01:24:26.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 --2- 172.21.15.169:0/1699155257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173e9390 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- 172.21.15.169:0/1699155257 >> 172.21.15.169:0/1699155257 conn(0x560f172f0300 msgr2=0x560f173e4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- 172.21.15.169:0/1699155257 shutdown_connections 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- 172.21.15.169:0/1699155257 wait complete. 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa458f46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560f172f5f40 con 0x560f172f4780 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.128+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173f0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59238/0 (socket says 172.21.15.169:59238) 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa456a45640 1 -- 172.21.15.169:0/1913918084 learned_addr learned my addr 172.21.15.169:0/1913918084 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa456a45640 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f173f1340 con 0x560f172f4780 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa456a45640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173f0e00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa44805f040 tx=0x7fa448002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa343606640 1 -- 172.21.15.169:0/1913918084 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa44806b070 con 0x560f172f4780 2024-04-24T01:24:26.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa343606640 1 -- 172.21.15.169:0/1913918084 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa44805d960 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f173f15d0 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa343606640 1 -- 172.21.15.169:0/1913918084 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448057070 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.129+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f173f4280 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa343606640 1 -- 172.21.15.169:0/1913918084 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa44805dc80 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa343606640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa33c036900 0x7fa33c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa343606640 1 -- 172.21.15.169:0/1913918084 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa44808e2b0 con 0x560f172f4780 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa44e244640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa33c036900 0x7fa33c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f172f50e0 0x560f173f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f173f85c0 con 0x560f172f50e0 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa457246640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f172f50e0 0x560f173f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.130+0000 7fa44e244640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa33c036900 0x7fa33c038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa440000f60 tx=0x7fa4400012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa457246640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f172f50e0 0x560f173f8040 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa457246640 1 -- 172.21.15.169:0/1913918084 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f172f50e0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f173f5610 con 0x560f172f50e0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa457246640 1 -- 172.21.15.169:0/1913918084 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f172f50e0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f173fa920 0x560f173fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f173fd3b0 con 0x560f173fa920 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.131+0000 7fa456a45640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f173fa920 0x560f173fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa456a45640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f173fa920 0x560f173fcd10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa456a45640 1 -- 172.21.15.169:0/1913918084 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa44805a040 con 0x560f173fa920 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f173f98d0 con 0x560f172f50e0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa457246640 1 -- 172.21.15.169:0/1913918084 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f172f50e0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560f173fe860 0x560f17400cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17401410 con 0x560f173fe860 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa44e244640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560f173fe860 0x560f17400cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.132+0000 7fa44e244640 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560f173fe860 0x560f17400cb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa44e244640 1 -- 172.21.15.169:0/1913918084 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa440009050 con 0x560f173fe860 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa458f46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa458f46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560f171e76b0 con 0x560f1740f800 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.133+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59248/0 (socket says 172.21.15.169:59248) 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa456a45640 1 -- 172.21.15.169:0/2585703729 learned_addr learned my addr 172.21.15.169:0/2585703729 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa456a45640 1 -- 172.21.15.169:0/2585703729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f17410160 con 0x560f1740f800 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa456a45640 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa448000c00 tx=0x7fa448078ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa340e01640 1 -- 172.21.15.169:0/2585703729 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448084070 con 0x560f1740f800 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa340e01640 1 -- 172.21.15.169:0/2585703729 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa448009410 con 0x560f1740f800 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa340e01640 1 -- 172.21.15.169:0/2585703729 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448066bb0 con 0x560f1740f800 2024-04-24T01:24:26.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f17410bd0 con 0x560f1740f800 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.134+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f174110d0 con 0x560f1740f800 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa340e01640 1 -- 172.21.15.169:0/2585703729 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa448072b10 con 0x560f1740f800 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa340e01640 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 0x7fa330038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa340e01640 1 -- 172.21.15.169:0/2585703729 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa448088030 con 0x560f1740f800 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa44e244640 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 0x7fa330038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa44e244640 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 0x7fa330038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa44000bf50 tx=0x7fa44000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.135+0000 7fa458f46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa458f46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560f173e9c20 con 0x560f1741c940 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59256/0 (socket says 172.21.15.169:59256) 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa456a45640 1 -- 172.21.15.169:0/2067396750 learned_addr learned my addr 172.21.15.169:0/2067396750 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:26.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa456a45640 1 -- 172.21.15.169:0/2067396750 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f1741d330 con 0x560f1741c940 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa456a45640 1 --2- 172.21.15.169:0/2067396750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa44805d490 tx=0x7fa448070460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624f4f5580875c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa33a7fc640 1 -- 172.21.15.169:0/2067396750 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448079760 con 0x560f1741c940 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa33a7fc640 1 -- 172.21.15.169:0/2067396750 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4480a0070 con 0x560f1741c940 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.136+0000 7fa33a7fc640 1 -- 172.21.15.169:0/2067396750 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448009c00 con 0x560f1741c940 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- 172.21.15.169:0/2067396750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 msgr2=0x560f1741cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 --2- 172.21.15.169:0/2067396750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa44805d490 tx=0x7fa448070460 comp rx=0 tx=0).stop 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- 172.21.15.169:0/2067396750 shutdown_connections 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 --2- 172.21.15.169:0/2067396750 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f1741cd60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- 172.21.15.169:0/2067396750 >> 172.21.15.169:0/2067396750 conn(0x560f17418ca0 msgr2=0x560f17416d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- 172.21.15.169:0/2067396750 shutdown_connections 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- 172.21.15.169:0/2067396750 wait complete. 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 Processor -- start 2024-04-24T01:24:26.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- start start 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa458f46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560f1741d9e0 con 0x560f1741c940 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa456a45640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59266/0 (socket says 172.21.15.169:59266) 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.137+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 learned_addr learned my addr 172.21.15.169:0/2264810841 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f174242f0 con 0x560f1741c940 2024-04-24T01:24:26.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa456a45640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa448085510 tx=0x7fa44808aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa338ff9640 1 -- 172.21.15.169:0/2264810841 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448080b90 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa338ff9640 1 -- 172.21.15.169:0/2264810841 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4480720c0 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f174242f0 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa338ff9640 1 -- 172.21.15.169:0/2264810841 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa448079760 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.138+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f174242f0 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa338ff9640 1 -- 172.21.15.169:0/2264810841 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa4480b7060 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa338ff9640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa3200368b0 0x7fa320038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa338ff9640 1 -- 172.21.15.169:0/2264810841 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 6133+0+0 (secure 0 0 0) 0x7fa4480ac030 con 0x560f1741c940 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa44e244640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa3200368b0 0x7fa320038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f1742f4a0 0x560f17431960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f174320b0 con 0x560f1742f4a0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa44e244640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa3200368b0 0x7fa320038d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa440001b60 tx=0x7fa440010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.139+0000 7fa457246640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f1742f4a0 0x560f17431960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa457246640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f1742f4a0 0x560f17431960 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 realm 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f174324c0 con 0x560f1742f4a0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17432d90 con 0x560f1742f4a0 2024-04-24T01:24:26.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.140+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f17433e90 0x560f17436280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17436890 con 0x560f17433e90 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa456a45640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f17433e90 0x560f17436280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa456a45640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f17433e90 0x560f17436280 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:26.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 20 searching for the correct realm 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560f17438840 0x560f1743ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.141+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1743b3d0 con 0x560f17438840 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa44e244640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560f17438840 0x560f1743ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa44e244640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560f17438840 0x560f1743ad00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa44e244640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa440037040 0x7fa440036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f1743b3d0 con 0x7fa440037040 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.142+0000 7fa457246640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa440037040 0x7fa440036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:26.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa457246640 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa440037040 0x7fa440036410 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.143+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x7fa440037040 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.144+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.145+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.145+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.145+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.145+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x7fa440037040 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.146+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.147+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.148+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x7fa440037040 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.149+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x7fa440037040 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17438840 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f17433e90 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.150+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x560f1742f4a0 2024-04-24T01:24:26.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560f17433130 con 0x7fa440037040 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17437150 con 0x560f1742f4a0 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.151+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17437150 con 0x560f1742f4a0 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17437150 con 0x7fa440037040 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 zone default found 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 4 Realm: () 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:26.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 zonegroup default 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f174379f0 con 0x560f17433e90 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1743d230 con 0x560f17438840 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.152+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1743d5d0 con 0x560f17438840 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.153+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.153+0000 7fa458f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:26.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.153+0000 7fa458f46800 20 started sync module instance, tier type = 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.153+0000 7fa458f46800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.153+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743c6d0 con 0x7fa440037040 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.154+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.154+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94622814817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743c6d0 con 0x7fa440037040 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.154+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743df90 con 0x560f1742f4a0 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.155+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94622814817232] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.155+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.155+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94622814815232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743df90 con 0x560f1742f4a0 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.155+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743e950 con 0x560f17438840 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.156+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94622814815232] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.156+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.156+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94622814821088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743df00 con 0x560f17438840 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.156+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743f810 con 0x7fa440037040 2024-04-24T01:24:26.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.157+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94622814821088] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.157+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.157+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94622814827360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743fc30 con 0x7fa440037040 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.157+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f174405f0 con 0x560f1742f4a0 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.158+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94622814827360] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.158+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.158+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94622814831392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743fc30 con 0x560f1742f4a0 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.159+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17441000 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.159+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94622814831392] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.159+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.159+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94622814828416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743fba0 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.160+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17441ec0 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.160+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94622814828416] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.161+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.161+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94622814835696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17441ec0 con 0x560f17433e90 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.161+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17442880 con 0x560f17433e90 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94622814839760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17442ca0 con 0x560f17433e90 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=0 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=1 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=2 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=3 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=4 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=5 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94622814835696] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.162+0000 7fa458f46800 20 add_watcher() i=6 2024-04-24T01:24:26.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94622814839760] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa458f46800 20 add_watcher() i=7 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa458f46800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17442ca0 con 0x560f1742f4a0 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.163+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94622814840816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17442c10 con 0x560f1742f4a0 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94622814840816] v32'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa30d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa458f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa458f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa458f46800 5 note: GC not initialized 2024-04-24T01:24:26.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa287fff640 20 reqs_thread_entry: start 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa458f46800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.164+0000 7fa458f46800 20 Filter name: none 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa285ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17478ef0 con 0x560f1742f4a0 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f174789d0 con 0x7fa440037040 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.165+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 20 enabling bucket name=myfoo 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:26.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f17479960 con 0x7fa440037040 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 : miss 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1747c1a0 con 0x560f17438840 2024-04-24T01:24:26.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(65 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.166+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 8.0 8:0276357f:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f17484190 con 0x560f17438840 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa458f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa458f46800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa458f46800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa458f46800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1, ofs0, ns] 2024-04-24T01:24:26.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.167+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94622815078496 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1747f7f0 con 0x560f17438840 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify (1) cookie 94622814821088 notify 137438953484 ret 0) ==== 794+0+0 (crc 0 0 0) 0x560f1747c590 con 0x560f17438840 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94622814821088 notifier 4598 bl.length()=752 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 info.flags=0x17 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(67 notify.2 [notify cookie 94622815078496 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa33a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.1 to cache LRU end 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa33a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa33a7fc640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa31c003ea0 con 0x560f17438840 2024-04-24T01:24:26.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== watch-notify(notify_complete (2) cookie 94622815078496 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560f1747b630 con 0x560f17438840 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa458f46800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_sources= new_sources= 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa458f46800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential sources added=[] removed=[] 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa458f46800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): orig_dests= new_dests= 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa458f46800 20 handle_bi_update(): bucket=:myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.1]): potential dests added=[] removed=[] 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.168+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1747c820 con 0x560f1742f4a0 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa458f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa458f46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa458f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94622815078432 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560f1747e260 con 0x560f1742f4a0 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94622814831392 notify 137438953489 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fa450044700 con 0x560f1742f4a0 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa33a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94622814831392 notifier 4598 bl.length()=567 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa33a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:26.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa33a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:26.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.169+0000 7fa33a7fc640 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fa31c003ea0 con 0x560f1742f4a0 2024-04-24T01:24:26.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.170+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 notify.4 [notify cookie 94622815078432 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.170+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94622815078432 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa450018dd0 con 0x560f1742f4a0 2024-04-24T01:24:26.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.170+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.192 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:26.199 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.171+0000 7fa30d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.171+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94622814840816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1747a970 con 0x560f1742f4a0 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.172+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94622814840816] v32'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.172+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94622814817232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f174427f0 con 0x7fa440037040 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.173+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94622814817232] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.173+0000 7fa458f46800 20 remove_watcher() i=0 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.173+0000 7fa458f46800 2 removed watcher, disabling cache 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.173+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94622814815232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f174427f0 con 0x560f1742f4a0 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.174+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94622814815232] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.174+0000 7fa458f46800 20 remove_watcher() i=1 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.174+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94622814821088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743c400 con 0x560f17438840 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.175+0000 7fa44e244640 1 -- 172.21.15.169:0/2264810841 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94622814821088] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa440009050 con 0x560f17438840 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.175+0000 7fa458f46800 20 remove_watcher() i=2 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.175+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94622814827360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f174427f0 con 0x7fa440037040 2024-04-24T01:24:26.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.176+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94622814827360] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x7fa440037040 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.176+0000 7fa458f46800 20 remove_watcher() i=3 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.176+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94622814831392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743dae0 con 0x560f1742f4a0 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.177+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94622814831392] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa45000a4a0 con 0x560f1742f4a0 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.177+0000 7fa458f46800 20 remove_watcher() i=4 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.177+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94622814828416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743f360 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.178+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94622814828416] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.178+0000 7fa458f46800 20 remove_watcher() i=5 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.178+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94622814835696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f174427f0 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.179+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94622814835696] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.179+0000 7fa458f46800 20 remove_watcher() i=6 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.179+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94622814839760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560f1743dae0 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa456a45640 1 -- 172.21.15.169:0/2264810841 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94622814839760] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa4480c2040 con 0x560f17433e90 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 20 remove_watcher() i=7 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f17433e90 msgr2=0x560f17436280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.201 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f17433e90 0x560f17436280 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f1742f4a0 msgr2=0x560f17431960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f1742f4a0 0x560f17431960 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa440037040 msgr2=0x7fa440036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa440037040 0x7fa440036410 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560f17438840 msgr2=0x560f1743ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560f17438840 0x560f1743ad00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa3200368b0 msgr2=0x7fa320038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa3200368b0 0x7fa320038d70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa440001b60 tx=0x7fa440010000 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 msgr2=0x560f17423db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa457246640 1 -- 172.21.15.169:0/2264810841 reap_dead start 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa448085510 tx=0x7fa44808aee0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 shutdown_connections 2024-04-24T01:24:26.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2264810841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1741c940 0x560f17423db0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 >> 172.21.15.169:0/2264810841 conn(0x560f17418ca0 msgr2=0x560f17416300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 shutdown_connections 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2264810841 wait complete. 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 msgr2=0x7fa330038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 0x7fa330038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa44000bf50 tx=0x7fa44000f000 comp rx=0 tx=0).stop 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 msgr2=0x560f1740fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa448000c00 tx=0x7fa448078ef0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 shutdown_connections 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa330036950 0x7fa330038e10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 --2- 172.21.15.169:0/2585703729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f1740f800 0x560f1740fc20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 >> 172.21.15.169:0/2585703729 conn(0x560f174038a0 msgr2=0x560f17403ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 shutdown_connections 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.180+0000 7fa458f46800 1 -- 172.21.15.169:0/2585703729 wait complete. 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f173fa920 msgr2=0x560f173fcd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560f173fa920 0x560f173fcd10 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f172f50e0 msgr2=0x560f173f8040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560f172f50e0 0x560f173f8040 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560f173fe860 msgr2=0x560f17400cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560f173fe860 0x560f17400cb0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa33c036900 msgr2=0x7fa33c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa33c036900 0x7fa33c038dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa440000f60 tx=0x7fa4400012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 msgr2=0x560f173f0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 --2- 172.21.15.169:0/1913918084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f172f4780 0x560f173f0e00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa44805f040 tx=0x7fa448002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa457246640 1 -- 172.21.15.169:0/1913918084 reap_dead start 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 shutdown_connections 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 >> 172.21.15.169:0/1913918084 conn(0x560f172f0300 msgr2=0x560f173e34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 shutdown_connections 2024-04-24T01:24:26.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:26.181+0000 7fa458f46800 1 -- 172.21.15.169:0/1913918084 wait complete. 2024-04-24T01:24:26.205 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:26.212 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:24:26.459 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-04-24T01:24:26.468 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:41.469 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T01:24:41.470 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T01:24:41.470 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T01:24:41.519 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:41.519 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:41.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.519+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.519+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0bfab46800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562760abb370 0x562760abd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0bfab46800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562760975d40 con 0x562760ab5100 2024-04-24T01:24:41.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0bfab46800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5627609484d0 con 0x562760abb370 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0befe4b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562760abb370 0x562760abd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0befe4b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562760abb370 0x562760abd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51728/0 (socket says 172.21.15.169:51728) 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0bf864c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x562760ab5100 0x562760ab5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39782/0 (socket says 172.21.15.169:39782) 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0befe4b640 1 -- 172.21.15.169:0/2517135703 learned_addr learned my addr 172.21.15.169:0/2517135703 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0befe4b640 1 -- 172.21.15.169:0/2517135703 >> v1:172.21.15.142:6789/0 conn(0x562760ab5100 legacy=0x562760ab5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.520+0000 7f0befe4b640 1 -- 172.21.15.169:0/2517135703 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760974590 con 0x562760abb370 2024-04-24T01:24:41.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.522+0000 7f0befe4b640 1 --2- 172.21.15.169:0/2517135703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760abb370 0x562760abd760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a520 tx=0x7f0be001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbf3716a6772447 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.522+0000 7f0bf7e4b640 1 -- 172.21.15.169:0/2517135703 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0057070 con 0x562760abb370 2024-04-24T01:24:41.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.522+0000 7f0bf7e4b640 1 -- 172.21.15.169:0/2517135703 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be0052570 con 0x562760abb370 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.522+0000 7f0bf7e4b640 1 -- 172.21.15.169:0/2517135703 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be004ae60 con 0x562760abb370 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 -- 172.21.15.169:0/2517135703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760abb370 msgr2=0x562760abd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 --2- 172.21.15.169:0/2517135703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760abb370 0x562760abd760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0be000a520 tx=0x7f0be001d010 comp rx=0 tx=0).stop 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 -- 172.21.15.169:0/2517135703 shutdown_connections 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 --2- 172.21.15.169:0/2517135703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760abb370 0x562760abd760 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 -- 172.21.15.169:0/2517135703 >> 172.21.15.169:0/2517135703 conn(0x562760ab0b00 msgr2=0x562760ab2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 -- 172.21.15.169:0/2517135703 shutdown_connections 2024-04-24T01:24:41.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.523+0000 7f0bfab46800 1 -- 172.21.15.169:0/2517135703 wait complete. 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.537+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.537+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.537+0000 7f0bfab46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.537+0000 7f0bfab46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562760a023c0 con 0x562760ab5100 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51730/0 (socket says 172.21.15.169:51730) 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0bf864c640 1 -- 172.21.15.169:0/3464565429 learned_addr learned my addr 172.21.15.169:0/3464565429 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0bf864c640 1 -- 172.21.15.169:0/3464565429 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760ba8660 con 0x562760ab5100 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0bf864c640 1 --2- 172.21.15.169:0/3464565429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0be800b230 tx=0x7f0be800b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6452180b0261b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0ae660c640 1 -- 172.21.15.169:0/3464565429 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be800e5c0 con 0x562760ab5100 2024-04-24T01:24:41.539 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0ae660c640 1 -- 172.21.15.169:0/3464565429 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8006070 con 0x562760ab5100 2024-04-24T01:24:41.540 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.538+0000 7f0ae660c640 1 -- 172.21.15.169:0/3464565429 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be800e890 con 0x562760ab5100 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 -- 172.21.15.169:0/3464565429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 msgr2=0x562760ba8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 --2- 172.21.15.169:0/3464565429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0be800b230 tx=0x7f0be800b6f0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 -- 172.21.15.169:0/3464565429 shutdown_connections 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 --2- 172.21.15.169:0/3464565429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760ba8090 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 -- 172.21.15.169:0/3464565429 >> 172.21.15.169:0/3464565429 conn(0x562760ab0b00 msgr2=0x562760ba39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 -- 172.21.15.169:0/3464565429 shutdown_connections 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.539+0000 7f0bfab46800 1 -- 172.21.15.169:0/3464565429 wait complete. 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bfab46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760bafc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bfab46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562760abdfa0 con 0x562760ab5100 2024-04-24T01:24:41.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760bafc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760bafc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51746/0 (socket says 172.21.15.169:51746) 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bf864c640 1 -- 172.21.15.169:0/4248801874 learned_addr learned my addr 172.21.15.169:0/4248801874 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bf864c640 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760bb01d0 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.540+0000 7f0bf864c640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760bafc90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000fd0 tx=0x7f0be8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.541+0000 7f0ae4e09640 1 -- 172.21.15.169:0/4248801874 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be800f8d0 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.541+0000 7f0ae4e09640 1 -- 172.21.15.169:0/4248801874 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be800fa90 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.541+0000 7f0ae4e09640 1 -- 172.21.15.169:0/4248801874 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be800fdb0 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.541+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562760bb0460 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.541+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562760bb3110 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0ae4e09640 1 -- 172.21.15.169:0/4248801874 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0be8017070 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0ae4e09640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ae0036900 0x7f0ae0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0ae4e09640 1 -- 172.21.15.169:0/4248801874 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be8015020 con 0x562760ab5100 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0befe4b640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ae0036900 0x7f0ae0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760abb370 0x562760bb6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.544 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bb7460 con 0x562760abb370 2024-04-24T01:24:41.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760abb370 0x562760bb6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0befe4b640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ae0036900 0x7f0ae0038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0be0054000 tx=0x7f0be004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.545 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.542+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760abb370 0x562760bb6ed0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/4248801874 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760abb370 2024-04-24T01:24:41.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bb44a0 con 0x562760abb370 2024-04-24T01:24:41.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/4248801874 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760abb370 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bb9790 0x562760bbbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bbc220 con 0x562760bb9790 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.543+0000 7f0bf864c640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bb9790 0x562760bbbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.544+0000 7f0bf864c640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bb9790 0x562760bbbb80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.544+0000 7f0bf864c640 1 -- 172.21.15.169:0/4248801874 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0be802e070 con 0x562760bb9790 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.544+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bb8740 con 0x562760abb370 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/4248801874 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760abb370 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562760bbd6d0 0x562760bbfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bc0280 con 0x562760bbd6d0 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0befe4b640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562760bbd6d0 0x562760bbfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0befe4b640 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562760bbd6d0 0x562760bbfb20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.545+0000 7f0befe4b640 1 -- 172.21.15.169:0/4248801874 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0be005a040 con 0x562760bbd6d0 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bfab46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bfab46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5627609a86b0 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51758/0 (socket says 172.21.15.169:51758) 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.546+0000 7f0bf864c640 1 -- 172.21.15.169:0/1411742261 learned_addr learned my addr 172.21.15.169:0/1411742261 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0bf864c640 1 -- 172.21.15.169:0/1411742261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760ab66b0 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0bf864c640 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0be800ff70 tx=0x7f0be8017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0addffb640 1 -- 172.21.15.169:0/1411742261 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8040a50 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0addffb640 1 -- 172.21.15.169:0/1411742261 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8040bf0 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562760ab6940 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0addffb640 1 -- 172.21.15.169:0/1411742261 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8044aa0 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.547+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562760ab6e40 con 0x562760ab7d00 2024-04-24T01:24:41.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.548+0000 7f0addffb640 1 -- 172.21.15.169:0/1411742261 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0be8044c40 con 0x562760ab7d00 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.548+0000 7f0addffb640 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 0x7f0ad0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.548+0000 7f0addffb640 1 -- 172.21.15.169:0/1411742261 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be803bd50 con 0x562760ab7d00 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.548+0000 7f0befe4b640 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 0x7f0ad0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.548+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0befe4b640 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 0x7f0ad0038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562760bb43c0 tx=0x7f0be0005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bfab46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bfab46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562760ba89e0 con 0x562760bdd910 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51768/0 (socket says 172.21.15.169:51768) 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bf864c640 1 -- 172.21.15.169:0/3581124728 learned_addr learned my addr 172.21.15.169:0/3581124728 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bf864c640 1 -- 172.21.15.169:0/3581124728 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760bde300 con 0x562760bdd910 2024-04-24T01:24:41.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.549+0000 7f0bf864c640 1 --2- 172.21.15.169:0/3581124728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0be8018fd0 tx=0x7f0be8026390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81cb717ca00acec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0ad77fe640 1 -- 172.21.15.169:0/3581124728 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be803f050 con 0x562760bdd910 2024-04-24T01:24:41.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0ad77fe640 1 -- 172.21.15.169:0/3581124728 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8026750 con 0x562760bdd910 2024-04-24T01:24:41.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0ad77fe640 1 -- 172.21.15.169:0/3581124728 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8057040 con 0x562760bdd910 2024-04-24T01:24:41.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- 172.21.15.169:0/3581124728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 msgr2=0x562760bddd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 --2- 172.21.15.169:0/3581124728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0be8018fd0 tx=0x7f0be8026390 comp rx=0 tx=0).stop 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- 172.21.15.169:0/3581124728 shutdown_connections 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 --2- 172.21.15.169:0/3581124728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760bddd30 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- 172.21.15.169:0/3581124728 >> 172.21.15.169:0/3581124728 conn(0x562760bd9c70 msgr2=0x562760bd7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- 172.21.15.169:0/3581124728 shutdown_connections 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- 172.21.15.169:0/3581124728 wait complete. 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 Processor -- start 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.550+0000 7f0bfab46800 1 -- start start 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bfab46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bfab46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562760bde9b0 con 0x562760bdd910 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bf864c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51784/0 (socket says 172.21.15.169:51784) 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 learned_addr learned my addr 172.21.15.169:0/783804717 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.564 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562760be5270 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bf864c640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0be8017450 tx=0x7f0be8012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0ad5ffb640 1 -- 172.21.15.169:0/783804717 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be8061040 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0ad5ffb640 1 -- 172.21.15.169:0/783804717 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0be8045000 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562760be5270 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.551+0000 7f0ad5ffb640 1 -- 172.21.15.169:0/783804717 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be803f180 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.552+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562760be5270 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.552+0000 7f0ad5ffb640 1 -- 172.21.15.169:0/783804717 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0be806d020 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.552+0000 7f0ad5ffb640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ac8036900 0x7f0ac8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.552+0000 7f0ad5ffb640 1 -- 172.21.15.169:0/783804717 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0be806b020 con 0x562760bdd910 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0befe4b640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ac8036900 0x7f0ac8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760bf0490 0x562760bf2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf30a0 con 0x562760bf0490 2024-04-24T01:24:41.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760bf0490 0x562760bf2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0befe4b640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ac8036900 0x7f0ac8038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x562760bc0680 tx=0x7f0be004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760bf0490 0x562760bf2950 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 20 realm 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.553+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf34b0 con 0x562760bf0490 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.566 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf3d80 con 0x562760bf0490 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bf4c10 0x562760bf7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf7760 con 0x562760bf4c10 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.554+0000 7f0bf864c640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bf4c10 0x562760bf7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bf864c640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bf4c10 0x562760bf7000 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bfab46800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:41.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bfab46800 20 searching for the correct realm 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562760bf9810 0x562760bfbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bfc3a0 con 0x562760bf9810 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.555+0000 7f0befe4b640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562760bf9810 0x562760bfbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.556+0000 7f0befe4b640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562760bf9810 0x562760bfbcd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.556+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.556+0000 7f0befe4b640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0be0074040 0x7f0be0081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.556+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bfc3a0 con 0x7f0be0074040 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.556+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0be0074040 0x7f0be0081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf8e4d640 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0be0074040 0x7f0be0081410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x7f0be0074040 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf4c10 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.557+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf4c10 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.558+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x7f0be0074040 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x7f0be0074040 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf9810 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf4c10 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.559+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf0490 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf000a4a0 con 0x562760bf0490 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x7f0be0074040 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562760bf4120 con 0x562760bf9810 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.560+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf4c10 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.561+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf0490 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf0490 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf4c10 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.562+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x7f0be0074040 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf0490 2024-04-24T01:24:41.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf4c10 2024-04-24T01:24:41.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.563+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf4c10 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x7f0be0074040 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf9810 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.580 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.564+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf4c10 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x562760bf0490 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0be008e040 con 0x7f0be0074040 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf8110 con 0x562760bf0490 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.565+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.581 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf8110 con 0x562760bf0490 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf80e0 con 0x7f0be0074040 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 zone default found 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 4 Realm: () 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 zonegroup default 2024-04-24T01:24:41.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf8500 con 0x562760bf4c10 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.566+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bfe200 con 0x562760bf9810 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760bf8110 con 0x562760bf9810 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 started sync module instance, tier type = 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.567+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfd6a0 con 0x7f0be0074040 2024-04-24T01:24:41.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.568+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.568+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94727126899648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfd6a0 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.568+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfebc0 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.569+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94727126899648] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.570+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.570+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94727126903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfd6a0 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.570+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bff610 con 0x562760bf9810 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.571+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.571+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94727126905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bffee0 con 0x562760bf9810 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.571+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c00940 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.571+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94727126903024] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.572+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.572+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94727126897136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c00d60 con 0x7f0be0074040 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.572+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c01780 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.572+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94727126905120] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.573+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.573+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94727126897136] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.573+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94727126913648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c01740 con 0x562760bf0490 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.573+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c02020 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.575+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.575+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94727126915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c01740 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.575+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c02f40 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.575+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94727126913648] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.576+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.576+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94727126910032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c02f40 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.576+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c039c0 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.576+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94727126915952] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94727126910032] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94727126922416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c02ad0 con 0x562760bf4c10 2024-04-24T01:24:41.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=0 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=1 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=2 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=3 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=4 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=5 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.577+0000 7f0bfab46800 20 add_watcher() i=6 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.578+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94727126922416] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.578+0000 7f0bfab46800 20 add_watcher() i=7 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.578+0000 7f0bfab46800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.578+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c06ac0 con 0x562760bf0490 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.579+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.579+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94727126918080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c03f40 con 0x562760bf0490 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.580+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94727126918080] v34'158 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.580+0000 7f0aae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:41.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.580+0000 7f0bfab46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:41.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.580+0000 7f0bfab46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:41.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.580+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0ef60 con 0x562760bf0490 2024-04-24T01:24:41.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.581+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'50 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.581+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0f520 con 0x562760bf4c10 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.583+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.583+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0f520 con 0x562760bf9810 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.584+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.584+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0ff40 con 0x562760bf0490 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.585+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'159 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.585+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0cf70 con 0x7f0be0074040 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.586+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'52 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.586+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c0cf40 con 0x562760bf9810 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.587+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.587+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c10c70 con 0x562760bf0490 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.588+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.588+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c11080 con 0x562760bf4c10 2024-04-24T01:24:41.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.589+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'35 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.589+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c11080 con 0x7f0be0074040 2024-04-24T01:24:41.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.591+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.591+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c11080 con 0x562760bf9810 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.592+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.592+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c11530 con 0x7f0be0074040 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.593+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'53 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.593+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf4c10 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.594+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.594+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x7f0be0074040 2024-04-24T01:24:41.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.595+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.595+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf4c10 2024-04-24T01:24:41.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.596+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.596+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf0490 2024-04-24T01:24:41.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.597+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'160 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.598+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.599+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.599+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x7f0be0074040 2024-04-24T01:24:41.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.600+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'54 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.600+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.601+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.601 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.601+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf0490 2024-04-24T01:24:41.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.602+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.602+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf0490 2024-04-24T01:24:41.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.603+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'161 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.603+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.604+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'45 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.604+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x7f0be0074040 2024-04-24T01:24:41.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.605+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.605+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.606+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.606+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.607+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'36 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.607+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.611+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.611+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.611+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.611+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf4c10 2024-04-24T01:24:41.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.613+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.613+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.614+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'31 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.614+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf4c10 2024-04-24T01:24:41.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.615+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'36 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.615+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf9810 2024-04-24T01:24:41.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.616+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'46 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.616+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x562760bf4c10 2024-04-24T01:24:41.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.617+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.617+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c114e0 con 0x7f0be0074040 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0aad7e2640 20 reqs_thread_entry: start 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bfab46800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bfab46800 20 Filter name: none 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0a1effd640 20 reqs_thread_entry: start 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.619+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.620+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.620+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.620+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.620+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.620+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.621+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.622+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.623+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.624+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x562760bf0490 2024-04-24T01:24:41.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.625+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.626+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0bf0032040 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.627+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.628+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.629+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.629+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.629+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.629+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.629+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.630+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.630+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.630+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.630+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.630+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.631+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.632+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.633+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c0c2d0 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(144 gc.16 [call out=1702b] v0'0 uv51 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.634+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3d7a0 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.635+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.636+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf0490 2024-04-24T01:24:41.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.637+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.638+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.639+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.640+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv18 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv18 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.641+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.642+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.642+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.642+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.642+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.643+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv14 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.644+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv14 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.645+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x562760bf4c10 2024-04-24T01:24:41.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.646+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.647+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.647+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.647+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.647+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c750 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.647+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.648+0000 7f0aae7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.648+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94727126918080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c3c0c0 con 0x562760bf0490 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.649+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94727126918080] v34'162 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.649+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94727126899648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c023c0 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.650+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94727126899648] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.650+0000 7f0bfab46800 20 remove_watcher() i=0 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.650+0000 7f0bfab46800 2 removed watcher, disabling cache 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.650+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94727126903024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfdbc0 con 0x562760bf0490 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.651+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94727126903024] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.651+0000 7f0bfab46800 20 remove_watcher() i=1 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.651+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94727126905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfe8f0 con 0x562760bf9810 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.653+0000 7f0befe4b640 1 -- 172.21.15.169:0/783804717 <== osd.3 v2:172.21.15.169:6816/1313458488 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94727126905120] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be007f070 con 0x562760bf9810 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.653+0000 7f0bfab46800 20 remove_watcher() i=2 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.653+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94727126897136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfe8f0 con 0x7f0be0074040 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.654+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94727126897136] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf004c040 con 0x7f0be0074040 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.654+0000 7f0bfab46800 20 remove_watcher() i=3 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.654+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94727126913648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfe8f0 con 0x562760bf0490 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.655+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94727126913648] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bf004c040 con 0x562760bf0490 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.655+0000 7f0bfab46800 20 remove_watcher() i=4 2024-04-24T01:24:41.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.655+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94727126915952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c01270 con 0x562760bf4c10 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.656+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94727126915952] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.656+0000 7f0bfab46800 20 remove_watcher() i=5 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.656+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94727126910032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760bfe8f0 con 0x562760bf4c10 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.657+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94727126910032] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.657+0000 7f0bfab46800 20 remove_watcher() i=6 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.657+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94727126922416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562760c01b70 con 0x562760bf4c10 2024-04-24T01:24:41.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bf864c640 1 -- 172.21.15.169:0/783804717 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94727126922416] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0be8064040 con 0x562760bf4c10 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 20 remove_watcher() i=7 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bf4c10 msgr2=0x562760bf7000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bf4c10 0x562760bf7000 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760bf0490 msgr2=0x562760bf2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760bf0490 0x562760bf2950 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0be0074040 msgr2=0x7f0be0081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0be0074040 0x7f0be0081410 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562760bf9810 msgr2=0x562760bfbcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562760bf9810 0x562760bfbcd0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ac8036900 msgr2=0x7f0ac8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ac8036900 0x7f0ac8038dc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x562760bc0680 tx=0x7f0be004f000 comp rx=0 tx=0).stop 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 msgr2=0x562760be4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/783804717 reap_dead start 2024-04-24T01:24:41.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f0be8017450 tx=0x7f0be8012f50 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 shutdown_connections 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.658+0000 7f0bfab46800 1 --2- 172.21.15.169:0/783804717 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760bdd910 0x562760be4d30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 >> 172.21.15.169:0/783804717 conn(0x562760bd9c70 msgr2=0x562760bd72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 shutdown_connections 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/783804717 wait complete. 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 msgr2=0x7f0ad0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 0x7f0ad0038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x562760bb43c0 tx=0x7f0be0005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 msgr2=0x562760ab6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0be800ff70 tx=0x7f0be8017d50 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 shutdown_connections 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ad0036950 0x7f0ad0038e10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/1411742261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab7d00 0x562760ab6170 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 >> 172.21.15.169:0/1411742261 conn(0x562760bc2710 msgr2=0x562760bc2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 shutdown_connections 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/1411742261 wait complete. 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bb9790 msgr2=0x562760bbbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562760bb9790 0x562760bbbb80 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760abb370 msgr2=0x562760bb6ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562760abb370 0x562760bb6ed0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562760bbd6d0 msgr2=0x562760bbfb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562760bbd6d0 0x562760bbfb20 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ae0036900 msgr2=0x7f0ae0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0ae0036900 0x7f0ae0038dc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0be0054000 tx=0x7f0be004e000 comp rx=0 tx=0).stop 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 msgr2=0x562760bafc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 --2- 172.21.15.169:0/4248801874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562760ab5100 0x562760bafc90 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0be8000fd0 tx=0x7f0be8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bf8e4d640 1 -- 172.21.15.169:0/4248801874 reap_dead start 2024-04-24T01:24:41.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 shutdown_connections 2024-04-24T01:24:41.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.659+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 >> 172.21.15.169:0/4248801874 conn(0x562760ab0b00 msgr2=0x562760ba2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.660+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 shutdown_connections 2024-04-24T01:24:41.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.660+0000 7f0bfab46800 1 -- 172.21.15.169:0/4248801874 wait complete. 2024-04-24T01:24:41.668 INFO:teuthology.orchestra.run.smithi169.stdout:[{"tag":"f341815c-ea59-4c61-b01b-010b058e6023.4227.16155695398056510280\u0000","time":"2024-04-24T01:24:41.465368+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_7","key":"","instance":""}]}] 2024-04-24T01:24:41.668 DEBUG:tasks.util.rgw: json result: [{'tag': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.16155695398056510280\x00', 'time': '2024-04-24T01:24:41.465368+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_7', 'key': '', 'instance': ''}]}] 2024-04-24T01:24:41.668 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-04-24T01:24:41.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-04-24T01:24:41.669 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-04-24T01:24:41.709 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:41.709 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.709+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.709+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.709+0000 7fb1abb2f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564542e9a960 0x564542e9cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.709+0000 7fb1abb2f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564542d58d40 con 0x564542e9d290 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.709+0000 7fb1abb2f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x564542d2b4d0 con 0x564542e9a960 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a77ae640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564542e9a960 0x564542e9cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a6fad640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x564542e9d290 0x564542e9f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39794/0 (socket says 172.21.15.169:39794) 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a77ae640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564542e9a960 0x564542e9cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51788/0 (socket says 172.21.15.169:51788) 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a77ae640 1 -- 172.21.15.169:0/3209981698 learned_addr learned my addr 172.21.15.169:0/3209981698 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a77ae640 1 -- 172.21.15.169:0/3209981698 >> v1:172.21.15.142:6789/0 conn(0x564542e9d290 legacy=0x564542e9f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.710+0000 7fb1a77ae640 1 -- 172.21.15.169:0/3209981698 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542d57590 con 0x564542e9a960 2024-04-24T01:24:41.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/3209981698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9cd50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb19800a520 tx=0x7fb19801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64f56e02c667488 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1a67ac640 1 -- 172.21.15.169:0/3209981698 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198057070 con 0x564542e9a960 2024-04-24T01:24:41.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1a67ac640 1 -- 172.21.15.169:0/3209981698 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb198052570 con 0x564542e9a960 2024-04-24T01:24:41.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1a67ac640 1 -- 172.21.15.169:0/3209981698 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19804ae60 con 0x564542e9a960 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3209981698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 msgr2=0x564542e9cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/3209981698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9cd50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb19800a520 tx=0x7fb19801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3209981698 shutdown_connections 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/3209981698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9cd50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3209981698 >> 172.21.15.169:0/3209981698 conn(0x564542e94310 msgr2=0x564542e96730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.712+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3209981698 shutdown_connections 2024-04-24T01:24:41.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.713+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3209981698 wait complete. 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.724+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.724+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.724+0000 7fb1abb2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.724+0000 7fb1abb2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564542de53b0 con 0x564542e9a960 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51804/0 (socket says 172.21.15.169:51804) 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb1a77ae640 1 -- 172.21.15.169:0/1912621702 learned_addr learned my addr 172.21.15.169:0/1912621702 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb1a77ae640 1 -- 172.21.15.169:0/1912621702 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542e98860 con 0x564542e9a960 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/1912621702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb198055040 tx=0x7fb19804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa11f8077b5421c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb09560a640 1 -- 172.21.15.169:0/1912621702 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198057040 con 0x564542e9a960 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb09560a640 1 -- 172.21.15.169:0/1912621702 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb198052720 con 0x564542e9a960 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.725+0000 7fb09560a640 1 -- 172.21.15.169:0/1912621702 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198052a40 con 0x564542e9a960 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- 172.21.15.169:0/1912621702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 msgr2=0x564542e9a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/1912621702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb198055040 tx=0x7fb19804c000 comp rx=0 tx=0).stop 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- 172.21.15.169:0/1912621702 shutdown_connections 2024-04-24T01:24:41.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/1912621702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542e9a2a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- 172.21.15.169:0/1912621702 >> 172.21.15.169:0/1912621702 conn(0x564542e94310 msgr2=0x564542f86a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- 172.21.15.169:0/1912621702 shutdown_connections 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- 172.21.15.169:0/1912621702 wait complete. 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.726+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1abb2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542f94d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1abb2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564542ea30b0 con 0x564542e9a960 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542f94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542f94d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51820/0 (socket says 172.21.15.169:51820) 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1a77ae640 1 -- 172.21.15.169:0/140153993 learned_addr learned my addr 172.21.15.169:0/140153993 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1a77ae640 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542f952c0 con 0x564542e9a960 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542f94d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb198052540 tx=0x7fb198003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb093e07640 1 -- 172.21.15.169:0/140153993 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198073070 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb093e07640 1 -- 172.21.15.169:0/140153993 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19805d440 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb093e07640 1 -- 172.21.15.169:0/140153993 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198057070 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564542f95550 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.727+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564542f98200 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb093e07640 1 -- 172.21.15.169:0/140153993 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb198076070 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb093e07640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb08c036900 0x7fb08c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb093e07640 1 -- 172.21.15.169:0/140153993 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb19808dcf0 con 0x564542e9a960 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb08c036900 0x7fb08c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542e9d290 0x564542f9bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.728+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542f9c500 con 0x564542e9d290 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542e9d290 0x564542f9bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb08c036900 0x7fb08c038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb19c001e40 tx=0x7fb19c0013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542e9d290 0x564542f9bfc0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1a7faf640 1 -- 172.21.15.169:0/140153993 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542e9d290 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542f9ce10 con 0x564542e9d290 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1a7faf640 1 -- 172.21.15.169:0/140153993 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542e9d290 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542f9e720 0x564542fa0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.729+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fa1340 con 0x564542f9e720 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.730+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542f9e720 0x564542fa0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.730+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542f9e720 0x564542fa0bb0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.730+0000 7fb1a77ae640 1 -- 172.21.15.169:0/140153993 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb198075030 con 0x564542f9e720 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.730+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542f9d690 con 0x564542e9d290 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1a7faf640 1 -- 172.21.15.169:0/140153993 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542e9d290 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564542fa27f0 0x564542fa4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fa53c0 con 0x564542fa27f0 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564542fa27f0 0x564542fa4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564542fa27f0 0x564542fa4c60 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.731+0000 7fb1a6fad640 1 -- 172.21.15.169:0/140153993 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb19c00f6d0 con 0x564542fa27f0 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1abb2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1abb2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564542d8b6b0 con 0x564542fb3820 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51834/0 (socket says 172.21.15.169:51834) 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1a77ae640 1 -- 172.21.15.169:0/461314374 learned_addr learned my addr 172.21.15.169:0/461314374 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1a77ae640 1 -- 172.21.15.169:0/461314374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542fb4180 con 0x564542fb3820 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.732+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb198052a30 tx=0x7fb198076f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb091602640 1 -- 172.21.15.169:0/461314374 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198076820 con 0x564542fb3820 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb091602640 1 -- 172.21.15.169:0/461314374 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1980769c0 con 0x564542fb3820 2024-04-24T01:24:41.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564542fb4bf0 con 0x564542fb3820 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb091602640 1 -- 172.21.15.169:0/461314374 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198077ba0 con 0x564542fb3820 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564542fb50f0 con 0x564542fb3820 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb091602640 1 -- 172.21.15.169:0/461314374 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb198077d40 con 0x564542fb3820 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.733+0000 7fb091602640 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 0x7fb080038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb091602640 1 -- 172.21.15.169:0/461314374 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb198083040 con 0x564542fb3820 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 0x7fb080038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 0x7fb080038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564542f994b0 tx=0x7fb19c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1abb2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1abb2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564542e98b20 con 0x564542fc0a30 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51844/0 (socket says 172.21.15.169:51844) 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.734+0000 7fb1a77ae640 1 -- 172.21.15.169:0/3052526571 learned_addr learned my addr 172.21.15.169:0/3052526571 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1a77ae640 1 -- 172.21.15.169:0/3052526571 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542fc1420 con 0x564542fc0a30 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/3052526571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb198089580 tx=0x7fb19806fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f655b885123a067 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb08affd640 1 -- 172.21.15.169:0/3052526571 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19807edb0 con 0x564542fc0a30 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb08affd640 1 -- 172.21.15.169:0/3052526571 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19805c750 con 0x564542fc0a30 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb08affd640 1 -- 172.21.15.169:0/3052526571 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19807b120 con 0x564542fc0a30 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3052526571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 msgr2=0x564542fc0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/3052526571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb198089580 tx=0x7fb19806fda0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3052526571 shutdown_connections 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/3052526571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc0e50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3052526571 >> 172.21.15.169:0/3052526571 conn(0x564542fbcd00 msgr2=0x564542fbad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3052526571 shutdown_connections 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.735+0000 7fb1abb2f800 1 -- 172.21.15.169:0/3052526571 wait complete. 2024-04-24T01:24:41.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1abb2f800 1 Processor -- start 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1abb2f800 1 -- start start 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1abb2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1abb2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564542fc1a80 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1a77ae640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51846/0 (socket says 172.21.15.169:51846) 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 learned_addr learned my addr 172.21.15.169:0/4032322377 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564542fc8310 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.736+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb198089580 tx=0x7fb198071f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb0897fa640 1 -- 172.21.15.169:0/4032322377 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19806f410 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb0897fa640 1 -- 172.21.15.169:0/4032322377 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1980ba070 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564542fc8310 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb0897fa640 1 -- 172.21.15.169:0/4032322377 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb198078c80 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564542fc8310 con 0x564542fc0a30 2024-04-24T01:24:41.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.737+0000 7fb0897fa640 1 -- 172.21.15.169:0/4032322377 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb19806f5f0 con 0x564542fc0a30 2024-04-24T01:24:41.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb0897fa640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb070036950 0x7fb070038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb0897fa640 1 -- 172.21.15.169:0/4032322377 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb19809b5f0 con 0x564542fc0a30 2024-04-24T01:24:41.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb070036950 0x7fb070038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb070036950 0x7fb070038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564542fa57c0 tx=0x7fb19c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542fd3510 0x564542fd59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fd6120 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.738+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542fd3510 0x564542fd59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542fd3510 0x564542fd59d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 realm 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fd6530 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fd6e00 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.739+0000 7fb1abb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.740+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.740+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542fd7f00 0x564542fda2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.740+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fda900 con 0x564542fd7f00 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.740+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542fd7f00 0x564542fda2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.740+0000 7fb1a77ae640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542fd7f00 0x564542fda2f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1abb2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1abb2f800 20 searching for the correct realm 2024-04-24T01:24:41.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564542fdc8b0 0x564542fded70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fdf440 con 0x564542fdc8b0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564542fdc8b0 0x564542fded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564542fdc8b0 0x564542fded70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a6fad640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb19c00f070 0x7fb19c03a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fdf440 con 0x7fb19c00f070 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.741+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb19c00f070 0x7fb19c03a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.742+0000 7fb1a7faf640 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb19c00f070 0x7fb19c03a3c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.742+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x7fb19c00f070 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.742+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.742+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.742+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x7fb19c00f070 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x7fb19c00f070 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.743+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a000a4a0 con 0x564542fd3510 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.744+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x7fb19c00f070 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.745+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.746+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x7fb19c00f070 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.747+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.748+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x7fb19c00f070 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fdc8b0 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x564542fd3510 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.749+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564542fd71a0 con 0x7fb19c00f070 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fdb1c0 con 0x564542fd3510 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fdb1c0 con 0x564542fd3510 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fdb1c0 con 0x7fb19c00f070 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 zone default found 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 4 Realm: () 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 zonegroup default 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.750+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fdbab0 con 0x564542fd7f00 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fe12a0 con 0x564542fdc8b0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fe1640 con 0x564542fdc8b0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 started sync module instance, tier type = 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.751+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe0740 con 0x7fb19c00f070 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.752+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.752+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94855476677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe0740 con 0x7fb19c00f070 2024-04-24T01:24:41.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.752+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe2000 con 0x564542fd3510 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.753+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94855476677696] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.754+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.754+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94855476675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe2000 con 0x564542fd3510 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.754+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe2a00 con 0x564542fdc8b0 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.755+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94855476675728] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.755+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.755+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94855476681552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe1f70 con 0x564542fdc8b0 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.755+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe38c0 con 0x7fb19c00f070 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.756+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94855476681552] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.756+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.756+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94855476687888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe3ce0 con 0x7fb19c00f070 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.756+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe46a0 con 0x564542fd3510 2024-04-24T01:24:41.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.757+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94855476687888] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.757+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.757+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94855476691920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe3ce0 con 0x564542fd3510 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.757+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe50b0 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.758+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94855476691920] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.759+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.759+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94855476688944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe3c50 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.759+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe5f20 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.760+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.760+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94855476699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe6b90 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.760+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe7550 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.760+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94855476688944] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.760+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94855476699840] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94855476696144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe7550 con 0x564542fd7f00 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=0 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=1 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=2 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=3 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=4 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=5 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.761+0000 7fb1abb2f800 20 add_watcher() i=6 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94855476696144] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1abb2f800 20 add_watcher() i=7 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1abb2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564542fea720 con 0x564542fd3510 2024-04-24T01:24:41.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.762+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94855476703392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe7970 con 0x564542fd3510 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.763+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94855476703392] v34'163 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.763+0000 7fb05dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.763+0000 7fb1abb2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.763+0000 7fb1abb2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:41.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.763+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe9ef0 con 0x564542fd3510 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.764+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'51 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.765+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff37e0 con 0x564542fd7f00 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.766+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.766+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff37e0 con 0x564542fdc8b0 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.767+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.767+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff40f0 con 0x564542fd3510 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.767+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'164 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.768+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff2ee0 con 0x7fb19c00f070 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.769+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'55 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.769+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff2ee0 con 0x564542fdc8b0 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.770+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.770+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff52b0 con 0x564542fd3510 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.771+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.771+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff1e40 con 0x564542fd7f00 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.772+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.772+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff1e40 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.773+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.773+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff1e40 con 0x564542fdc8b0 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.774+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.774+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff1ed0 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.775+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'56 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.775+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff1ed0 con 0x564542fd7f00 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.776+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.776+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff20a0 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.777+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.777+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5c40 con 0x564542fd7f00 2024-04-24T01:24:41.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.778+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'49 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.778+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5c40 con 0x564542fd3510 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.779+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'165 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.779+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5c40 con 0x564542fdc8b0 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.780+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.780+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5c40 con 0x7fb19c00f070 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.781+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.781+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5c40 con 0x564542fdc8b0 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.782+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.782+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fd3510 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.783+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.783+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fd3510 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.784+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'166 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.784+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.785+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'48 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.785+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x7fb19c00f070 2024-04-24T01:24:41.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.786+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.786+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.787+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.787+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.788+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'37 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.788+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.789+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.789+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.790+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv18 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.790+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fd7f00 2024-04-24T01:24:41.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.791+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.791+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.792+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'32 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.792+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fd7f00 2024-04-24T01:24:41.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.793+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv14 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.793+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fdc8b0 2024-04-24T01:24:41.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.794+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'49 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.794+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x564542fd7f00 2024-04-24T01:24:41.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.795+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'50 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.795+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542ff5d50 con 0x7fb19c00f070 2024-04-24T01:24:41.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.796+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fb05cfe1640 20 reqs_thread_entry: start 2024-04-24T01:24:41.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fb1abb2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:41.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fb1abb2f800 20 Filter name: none 2024-04-24T01:24:41.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fafd67fc640 20 reqs_thread_entry: start 2024-04-24T01:24:41.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-04-24T01:24:41.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.797+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.798+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 gc.19 [call] v34'167 uv167 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.798+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.798+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(95 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.798+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.798+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(96 gc.19 [call out=24b] v0'0 uv167 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(97 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:98 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(98 gc.19 [call out=15b] v0'0 uv167 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.799+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.800+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(99 gc.19 [call] v34'168 uv168 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.800+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-04-24T01:24:41.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.800+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:100 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.801+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(100 gc.20 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.801+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(101 gc.20 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(102 gc.20 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:103 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(103 gc.20 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:104 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(104 gc.20 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.802+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:105 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.803+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(105 gc.20 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.803+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.803+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.804+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(106 gc.21 [call] v34'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.804+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.804+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(107 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.804+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.804+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:108 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(108 gc.21 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:109 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(109 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:110 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(110 gc.21 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.805+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:111 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.806+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(111 gc.21 [call] v34'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.806+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.806+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:112 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.807+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(112 gc.22 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.807+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:113 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.807+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(113 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.807+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.807+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:114 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(114 gc.22 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:115 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(115 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:116 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(116 gc.22 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.808+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:117 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.809+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(117 gc.22 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.809+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-04-24T01:24:41.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.809+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:118 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(118 gc.23 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:119 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(119 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:120 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(120 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.810+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(121 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:122 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== osd_op_reply(122 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.811+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:123 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.812+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 43 ==== osd_op_reply(123 gc.23 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.812+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-04-24T01:24:41.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.812+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:124 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 44 ==== osd_op_reply(124 gc.24 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:125 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 45 ==== osd_op_reply(125 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:126 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 46 ==== osd_op_reply(126 gc.24 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:127 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.813+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 47 ==== osd_op_reply(127 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.814+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.814+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:128 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.814+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 48 ==== osd_op_reply(128 gc.24 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.814+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.814+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:129 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.815+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 49 ==== osd_op_reply(129 gc.24 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.815+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.815+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:130 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 50 ==== osd_op_reply(130 gc.25 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:131 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 51 ==== osd_op_reply(131 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:132 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 52 ==== osd_op_reply(132 gc.25 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:133 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 53 ==== osd_op_reply(133 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.816+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:134 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 54 ==== osd_op_reply(134 gc.25 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:135 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 55 ==== osd_op_reply(135 gc.25 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-04-24T01:24:41.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.817+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:136 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(136 gc.26 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:137 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(137 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:138 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(138 gc.26 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.819+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:139 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(139 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:140 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(140 gc.26 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.820+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:141 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.821+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(141 gc.26 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.821+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-04-24T01:24:41.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.821+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:142 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 56 ==== osd_op_reply(142 gc.27 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:143 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 57 ==== osd_op_reply(143 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:144 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 58 ==== osd_op_reply(144 gc.27 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.822+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:145 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 59 ==== osd_op_reply(145 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:146 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 60 ==== osd_op_reply(146 gc.27 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.823+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:147 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.824+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 61 ==== osd_op_reply(147 gc.27 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.824+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-04-24T01:24:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.824+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:148 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.825+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(148 gc.28 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.825+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:149 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.825+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(149 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.825+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.825+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:150 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(150 gc.28 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:151 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(151 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:152 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(152 gc.28 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.826+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:153 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.827+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(153 gc.28 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.827+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-04-24T01:24:41.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.827+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:154 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.828+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 62 ==== osd_op_reply(154 gc.29 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.828+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:155 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 63 ==== osd_op_reply(155 gc.29 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:156 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 64 ==== osd_op_reply(156 gc.29 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:157 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 65 ==== osd_op_reply(157 gc.29 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:158 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 66 ==== osd_op_reply(158 gc.29 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.829+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:159 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.830+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 67 ==== osd_op_reply(159 gc.29 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.830+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-04-24T01:24:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.830+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:160 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.831+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(160 gc.30 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.831+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:161 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(161 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:162 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(162 gc.30 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:163 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(163 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.832+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:164 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.833+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(164 gc.30 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.833+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.833+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:165 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.834+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(165 gc.30 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.834+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-04-24T01:24:41.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.834+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:166 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.835+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(166 gc.31 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.835+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:167 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.835+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(167 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.835+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.835+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:168 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(168 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:169 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(169 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:170 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(170 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.836+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:171 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.838+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(171 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.838+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-04-24T01:24:41.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.838+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:172 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(172 gc.0 [call] v34'52 uv52 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:173 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(173 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:174 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(174 gc.0 [call out=24b] v0'0 uv52 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:175 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(175 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.839+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:176 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.840+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(176 gc.0 [call out=15b] v0'0 uv52 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.840+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.840+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:177 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.841+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(177 gc.0 [call] v34'53 uv53 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.841+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-04-24T01:24:41.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.841+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:178 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.842+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(178 gc.1 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.842+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:179 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.842+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(179 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.842+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.842+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:180 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(180 gc.1 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:181 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(181 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:182 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(182 gc.1 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.843+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:183 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.844+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(183 gc.1 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.844+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-04-24T01:24:41.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.844+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:184 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.845+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 68 ==== osd_op_reply(184 gc.2 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.845+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:185 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.845+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 69 ==== osd_op_reply(185 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.845+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:186 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 70 ==== osd_op_reply(186 gc.2 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:187 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 71 ==== osd_op_reply(187 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:188 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 72 ==== osd_op_reply(188 gc.2 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.846+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:189 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.847+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 73 ==== osd_op_reply(189 gc.2 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.847+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.847+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:190 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(190 gc.3 [call] v34'169 uv169 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:191 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(191 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:192 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(192 gc.3 [call out=24b] v0'0 uv169 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.848+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:193 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(193 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:194 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(194 gc.3 [call out=15b] v0'0 uv169 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.849+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:195 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.850+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(195 gc.3 [call] v34'170 uv170 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.850+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.850+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:196 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(196 gc.4 [call] v34'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:197 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(197 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:198 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(198 gc.4 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:199 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(199 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.851+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:200 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.852+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== osd_op_reply(200 gc.4 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.852+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.852+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:201 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.853+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== osd_op_reply(201 gc.4 [call] v34'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.853+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-04-24T01:24:41.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.853+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:202 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 74 ==== osd_op_reply(202 gc.5 [call] v34'47 uv47 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:203 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 75 ==== osd_op_reply(203 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:204 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 76 ==== osd_op_reply(204 gc.5 [call out=24b] v0'0 uv47 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:205 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 77 ==== osd_op_reply(205 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:206 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 78 ==== osd_op_reply(206 gc.5 [call out=15b] v0'0 uv47 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.854+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.855+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:207 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.855+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 79 ==== osd_op_reply(207 gc.5 [call] v34'48 uv48 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.855+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-04-24T01:24:41.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.855+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:208 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(208 gc.6 [call] v34'28 uv28 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:209 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(209 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:210 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(210 gc.6 [call out=24b] v0'0 uv28 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:211 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 49 ==== osd_op_reply(211 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:212 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 50 ==== osd_op_reply(212 gc.6 [call out=15b] v0'0 uv28 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.857+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:213 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.859+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 51 ==== osd_op_reply(213 gc.6 [call] v34'29 uv29 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.859+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-04-24T01:24:41.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.859+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:214 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== osd_op_reply(214 gc.7 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:215 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== osd_op_reply(215 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:216 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(216 gc.7 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.860+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:217 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 51 ==== osd_op_reply(217 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:218 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 52 ==== osd_op_reply(218 gc.7 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.861+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:219 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.862+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 53 ==== osd_op_reply(219 gc.7 [call] v34'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.862+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-04-24T01:24:41.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.862+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:220 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.863+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(220 gc.8 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.863+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:221 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.863+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== osd_op_reply(221 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.863+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.863+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:222 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== osd_op_reply(222 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:223 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== osd_op_reply(223 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:224 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(224 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.864+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:225 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.865+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 42 ==== osd_op_reply(225 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.865+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-04-24T01:24:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.865+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:226 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 80 ==== osd_op_reply(226 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:227 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 81 ==== osd_op_reply(227 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:228 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 82 ==== osd_op_reply(228 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.866+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:229 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 83 ==== osd_op_reply(229 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:230 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 84 ==== osd_op_reply(230 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.867+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:231 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.868+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 85 ==== osd_op_reply(231 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.868+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.868+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:232 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 43 ==== osd_op_reply(232 gc.10 [call] v34'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:233 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 44 ==== osd_op_reply(233 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:234 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 45 ==== osd_op_reply(234 gc.10 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:235 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 46 ==== osd_op_reply(235 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.869+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:236 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.870+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 47 ==== osd_op_reply(236 gc.10 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.870+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.870+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:237 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.871+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 48 ==== osd_op_reply(237 gc.10 [call] v34'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.871+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-04-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.871+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:238 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.872+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 54 ==== osd_op_reply(238 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.872+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:239 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.872+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 55 ==== osd_op_reply(239 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.872+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.872+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:240 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 56 ==== osd_op_reply(240 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:241 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 57 ==== osd_op_reply(241 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:242 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 58 ==== osd_op_reply(242 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.873+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:243 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.875+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 59 ==== osd_op_reply(243 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.875+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-04-24T01:24:41.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.875+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:244 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 49 ==== osd_op_reply(244 gc.12 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:245 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 50 ==== osd_op_reply(245 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:246 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 51 ==== osd_op_reply(246 gc.12 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:247 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 52 ==== osd_op_reply(247 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:248 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.876+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 53 ==== osd_op_reply(248 gc.12 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.877+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.877+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:249 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.877+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 54 ==== osd_op_reply(249 gc.12 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.877+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-04-24T01:24:41.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.877+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:250 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.878+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 60 ==== osd_op_reply(250 gc.13 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.878+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:251 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 61 ==== osd_op_reply(251 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:252 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 62 ==== osd_op_reply(252 gc.13 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:253 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 63 ==== osd_op_reply(253 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.879+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:254 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.880+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 64 ==== osd_op_reply(254 gc.13 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.880+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.880+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:255 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd7f00 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.881+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 65 ==== osd_op_reply(255 gc.13 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.881+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-04-24T01:24:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.881+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:256 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 52 ==== osd_op_reply(256 gc.14 [call] v34'171 uv171 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:257 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 53 ==== osd_op_reply(257 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:258 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.882+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 54 ==== osd_op_reply(258 gc.14 [call out=24b] v0'0 uv171 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:259 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 55 ==== osd_op_reply(259 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:260 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 56 ==== osd_op_reply(260 gc.14 [call out=15b] v0'0 uv171 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.883+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:261 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fd3510 2024-04-24T01:24:41.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.884+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 57 ==== osd_op_reply(261 gc.14 [call] v34'172 uv172 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.884+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.884+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:262 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.885+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 86 ==== osd_op_reply(262 gc.15 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.885+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:263 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.885+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 87 ==== osd_op_reply(263 gc.15 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.885+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.885+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:264 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 88 ==== osd_op_reply(264 gc.15 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:265 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 89 ==== osd_op_reply(265 gc.15 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:266 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 90 ==== osd_op_reply(266 gc.15 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.886+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:267 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x564542fdc8b0 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.887+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 91 ==== osd_op_reply(267 gc.15 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.887+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.887+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:268 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.888+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 55 ==== osd_op_reply(268 gc.16 [call] v34'62 uv62 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.888+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:269 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.888+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 56 ==== osd_op_reply(269 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.888+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:270 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543020e10 con 0x7fb19c00f070 2024-04-24T01:24:41.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 57 ==== osd_op_reply(270 gc.16 [call out=24b] v0'0 uv62 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:271 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 58 ==== osd_op_reply(271 gc.16 [call out=15b] v0'0 uv62 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:272 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021e20 con 0x7fb19c00f070 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 59 ==== osd_op_reply(272 gc.16 [call out=1702b] v0'0 uv62 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 20 garbage collection: RGWGC::process iterating over entry tag='f341815c-ea59-4c61-b01b-010b058e6023.4227.16155695398056510280', time=2024-04-24T01:24:41.465368+0000, chain.objs.size()=7 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_1 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:273 3.27s0 3:e48e3997:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430224a0 con 0x564542fd7f00 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_2 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:274 3.3cs0 3:3eedc249:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430250a0 con 0x7fb19c00f070 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_3 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:275 3.3bs0 3:df8a8633:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430279b0 con 0x564542fdc8b0 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_4 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:276 3.es0 3:70741c5d:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56454302a220 con 0x7fb19c00f070 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_5 2024-04-24T01:24:41.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:277 3.1cs0 3:3b757828:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56454302ca90 con 0x564542fd3510 2024-04-24T01:24:41.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_6 2024-04-24T01:24:41.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:278 3.bs0 3:d1410df4:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56454302f300 con 0x564542fd7f00 2024-04-24T01:24:41.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_7 2024-04-24T01:24:41.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.889+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:279 3.21s0 3:84b02b1b:::f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56454302ca90 con 0x564542fd7f00 2024-04-24T01:24:41.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.892+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 92 ==== osd_op_reply(275 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.893+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 66 ==== osd_op_reply(273 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.893+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 58 ==== osd_op_reply(277 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.893+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 67 ==== osd_op_reply(279 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.893+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 68 ==== osd_op_reply(278 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.894+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 60 ==== osd_op_reply(274 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.894+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 61 ==== osd_op_reply(276 f341815c-ea59-4c61-b01b-010b058e6023.4227.1__shadow_.NGDRSS-6TDC9YuwJG1rJra1L_39gOTM_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.894+0000 7fb1abb2f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T01:24:41.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.894+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:280 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x7fb19c00f070 2024-04-24T01:24:41.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.898+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 62 ==== osd_op_reply(280 gc.16 [call] v34'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.898+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:281 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x7fb19c00f070 2024-04-24T01:24:41.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.901+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 63 ==== osd_op_reply(281 gc.16 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.901+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-04-24T01:24:41.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.901+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:282 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fdc8b0 2024-04-24T01:24:41.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.902+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 93 ==== osd_op_reply(282 gc.17 [call] v34'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.902+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:283 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.902+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 94 ==== osd_op_reply(283 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.902+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.902+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:284 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021430 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 95 ==== osd_op_reply(284 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:285 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 96 ==== osd_op_reply(285 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:286 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 97 ==== osd_op_reply(286 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.903+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:287 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fdc8b0 2024-04-24T01:24:41.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.904+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 98 ==== osd_op_reply(287 gc.17 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.904+0000 7fb1abb2f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-04-24T01:24:41.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.904+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:288 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.905+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 59 ==== osd_op_reply(288 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.905+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:289 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 60 ==== osd_op_reply(289 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:290 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564543021430 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 61 ==== osd_op_reply(290 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:291 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 62 ==== osd_op_reply(291 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:24:41.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:292 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fd3510 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 63 ==== osd_op_reply(292 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.906+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:293 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645430254e0 con 0x564542fd3510 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.907+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 64 ==== osd_op_reply(293 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.908+0000 7fb05dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:41.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.908+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94855476703392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fcfca0 con 0x564542fd3510 2024-04-24T01:24:41.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.909+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94855476703392] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.909+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94855476677696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe70a0 con 0x7fb19c00f070 2024-04-24T01:24:41.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.910+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94855476677696] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.910+0000 7fb1abb2f800 20 remove_watcher() i=0 2024-04-24T01:24:41.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.910+0000 7fb1abb2f800 2 removed watcher, disabling cache 2024-04-24T01:24:41.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.910+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94855476675728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe70a0 con 0x564542fd3510 2024-04-24T01:24:41.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.912+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94855476675728] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.912+0000 7fb1abb2f800 20 remove_watcher() i=1 2024-04-24T01:24:41.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.912+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94855476681552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe70a0 con 0x564542fdc8b0 2024-04-24T01:24:41.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.913+0000 7fb1a6fad640 1 -- 172.21.15.169:0/4032322377 <== osd.3 v2:172.21.15.169:6816/1313458488 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94855476681552] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb19c037040 con 0x564542fdc8b0 2024-04-24T01:24:41.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.913+0000 7fb1abb2f800 20 remove_watcher() i=2 2024-04-24T01:24:41.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.913+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94855476687888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe1b50 con 0x7fb19c00f070 2024-04-24T01:24:41.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.914+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.2 v2:172.21.15.169:6808/1447817104 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94855476687888] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x7fb19c00f070 2024-04-24T01:24:41.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.914+0000 7fb1abb2f800 20 remove_watcher() i=3 2024-04-24T01:24:41.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.914+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94855476691920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe70a0 con 0x564542fd3510 2024-04-24T01:24:41.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.916+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 <== osd.1 v2:172.21.15.169:6800/461208471 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94855476691920] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1a0032040 con 0x564542fd3510 2024-04-24T01:24:41.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.916+0000 7fb1abb2f800 20 remove_watcher() i=4 2024-04-24T01:24:41.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.916+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94855476688944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe3410 con 0x564542fd7f00 2024-04-24T01:24:41.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.917+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94855476688944] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.917+0000 7fb1abb2f800 20 remove_watcher() i=5 2024-04-24T01:24:41.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.917+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94855476699840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe1b50 con 0x564542fd7f00 2024-04-24T01:24:41.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.918+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94855476699840] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.918+0000 7fb1abb2f800 20 remove_watcher() i=6 2024-04-24T01:24:41.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.918+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94855476696144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564542fe43d0 con 0x564542fd7f00 2024-04-24T01:24:41.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1a77ae640 1 -- 172.21.15.169:0/4032322377 <== osd.0 v2:172.21.15.142:6800/3255114084 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94855476696144] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb198086040 con 0x564542fd7f00 2024-04-24T01:24:41.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 20 remove_watcher() i=7 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542fd7f00 msgr2=0x564542fda2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542fd7f00 0x564542fda2f0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542fd3510 msgr2=0x564542fd59d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542fd3510 0x564542fd59d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb19c00f070 msgr2=0x7fb19c03a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fb19c00f070 0x7fb19c03a3c0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564542fdc8b0 msgr2=0x564542fded70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564542fdc8b0 0x564542fded70 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb070036950 msgr2=0x7fb070038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb070036950 0x7fb070038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x564542fa57c0 tx=0x7fb19c010000 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 msgr2=0x564542fc7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb198089580 tx=0x7fb198071f00 comp rx=0 tx=0).stop 2024-04-24T01:24:41.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1a7faf640 1 -- 172.21.15.169:0/4032322377 reap_dead start 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 shutdown_connections 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/4032322377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fc0a30 0x564542fc7dd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 >> 172.21.15.169:0/4032322377 conn(0x564542fbcd00 msgr2=0x564542fba360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 shutdown_connections 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/4032322377 wait complete. 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 msgr2=0x7fb080038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 0x7fb080038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x564542f994b0 tx=0x7fb19c00f000 comp rx=0 tx=0).stop 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 msgr2=0x564542fb3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb198052a30 tx=0x7fb198076f70 comp rx=0 tx=0).stop 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 shutdown_connections 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb080036900 0x7fb080038dc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/461314374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542fb3820 0x564542fb3c40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.919+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 >> 172.21.15.169:0/461314374 conn(0x564542fa78c0 msgr2=0x564542fa7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 shutdown_connections 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/461314374 wait complete. 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542f9e720 msgr2=0x564542fa0bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564542f9e720 0x564542fa0bb0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542e9d290 msgr2=0x564542f9bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564542e9d290 0x564542f9bfc0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564542fa27f0 msgr2=0x564542fa4c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564542fa27f0 0x564542fa4c60 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb08c036900 msgr2=0x7fb08c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb08c036900 0x7fb08c038dc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb19c001e40 tx=0x7fb19c0013a0 comp rx=0 tx=0).stop 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 msgr2=0x564542f94d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 --2- 172.21.15.169:0/140153993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564542e9a960 0x564542f94d80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb198052540 tx=0x7fb198003020 comp rx=0 tx=0).stop 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1a7faf640 1 -- 172.21.15.169:0/140153993 reap_dead start 2024-04-24T01:24:41.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 shutdown_connections 2024-04-24T01:24:41.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 >> 172.21.15.169:0/140153993 conn(0x564542e94310 msgr2=0x564542e99080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:41.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 shutdown_connections 2024-04-24T01:24:41.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:41.920+0000 7fb1abb2f800 1 -- 172.21.15.169:0/140153993 wait complete. 2024-04-24T01:24:41.928 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-04-24T01:24:41.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-04-24T01:24:41.928 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-04-24T01:24:42.009 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:42.009 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f6360936800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56545e12f8f0 0x56545e131ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f6360936800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56545dfedd40 con 0x56545e132220 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f6360936800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x56545dfc04d0 con 0x56545e12f8f0 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f635c6cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56545e12f8f0 0x56545e131ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f635c6cc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56545e12f8f0 0x56545e131ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51850/0 (socket says 172.21.15.169:51850) 2024-04-24T01:24:42.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f635c6cc640 1 -- 172.21.15.169:0/3859152267 learned_addr learned my addr 172.21.15.169:0/3859152267 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.010+0000 7f635becb640 1 --1- 172.21.15.169:0/3859152267 >> v1:172.21.15.142:6789/0 conn(0x56545e132220 0x56545e134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39800/0 (socket says 172.21.15.169:39800) 2024-04-24T01:24:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.011+0000 7f635c6cc640 1 -- 172.21.15.169:0/3859152267 >> v1:172.21.15.142:6789/0 conn(0x56545e132220 legacy=0x56545e134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.011+0000 7f635b6ca640 1 -- 172.21.15.169:0/3859152267 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987151944 0 0) 0x56545dfedd40 con 0x56545e132220 2024-04-24T01:24:42.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.011+0000 7f635c6cc640 1 -- 172.21.15.169:0/3859152267 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545dfec590 con 0x56545e12f8f0 2024-04-24T01:24:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.012+0000 7f635c6cc640 1 --2- 172.21.15.169:0/3859152267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e131ce0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f634c00a520 tx=0x7f634c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dddddbe8aa088c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f635b6ca640 1 -- 172.21.15.169:0/3859152267 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c057070 con 0x56545e12f8f0 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f635b6ca640 1 -- 172.21.15.169:0/3859152267 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c052570 con 0x56545e12f8f0 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f635b6ca640 1 -- 172.21.15.169:0/3859152267 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c04ae60 con 0x56545e12f8f0 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 -- 172.21.15.169:0/3859152267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 msgr2=0x56545e131ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 --2- 172.21.15.169:0/3859152267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e131ce0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f634c00a520 tx=0x7f634c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 -- 172.21.15.169:0/3859152267 shutdown_connections 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 --2- 172.21.15.169:0/3859152267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e131ce0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 -- 172.21.15.169:0/3859152267 >> 172.21.15.169:0/3859152267 conn(0x56545e129320 msgr2=0x56545e12b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 -- 172.21.15.169:0/3859152267 shutdown_connections 2024-04-24T01:24:42.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.013+0000 7f6360936800 1 -- 172.21.15.169:0/3859152267 wait complete. 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f6360936800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f6360936800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56545e07a3c0 con 0x56545e12f8f0 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51856/0 (socket says 172.21.15.169:51856) 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.025+0000 7f635c6cc640 1 -- 172.21.15.169:0/2538455488 learned_addr learned my addr 172.21.15.169:0/2538455488 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.026+0000 7f635c6cc640 1 -- 172.21.15.169:0/2538455488 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e220420 con 0x56545e12f8f0 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.026+0000 7f635c6cc640 1 --2- 172.21.15.169:0/2538455488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f634c055040 tx=0x7f634c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da0a094429bcf10 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.026+0000 7f624a60c640 1 -- 172.21.15.169:0/2538455488 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c062070 con 0x56545e12f8f0 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.026+0000 7f624a60c640 1 -- 172.21.15.169:0/2538455488 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c052720 con 0x56545e12f8f0 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.026+0000 7f624a60c640 1 -- 172.21.15.169:0/2538455488 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c057040 con 0x56545e12f8f0 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- 172.21.15.169:0/2538455488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 msgr2=0x56545e21fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 --2- 172.21.15.169:0/2538455488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f634c055040 tx=0x7f634c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- 172.21.15.169:0/2538455488 shutdown_connections 2024-04-24T01:24:42.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 --2- 172.21.15.169:0/2538455488 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e21fe50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- 172.21.15.169:0/2538455488 >> 172.21.15.169:0/2538455488 conn(0x56545e129320 msgr2=0x56545e21b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- 172.21.15.169:0/2538455488 shutdown_connections 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- 172.21.15.169:0/2538455488 wait complete. 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e2278d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f6360936800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56545e136030 con 0x56545e12f8f0 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e2278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e2278d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51866/0 (socket says 172.21.15.169:51866) 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.027+0000 7f635c6cc640 1 -- 172.21.15.169:0/148997245 learned_addr learned my addr 172.21.15.169:0/148997245 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f635c6cc640 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e227e10 con 0x56545e12f8f0 2024-04-24T01:24:42.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f635c6cc640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e2278d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f634c0057e0 tx=0x7f634c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f6248e09640 1 -- 172.21.15.169:0/148997245 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c057050 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f6248e09640 1 -- 172.21.15.169:0/148997245 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c067450 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545e2280a0 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f6248e09640 1 -- 172.21.15.169:0/148997245 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c062040 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.028+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545e22ad50 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f6248e09640 1 -- 172.21.15.169:0/148997245 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f634c067750 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f6248e09640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6244036950 0x7f6244038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f6248e09640 1 -- 172.21.15.169:0/148997245 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f634c08e280 con 0x56545e12f8f0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f635becb640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6244036950 0x7f6244038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e132220 0x56545e22eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e22f050 con 0x56545e132220 2024-04-24T01:24:42.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f635cecd640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e132220 0x56545e22eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.029+0000 7f635becb640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6244036950 0x7f6244038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f63500013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f635cecd640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e132220 0x56545e22eb10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f635cecd640 1 -- 172.21.15.169:0/148997245 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e132220 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e22c0c0 con 0x56545e132220 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f635cecd640 1 -- 172.21.15.169:0/148997245 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e132220 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e231320 0x56545e233710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e233de0 con 0x56545e231320 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.030+0000 7f635c6cc640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e231320 0x56545e233710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f635c6cc640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e231320 0x56545e233710 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f635c6cc640 1 -- 172.21.15.169:0/148997245 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f634c064070 con 0x56545e231320 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2302d0 con 0x56545e132220 2024-04-24T01:24:42.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f635cecd640 1 -- 172.21.15.169:0/148997245 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e132220 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56545e235220 0x56545e2376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e237e70 con 0x56545e235220 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.031+0000 7f635becb640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56545e235220 0x56545e2376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f635becb640 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56545e235220 0x56545e2376e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f635becb640 1 -- 172.21.15.169:0/148997245 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f635000f670 con 0x56545e235220 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f6360936800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.032+0000 7f6360936800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56545e0206b0 con 0x56545e12f470 2024-04-24T01:24:42.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51880/0 (socket says 172.21.15.169:51880) 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f635c6cc640 1 -- 172.21.15.169:0/3203032247 learned_addr learned my addr 172.21.15.169:0/3203032247 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f635c6cc640 1 -- 172.21.15.169:0/3203032247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e12de20 con 0x56545e12f470 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f635c6cc640 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f634c08c5b0 tx=0x7f634c066d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f6241ffb640 1 -- 172.21.15.169:0/3203032247 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c089070 con 0x56545e12f470 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f6241ffb640 1 -- 172.21.15.169:0/3203032247 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c08c920 con 0x56545e12f470 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545e12e050 con 0x56545e12f470 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f6241ffb640 1 -- 172.21.15.169:0/3203032247 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c08cc40 con 0x56545e12f470 2024-04-24T01:24:42.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.033+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545e12e550 con 0x56545e12f470 2024-04-24T01:24:42.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f6241ffb640 1 -- 172.21.15.169:0/3203032247 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f634c05b570 con 0x56545e12f470 2024-04-24T01:24:42.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f6241ffb640 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 0x7f6234038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.062 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f6241ffb640 1 -- 172.21.15.169:0/3203032247 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f634c0900c0 con 0x56545e12f470 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f635becb640 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 0x7f6234038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.034+0000 7f635becb640 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 0x7f6234038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56545e22f4c0 tx=0x7f6350006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f6360936800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f6360936800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56545e2206e0 con 0x56545e2556c0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51882/0 (socket says 172.21.15.169:51882) 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f635c6cc640 1 -- 172.21.15.169:0/3616056902 learned_addr learned my addr 172.21.15.169:0/3616056902 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f635c6cc640 1 -- 172.21.15.169:0/3616056902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e2560b0 con 0x56545e2556c0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f635c6cc640 1 --2- 172.21.15.169:0/3616056902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f634c05dc70 tx=0x7f634c08cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a98ef5bb2eb33a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f623b7fe640 1 -- 172.21.15.169:0/3616056902 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c085d30 con 0x56545e2556c0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f623b7fe640 1 -- 172.21.15.169:0/3616056902 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c066760 con 0x56545e2556c0 2024-04-24T01:24:42.063 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.035+0000 7f623b7fe640 1 -- 172.21.15.169:0/3616056902 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c06fba0 con 0x56545e2556c0 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- 172.21.15.169:0/3616056902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 msgr2=0x56545e255ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 --2- 172.21.15.169:0/3616056902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f634c05dc70 tx=0x7f634c08cde0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- 172.21.15.169:0/3616056902 shutdown_connections 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 --2- 172.21.15.169:0/3616056902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e255ae0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- 172.21.15.169:0/3616056902 >> 172.21.15.169:0/3616056902 conn(0x56545e2519d0 msgr2=0x56545e24fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- 172.21.15.169:0/3616056902 shutdown_connections 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- 172.21.15.169:0/3616056902 wait complete. 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 Processor -- start 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- start start 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f6360936800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56545e256740 con 0x56545e2556c0 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f635c6cc640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51896/0 (socket says 172.21.15.169:51896) 2024-04-24T01:24:42.064 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.036+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 learned_addr learned my addr 172.21.15.169:0/26282133 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545e25cf20 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f635c6cc640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f634c066550 tx=0x7f634c087e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f6239ffb640 1 -- 172.21.15.169:0/26282133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c051a60 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f6239ffb640 1 -- 172.21.15.169:0/26282133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c0b0070 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545e25cf20 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f6239ffb640 1 -- 172.21.15.169:0/26282133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634c051d30 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.037+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545e25cf20 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6239ffb640 1 -- 172.21.15.169:0/26282133 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f634c0a0070 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6239ffb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f622c036900 0x7f622c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6239ffb640 1 -- 172.21.15.169:0/26282133 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f634c0a6070 con 0x56545e2556c0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f635becb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f622c036900 0x7f622c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e267f50 0x56545e26a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26ab60 con 0x56545e267f50 2024-04-24T01:24:42.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f635cecd640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e267f50 0x56545e26a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.038+0000 7f635becb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f622c036900 0x7f622c038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56545e238270 tx=0x7f6350023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f635cecd640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e267f50 0x56545e26a410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 realm 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26af70 con 0x56545e267f50 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26b840 con 0x56545e267f50 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.039+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e26c6d0 0x56545e26eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26f200 con 0x56545e26c6d0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f635c6cc640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e26c6d0 0x56545e26eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f635c6cc640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e26c6d0 0x56545e26eac0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 20 searching for the correct realm 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56545e2712a0 0x56545e273760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.040+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e273e30 con 0x56545e2712a0 2024-04-24T01:24:42.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635becb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56545e2712a0 0x56545e273760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635becb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56545e2712a0 0x56545e273760 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635becb640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f635003a3c0 0x7f635003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e273e30 con 0x7f635003a3c0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.041+0000 7f635cecd640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f635003a3c0 0x7f635003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635cecd640 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f635003a3c0 0x7f635003a810 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x7f635003a3c0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.042+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x7f635003a3c0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x7f635003a3c0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.043+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f635400a4a0 con 0x56545e267f50 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.044+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x7f635003a3c0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.045+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.046+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x7f635003a3c0 2024-04-24T01:24:42.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.047+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x7f635003a3c0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e2712a0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.048+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e26c6d0 2024-04-24T01:24:42.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x56545e267f50 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56545e26bbe0 con 0x7f635003a3c0 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.049+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26fba0 con 0x56545e267f50 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.073 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26fba0 con 0x56545e267f50 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26fba0 con 0x7f635003a3c0 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 zone default found 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 4 Realm: () 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:42.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 zonegroup default 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.050+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e26ff90 con 0x56545e26c6d0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e275c90 con 0x56545e2712a0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e276030 con 0x56545e2712a0 2024-04-24T01:24:42.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 started sync module instance, tier type = 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.051+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e26fba0 con 0x7f635003a3c0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.052+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.052+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94920356875392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e275550 con 0x7f635003a3c0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.052+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e276880 con 0x56545e267f50 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.053+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94920356875392] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.054+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.054+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94920356876928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e276880 con 0x56545e267f50 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.054+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e277240 con 0x56545e2712a0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.055+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94920356876928] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.055+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.076 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.055+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94920356881360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2767f0 con 0x56545e2712a0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.055+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e278100 con 0x7f635003a3c0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.056+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94920356881360] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.056+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.056+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94920356887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e278070 con 0x7f635003a3c0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.056+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e278ec0 con 0x56545e267f50 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.057+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94920356887632] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.057+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.057+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94920356889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e278ec0 con 0x56545e267f50 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.057+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2798d0 con 0x56545e26c6d0 2024-04-24T01:24:42.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.058+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94920356889696] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.058+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.058+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94920356893728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e279c70 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.058+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27a670 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.059+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94920356893728] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.059+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.059+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94920356890752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27a630 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.059+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b080 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94920356899696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b4f0 con 0x56545e26c6d0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=0 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=1 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=2 2024-04-24T01:24:42.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=3 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=4 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=5 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94920356890752] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.060+0000 7f6360936800 20 add_watcher() i=6 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.061+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94920356899696] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.061+0000 7f6360936800 20 add_watcher() i=7 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.061+0000 7f6360936800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.061+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b4f0 con 0x56545e267f50 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.062+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.062+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94920356900928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b460 con 0x56545e267f50 2024-04-24T01:24:42.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.063+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94920356900928] v34'174 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.063+0000 7f62127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.063+0000 7f6360936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:42.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.063+0000 7f6360936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.063+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e286b30 con 0x56545e267f50 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.065+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'54 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.065+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2870e0 con 0x56545e26c6d0 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.066+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.066+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2870e0 con 0x56545e2712a0 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.066+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.066+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e287b00 con 0x56545e267f50 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.067+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'175 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.086 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.067+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288070 con 0x7f635003a3c0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.068+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.068+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288520 con 0x56545e2712a0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.069+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'49 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.069+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288d70 con 0x56545e267f50 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.070+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.070+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288d70 con 0x56545e26c6d0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.072+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.072+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288e00 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.072+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.073+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e288e90 con 0x56545e2712a0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.073+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.073+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289400 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.074+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.074+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289400 con 0x56545e26c6d0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.075+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.075+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289400 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.076+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.076+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289400 con 0x56545e26c6d0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.077+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'55 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.077+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289490 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.079+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'176 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.079+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289490 con 0x56545e2712a0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.080+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.080+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289a20 con 0x7f635003a3c0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.081+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.081+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2899d0 con 0x56545e2712a0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.082+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'34 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.082+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2899d0 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.083+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.083+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2899d0 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.084+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'177 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.084+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2899d0 con 0x56545e2712a0 2024-04-24T01:24:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.085+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.085+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x7f635003a3c0 2024-04-24T01:24:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.086+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'38 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.086+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.091 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.087+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.087+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.088+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.088+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.089+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.089+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.090+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'50 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.090+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e26c6d0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.091+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.092 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.091+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.092+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'35 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.092+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e26c6d0 2024-04-24T01:24:42.093 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.093+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.093+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e2712a0 2024-04-24T01:24:42.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.094+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.094+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x56545e26c6d0 2024-04-24T01:24:42.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.095+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'56 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.095+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e289940 con 0x7f635003a3c0 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.096+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.096+0000 7f62117e2640 20 reqs_thread_entry: start 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.096+0000 7f6360936800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f6360936800 20 Filter name: none 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f6182ffd640 20 reqs_thread_entry: start 2024-04-24T01:24:42.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2850f0 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv53 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.097+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv53 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.098+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv170 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.099+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv170 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv170 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv59 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.100+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv59 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv48 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.101+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv48 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv29 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv29 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.102+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.103+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.103+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.103+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv42 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.103+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.104+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv42 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.104+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.104+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.104+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.105+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv61 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv61 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.106+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.107+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.108+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.109+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.109+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.109+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.109+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.109+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv172 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv172 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.110+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.111+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.112+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.113+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv168 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv168 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv51 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.114+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv51 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.115+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.116+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.117+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.118+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.119+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.119+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.119+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.119+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.120+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.120+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.120+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.120+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.120+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.121+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e2712a0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e2712a0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.122+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.123+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b41a0 con 0x7f635003a3c0 2024-04-24T01:24:42.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.124+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.124+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56545e2b51b0 con 0x7f635003a3c0 2024-04-24T01:24:42.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.124+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.125+0000 7f62127e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.125+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94920356900928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e265150 con 0x56545e267f50 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.126+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94920356900928] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.126+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94920356875392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b040 con 0x7f635003a3c0 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.127+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94920356875392] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.127+0000 7f6360936800 20 remove_watcher() i=0 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.127+0000 7f6360936800 2 removed watcher, disabling cache 2024-04-24T01:24:42.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.127+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94920356876928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b040 con 0x56545e267f50 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.128+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94920356876928] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.128+0000 7f6360936800 20 remove_watcher() i=1 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.128+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94920356881360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e275280 con 0x56545e2712a0 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.129+0000 7f635becb640 1 -- 172.21.15.169:0/26282133 <== osd.3 v2:172.21.15.169:6816/1313458488 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94920356881360] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6350037040 con 0x56545e2712a0 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.129+0000 7f6360936800 20 remove_watcher() i=2 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.129+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94920356887632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b040 con 0x7f635003a3c0 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.130+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94920356887632] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x7f635003a3c0 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.130+0000 7f6360936800 20 remove_watcher() i=3 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.130+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94920356889696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2763d0 con 0x56545e267f50 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.131+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94920356889696] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6354032040 con 0x56545e267f50 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.131+0000 7f6360936800 20 remove_watcher() i=4 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.131+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94920356893728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e277c50 con 0x56545e26c6d0 2024-04-24T01:24:42.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.132+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94920356893728] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.132+0000 7f6360936800 20 remove_watcher() i=5 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.132+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94920356890752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e27b040 con 0x56545e26c6d0 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.133+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94920356890752] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.133+0000 7f6360936800 20 remove_watcher() i=6 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.133+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94920356899696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56545e2763d0 con 0x56545e26c6d0 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f635c6cc640 1 -- 172.21.15.169:0/26282133 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94920356899696] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634c094020 con 0x56545e26c6d0 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 20 remove_watcher() i=7 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e26c6d0 msgr2=0x56545e26eac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e26c6d0 0x56545e26eac0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e267f50 msgr2=0x56545e26a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e267f50 0x56545e26a410 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f635003a3c0 msgr2=0x7f635003a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f635003a3c0 0x7f635003a810 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56545e2712a0 msgr2=0x56545e273760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56545e2712a0 0x56545e273760 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f622c036900 msgr2=0x7f622c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f622c036900 0x7f622c038dc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56545e238270 tx=0x7f6350023040 comp rx=0 tx=0).stop 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 msgr2=0x56545e25c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f634c066550 tx=0x7f634c087e90 comp rx=0 tx=0).stop 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.134+0000 7f635cecd640 1 -- 172.21.15.169:0/26282133 reap_dead start 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 shutdown_connections 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/26282133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e2556c0 0x56545e25c9e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 >> 172.21.15.169:0/26282133 conn(0x56545e2519d0 msgr2=0x56545e24f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 shutdown_connections 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/26282133 wait complete. 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 msgr2=0x7f6234038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 0x7f6234038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x56545e22f4c0 tx=0x7f6350006000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 msgr2=0x56545e12d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f634c08c5b0 tx=0x7f634c066d20 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 shutdown_connections 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6234036950 0x7f6234038e10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/3203032247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f470 0x56545e12d8e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 >> 172.21.15.169:0/3203032247 conn(0x56545e23a3c0 msgr2=0x56545e23a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 shutdown_connections 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/3203032247 wait complete. 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e231320 msgr2=0x56545e233710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56545e231320 0x56545e233710 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e132220 msgr2=0x56545e22eb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56545e132220 0x56545e22eb10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56545e235220 msgr2=0x56545e2376e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56545e235220 0x56545e2376e0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6244036950 msgr2=0x7f6244038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6244036950 0x7f6244038e10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6350000c00 tx=0x7f63500013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 msgr2=0x56545e2278d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 --2- 172.21.15.169:0/148997245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56545e12f8f0 0x56545e2278d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f634c0057e0 tx=0x7f634c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f635cecd640 1 -- 172.21.15.169:0/148997245 reap_dead start 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 shutdown_connections 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.135+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 >> 172.21.15.169:0/148997245 conn(0x56545e129320 msgr2=0x56545e219f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.136+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 shutdown_connections 2024-04-24T01:24:42.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.136+0000 7f6360936800 1 -- 172.21.15.169:0/148997245 wait complete. 2024-04-24T01:24:42.145 INFO:teuthology.orchestra.run.smithi169.stdout:[] 2024-04-24T01:24:42.145 DEBUG:tasks.util.rgw: json result: [] 2024-04-24T01:24:42.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:42.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:42.146 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:24:42.227 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:42.228 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:42.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f7445da2800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5650f25dc7a0 0x5650f25dcbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.229 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f7445da2800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5650f249cd40 con 0x5650f25dd100 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f7445da2800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5650f246f4d0 con 0x5650f25dc7a0 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f74438a8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5650f25dc7a0 0x5650f25dcbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f74430a7640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5650f25dd100 0x5650f25dd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39804/0 (socket says 172.21.15.169:39804) 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f74438a8640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5650f25dc7a0 0x5650f25dcbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51908/0 (socket says 172.21.15.169:51908) 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.228+0000 7f74430a7640 1 -- 172.21.15.169:0/686426774 learned_addr learned my addr 172.21.15.169:0/686426774 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.229+0000 7f74438a8640 1 -- 172.21.15.169:0/686426774 >> v1:172.21.15.142:6789/0 conn(0x5650f25dd100 legacy=0x5650f25dd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.230 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.229+0000 7f74438a8640 1 -- 172.21.15.169:0/686426774 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f249b590 con 0x5650f25dc7a0 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.230+0000 7f74438a8640 1 --2- 172.21.15.169:0/686426774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f25dcbc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f743400a470 tx=0x7f743401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74ac689bf39d1b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f74428a6640 1 -- 172.21.15.169:0/686426774 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434057070 con 0x5650f25dc7a0 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f74428a6640 1 -- 172.21.15.169:0/686426774 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743404adc0 con 0x5650f25dc7a0 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f74428a6640 1 -- 172.21.15.169:0/686426774 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434052590 con 0x5650f25dc7a0 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 -- 172.21.15.169:0/686426774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 msgr2=0x5650f25dcbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.232 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 --2- 172.21.15.169:0/686426774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f25dcbc0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f743400a470 tx=0x7f743401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 -- 172.21.15.169:0/686426774 shutdown_connections 2024-04-24T01:24:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 --2- 172.21.15.169:0/686426774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f25dcbc0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 -- 172.21.15.169:0/686426774 >> 172.21.15.169:0/686426774 conn(0x5650f25d8320 msgr2=0x5650f25da740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 -- 172.21.15.169:0/686426774 shutdown_connections 2024-04-24T01:24:42.233 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.231+0000 7f7445da2800 1 -- 172.21.15.169:0/686426774 wait complete. 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f7445da2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f7445da2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5650f25293c0 con 0x5650f25dc7a0 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51914/0 (socket says 172.21.15.169:51914) 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f74438a8640 1 -- 172.21.15.169:0/2572546529 learned_addr learned my addr 172.21.15.169:0/2572546529 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f74438a8640 1 -- 172.21.15.169:0/2572546529 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f26d19d0 con 0x5650f25dc7a0 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.243+0000 7f74438a8640 1 --2- 172.21.15.169:0/2572546529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7434055040 tx=0x7f743404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef03ecb399460db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7331e0b640 1 -- 172.21.15.169:0/2572546529 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434057040 con 0x5650f25dc7a0 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7331e0b640 1 -- 172.21.15.169:0/2572546529 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7434062070 con 0x5650f25dc7a0 2024-04-24T01:24:42.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7331e0b640 1 -- 172.21.15.169:0/2572546529 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743405d470 con 0x5650f25dc7a0 2024-04-24T01:24:42.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 -- 172.21.15.169:0/2572546529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 msgr2=0x5650f26d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.255 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 --2- 172.21.15.169:0/2572546529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7434055040 tx=0x7f743404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 -- 172.21.15.169:0/2572546529 shutdown_connections 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 --2- 172.21.15.169:0/2572546529 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d1400 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 -- 172.21.15.169:0/2572546529 >> 172.21.15.169:0/2572546529 conn(0x5650f25d8320 msgr2=0x5650f26ccd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 -- 172.21.15.169:0/2572546529 shutdown_connections 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.244+0000 7f7445da2800 1 -- 172.21.15.169:0/2572546529 wait complete. 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f7445da2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f7445da2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5650f25ddf60 con 0x5650f25dc7a0 2024-04-24T01:24:42.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51924/0 (socket says 172.21.15.169:51924) 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f74438a8640 1 -- 172.21.15.169:0/1277969345 learned_addr learned my addr 172.21.15.169:0/1277969345 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f74438a8640 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f26d9350 con 0x5650f25dc7a0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f74438a8640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d8e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f743405f040 tx=0x7f7434002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f732bfff640 1 -- 172.21.15.169:0/1277969345 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743406b070 con 0x5650f25dc7a0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f732bfff640 1 -- 172.21.15.169:0/1277969345 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743405d9a0 con 0x5650f25dc7a0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f732bfff640 1 -- 172.21.15.169:0/1277969345 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434057070 con 0x5650f25dc7a0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.245+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650f26d95e0 con 0x5650f25dc7a0 2024-04-24T01:24:42.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.246+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650f26dc290 con 0x5650f25dc7a0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.246+0000 7f732bfff640 1 -- 172.21.15.169:0/1277969345 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f743405dca0 con 0x5650f25dc7a0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.246+0000 7f732bfff640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f732c036900 0x7f732c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.246+0000 7f732bfff640 1 -- 172.21.15.169:0/1277969345 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f743408e2c0 con 0x5650f25dc7a0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.246+0000 7f74430a7640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f732c036900 0x7f732c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f25dd100 0x5650f26e0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f26e0590 con 0x5650f25dd100 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f74440a9640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f25dd100 0x5650f26e0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f74430a7640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f732c036900 0x7f732c038dc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7438000f60 tx=0x7f74380012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f74440a9640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f25dd100 0x5650f26e0050 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f74440a9640 1 -- 172.21.15.169:0/1277969345 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f25dd100 2024-04-24T01:24:42.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.247+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f26dd620 con 0x5650f25dd100 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f74440a9640 1 -- 172.21.15.169:0/1277969345 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f25dd100 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f26e28e0 0x5650f26e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f26e53c0 con 0x5650f26e28e0 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f74438a8640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f26e28e0 0x5650f26e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f74438a8640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f26e28e0 0x5650f26e4cd0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f74438a8640 1 -- 172.21.15.169:0/1277969345 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f743405a040 con 0x5650f26e28e0 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.248+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f26e1890 con 0x5650f25dd100 2024-04-24T01:24:42.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f74440a9640 1 -- 172.21.15.169:0/1277969345 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f25dd100 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5650f26e6870 0x5650f26e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f26e9420 con 0x5650f26e6870 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f74430a7640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5650f26e6870 0x5650f26e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f74430a7640 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5650f26e6870 0x5650f26e8cc0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.249+0000 7f74430a7640 1 -- 172.21.15.169:0/1277969345 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7438009050 con 0x5650f26e6870 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f7445da2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f7445da2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5650f24cf6b0 con 0x5650f26f7880 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51934/0 (socket says 172.21.15.169:51934) 2024-04-24T01:24:42.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f74438a8640 1 -- 172.21.15.169:0/1829468034 learned_addr learned my addr 172.21.15.169:0/1829468034 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f74438a8640 1 -- 172.21.15.169:0/1829468034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f26f81e0 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f74438a8640 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f743408c640 tx=0x7f7434078690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f73297fa640 1 -- 172.21.15.169:0/1829468034 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434080040 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f73297fa640 1 -- 172.21.15.169:0/1829468034 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743408b260 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.250+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650f26f8c50 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f73297fa640 1 -- 172.21.15.169:0/1829468034 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743405bb90 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650f26f9150 con 0x5650f26f7880 2024-04-24T01:24:42.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f73297fa640 1 -- 172.21.15.169:0/1829468034 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7434002a30 con 0x5650f26f7880 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f73297fa640 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 0x7f731c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f73297fa640 1 -- 172.21.15.169:0/1829468034 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f74340900c0 con 0x5650f26f7880 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.251+0000 7f74430a7640 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 0x7f731c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74430a7640 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 0x7f731c038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f743800bf50 tx=0x7f743800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f7445da2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f7445da2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5650f26d1c90 con 0x5650f27049c0 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51946/0 (socket says 172.21.15.169:51946) 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74438a8640 1 -- 172.21.15.169:0/1546254337 learned_addr learned my addr 172.21.15.169:0/1546254337 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74438a8640 1 -- 172.21.15.169:0/1546254337 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f27053b0 con 0x5650f27049c0 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.252+0000 7f74438a8640 1 --2- 172.21.15.169:0/1546254337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74340706f0 tx=0x7f7434070460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb2a7b76d78c633 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7322ffd640 1 -- 172.21.15.169:0/1546254337 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434068070 con 0x5650f27049c0 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7322ffd640 1 -- 172.21.15.169:0/1546254337 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74340a6070 con 0x5650f27049c0 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7322ffd640 1 -- 172.21.15.169:0/1546254337 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7434009c40 con 0x5650f27049c0 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- 172.21.15.169:0/1546254337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 msgr2=0x5650f2704de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 --2- 172.21.15.169:0/1546254337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f74340706f0 tx=0x7f7434070460 comp rx=0 tx=0).stop 2024-04-24T01:24:42.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- 172.21.15.169:0/1546254337 shutdown_connections 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 --2- 172.21.15.169:0/1546254337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f2704de0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- 172.21.15.169:0/1546254337 >> 172.21.15.169:0/1546254337 conn(0x5650f2700d20 msgr2=0x5650f26fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- 172.21.15.169:0/1546254337 shutdown_connections 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- 172.21.15.169:0/1546254337 wait complete. 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 Processor -- start 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- start start 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.253+0000 7f7445da2800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5650f2705a60 con 0x5650f27049c0 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f74438a8640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51950/0 (socket says 172.21.15.169:51950) 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 learned_addr learned my addr 172.21.15.169:0/2431816802 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650f270c2a0 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f74438a8640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7434002f20 tx=0x7f743406df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f73217fa640 1 -- 172.21.15.169:0/2431816802 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f743406eae0 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f73217fa640 1 -- 172.21.15.169:0/2431816802 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f743406ec80 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5650f270c2a0 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f73217fa640 1 -- 172.21.15.169:0/2431816802 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74340021c0 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.254+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650f270c2a0 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.255+0000 7f73217fa640 1 -- 172.21.15.169:0/2431816802 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f74340bc060 con 0x5650f27049c0 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.255+0000 7f73217fa640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f730c036900 0x7f730c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.255+0000 7f73217fa640 1 -- 172.21.15.169:0/2431816802 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f743409d040 con 0x5650f27049c0 2024-04-24T01:24:42.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.255+0000 7f74430a7640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f730c036900 0x7f730c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f74430a7640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f730c036900 0x7f730c038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7438001b60 tx=0x7f7438010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f27172c0 0x5650f2719780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f2719ed0 con 0x5650f27172c0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f74440a9640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f27172c0 0x5650f2719780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f74440a9640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f27172c0 0x5650f2719780 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 20 realm 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.256+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271a2e0 con 0x5650f27172c0 2024-04-24T01:24:42.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271abb0 con 0x5650f27172c0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f271bcb0 0x5650f271e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271e6b0 con 0x5650f271bcb0 2024-04-24T01:24:42.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.257+0000 7f74438a8640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f271bcb0 0x5650f271e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f74438a8640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f271bcb0 0x5650f271e0a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f7445da2800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f7445da2800 20 searching for the correct realm 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5650f2720660 0x5650f2722b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f27231f0 con 0x5650f2720660 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f74430a7640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5650f2720660 0x5650f2722b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.258+0000 7f74430a7640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5650f2720660 0x5650f2722b20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74430a7640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7438038040 0x7f743801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f27231f0 con 0x7f7438038040 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74440a9640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7438038040 0x7f743801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74440a9640 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7438038040 0x7f743801bab0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x7f7438038040 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.259+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.260+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x7f7438038040 2024-04-24T01:24:42.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x7f7438038040 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.261+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c00a4a0 con 0x5650f27172c0 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x7f7438038040 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.262+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.263+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.264+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x7f7438038040 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.265+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x7f7438038040 2024-04-24T01:24:42.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f2720660 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f271bcb0 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.266+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x5650f27172c0 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5650f271af50 con 0x7f7438038040 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271ef70 con 0x5650f27172c0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271ef70 con 0x5650f27172c0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.267+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271ef70 con 0x7f7438038040 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 zone default found 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 4 Realm: () 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 zonegroup default 2024-04-24T01:24:42.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f271f860 con 0x5650f271bcb0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f2725050 con 0x5650f2720660 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.268+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f27253f0 con 0x5650f2720660 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.269+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.269+0000 7f7445da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.269+0000 7f7445da2800 20 started sync module instance, tier type = 2024-04-24T01:24:42.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.269+0000 7f7445da2800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.269+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27244f0 con 0x7f7438038040 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.270+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.270+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94905664948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27244f0 con 0x7f7438038040 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.270+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2725db0 con 0x5650f27172c0 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.271+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.271+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94905664952576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27261d0 con 0x5650f27172c0 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.271+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2726c80 con 0x5650f2720660 2024-04-24T01:24:42.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.271+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94905664948720] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.272+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94905664952576] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.272+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.272+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94905664946240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27261d0 con 0x5650f2720660 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.272+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2727520 con 0x7f7438038040 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.273+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94905664946240] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.274+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.274+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94905664958576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2727940 con 0x7f7438038040 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.274+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2728300 con 0x5650f27172c0 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.275+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.275+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94905664962128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2728270 con 0x5650f27172c0 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.275+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27292b0 con 0x5650f271bcb0 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.275+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94905664958576] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.276+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.276+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94905664962128] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.276+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94905664959632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2728d90 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.276+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2729cc0 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.277+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94905664959632] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.277+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.277+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94905664964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272a510 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.277+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272ad60 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94905664964336] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94905664971328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272ab70 con 0x5650f271bcb0 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=0 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=1 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=2 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=3 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=4 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=5 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.278+0000 7f7445da2800 20 add_watcher() i=6 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94905664971328] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f7445da2800 20 add_watcher() i=7 2024-04-24T01:24:42.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f7445da2800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f272e0e0 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.279+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94905664972384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272b5a0 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.280+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94905664972384] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.280+0000 7f72f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.280+0000 7f7445da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.280+0000 7f7445da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.280+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272ddf0 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.281+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'55 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.281+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2737150 con 0x5650f271bcb0 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.283+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.283+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2737150 con 0x5650f2720660 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.284+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.284+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2737bf0 con 0x5650f27172c0 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.285+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'180 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.285+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27367c0 con 0x7f7438038040 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.286+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.286+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f27367c0 con 0x5650f2720660 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.287+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'51 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.287+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2738dd0 con 0x5650f27172c0 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.288+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.288+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2738dd0 con 0x5650f271bcb0 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.289+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.289+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x7f7438038040 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.290+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.290+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x5650f2720660 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.291+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.291+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.292+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.292+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x5650f271bcb0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.293+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.293+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.294+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.294+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x5650f271bcb0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.296+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'57 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.296+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x5650f27172c0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.297+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'181 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.297+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735720 con 0x5650f2720660 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.298+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.298+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.299+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.299+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f2720660 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.300+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'35 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.300+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f27172c0 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.301+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.301+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f27172c0 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.302+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'182 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.302+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f2720660 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.303+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.303+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x7f7438038040 2024-04-24T01:24:42.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.304+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.304+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.305+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.305+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2739930 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.306+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'41 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.306+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.307+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.307+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.308+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'52 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.308+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f271bcb0 2024-04-24T01:24:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.309+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.309+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f2720660 2024-04-24T01:24:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.310+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'36 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.310+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f271bcb0 2024-04-24T01:24:42.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.311+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.311+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f2720660 2024-04-24T01:24:42.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.312+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.312+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x5650f271bcb0 2024-04-24T01:24:42.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.313+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'58 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.313+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2735130 con 0x7f7438038040 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.314+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.314+0000 7f72f8fe1640 20 reqs_thread_entry: start 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.314+0000 7f7445da2800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.314+0000 7f7445da2800 20 Filter name: none 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f72727fc640 20 reqs_thread_entry: start 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f27646a0 con 0x5650f27172c0 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:42.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5650f2764680 con 0x7f7438038040 2024-04-24T01:24:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.315+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:24:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.316+0000 7f72f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.316+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94905664972384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2737740 con 0x5650f27172c0 2024-04-24T01:24:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.317+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94905664972384] v34'183 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.317+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94905664948720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272a660 con 0x7f7438038040 2024-04-24T01:24:42.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.318+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94905664948720] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.318+0000 7f7445da2800 20 remove_watcher() i=0 2024-04-24T01:24:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.318+0000 7f7445da2800 2 removed watcher, disabling cache 2024-04-24T01:24:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.318+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94905664952576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272a660 con 0x5650f27172c0 2024-04-24T01:24:42.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.319+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94905664952576] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.319+0000 7f7445da2800 20 remove_watcher() i=1 2024-04-24T01:24:42.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.319+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94905664946240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2725900 con 0x5650f2720660 2024-04-24T01:24:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.320+0000 7f74430a7640 1 -- 172.21.15.169:0/2431816802 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94905664946240] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7438009050 con 0x5650f2720660 2024-04-24T01:24:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.320+0000 7f7445da2800 20 remove_watcher() i=2 2024-04-24T01:24:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.320+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94905664958576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272a660 con 0x7f7438038040 2024-04-24T01:24:42.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.321+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94905664958576] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x7f7438038040 2024-04-24T01:24:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.321+0000 7f7445da2800 20 remove_watcher() i=3 2024-04-24T01:24:42.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.321+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94905664962128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2725900 con 0x5650f27172c0 2024-04-24T01:24:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.322+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94905664962128] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f743c032040 con 0x5650f27172c0 2024-04-24T01:24:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.322+0000 7f7445da2800 20 remove_watcher() i=4 2024-04-24T01:24:42.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.322+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94905664959632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2727070 con 0x5650f271bcb0 2024-04-24T01:24:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.323+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94905664959632] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.323+0000 7f7445da2800 20 remove_watcher() i=5 2024-04-24T01:24:42.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.323+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94905664964336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f272a660 con 0x5650f271bcb0 2024-04-24T01:24:42.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.324+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94905664964336] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.324+0000 7f7445da2800 20 remove_watcher() i=6 2024-04-24T01:24:42.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.324+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94905664971328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5650f2727e50 con 0x5650f271bcb0 2024-04-24T01:24:42.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.325+0000 7f74438a8640 1 -- 172.21.15.169:0/2431816802 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94905664971328] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7434094020 con 0x5650f271bcb0 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.325+0000 7f7445da2800 20 remove_watcher() i=7 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.325+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f271bcb0 msgr2=0x5650f271e0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.325+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f271bcb0 0x5650f271e0a0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f27172c0 msgr2=0x5650f2719780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f27172c0 0x5650f2719780 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7438038040 msgr2=0x7f743801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7438038040 0x7f743801bab0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5650f2720660 msgr2=0x5650f2722b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5650f2720660 0x5650f2722b20 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f730c036900 msgr2=0x7f730c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f730c036900 0x7f730c038dc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7438001b60 tx=0x7f7438010000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 msgr2=0x5650f270bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f74440a9640 1 -- 172.21.15.169:0/2431816802 reap_dead start 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7434002f20 tx=0x7f743406df30 comp rx=0 tx=0).stop 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 shutdown_connections 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/2431816802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f27049c0 0x5650f270bd60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 >> 172.21.15.169:0/2431816802 conn(0x5650f2700d20 msgr2=0x5650f26fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 shutdown_connections 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/2431816802 wait complete. 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 msgr2=0x7f731c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 0x7f731c038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f743800bf50 tx=0x7f743800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 msgr2=0x5650f26f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f743408c640 tx=0x7f7434078690 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 shutdown_connections 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f731c036950 0x7f731c038e10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1829468034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f26f7880 0x5650f26f7ca0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 >> 172.21.15.169:0/1829468034 conn(0x5650f26eb920 msgr2=0x5650f26ebd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 shutdown_connections 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1829468034 wait complete. 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f26e28e0 msgr2=0x5650f26e4cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5650f26e28e0 0x5650f26e4cd0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f25dd100 msgr2=0x5650f26e0050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5650f25dd100 0x5650f26e0050 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5650f26e6870 msgr2=0x5650f26e8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.326+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5650f26e6870 0x5650f26e8cc0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f732c036900 msgr2=0x7f732c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f732c036900 0x7f732c038dc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7438000f60 tx=0x7f74380012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 msgr2=0x5650f26d8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 --2- 172.21.15.169:0/1277969345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5650f25dc7a0 0x5650f26d8e10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f743405f040 tx=0x7f7434002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f74440a9640 1 -- 172.21.15.169:0/1277969345 reap_dead start 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 shutdown_connections 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 >> 172.21.15.169:0/1277969345 conn(0x5650f25d8320 msgr2=0x5650f26cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 shutdown_connections 2024-04-24T01:24:42.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.327+0000 7f7445da2800 1 -- 172.21.15.169:0/1277969345 wait complete. 2024-04-24T01:24:42.335 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:24:42.344 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-04-24T01:24:42.349 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.373 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.382 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.427 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T01:24:42.432 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.432 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:24:42.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:24:42.432 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:24:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:42.476 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:42.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.476+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.476+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed24287800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562169fc42c0 0x562169fccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed24287800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562169e82d40 con 0x562169fc2780 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed24287800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x562169e554d0 con 0x562169fc42c0 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21585640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562169fc42c0 0x562169fccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21585640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562169fc42c0 0x562169fccdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51954/0 (socket says 172.21.15.169:51954) 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21585640 1 -- 172.21.15.169:0/3950728721 learned_addr learned my addr 172.21.15.169:0/3950728721 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21d86640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x562169fc2780 0x562169fc2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39814/0 (socket says 172.21.15.169:39814) 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21585640 1 -- 172.21.15.169:0/3950728721 >> v1:172.21.15.142:6789/0 conn(0x562169fc2780 legacy=0x562169fc2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed20d84640 1 -- 172.21.15.169:0/3950728721 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034686768 0 0) 0x562169e82d40 con 0x562169fc2780 2024-04-24T01:24:42.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.477+0000 7fed21585640 1 -- 172.21.15.169:0/3950728721 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562169e81590 con 0x562169fc42c0 2024-04-24T01:24:42.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.479+0000 7fed21585640 1 --2- 172.21.15.169:0/3950728721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc42c0 0x562169fccdc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fed1800a520 tx=0x7fed1801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b644bc0adc1ac455 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.479+0000 7fed20d84640 1 -- 172.21.15.169:0/3950728721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed18057070 con 0x562169fc42c0 2024-04-24T01:24:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.479+0000 7fed20d84640 1 -- 172.21.15.169:0/3950728721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed18052440 con 0x562169fc42c0 2024-04-24T01:24:42.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.479+0000 7fed20d84640 1 -- 172.21.15.169:0/3950728721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1804ae60 con 0x562169fc42c0 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 -- 172.21.15.169:0/3950728721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc42c0 msgr2=0x562169fccdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 --2- 172.21.15.169:0/3950728721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc42c0 0x562169fccdc0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fed1800a520 tx=0x7fed1801d010 comp rx=0 tx=0).stop 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 -- 172.21.15.169:0/3950728721 shutdown_connections 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 --2- 172.21.15.169:0/3950728721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc42c0 0x562169fccdc0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 -- 172.21.15.169:0/3950728721 >> 172.21.15.169:0/3950728721 conn(0x562169fbe3a0 msgr2=0x562169fc07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 -- 172.21.15.169:0/3950728721 shutdown_connections 2024-04-24T01:24:42.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.480+0000 7fed24287800 1 -- 172.21.15.169:0/3950728721 wait complete. 2024-04-24T01:24:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.491+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.491+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed24287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed24287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562169f0f3b0 con 0x562169fc2780 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51970/0 (socket says 172.21.15.169:51970) 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed21d86640 1 -- 172.21.15.169:0/148418338 learned_addr learned my addr 172.21.15.169:0/148418338 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed21d86640 1 -- 172.21.15.169:0/148418338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0b78b0 con 0x562169fc2780 2024-04-24T01:24:42.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.492+0000 7fed21d86640 1 --2- 172.21.15.169:0/148418338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b210 tx=0x7fed1400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ca4d78682019d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fec0fe07640 1 -- 172.21.15.169:0/148418338 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14008070 con 0x562169fc2780 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fec0fe07640 1 -- 172.21.15.169:0/148418338 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1400d500 con 0x562169fc2780 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fec0fe07640 1 -- 172.21.15.169:0/148418338 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1400d840 con 0x562169fc2780 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 -- 172.21.15.169:0/148418338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 msgr2=0x56216a0b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 --2- 172.21.15.169:0/148418338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fed1400b210 tx=0x7fed1400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 -- 172.21.15.169:0/148418338 shutdown_connections 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 --2- 172.21.15.169:0/148418338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0b72e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 -- 172.21.15.169:0/148418338 >> 172.21.15.169:0/148418338 conn(0x562169fbe3a0 msgr2=0x56216a0b2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 -- 172.21.15.169:0/148418338 shutdown_connections 2024-04-24T01:24:42.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.493+0000 7fed24287800 1 -- 172.21.15.169:0/148418338 wait complete. 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed24287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0bee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed24287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562169fcf5e0 con 0x562169fc2780 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0bee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51980/0 (socket says 172.21.15.169:51980) 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed21d86640 1 -- 172.21.15.169:0/2344573805 learned_addr learned my addr 172.21.15.169:0/2344573805 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed21d86640 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0bf3d0 con 0x562169fc2780 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.494+0000 7fed21d86640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0bee90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fed14001e60 tx=0x7fed14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fec0e604640 1 -- 172.21.15.169:0/2344573805 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14019870 con 0x562169fc2780 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fec0e604640 1 -- 172.21.15.169:0/2344573805 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14019a10 con 0x562169fc2780 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56216a0bf660 con 0x562169fc2780 2024-04-24T01:24:42.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fec0e604640 1 -- 172.21.15.169:0/2344573805 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14019cf0 con 0x562169fc2780 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216a0c2310 con 0x562169fc2780 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.495+0000 7fec0e604640 1 -- 172.21.15.169:0/2344573805 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed14017040 con 0x562169fc2780 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fec0e604640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec08036900 0x7fec08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fec0e604640 1 -- 172.21.15.169:0/2344573805 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed14015020 con 0x562169fc2780 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed21585640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec08036900 0x7fec08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562169fc42c0 0x56216a0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a0c6650 con 0x562169fc42c0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed22587640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562169fc42c0 0x56216a0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed21585640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec08036900 0x7fec08038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fed18054000 tx=0x7fed1804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed22587640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562169fc42c0 0x56216a0c60d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed22587640 1 -- 172.21.15.169:0/2344573805 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed1c00a4a0 con 0x562169fc42c0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.496+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a0c36a0 con 0x562169fc42c0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.497+0000 7fed22587640 1 -- 172.21.15.169:0/2344573805 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed1c00a4a0 con 0x562169fc42c0 2024-04-24T01:24:42.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.497+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a0c8980 0x56216a0cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.497+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a0cb460 con 0x56216a0c8980 2024-04-24T01:24:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.497+0000 7fed21d86640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a0c8980 0x56216a0cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.497+0000 7fed21d86640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a0c8980 0x56216a0cad70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed21d86640 1 -- 172.21.15.169:0/2344573805 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed1402d070 con 0x56216a0c8980 2024-04-24T01:24:42.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a0c7930 con 0x562169fc42c0 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed22587640 1 -- 172.21.15.169:0/2344573805 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed1c00a4a0 con 0x562169fc42c0 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56216a0cc910 0x56216a0ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a0cf4c0 con 0x56216a0cc910 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed21585640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56216a0cc910 0x56216a0ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.498+0000 7fed21585640 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56216a0cc910 0x56216a0ced60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed21585640 1 -- 172.21.15.169:0/2344573805 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed1805a040 con 0x56216a0cc910 2024-04-24T01:24:42.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed24287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed24287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562169eb56b0 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51982/0 (socket says 172.21.15.169:51982) 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.499+0000 7fed21d86640 1 -- 172.21.15.169:0/150847934 learned_addr learned my addr 172.21.15.169:0/150847934 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fed21d86640 1 -- 172.21.15.169:0/150847934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0de280 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fed21d86640 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fed1401a530 tx=0x7fed1400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fec077fe640 1 -- 172.21.15.169:0/150847934 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14044a40 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fec077fe640 1 -- 172.21.15.169:0/150847934 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14044be0 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56216a0decf0 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fec077fe640 1 -- 172.21.15.169:0/150847934 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14044ee0 con 0x56216a0dd920 2024-04-24T01:24:42.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.500+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216a0df1f0 con 0x56216a0dd920 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fec077fe640 1 -- 172.21.15.169:0/150847934 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed1403f250 con 0x56216a0dd920 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fec077fe640 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 0x7febfc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fec077fe640 1 -- 172.21.15.169:0/150847934 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed14008280 con 0x56216a0dd920 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed21585640 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 0x7febfc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed21585640 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 0x7febfc038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56216a0c6f30 tx=0x7fed18005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed24287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.501+0000 7fed24287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56216a0b7c30 con 0x56216a0eaa90 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:51988/0 (socket says 172.21.15.169:51988) 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed21d86640 1 -- 172.21.15.169:0/4235003570 learned_addr learned my addr 172.21.15.169:0/4235003570 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed21d86640 1 -- 172.21.15.169:0/4235003570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0eb480 con 0x56216a0eaa90 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed21d86640 1 --2- 172.21.15.169:0/4235003570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fed14025a90 tx=0x7fed14013500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602765d9f483683e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fec057fa640 1 -- 172.21.15.169:0/4235003570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1403e040 con 0x56216a0eaa90 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fec057fa640 1 -- 172.21.15.169:0/4235003570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed14025750 con 0x56216a0eaa90 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fec057fa640 1 -- 172.21.15.169:0/4235003570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14030da0 con 0x56216a0eaa90 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed24287800 1 -- 172.21.15.169:0/4235003570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 msgr2=0x56216a0eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed24287800 1 --2- 172.21.15.169:0/4235003570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fed14025a90 tx=0x7fed14013500 comp rx=0 tx=0).stop 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed24287800 1 -- 172.21.15.169:0/4235003570 shutdown_connections 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed24287800 1 --2- 172.21.15.169:0/4235003570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0eaeb0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.502+0000 7fed24287800 1 -- 172.21.15.169:0/4235003570 >> 172.21.15.169:0/4235003570 conn(0x56216a0e6d10 msgr2=0x56216a0e4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 -- 172.21.15.169:0/4235003570 shutdown_connections 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 -- 172.21.15.169:0/4235003570 wait complete. 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 Processor -- start 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 -- start start 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed24287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56216a0ebaf0 con 0x56216a0eaa90 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed21d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52004/0 (socket says 172.21.15.169:52004) 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 learned_addr learned my addr 172.21.15.169:0/4117329165 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.503+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56216a0f22f0 con 0x56216a0eaa90 2024-04-24T01:24:42.526 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7fed21d86640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0f1db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed14001600 tx=0x7fed1401ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7febf37fe640 1 -- 172.21.15.169:0/4117329165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1406d070 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7febf37fe640 1 -- 172.21.15.169:0/4117329165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1403f540 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56216a0f22f0 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7febf37fe640 1 -- 172.21.15.169:0/4117329165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1403e040 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.504+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56216a0f22f0 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7febf37fe640 1 -- 172.21.15.169:0/4117329165 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed14070070 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7febf37fe640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febec036900 0x7febec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7febf37fe640 1 -- 172.21.15.169:0/4117329165 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed14065070 con 0x56216a0eaa90 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed21585640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febec036900 0x7febec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed21585640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febec036900 0x7febec038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56216a0cf8c0 tx=0x7fed1804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56216a0fd4f0 0x56216a0ff9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.527 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a100100 con 0x56216a0fd4f0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.505+0000 7fed22587640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56216a0fd4f0 0x56216a0ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed22587640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56216a0fd4f0 0x56216a0ff9b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 realm 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a100510 con 0x56216a0fd4f0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:42.528 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a100de0 con 0x56216a0fd4f0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.506+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a101ee0 0x56216a1042d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a1048e0 con 0x56216a101ee0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed21d86640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a101ee0 0x56216a1042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed21d86640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a101ee0 0x56216a1042d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.529 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 20 searching for the correct realm 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.507+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56216a106890 0x56216a108d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a109420 con 0x56216a106890 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed21585640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56216a106890 0x56216a108d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed21585640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56216a106890 0x56216a108d50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed21585640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed18082040 0x7fed18083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a109420 con 0x7fed18082040 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.508+0000 7fed22587640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed18082040 0x7fed18083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed22587640 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed18082040 0x7fed18083430 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x7fed18082040 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.530 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.509+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.510+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x7fed18082040 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x7fed18082040 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.531 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.511+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c00a4a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x7fed18082040 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.512+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.513+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.514+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x7fed18082040 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.515+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x7fed18082040 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a106890 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.516+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x56216a0fd4f0 2024-04-24T01:24:42.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56216a101180 con 0x7fed18082040 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a1051a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.517+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a1051a0 con 0x56216a0fd4f0 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a1051a0 con 0x7fed18082040 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 zone default found 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 4 Realm: () 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 zonegroup default 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a105a40 con 0x56216a101ee0 2024-04-24T01:24:42.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.518+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a10b280 con 0x56216a106890 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a10b620 con 0x56216a106890 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 started sync module instance, tier type = 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.519+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10a720 con 0x7fed18082040 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.520+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.520+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94701513386768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10a720 con 0x7fed18082040 2024-04-24T01:24:42.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.520+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10be70 con 0x56216a0fd4f0 2024-04-24T01:24:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.521+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94701513386768] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.521+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.521+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94701513391008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10a720 con 0x56216a0fd4f0 2024-04-24T01:24:42.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.521+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10c900 con 0x56216a106890 2024-04-24T01:24:42.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.522+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94701513391008] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.523+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.523+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94701513384560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10a690 con 0x56216a106890 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.523+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10d7c0 con 0x7fed18082040 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.524+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94701513384560] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.524+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.524+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94701513397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10d730 con 0x7fed18082040 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.524+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10e680 con 0x56216a0fd4f0 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.525+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94701513397008] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.525+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.525+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94701513399104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10e680 con 0x56216a0fd4f0 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.525+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10f040 con 0x56216a101ee0 2024-04-24T01:24:42.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.526+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.526+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94701513403280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10f890 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.526+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1102f0 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.526+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94701513399104] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.527+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94701513403280] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.527+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.527+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94701513405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10fdd0 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.527+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a110bd0 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94701513405408] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94701513410272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a110ff0 con 0x56216a101ee0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=0 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=1 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=2 2024-04-24T01:24:42.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=3 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=4 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=5 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.528+0000 7fed24287800 20 add_watcher() i=6 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94701513410272] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed24287800 20 add_watcher() i=7 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed24287800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a10e290 con 0x56216a0fd4f0 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.529+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94701513411328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a10e290 con 0x56216a0fd4f0 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.530+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94701513411328] v34'184 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.530+0000 7febd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.530+0000 7fed24287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.530+0000 7fed24287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:42.552 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 5 note: GC not initialized 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7febd27fc640 20 reqs_thread_entry: start 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 20 Filter name: none 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7feb43fff640 20 reqs_thread_entry: start 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.531+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a1479a0 con 0x7fed18082040 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 : miss 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.553 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.15 8:a886c100:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a149420 con 0x56216a106890 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 info.flags=0x17 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 to cache LRU end 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 20 get_obj_state: octx=0x7fed14039660 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56216a14bda8 s->prefetch_data=0 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.532+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 3.29s0 3:96c7ece6:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56216a14cfa0 con 0x56216a101ee0 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.533+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(64 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.533+0000 7fed24287800 10 manifest: total_size = 5 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.533+0000 7fed24287800 20 get_obj_state: setting s->obj_tag to _piuPU8oZbFgeHTRO5bIjtu_32t4Wmja 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.533+0000 7febd37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.533+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94701513411328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x56216a0fd4f0 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.534+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94701513411328] v34'185 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.534+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94701513386768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a14cfa0 con 0x7fed18082040 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.535+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94701513386768] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.535+0000 7fed24287800 20 remove_watcher() i=0 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.535+0000 7fed24287800 2 removed watcher, disabling cache 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.535+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94701513391008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a14cfa0 con 0x56216a0fd4f0 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.537+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94701513391008] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.537+0000 7fed24287800 20 remove_watcher() i=1 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.537+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94701513384560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a14cfa0 con 0x56216a106890 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.538+0000 7fed21585640 1 -- 172.21.15.169:0/4117329165 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94701513384560] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1807f070 con 0x56216a106890 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.538+0000 7fed24287800 20 remove_watcher() i=2 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.538+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94701513397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x7fed18082040 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.539+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94701513397008] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x7fed18082040 2024-04-24T01:24:42.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.539+0000 7fed24287800 20 remove_watcher() i=3 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.539+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94701513399104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x56216a0fd4f0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.540+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94701513399104] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c032040 con 0x56216a0fd4f0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.540+0000 7fed24287800 20 remove_watcher() i=4 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.540+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94701513403280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.541+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94701513403280] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.541+0000 7fed24287800 20 remove_watcher() i=5 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.541+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94701513405408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.542+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94701513405408] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.542+0000 7fed24287800 20 remove_watcher() i=6 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.542+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94701513410272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56216a1452f0 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed21d86640 1 -- 172.21.15.169:0/4117329165 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94701513410272] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1406f030 con 0x56216a101ee0 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 20 remove_watcher() i=7 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a101ee0 msgr2=0x56216a1042d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a101ee0 0x56216a1042d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56216a0fd4f0 msgr2=0x56216a0ff9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56216a0fd4f0 0x56216a0ff9b0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed18082040 msgr2=0x7fed18083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed18082040 0x7fed18083430 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56216a106890 msgr2=0x56216a108d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56216a106890 0x56216a108d50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febec036900 msgr2=0x7febec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febec036900 0x7febec038dc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x56216a0cf8c0 tx=0x7fed1804f000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 msgr2=0x56216a0f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 --2- 172.21.15.169:0/4117329165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0eaa90 0x56216a0f1db0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed14001600 tx=0x7fed1401ee70 comp rx=0 tx=0).stop 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 reap_dead start 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed22587640 1 -- 172.21.15.169:0/4117329165 reap_dead start 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 shutdown_connections 2024-04-24T01:24:42.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 >> 172.21.15.169:0/4117329165 conn(0x56216a0e6d10 msgr2=0x56216a0e4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 shutdown_connections 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.543+0000 7fed24287800 1 -- 172.21.15.169:0/4117329165 wait complete. 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 msgr2=0x7febfc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 0x7febfc038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x56216a0c6f30 tx=0x7fed18005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 msgr2=0x56216a0ddd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fed1401a530 tx=0x7fed1400ed50 comp rx=0 tx=0).stop 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 shutdown_connections 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febfc036950 0x7febfc038e10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/150847934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56216a0dd920 0x56216a0ddd40 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 >> 172.21.15.169:0/150847934 conn(0x56216a0d19c0 msgr2=0x56216a0d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 shutdown_connections 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/150847934 wait complete. 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a0c8980 msgr2=0x56216a0cad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56216a0c8980 0x56216a0cad70 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562169fc42c0 msgr2=0x56216a0c60d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562169fc42c0 0x56216a0c60d0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56216a0cc910 msgr2=0x56216a0ced60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56216a0cc910 0x56216a0ced60 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec08036900 msgr2=0x7fec08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec08036900 0x7fec08038dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fed18054000 tx=0x7fed1804e000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 msgr2=0x56216a0bee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 --2- 172.21.15.169:0/2344573805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562169fc2780 0x56216a0bee90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fed14001e60 tx=0x7fed14000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed22587640 1 -- 172.21.15.169:0/2344573805 reap_dead start 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 shutdown_connections 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 >> 172.21.15.169:0/2344573805 conn(0x562169fbe3a0 msgr2=0x56216a0b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 shutdown_connections 2024-04-24T01:24:42.559 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.544+0000 7fed24287800 1 -- 172.21.15.169:0/2344573805 wait complete. 2024-04-24T01:24:42.561 INFO:teuthology.orchestra.run.smithi169.stdout:fooFoofooFooFULL_CONTROL 2024-04-24T01:24:42.561 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-04-24T01:24:42.563 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-04-24T01:24:42.568 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.569 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:24:42.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-04-24T01:24:42.569 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9424287800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b5537697a0 0x55b553769bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9424287800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b553629d40 con 0x55b55376a100 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9424287800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b5535fc4d0 con 0x55b5537697a0 2024-04-24T01:24:42.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.613+0000 7f9421d86640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b5537697a0 0x55b553769bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.614+0000 7f9421585640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b55376a100 0x55b55376a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39824/0 (socket says 172.21.15.169:39824) 2024-04-24T01:24:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.614+0000 7f9421585640 1 -- 172.21.15.169:0/2450384429 learned_addr learned my addr 172.21.15.169:0/2450384429 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.614+0000 7f9421d86640 1 --2- 172.21.15.169:0/2450384429 >> v2:172.21.15.142:3300/0 conn(0x55b5537697a0 0x55b553769bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52008/0 (socket says 172.21.15.169:52008) 2024-04-24T01:24:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.614+0000 7f9421d86640 1 -- 172.21.15.169:0/2450384429 >> v1:172.21.15.142:6789/0 conn(0x55b55376a100 legacy=0x55b55376a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.614+0000 7f9421d86640 1 -- 172.21.15.169:0/2450384429 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b553628590 con 0x55b5537697a0 2024-04-24T01:24:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9421d86640 1 --2- 172.21.15.169:0/2450384429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553769bc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f941400a470 tx=0x7f941401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a258b50052fb95 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9420d84640 1 -- 172.21.15.169:0/2450384429 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414057070 con 0x55b5537697a0 2024-04-24T01:24:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9420d84640 1 -- 172.21.15.169:0/2450384429 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941404adc0 con 0x55b5537697a0 2024-04-24T01:24:42.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9420d84640 1 -- 172.21.15.169:0/2450384429 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414052590 con 0x55b5537697a0 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 -- 172.21.15.169:0/2450384429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 msgr2=0x55b553769bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 --2- 172.21.15.169:0/2450384429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553769bc0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f941400a470 tx=0x7f941401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 -- 172.21.15.169:0/2450384429 shutdown_connections 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 --2- 172.21.15.169:0/2450384429 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553769bc0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 -- 172.21.15.169:0/2450384429 >> 172.21.15.169:0/2450384429 conn(0x55b553765340 msgr2=0x55b553767760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 -- 172.21.15.169:0/2450384429 shutdown_connections 2024-04-24T01:24:42.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.616+0000 7f9424287800 1 -- 172.21.15.169:0/2450384429 wait complete. 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9424287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9424287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b5536b63b0 con 0x55b5537697a0 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52014/0 (socket says 172.21.15.169:52014) 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.628+0000 7f9421d86640 1 -- 172.21.15.169:0/902338914 learned_addr learned my addr 172.21.15.169:0/902338914 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.629+0000 7f9421d86640 1 -- 172.21.15.169:0/902338914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b55385ea40 con 0x55b5537697a0 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.629+0000 7f9421d86640 1 --2- 172.21.15.169:0/902338914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9414055040 tx=0x7f941404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920de2a453001269 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.629+0000 7f930fe07640 1 -- 172.21.15.169:0/902338914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414057040 con 0x55b5537697a0 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.629+0000 7f930fe07640 1 -- 172.21.15.169:0/902338914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9414062070 con 0x55b5537697a0 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.629+0000 7f930fe07640 1 -- 172.21.15.169:0/902338914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941405d470 con 0x55b5537697a0 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- 172.21.15.169:0/902338914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 msgr2=0x55b55385e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 --2- 172.21.15.169:0/902338914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9414055040 tx=0x7f941404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- 172.21.15.169:0/902338914 shutdown_connections 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 --2- 172.21.15.169:0/902338914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b55385e470 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- 172.21.15.169:0/902338914 >> 172.21.15.169:0/902338914 conn(0x55b553765340 msgr2=0x55b553859d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- 172.21.15.169:0/902338914 shutdown_connections 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- 172.21.15.169:0/902338914 wait complete. 2024-04-24T01:24:42.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553865fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9424287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b55376af60 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553865fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553865fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52016/0 (socket says 172.21.15.169:52016) 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.630+0000 7f9421d86640 1 -- 172.21.15.169:0/3382867452 learned_addr learned my addr 172.21.15.169:0/3382867452 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f9421d86640 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5538664f0 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f9421d86640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553865fb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f941401ce60 tx=0x7f9414002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f930e604640 1 -- 172.21.15.169:0/3382867452 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941406b070 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f930e604640 1 -- 172.21.15.169:0/3382867452 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941405d970 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b553866780 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f930e604640 1 -- 172.21.15.169:0/3382867452 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414057070 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.631+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b553869390 con 0x55b5537697a0 2024-04-24T01:24:42.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f930e604640 1 -- 172.21.15.169:0/3382867452 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f941405dc90 con 0x55b5537697a0 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f930e604640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9308036950 0x7f9308038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f930e604640 1 -- 172.21.15.169:0/3382867452 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f941408e230 con 0x55b5537697a0 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f9421585640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9308036950 0x7f9308038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b55376a100 0x55b55386d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b55386d690 con 0x55b55376a100 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.632+0000 7f9422587640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b55376a100 0x55b55386d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9421585640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9308036950 0x7f9308038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f60 tx=0x7f94180012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9422587640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b55376a100 0x55b55386d150 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9422587640 1 -- 172.21.15.169:0/3382867452 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b55376a100 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b55386a720 con 0x55b55376a100 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9422587640 1 -- 172.21.15.169:0/3382867452 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b55376a100 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b55386f9c0 0x55b553871db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538724a0 con 0x55b55386f9c0 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.633+0000 7f9421d86640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b55386f9c0 0x55b553871db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9421d86640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b55386f9c0 0x55b553871db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9421d86640 1 -- 172.21.15.169:0/3382867452 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f941405a040 con 0x55b55386f9c0 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b55386e970 con 0x55b55376a100 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9422587640 1 -- 172.21.15.169:0/3382867452 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b55376a100 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b553873950 0x55b553875da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b553876500 con 0x55b553873950 2024-04-24T01:24:42.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.634+0000 7f9421585640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b553873950 0x55b553875da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.635+0000 7f9421585640 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b553873950 0x55b553875da0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.635+0000 7f9421585640 1 -- 172.21.15.169:0/3382867452 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9418009050 con 0x55b553873950 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.635+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.635+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.635+0000 7f9424287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9424287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b55365c6b0 con 0x55b553884960 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52030/0 (socket says 172.21.15.169:52030) 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9421d86640 1 -- 172.21.15.169:0/3746790175 learned_addr learned my addr 172.21.15.169:0/3746790175 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9421d86640 1 -- 172.21.15.169:0/3746790175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5538852c0 con 0x55b553884960 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9421d86640 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f941408c520 tx=0x7f9414072da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f93077fe640 1 -- 172.21.15.169:0/3746790175 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414089070 con 0x55b553884960 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f93077fe640 1 -- 172.21.15.169:0/3746790175 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9414071e30 con 0x55b553884960 2024-04-24T01:24:42.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b553885d30 con 0x55b553884960 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f93077fe640 1 -- 172.21.15.169:0/3746790175 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414009750 con 0x55b553884960 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.636+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b553885d30 con 0x55b553884960 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.637+0000 7f93077fe640 1 -- 172.21.15.169:0/3746790175 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f941408c8d0 con 0x55b553884960 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.637+0000 7f93077fe640 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 0x7f92fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.637+0000 7f93077fe640 1 -- 172.21.15.169:0/3746790175 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f941408fdf0 con 0x55b553884960 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.637+0000 7f9421585640 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 0x7f92fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.637+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421585640 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 0x7f92fc038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f941800bf50 tx=0x7f941800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9424287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9424287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b55385ed00 con 0x55b553891990 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52038/0 (socket says 172.21.15.169:52038) 2024-04-24T01:24:42.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421d86640 1 -- 172.21.15.169:0/190745254 learned_addr learned my addr 172.21.15.169:0/190745254 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421d86640 1 -- 172.21.15.169:0/190745254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b553892380 con 0x55b553891990 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f9421d86640 1 --2- 172.21.15.169:0/190745254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9414094fd0 tx=0x7f9414097440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3716286043465b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f93057fa640 1 -- 172.21.15.169:0/190745254 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9414079d70 con 0x55b553891990 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f93057fa640 1 -- 172.21.15.169:0/190745254 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94140a6070 con 0x55b553891990 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.638+0000 7f93057fa640 1 -- 172.21.15.169:0/190745254 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941408cd10 con 0x55b553891990 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- 172.21.15.169:0/190745254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 msgr2=0x55b553891db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 --2- 172.21.15.169:0/190745254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9414094fd0 tx=0x7f9414097440 comp rx=0 tx=0).stop 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- 172.21.15.169:0/190745254 shutdown_connections 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 --2- 172.21.15.169:0/190745254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553891db0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- 172.21.15.169:0/190745254 >> 172.21.15.169:0/190745254 conn(0x55b55388dc10 msgr2=0x55b55388bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- 172.21.15.169:0/190745254 shutdown_connections 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- 172.21.15.169:0/190745254 wait complete. 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 Processor -- start 2024-04-24T01:24:42.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- start start 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9424287800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b5538929f0 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9421d86640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52050/0 (socket says 172.21.15.169:52050) 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.639+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 learned_addr learned my addr 172.21.15.169:0/3279999828 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b553899290 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f9421d86640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9414097bc0 tx=0x7f9414065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f92f37fe640 1 -- 172.21.15.169:0/3279999828 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941406e800 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f92f37fe640 1 -- 172.21.15.169:0/3279999828 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f941406ea50 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f92f37fe640 1 -- 172.21.15.169:0/3279999828 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f941406ed70 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b553899290 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.640+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b553899290 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.641+0000 7f92f37fe640 1 -- 172.21.15.169:0/3279999828 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94140bc060 con 0x55b553891990 2024-04-24T01:24:42.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.641+0000 7f92f37fe640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92ec036950 0x7f92ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.641+0000 7f92f37fe640 1 -- 172.21.15.169:0/3279999828 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f94140b6d10 con 0x55b553891990 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.641+0000 7f9421585640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92ec036950 0x7f92ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.641+0000 7f9421585640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92ec036950 0x7f92ec038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9418001b60 tx=0x7f9418010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b5538a44c0 0x55b5538a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a70d0 con 0x55b5538a44c0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9422587640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b5538a44c0 0x55b5538a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9422587640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b5538a44c0 0x55b5538a6980 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 realm 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a74e0 con 0x55b5538a44c0 2024-04-24T01:24:42.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.642+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a7db0 con 0x55b5538a44c0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b5538a8eb0 0x55b5538ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ab8b0 con 0x55b5538a8eb0 2024-04-24T01:24:42.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.643+0000 7f9421d86640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b5538a8eb0 0x55b5538ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9421d86640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b5538a8eb0 0x55b5538ab2a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9424287800 20 searching for the correct realm 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b5538ad860 0x55b5538afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b03f0 con 0x55b5538ad860 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9421585640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b5538ad860 0x55b5538afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.644+0000 7f9421585640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b5538ad860 0x55b5538afd20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9421585640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9418038040 0x7f941801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b03f0 con 0x7f9418038040 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9422587640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9418038040 0x7f941801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9422587640 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9418038040 0x7f941801bab0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x7f9418038040 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.645+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.646+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x7f9418038040 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x7f9418038040 2024-04-24T01:24:42.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.647+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c00a4a0 con 0x55b5538a44c0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x7f9418038040 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.648+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.649+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.650+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x7f9418038040 2024-04-24T01:24:42.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.651+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x7f9418038040 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538ad860 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.652+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a8eb0 2024-04-24T01:24:42.669 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.653+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.653+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x55b5538a44c0 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.653+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.653+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b5538a8150 con 0x7f9418038040 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.670 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ac170 con 0x55b5538a44c0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ac170 con 0x55b5538a44c0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ac170 con 0x7f9418038040 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 zone default found 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 4 Realm: () 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:42.671 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 zonegroup default 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.654+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538aca10 con 0x55b5538a8eb0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b2250 con 0x55b5538ad860 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b25f0 con 0x55b5538ad860 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 started sync module instance, tier type = 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.655+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b16f0 con 0x7f9418038040 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.656+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.656+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94237279066896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b16f0 con 0x7f9418038040 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.656+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b2e40 con 0x55b5538a44c0 2024-04-24T01:24:42.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.657+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94237279066896] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.684 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.658+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.658+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94237279071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b16f0 con 0x55b5538a44c0 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.658+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b3890 con 0x55b5538ad860 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.659+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.659+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94237279073184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b4160 con 0x55b5538ad860 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.659+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b4be0 con 0x7f9418038040 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.659+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94237279071088] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.660+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94237279073184] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.660+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.685 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.660+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94237279075504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b1240 con 0x7f9418038040 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.660+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b54b0 con 0x55b5538a44c0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.661+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.661+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94237279080368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b53d0 con 0x55b5538a44c0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.661+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b63d0 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.661+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94237279075504] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.662+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94237279080368] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.662+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.662+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94237279082656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b46d0 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.662+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b6c70 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.663+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94237279082656] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.663+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.663+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94237279084224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b74c0 con 0x55b5538a8eb0 2024-04-24T01:24:42.686 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.663+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b7d90 con 0x55b5538a8eb0 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94237279084224] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94237279088656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b7f90 con 0x55b5538a8eb0 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=0 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=1 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=2 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=3 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=4 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=5 2024-04-24T01:24:42.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.664+0000 7f9424287800 20 add_watcher() i=6 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94237279088656] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9424287800 20 add_watcher() i=7 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9424287800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538bb400 con 0x55b5538a44c0 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.665+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94237279092512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538b87f0 con 0x55b5538a44c0 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.666+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94237279092512] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.666+0000 7f92d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 5 note: GC not initialized 2024-04-24T01:24:42.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f92d27fc640 20 reqs_thread_entry: start 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 Filter name: none 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9243fff640 20 reqs_thread_entry: start 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538eeb40 con 0x7f9418038040 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:42.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 : miss 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.667+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.15 8:a886c100:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538f05a0 con 0x55b5538ad860 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 info.flags=0x17 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 to cache LRU end 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:42.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 20 get_obj_state: octx=0x7f94140be450 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55b5538f2fe8 s->prefetch_data=0 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 3.29s0 3:96c7ece6:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b5538f41e0 con 0x55b5538a8eb0 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(64 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 10 manifest: total_size = 5 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.668+0000 7f9424287800 20 get_obj_state: setting s->obj_tag to _-ct7JfgnTAQp4JwWQu6KB1pYy8cL38r 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.669+0000 7f92d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.669+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94237279092512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x55b5538a44c0 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.670+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94237279092512] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.670+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94237279066896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x7f9418038040 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.671+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94237279066896] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.671+0000 7f9424287800 20 remove_watcher() i=0 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.671+0000 7f9424287800 2 removed watcher, disabling cache 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.671+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94237279071088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538f41e0 con 0x55b5538a44c0 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.672+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94237279071088] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.672+0000 7f9424287800 20 remove_watcher() i=1 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.672+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94237279073184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538f41e0 con 0x55b5538ad860 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.673+0000 7f9421585640 1 -- 172.21.15.169:0/3279999828 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94237279073184] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9418009050 con 0x55b5538ad860 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.673+0000 7f9424287800 20 remove_watcher() i=2 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.673+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94237279075504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x7f9418038040 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.674+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94237279075504] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x7f9418038040 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.674+0000 7f9424287800 20 remove_watcher() i=3 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.674+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94237279080368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x55b5538a44c0 2024-04-24T01:24:42.692 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.675+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94237279080368] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f941c032040 con 0x55b5538a44c0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.675+0000 7f9424287800 20 remove_watcher() i=4 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.675+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94237279082656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.676+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94237279082656] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.676+0000 7f9424287800 20 remove_watcher() i=5 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.676+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94237279084224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.677+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94237279084224] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.677+0000 7f9424287800 20 remove_watcher() i=6 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.677+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94237279088656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b5538ec490 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9421d86640 1 -- 172.21.15.169:0/3279999828 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94237279088656] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9414094020 con 0x55b5538a8eb0 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 20 remove_watcher() i=7 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b5538a8eb0 msgr2=0x55b5538ab2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b5538a8eb0 0x55b5538ab2a0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b5538a44c0 msgr2=0x55b5538a6980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b5538a44c0 0x55b5538a6980 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9418038040 msgr2=0x7f941801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9418038040 0x7f941801bab0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b5538ad860 msgr2=0x55b5538afd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b5538ad860 0x55b5538afd20 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92ec036950 msgr2=0x7f92ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92ec036950 0x7f92ec038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9418001b60 tx=0x7f9418010000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 msgr2=0x55b553898d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9422587640 1 -- 172.21.15.169:0/3279999828 reap_dead start 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9414097bc0 tx=0x7f9414065eb0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 shutdown_connections 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 --2- 172.21.15.169:0/3279999828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553891990 0x55b553898d50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 >> 172.21.15.169:0/3279999828 conn(0x55b55388dc10 msgr2=0x55b55388b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 shutdown_connections 2024-04-24T01:24:42.694 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.678+0000 7f9424287800 1 -- 172.21.15.169:0/3279999828 wait complete. 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 msgr2=0x7f92fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 0x7f92fc038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f941800bf50 tx=0x7f941800f000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 msgr2=0x55b553884d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f941408c520 tx=0x7f9414072da0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 shutdown_connections 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f92fc036950 0x7f92fc038e10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3746790175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b553884960 0x55b553884d80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 >> 172.21.15.169:0/3746790175 conn(0x55b553878a00 msgr2=0x55b553878e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 shutdown_connections 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3746790175 wait complete. 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b55386f9c0 msgr2=0x55b553871db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b55386f9c0 0x55b553871db0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b55376a100 msgr2=0x55b55386d150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.695 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b55376a100 0x55b55386d150 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b553873950 msgr2=0x55b553875da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b553873950 0x55b553875da0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9308036950 msgr2=0x7f9308038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9308036950 0x7f9308038e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9418000f60 tx=0x7f94180012b0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 msgr2=0x55b553865fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 --2- 172.21.15.169:0/3382867452 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b5537697a0 0x55b553865fb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f941401ce60 tx=0x7f9414002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9422587640 1 -- 172.21.15.169:0/3382867452 reap_dead start 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 shutdown_connections 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 >> 172.21.15.169:0/3382867452 conn(0x55b553765340 msgr2=0x55b5538585b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 shutdown_connections 2024-04-24T01:24:42.696 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.679+0000 7f9424287800 1 -- 172.21.15.169:0/3382867452 wait complete. 2024-04-24T01:24:42.697 INFO:teuthology.orchestra.run.smithi169.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T01:24:42.697 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-04-24T01:24:42.700 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-04-24T01:24:42.717 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:42.815 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-04-24T01:24:42.815 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-04-24T01:24:42.815 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-04-24T01:24:42.815 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T01:24:42.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T01:24:42.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-04-24T01:24:42.816 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-04-24T01:24:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:42.861 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.860+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.860+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.860+0000 7fc18df33800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563950e947e0 0x563950e94c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.860+0000 7fc18df33800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563950d54d40 con 0x563950e95140 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.860+0000 7fc18df33800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x563950d274d0 con 0x563950e947e0 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc189bf5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563950e947e0 0x563950e94c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc1813f4640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x563950e95140 0x563950e955f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39832/0 (socket says 172.21.15.169:39832) 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc1813f4640 1 -- 172.21.15.169:0/2369391278 learned_addr learned my addr 172.21.15.169:0/2369391278 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc189bf5640 1 -- 172.21.15.169:0/2369391278 >> v1:172.21.15.142:6789/0 conn(0x563950e95140 legacy=0x563950e955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc1893f4640 1 -- 172.21.15.169:0/2369391278 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154263087 0 0) 0x563950d54d40 con 0x563950e95140 2024-04-24T01:24:42.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.861+0000 7fc189bf5640 1 -- 172.21.15.169:0/2369391278 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950d53590 con 0x563950e947e0 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc189bf5640 1 --2- 172.21.15.169:0/2369391278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950e94c00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00a470 tx=0x7fc17c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d30451b8384a56 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc1893f4640 1 -- 172.21.15.169:0/2369391278 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c057070 con 0x563950e947e0 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc1893f4640 1 -- 172.21.15.169:0/2369391278 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c04adc0 con 0x563950e947e0 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc1893f4640 1 -- 172.21.15.169:0/2369391278 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c052590 con 0x563950e947e0 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 -- 172.21.15.169:0/2369391278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 msgr2=0x563950e94c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 --2- 172.21.15.169:0/2369391278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950e94c00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00a470 tx=0x7fc17c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 -- 172.21.15.169:0/2369391278 shutdown_connections 2024-04-24T01:24:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 --2- 172.21.15.169:0/2369391278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950e94c00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 -- 172.21.15.169:0/2369391278 >> 172.21.15.169:0/2369391278 conn(0x563950e90320 msgr2=0x563950e92740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 -- 172.21.15.169:0/2369391278 shutdown_connections 2024-04-24T01:24:42.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.863+0000 7fc18df33800 1 -- 172.21.15.169:0/2369391278 wait complete. 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.875+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.875+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.875+0000 7fc18df33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.875+0000 7fc18df33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563950de13b0 con 0x563950e947e0 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52076/0 (socket says 172.21.15.169:52076) 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc189bf5640 1 -- 172.21.15.169:0/3094131031 learned_addr learned my addr 172.21.15.169:0/3094131031 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc189bf5640 1 -- 172.21.15.169:0/3094131031 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950f89760 con 0x563950e947e0 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc189bf5640 1 --2- 172.21.15.169:0/3094131031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc17c055040 tx=0x7fc17c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcca7cc0b08a67c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc077e07640 1 -- 172.21.15.169:0/3094131031 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c063070 con 0x563950e947e0 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc077e07640 1 -- 172.21.15.169:0/3094131031 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c00a230 con 0x563950e947e0 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.876+0000 7fc077e07640 1 -- 172.21.15.169:0/3094131031 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c057040 con 0x563950e947e0 2024-04-24T01:24:42.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- 172.21.15.169:0/3094131031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 msgr2=0x563950f89190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 --2- 172.21.15.169:0/3094131031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc17c055040 tx=0x7fc17c04c000 comp rx=0 tx=0).stop 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- 172.21.15.169:0/3094131031 shutdown_connections 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 --2- 172.21.15.169:0/3094131031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f89190 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- 172.21.15.169:0/3094131031 >> 172.21.15.169:0/3094131031 conn(0x563950e90320 msgr2=0x563950f84ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- 172.21.15.169:0/3094131031 shutdown_connections 2024-04-24T01:24:42.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- 172.21.15.169:0/3094131031 wait complete. 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.877+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc18df33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f90c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc18df33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563950e95fa0 con 0x563950e947e0 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f90c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f90c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52084/0 (socket says 172.21.15.169:52084) 2024-04-24T01:24:42.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc189bf5640 1 -- 172.21.15.169:0/2702233456 learned_addr learned my addr 172.21.15.169:0/2702233456 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc189bf5640 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950f911b0 con 0x563950e947e0 2024-04-24T01:24:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc189bf5640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f90c70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc17c061040 tx=0x7fc17c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc076604640 1 -- 172.21.15.169:0/2702233456 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c06c070 con 0x563950e947e0 2024-04-24T01:24:42.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.878+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563950f91440 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.879+0000 7fc076604640 1 -- 172.21.15.169:0/2702233456 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c05d7f0 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.879+0000 7fc076604640 1 -- 172.21.15.169:0/2702233456 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c063040 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.879+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563950f940f0 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.879+0000 7fc076604640 1 -- 172.21.15.169:0/2702233456 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc17c066070 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc076604640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc070036900 0x7fc070038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc076604640 1 -- 172.21.15.169:0/2702233456 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc17c08d4e0 con 0x563950e947e0 2024-04-24T01:24:42.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc1813f4640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc070036900 0x7fc070038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950e95140 0x563950f97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950f983f0 con 0x563950e95140 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950e95140 0x563950f97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc1813f4640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc070036900 0x7fc070038dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc174000c00 tx=0x7fc1740013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.880+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950e95140 0x563950f97eb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc18a3f6640 1 -- 172.21.15.169:0/2702233456 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950e95140 2024-04-24T01:24:42.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950f95460 con 0x563950e95140 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc18a3f6640 1 -- 172.21.15.169:0/2702233456 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950e95140 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950f9a6e0 0x563950f9cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950f9d1a0 con 0x563950f9a6e0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc189bf5640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950f9a6e0 0x563950f9cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.881+0000 7fc189bf5640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950f9a6e0 0x563950f9cad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc189bf5640 1 -- 172.21.15.169:0/2702233456 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc17c06e070 con 0x563950f9a6e0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950f99690 con 0x563950e95140 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc18a3f6640 1 -- 172.21.15.169:0/2702233456 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950e95140 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563950f9e5e0 0x563950fa0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fa1230 con 0x563950f9e5e0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc1813f4640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563950f9e5e0 0x563950fa0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.882+0000 7fc1813f4640 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563950f9e5e0 0x563950fa0aa0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc1813f4640 1 -- 172.21.15.169:0/2702233456 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc17400f670 con 0x563950f9e5e0 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc18df33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc18df33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563950d876b0 con 0x563950faf6e0 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52096/0 (socket says 172.21.15.169:52096) 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.883+0000 7fc189bf5640 1 -- 172.21.15.169:0/1408464739 learned_addr learned my addr 172.21.15.169:0/1408464739 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc189bf5640 1 -- 172.21.15.169:0/1408464739 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950fb0040 con 0x563950faf6e0 2024-04-24T01:24:42.918 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc189bf5640 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc17c070f10 tx=0x7fc17c08d110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc06f7fe640 1 -- 172.21.15.169:0/1408464739 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c080070 con 0x563950faf6e0 2024-04-24T01:24:42.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc06f7fe640 1 -- 172.21.15.169:0/1408464739 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c05dd00 con 0x563950faf6e0 2024-04-24T01:24:42.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563950fb0ab0 con 0x563950faf6e0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc06f7fe640 1 -- 172.21.15.169:0/1408464739 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c08b970 con 0x563950faf6e0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.884+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563950fb0fb0 con 0x563950faf6e0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc06f7fe640 1 -- 172.21.15.169:0/1408464739 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc17c08bb10 con 0x563950faf6e0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc06f7fe640 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 0x7fc064038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc06f7fe640 1 -- 172.21.15.169:0/1408464739 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc17c087050 con 0x563950faf6e0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 0x7fc064038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 0x7fc064038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563950f98880 tx=0x7fc174006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc18df33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.885+0000 7fc18df33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563950f89a20 con 0x563950fbc820 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52110/0 (socket says 172.21.15.169:52110) 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc189bf5640 1 -- 172.21.15.169:0/2912814964 learned_addr learned my addr 172.21.15.169:0/2912814964 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc189bf5640 1 -- 172.21.15.169:0/2912814964 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950fbd210 con 0x563950fbc820 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc189bf5640 1 --2- 172.21.15.169:0/2912814964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc17c08a010 tx=0x7fc17c0679d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80efd83a0134245 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc06d7fa640 1 -- 172.21.15.169:0/2912814964 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c067c40 con 0x563950fbc820 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc06d7fa640 1 -- 172.21.15.169:0/2912814964 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c0a6070 con 0x563950fbc820 2024-04-24T01:24:42.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc06d7fa640 1 -- 172.21.15.169:0/2912814964 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c08da10 con 0x563950fbc820 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc18df33800 1 -- 172.21.15.169:0/2912814964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 msgr2=0x563950fbcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.886+0000 7fc18df33800 1 --2- 172.21.15.169:0/2912814964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc17c08a010 tx=0x7fc17c0679d0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- 172.21.15.169:0/2912814964 shutdown_connections 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 --2- 172.21.15.169:0/2912814964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fbcc40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- 172.21.15.169:0/2912814964 >> 172.21.15.169:0/2912814964 conn(0x563950fb8b30 msgr2=0x563950fb6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- 172.21.15.169:0/2912814964 shutdown_connections 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- 172.21.15.169:0/2912814964 wait complete. 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 Processor -- start 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- start start 2024-04-24T01:24:42.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc18df33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563950fbd8a0 con 0x563950fbc820 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc189bf5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52120/0 (socket says 172.21.15.169:52120) 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 learned_addr learned my addr 172.21.15.169:0/1012750254 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.887+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563950fc4120 con 0x563950fbc820 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc189bf5640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc17c08eff0 tx=0x7fc17c092f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc05b7fe640 1 -- 172.21.15.169:0/1012750254 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c009a00 con 0x563950fbc820 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc05b7fe640 1 -- 172.21.15.169:0/1012750254 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c05b600 con 0x563950fbc820 2024-04-24T01:24:42.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563950fc4120 con 0x563950fbc820 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc05b7fe640 1 -- 172.21.15.169:0/1012750254 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc17c05b900 con 0x563950fbc820 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563950fc4120 con 0x563950fbc820 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.888+0000 7fc05b7fe640 1 -- 172.21.15.169:0/1012750254 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc17c09f030 con 0x563950fbc820 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc05b7fe640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc054036950 0x7fc054038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc05b7fe640 1 -- 172.21.15.169:0/1012750254 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc17c063d40 con 0x563950fbc820 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc054036950 0x7fc054038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc054036950 0x7fc054038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563950fa1630 tx=0x7fc174023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950fcf280 0x563950fd1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd1e90 con 0x563950fcf280 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.889+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950fcf280 0x563950fd1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950fcf280 0x563950fd1740 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 realm 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd22a0 con 0x563950fcf280 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:42.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2b70 con 0x563950fcf280 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.890+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950fd3c70 0x563950fd6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd6620 con 0x563950fd3c70 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc189bf5640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950fd3c70 0x563950fd6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc189bf5640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950fd3c70 0x563950fd6060 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.891+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc18df33800 20 searching for the correct realm 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563950fd85d0 0x563950fdaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fdb160 con 0x563950fd85d0 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563950fd85d0 0x563950fdaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563950fd85d0 0x563950fdaa90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc1813f4640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc17403a3c0 0x7fc17403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fdb160 con 0x7fc17403a3c0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.892+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc17403a3c0 0x7fc17403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.893+0000 7fc18a3f6640 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc17403a3c0 0x7fc17403a810 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.893+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x7fc17403a3c0 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.893+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.894+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x7fc17403a3c0 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x7fc17403a3c0 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.895+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc18400a4a0 con 0x563950fcf280 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x7fc17403a3c0 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.896+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.897+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.898+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x7fc17403a3c0 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.899+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x7fc17403a3c0 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd85d0 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.900+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fd3c70 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x563950fcf280 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563950fd2f10 con 0x7fc17403a3c0 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.901+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd6ee0 con 0x563950fcf280 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.936 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd6ee0 con 0x563950fcf280 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd6ee0 con 0x7fc17403a3c0 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 zone default found 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 4 Realm: () 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:42.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 zonegroup default 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.902+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fd7780 con 0x563950fd3c70 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fdcfc0 con 0x563950fd85d0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fdd360 con 0x563950fd85d0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 started sync module instance, tier type = 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.903+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc460 con 0x7fc17403a3c0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.904+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.904+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804171934048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc460 con 0x7fc17403a3c0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.904+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fddd20 con 0x563950fcf280 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.905+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804171934048] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.905+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.906+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804171932048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fddd20 con 0x563950fcf280 2024-04-24T01:24:42.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.906+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fde720 con 0x563950fd85d0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.907+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804171932048] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.907+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.907+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804171937904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fddc90 con 0x563950fd85d0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.907+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdf5e0 con 0x7fc17403a3c0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.908+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804171937904] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.908+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.908+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804171944240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdfa00 con 0x7fc17403a3c0 2024-04-24T01:24:42.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.908+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe03c0 con 0x563950fcf280 2024-04-24T01:24:42.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.911+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.911+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804171947792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe07e0 con 0x563950fcf280 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.911+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe1280 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.911+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804171944240] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.912+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804171947792] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.912+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.912+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804171945296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe07e0 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.912+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe1b20 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.913+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804171945296] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.913+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.913+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804171948848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe2370 con 0x563950fd3c70 2024-04-24T01:24:42.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.913+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe2d30 con 0x563950fd3c70 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804171948848] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804171956384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe2d30 con 0x563950fd3c70 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=0 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=1 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=2 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=3 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=4 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=5 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.914+0000 7fc18df33800 20 add_watcher() i=6 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.915+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804171956384] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.915+0000 7fc18df33800 20 add_watcher() i=7 2024-04-24T01:24:42.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.915+0000 7fc18df33800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.915+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563950fe6060 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.916+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.916+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804171958768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe32c0 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.917+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804171958768] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.917+0000 7fc03b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.917+0000 7fc18df33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.917+0000 7fc18df33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.917+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fe5800 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.918+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'56 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.918+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fef120 con 0x563950fd3c70 2024-04-24T01:24:42.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.919+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.919+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fef120 con 0x563950fd85d0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.921+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.921+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fefb80 con 0x563950fcf280 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.921+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'189 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.921+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fee790 con 0x7fc17403a3c0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.922+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.922+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fee790 con 0x563950fd85d0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.923+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'53 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.923+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0d60 con 0x563950fcf280 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.924+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.924+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0d60 con 0x563950fd3c70 2024-04-24T01:24:42.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.926+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.926+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.926+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.926+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fd85d0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.927+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.927+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.928+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.928+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fd3c70 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.930+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.930+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.930+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.930+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fd3c70 2024-04-24T01:24:42.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.932+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'59 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.932+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fcf280 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.933+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'190 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.933+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fd85d0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.934+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.934+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x7fc17403a3c0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.935+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.935+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.936+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'36 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.936+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fcf280 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.937+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.937+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fcf280 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.938+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'191 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.938+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.939+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.939+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x7fc17403a3c0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.940+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'40 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.940+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.941+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.941+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.942+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'42 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.942+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.943+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.943+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.944+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'54 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.944+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd3c70 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.945+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.945+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff18c0 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.946+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.946+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fed710 con 0x563950fd3c70 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.947+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.948+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff1eb0 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.949+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.949+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff1e00 con 0x563950fd3c70 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.950+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'60 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.950+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff1e00 con 0x7fc17403a3c0 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc03a7fc640 20 reqs_thread_entry: start 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 20 Filter name: none 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fbfabfff640 20 reqs_thread_entry: start 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395101c730 con 0x7fc17403a3c0 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc184032040 con 0x7fc17403a3c0 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.951+0000 7fc18df33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 : miss 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:95 8.15 8:a886c100:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395101e1f0 con 0x563950fd85d0 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(95 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 info.flags=0x17 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 to cache LRU end 2024-04-24T01:24:42.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:96 4.37 4:ee4cb02c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109ba20 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(96 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.952+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:97 4.4 4:212bc456:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109ba20 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(97 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:98 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109ba20 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(98 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc18df33800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-04-24T01:24:42.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 4.2f 4:f506b487:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(99 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.953+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:100 4.3c 4:3db29810:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(100 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 4.22 4:47051493:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(101 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:102 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(102 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [call out=424b] v0'0 uv5 ondisk = 0) ==== 194+0+424 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.954+0000 7fc18df33800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 4.2b 4:d737d4f9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(103 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc184032040 con 0x563950fcf280 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fd3c70 2024-04-24T01:24:42.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(104 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [call out=426b] v0'0 uv7 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc18df33800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.955+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:105 4.34 4:2ef468be:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x7fc17403a3c0 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(105 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:106 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395109bea0 con 0x563950fcf280 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(106 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [call out=697b] v0'0 uv9 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:107 3.9s0 3:91cc1966:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951099750 con 0x563950fd85d0 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(107 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 10 manifest: total_size = 6 2024-04-24T01:24:42.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.3809554337844321539 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 20 prepare_atomic_modification: state is not atomic. state=0x56395101efc8 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.956+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:108 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023e30 con 0x563950fd3c70 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.958+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(108 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.958+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 3.9s0 3:91cc1966:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951021e10 con 0x563950fd85d0 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.959+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(109 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.959+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:110 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023db0 con 0x563950fd3c70 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.959+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.959+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:111 3.34s0 3:2c86af74:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951023db0 con 0x563950fcf280 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(111 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=875b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+891 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:42.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 10 manifest: total_size = 3 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.498135177926104905 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 20 prepare_atomic_modification: state is not atomic. state=0x56395101efc8 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.960+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:112 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951028fb0 con 0x563950fcf280 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.961+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(110 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.961+0000 7fc06d7fa640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.961+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(112 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.961+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:113 3.34s0 3:2c86af74:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951028fb0 con 0x563950fcf280 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.962+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(113 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:42.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.962+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:114 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fcf280 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.962+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.962+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:115 3.3bs0 3:ddf00b5c:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd85d0 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(115 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 10 manifest: total_size = 4 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.10962151418322096655 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 20 prepare_atomic_modification: state is not atomic. state=0x56395101efc8 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 2024-04-24T01:24:42.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.963+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:116 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd3c70 2024-04-24T01:24:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.964+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(114 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.964+0000 7fc06cff9640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-04-24T01:24:43.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.964+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(116 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.964+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:117 3.3bs0 3:ddf00b5c:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd85d0 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.965+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(117 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.965+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:118 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd3c70 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.965+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.965+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:119 3.11s0 3:88ce187d:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd85d0 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(119 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 10 manifest: total_size = 5 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.9658035281215678452 2024-04-24T01:24:43.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 20 prepare_atomic_modification: state is not atomic. state=0x56395101efc8 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:120 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fcf280 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(118 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.966+0000 7fc06d7fa640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.967+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(120 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [stat,call,call] v34'10 uv10 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.967+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 3.11s0 3:88ce187d:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024a00 con 0x563950fd85d0 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.968+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(121 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.968+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:122 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fcf280 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.968+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.968+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:123 3.29s0 3:96c7ece6:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951024eb0 con 0x563950fd3c70 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(123 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 10 manifest: total_size = 5 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 20 get_obj_state: setting s->obj_tag to _-ct7JfgnTAQp4JwWQu6KB1pYy8cL38r 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 20 get_obj_state: octx=0x7fc17c0a1460 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x56395101efc8 s->prefetch_data=0 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 20 prepare_atomic_modification: state is not atomic. state=0x56395101efc8 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 2024-04-24T01:24:43.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.969+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:124 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951025010 con 0x563950fcf280 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.970+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(122 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [stat,call,call] v34'11 uv11 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.970+0000 7fc06cff9640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.970+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(124 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.970+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:125 3.29s0 3:96c7ece6:::f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951025010 con 0x563950fd3c70 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.971+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(125 f341815c-ea59-4c61-b01b-010b058e6023.4227.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.971+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:126 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951025010 con 0x563950fcf280 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.971+0000 7fc18df33800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.971+0000 7fc18df33800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:127 4.37 4:ee4cb02c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951025010 con 0x563950fd3c70 2024-04-24T01:24:43.005 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:128 4.4 4:212bc456:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951025010 con 0x563950fd3c70 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:129 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395102d080 con 0x563950fd3c70 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:130 4.2f 4:f506b487:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395102fad0 con 0x563950fcf280 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:131 4.3c 4:3db29810:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951032430 con 0x563950fcf280 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:132 4.22 4:47051493:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951032430 con 0x563950fcf280 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:133 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510373d0 con 0x563950fcf280 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:134 4.2b 4:d737d4f9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951039d10 con 0x563950fcf280 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:135 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103c6a0 con 0x563950fd3c70 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(127 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(128 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(129 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:136 4.34 4:2ef468be:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103f3b0 con 0x7fc17403a3c0 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:137 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395101ede0 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(130 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(131 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(135 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.972+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(132 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(133 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(136 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(134 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(126 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc06d7fa640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(137 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.5])"; uploads.size()=0; is_truncated=0 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:138 4.37 4:ee4cb02c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510387e0 con 0x563950fd3c70 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.973+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:139 4.4 4:212bc456:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395102c070 con 0x563950fd3c70 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:140 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510387e0 con 0x563950fd3c70 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:141 4.2f 4:f506b487:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103e080 con 0x563950fcf280 2024-04-24T01:24:43.008 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:142 4.3c 4:3db29810:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510387e0 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:143 4.22 4:47051493:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510321b0 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:144 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103e080 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:145 4.2b 4:d737d4f9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510387e0 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:146 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103e080 con 0x563950fd3c70 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:147 4.34 4:2ef468be:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5639510387e0 con 0x7fc17403a3c0 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:148 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(139 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(138 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(140 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(146 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(147 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(141 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 49 ==== osd_op_reply(142 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 50 ==== osd_op_reply(143 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 51 ==== osd_op_reply(144 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 52 ==== osd_op_reply(145 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 53 ==== osd_op_reply(148 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.974+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x7fc17403a3c0 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.975+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.975+0000 7fc18df33800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.975+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x7fc17403a3c0 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.976+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.976+0000 7fc18df33800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.976+0000 7fc18df33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.976+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94804172708592 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== watch-notify(notify (1) cookie 94804171948848 notify 146028888082 ret 0) ==== 191+0+0 (crc 0 0 0) 0x563950fede70 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc06d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94804171948848 notifier 4647 bl.length()=149 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(151 notify.6 [notify cookie 94804172708592 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc06d7fa640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc04c003d60 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== watch-notify(notify_complete (2) cookie 94804172708592 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563950fb0040 con 0x563950fd3c70 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.977+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:153 8.15 8:a886c100:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fd85d0 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(153 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc18df33800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5 from cache 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc18df33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.5, ofs0, ns] 2024-04-24T01:24:43.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:154 7.15 7:a93a5511:::notify.2:head [notify cookie 94804172708592 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== watch-notify(notify (1) cookie 94804171937904 notify 146028888081 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56395101c290 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc06d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94804171937904 notifier 4647 bl.length()=206 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc06d7fa640 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:155 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc04c003d60 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.978+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(154 notify.2 [notify cookie 94804172708592 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== watch-notify(notify_complete (2) cookie 94804172708592 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563950fee2e0 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(155 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:156 4.37 4:ee4cb02c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fd3c70 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:157 4.4 4:212bc456:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395103e8d0 con 0x563950fd3c70 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:158 4.7 4:e279b926:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101cb90 con 0x563950fd3c70 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:159 4.2f 4:f506b487:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101d460 con 0x563950fcf280 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:160 4.3c 4:3db29810:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395103e8d0 con 0x563950fcf280 2024-04-24T01:24:43.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:161 4.22 4:47051493:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101cb90 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:162 4.28 4:147eca61:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:163 4.2b 4:d737d4f9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101b6c0 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:164 4.17 4:eb54a953:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101d460 con 0x563950fd3c70 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:165 4.34 4:2ef468be:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563951023400 con 0x7fc17403a3c0 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.979+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:166 4.32 4:4f80789c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101cb90 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.980+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(165 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 54 ==== osd_op_reply(162 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 55 ==== osd_op_reply(160 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.4 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 56 ==== osd_op_reply(163 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.7 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 57 ==== osd_op_reply(161 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.5 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 58 ==== osd_op_reply(159 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.3 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(157 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(156 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 59 ==== osd_op_reply(166 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.10 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== osd_op_reply(158 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.2 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== osd_op_reply(164 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.5.8 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18df33800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.5 : miss 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18df33800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.983+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:167 6.0 6:00755858:::pubsub..bucket.myfoo%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56395103e8d0 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(167 pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc18df33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc18df33800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.5 info.flags=0x0 2024-04-24T01:24:43.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc18df33800 10 adding default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.5 to cache LRU end 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:168 6.0 6:00755858:::pubsub..bucket.myfoo%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5639510294f0 con 0x563950fd3c70 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 51 ==== osd_op_reply(168 pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.5 [delete] v34'61 uv54 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.984+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56395101cb90 con 0x7fc17403a3c0 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.986+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.986+0000 7fc03b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.986+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804171958768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0b10 con 0x563950fcf280 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.987+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 60 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94804171958768] v34'192 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.987+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804171934048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0b10 con 0x7fc17403a3c0 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.988+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94804171934048] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.988+0000 7fc18df33800 20 remove_watcher() i=0 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.988+0000 7fc18df33800 2 removed watcher, disabling cache 2024-04-24T01:24:43.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.988+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804171932048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc960 con 0x563950fcf280 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.989+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 61 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94804171932048] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.989+0000 7fc18df33800 20 remove_watcher() i=1 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.989+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804171937904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0b10 con 0x563950fd85d0 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.991+0000 7fc1813f4640 1 -- 172.21.15.169:0/1012750254 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94804171937904] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc174037040 con 0x563950fd85d0 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.991+0000 7fc18df33800 20 remove_watcher() i=2 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.991+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804171944240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc190 con 0x7fc17403a3c0 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.991+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94804171944240] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x7fc17403a3c0 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.992+0000 7fc18df33800 20 remove_watcher() i=3 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.992+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804171947792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc960 con 0x563950fcf280 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.992+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 <== osd.1 v2:172.21.15.169:6800/461208471 62 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94804171947792] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc18404e060 con 0x563950fcf280 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.992+0000 7fc18df33800 20 remove_watcher() i=4 2024-04-24T01:24:43.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.992+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804171945296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdd870 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.994+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 52 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94804171945296] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.994+0000 7fc18df33800 20 remove_watcher() i=5 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.994+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804171948848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950ff0b10 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.995+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 53 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94804171948848] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.995+0000 7fc18df33800 20 remove_watcher() i=6 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.995+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804171956384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563950fdc190 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc189bf5640 1 -- 172.21.15.169:0/1012750254 <== osd.0 v2:172.21.15.142:6800/3255114084 54 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94804171956384] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc17c06e070 con 0x563950fd3c70 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 20 remove_watcher() i=7 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950fd3c70 msgr2=0x563950fd6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950fd3c70 0x563950fd6060 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950fcf280 msgr2=0x563950fd1740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950fcf280 0x563950fd1740 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc17403a3c0 msgr2=0x7fc17403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc17403a3c0 0x7fc17403a810 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563950fd85d0 msgr2=0x563950fdaa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563950fd85d0 0x563950fdaa90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc054036950 msgr2=0x7fc054038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc054036950 0x7fc054038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x563950fa1630 tx=0x7fc174023040 comp rx=0 tx=0).stop 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 msgr2=0x563950fc3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18a3f6640 1 -- 172.21.15.169:0/1012750254 reap_dead start 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc17c08eff0 tx=0x7fc17c092f30 comp rx=0 tx=0).stop 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 shutdown_connections 2024-04-24T01:24:43.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 --2- 172.21.15.169:0/1012750254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950fbc820 0x563950fc3be0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 >> 172.21.15.169:0/1012750254 conn(0x563950fb8b30 msgr2=0x563950fb6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 shutdown_connections 2024-04-24T01:24:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.996+0000 7fc18df33800 1 -- 172.21.15.169:0/1012750254 wait complete. 2024-04-24T01:24:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 msgr2=0x7fc064038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 0x7fc064038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x563950f98880 tx=0x7fc174006000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 msgr2=0x563950fafb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fc17c070f10 tx=0x7fc17c08d110 comp rx=0 tx=0).stop 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 shutdown_connections 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc064036950 0x7fc064038e10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/1408464739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950faf6e0 0x563950fafb00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 >> 172.21.15.169:0/1408464739 conn(0x563950fa3780 msgr2=0x563950fa3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 shutdown_connections 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/1408464739 wait complete. 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950f9a6e0 msgr2=0x563950f9cad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563950f9a6e0 0x563950f9cad0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950e95140 msgr2=0x563950f97eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563950e95140 0x563950f97eb0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563950f9e5e0 msgr2=0x563950fa0aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563950f9e5e0 0x563950fa0aa0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc070036900 msgr2=0x7fc070038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc070036900 0x7fc070038dc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc174000c00 tx=0x7fc1740013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 msgr2=0x563950f90c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 --2- 172.21.15.169:0/2702233456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563950e947e0 0x563950f90c70 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fc17c061040 tx=0x7fc17c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18a3f6640 1 -- 172.21.15.169:0/2702233456 reap_dead start 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 shutdown_connections 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 >> 172.21.15.169:0/2702233456 conn(0x563950e90320 msgr2=0x563950f832b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 shutdown_connections 2024-04-24T01:24:43.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:42.997+0000 7fc18df33800 1 -- 172.21.15.169:0/2702233456 wait complete. 2024-04-24T01:24:43.024 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:24:43.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:24:43.025 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-04-24T01:24:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:43.110 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.110+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.110+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.110+0000 7f3d70c87800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55e6eb03c7c0 0x55e6eb03cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.110+0000 7f3d70c87800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6eaefcd40 con 0x55e6eb03d120 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.110+0000 7f3d70c87800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55e6eaecf4d0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6e786640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55e6eb03c7c0 0x55e6eb03cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6df85640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55e6eb03d120 0x55e6eb03d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39840/0 (socket says 172.21.15.169:39840) 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6df85640 1 -- 172.21.15.169:0/130132530 learned_addr learned my addr 172.21.15.169:0/130132530 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:43.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6e786640 1 -- 172.21.15.169:0/130132530 >> v1:172.21.15.142:6789/0 conn(0x55e6eb03d120 legacy=0x55e6eb03d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6e786640 1 -- 172.21.15.169:0/130132530 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eaefb590 con 0x55e6eb03c7c0 2024-04-24T01:24:43.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.111+0000 7f3d6d784640 1 -- 172.21.15.169:0/130132530 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537281907 0 0) 0x55e6eaefcd40 con 0x55e6eb03d120 2024-04-24T01:24:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d6e786640 1 --2- 172.21.15.169:0/130132530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb03cbe0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400a470 tx=0x7f3d6401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826c105d7f9ee4da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d6d784640 1 -- 172.21.15.169:0/130132530 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64057070 con 0x55e6eb03c7c0 2024-04-24T01:24:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d6d784640 1 -- 172.21.15.169:0/130132530 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6404adc0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d6d784640 1 -- 172.21.15.169:0/130132530 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64052590 con 0x55e6eb03c7c0 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d70c87800 1 -- 172.21.15.169:0/130132530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 msgr2=0x55e6eb03cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d70c87800 1 --2- 172.21.15.169:0/130132530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb03cbe0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400a470 tx=0x7f3d6401ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d70c87800 1 -- 172.21.15.169:0/130132530 shutdown_connections 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d70c87800 1 --2- 172.21.15.169:0/130132530 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb03cbe0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.113+0000 7f3d70c87800 1 -- 172.21.15.169:0/130132530 >> 172.21.15.169:0/130132530 conn(0x55e6eb038320 msgr2=0x55e6eb03a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.114+0000 7f3d70c87800 1 -- 172.21.15.169:0/130132530 shutdown_connections 2024-04-24T01:24:43.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.114+0000 7f3d70c87800 1 -- 172.21.15.169:0/130132530 wait complete. 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.125+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.125+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.125+0000 7f3d70c87800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.125+0000 7f3d70c87800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e6eaf893b0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52148/0 (socket says 172.21.15.169:52148) 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3d6e786640 1 -- 172.21.15.169:0/3608267144 learned_addr learned my addr 172.21.15.169:0/3608267144 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3d6e786640 1 -- 172.21.15.169:0/3608267144 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb131780 con 0x55e6eb03c7c0 2024-04-24T01:24:43.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3d6e786640 1 --2- 172.21.15.169:0/3608267144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3d64055040 tx=0x7f3d6404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53405539fc69f68 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3c5c608640 1 -- 172.21.15.169:0/3608267144 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64063070 con 0x55e6eb03c7c0 2024-04-24T01:24:43.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3c5c608640 1 -- 172.21.15.169:0/3608267144 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6400a230 con 0x55e6eb03c7c0 2024-04-24T01:24:43.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.126+0000 7f3c5c608640 1 -- 172.21.15.169:0/3608267144 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64057040 con 0x55e6eb03c7c0 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- 172.21.15.169:0/3608267144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 msgr2=0x55e6eb1311b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 --2- 172.21.15.169:0/3608267144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f3d64055040 tx=0x7f3d6404c000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- 172.21.15.169:0/3608267144 shutdown_connections 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 --2- 172.21.15.169:0/3608267144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb1311b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- 172.21.15.169:0/3608267144 >> 172.21.15.169:0/3608267144 conn(0x55e6eb038320 msgr2=0x55e6eb12cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- 172.21.15.169:0/3608267144 shutdown_connections 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- 172.21.15.169:0/3608267144 wait complete. 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.127+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d70c87800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb138c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d70c87800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb03dfe0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb138c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb138c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52154/0 (socket says 172.21.15.169:52154) 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d6e786640 1 -- 172.21.15.169:0/1757043639 learned_addr learned my addr 172.21.15.169:0/1757043639 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d6e786640 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb139190 con 0x55e6eb03c7c0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.128+0000 7f3d6e786640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb138c50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3d64061040 tx=0x7f3d64002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3c5ae05640 1 -- 172.21.15.169:0/1757043639 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6406c070 con 0x55e6eb03c7c0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3c5ae05640 1 -- 172.21.15.169:0/1757043639 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6405d7e0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6eb139420 con 0x55e6eb03c7c0 2024-04-24T01:24:43.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3c5ae05640 1 -- 172.21.15.169:0/1757043639 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64063040 con 0x55e6eb03c7c0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6eb13c030 con 0x55e6eb03c7c0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.129+0000 7f3c5ae05640 1 -- 172.21.15.169:0/1757043639 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d64066070 con 0x55e6eb03c7c0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3c5ae05640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c54036950 0x7f3c54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3c5ae05640 1 -- 172.21.15.169:0/1757043639 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3d6408d7d0 con 0x55e6eb03c7c0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d6df85640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c54036950 0x7f3c54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb03d120 0x55e6eb13fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb140370 con 0x55e6eb03d120 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb03d120 0x55e6eb13fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d6df85640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c54036950 0x7f3c54038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c00 tx=0x7f3d600013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb03d120 0x55e6eb13fdf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d6ef87640 1 -- 172.21.15.169:0/1757043639 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb03d120 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.130+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb13d3a0 con 0x55e6eb03d120 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.131+0000 7f3d6ef87640 1 -- 172.21.15.169:0/1757043639 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb03d120 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.131+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb142690 0x55e6eb144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.131+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb145120 con 0x55e6eb142690 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.131+0000 7f3d6e786640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb142690 0x55e6eb144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.131+0000 7f3d6e786640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb142690 0x55e6eb144a80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d6e786640 1 -- 172.21.15.169:0/1757043639 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d6406e070 con 0x55e6eb142690 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb141640 con 0x55e6eb03d120 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d6ef87640 1 -- 172.21.15.169:0/1757043639 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb03d120 2024-04-24T01:24:43.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55e6eb1465d0 0x55e6eb148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb149180 con 0x55e6eb1465d0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d6df85640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55e6eb1465d0 0x55e6eb148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d6df85640 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55e6eb1465d0 0x55e6eb148a20 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.132+0000 7f3d6df85640 1 -- 172.21.15.169:0/1757043639 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d6000f670 con 0x55e6eb1465d0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d70c87800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d70c87800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e6eaf2f6b0 con 0x55e6eb1575e0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52168/0 (socket says 172.21.15.169:52168) 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d6e786640 1 -- 172.21.15.169:0/861732431 learned_addr learned my addr 172.21.15.169:0/861732431 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.133+0000 7f3d6e786640 1 -- 172.21.15.169:0/861732431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb157f40 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3d6e786640 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3d6408bb80 tx=0x7f3d64068a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3c53fff640 1 -- 172.21.15.169:0/861732431 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64009590 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3c53fff640 1 -- 172.21.15.169:0/861732431 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6405dcd0 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6eb1589b0 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3c53fff640 1 -- 172.21.15.169:0/861732431 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d6408db30 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6eb158eb0 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.134+0000 7f3c53fff640 1 -- 172.21.15.169:0/861732431 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d64007e30 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3c53fff640 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 0x7f3c48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3c53fff640 1 -- 172.21.15.169:0/861732431 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3d64080070 con 0x55e6eb1575e0 2024-04-24T01:24:43.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6df85640 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 0x7f3c48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6df85640 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 0x7f3c48038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55e6eb13d2e0 tx=0x7f3d60006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d70c87800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d70c87800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb131a40 con 0x55e6eb1646c0 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52174/0 (socket says 172.21.15.169:52174) 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6e786640 1 -- 172.21.15.169:0/749031676 learned_addr learned my addr 172.21.15.169:0/749031676 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.135+0000 7f3d6e786640 1 -- 172.21.15.169:0/749031676 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb1650b0 con 0x55e6eb1646c0 2024-04-24T01:24:43.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d6e786640 1 --2- 172.21.15.169:0/749031676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3d6404aba0 tx=0x7f3d640073e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d2be760e654280 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3c51ffb640 1 -- 172.21.15.169:0/749031676 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64067ad0 con 0x55e6eb1646c0 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3c51ffb640 1 -- 172.21.15.169:0/749031676 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d6409b070 con 0x55e6eb1646c0 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3c51ffb640 1 -- 172.21.15.169:0/749031676 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64085a10 con 0x55e6eb1646c0 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 -- 172.21.15.169:0/749031676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 msgr2=0x55e6eb164ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 --2- 172.21.15.169:0/749031676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3d6404aba0 tx=0x7f3d640073e0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 -- 172.21.15.169:0/749031676 shutdown_connections 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 --2- 172.21.15.169:0/749031676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb164ae0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 -- 172.21.15.169:0/749031676 >> 172.21.15.169:0/749031676 conn(0x55e6eb1609d0 msgr2=0x55e6eb15ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 -- 172.21.15.169:0/749031676 shutdown_connections 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.136+0000 7f3d70c87800 1 -- 172.21.15.169:0/749031676 wait complete. 2024-04-24T01:24:43.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d70c87800 1 Processor -- start 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d70c87800 1 -- start start 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d70c87800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d70c87800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e6eb165740 con 0x55e6eb1646c0 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d6e786640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52176/0 (socket says 172.21.15.169:52176) 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 learned_addr learned my addr 172.21.15.169:0/167112543 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6eb16bfe0 con 0x55e6eb1646c0 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.137+0000 7f3d6e786640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d64007780 tx=0x7f3d64008310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3c3ffff640 1 -- 172.21.15.169:0/167112543 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d640b0070 con 0x55e6eb1646c0 2024-04-24T01:24:43.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3c3ffff640 1 -- 172.21.15.169:0/167112543 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d64079860 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6eb16bfe0 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3c3ffff640 1 -- 172.21.15.169:0/167112543 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d64079bf0 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6eb16bfe0 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.138+0000 7f3c3ffff640 1 -- 172.21.15.169:0/167112543 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3d640b3070 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3c3ffff640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c38036890 0x7f3c38038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3c3ffff640 1 -- 172.21.15.169:0/167112543 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3d640a6030 con 0x55e6eb1646c0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d6df85640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c38036890 0x7f3c38038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb177360 0x55e6eb179820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb179f70 con 0x55e6eb177360 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d6df85640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c38036890 0x7f3c38038d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6eb149580 tx=0x7f3d60023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.139+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb177360 0x55e6eb179820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb177360 0x55e6eb179820 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 realm 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17a380 con 0x55e6eb177360 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17ac50 con 0x55e6eb177360 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.140+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb17bd50 0x55e6eb17e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17e750 con 0x55e6eb17bd50 2024-04-24T01:24:43.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d6e786640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb17bd50 0x55e6eb17e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d6e786640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb17bd50 0x55e6eb17e140 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 20 searching for the correct realm 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55e6eb180700 0x55e6eb182bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.141+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb183290 con 0x55e6eb180700 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6df85640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55e6eb180700 0x55e6eb182bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6df85640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55e6eb180700 0x55e6eb182bc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6df85640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3d6003a3c0 0x7f3d6003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb183290 con 0x7f3d6003a3c0 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.142+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3d6003a3c0 0x7f3d6003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6ef87640 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3d6003a3c0 0x7f3d6003a810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.143+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.144+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d6800a4a0 con 0x55e6eb177360 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.145+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.146+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.147+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.148+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.149+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb180700 2024-04-24T01:24:43.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.150+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb17bd50 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x55e6eb177360 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17aff0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:43.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17f010 con 0x55e6eb177360 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.151+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17f010 con 0x55e6eb177360 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17f010 con 0x7f3d6003a3c0 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.180 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 zone default found 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 4 Realm: () 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 zonegroup default 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb17f8b0 con 0x55e6eb17bd50 2024-04-24T01:24:43.181 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.152+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1850f0 con 0x55e6eb180700 2024-04-24T01:24:43.182 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb185490 con 0x55e6eb180700 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 20 started sync module instance, tier type = 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.153+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb184590 con 0x7f3d6003a3c0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.154+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.154+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94450275076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb184590 con 0x7f3d6003a3c0 2024-04-24T01:24:43.183 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.154+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb185e50 con 0x55e6eb177360 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.155+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94450275076528] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.155+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.155+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94450275074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb185e50 con 0x55e6eb177360 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.155+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb186810 con 0x55e6eb180700 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.157+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94450275074752] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.157+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.157+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94450275080608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb185dc0 con 0x55e6eb180700 2024-04-24T01:24:43.184 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.157+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1876d0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.158+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94450275080608] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.158+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.158+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94450275086880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb187af0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.158+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1884b0 con 0x55e6eb177360 2024-04-24T01:24:43.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.159+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.159+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94450275090432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1888d0 con 0x55e6eb177360 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.159+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94450275086880] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.159+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb187680 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.160+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.160+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94450275094112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb189730 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.160+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb18a150 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.160+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94450275090432] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.161+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94450275094112] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.161+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.161+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94450275097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb189280 con 0x55e6eb17bd50 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.161+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb18a9f0 con 0x55e6eb17bd50 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94450275097664] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94450275091488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb189280 con 0x55e6eb17bd50 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=0 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=1 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=2 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=3 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=4 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=5 2024-04-24T01:24:43.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.162+0000 7f3d70c87800 20 add_watcher() i=6 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.163+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94450275091488] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.163+0000 7f3d70c87800 20 add_watcher() i=7 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.163+0000 7f3d70c87800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.163+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb18da50 con 0x55e6eb177360 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.164+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.164+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94450275099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb18af70 con 0x55e6eb177360 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94450275099968] v34'193 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d70c87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:43.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d70c87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d70c87800 5 note: GC not initialized 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3b9f7fe640 20 reqs_thread_entry: start 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d70c87800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.165+0000 7f3d70c87800 20 Filter name: none 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3b9d7fa640 20 reqs_thread_entry: start 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1c0de0 con 0x55e6eb177360 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.166+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1c6f80 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d70c87800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d70c87800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d70c87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94450275346960 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1c2860 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== watch-notify(notify (1) cookie 94450275090432 notify 146028888082 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f3d68026410 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3c51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94450275090432 notifier 4654 bl.length()=579 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3c51ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3c51ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.167+0000 7f3c51ffb640 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3c34003ea0 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.168+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(64 notify.4 [notify cookie 94450275346960 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.168+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.197 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.168+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify_complete (2) cookie 94450275346960 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3d680265e0 con 0x55e6eb177360 2024-04-24T01:24:43.197 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.169+0000 7f3c24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.169+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94450275099968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1c5960 con 0x55e6eb177360 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.170+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94450275099968] v34'194 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.170+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94450275076528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb18a540 con 0x7f3d6003a3c0 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.171+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94450275076528] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.171+0000 7f3d70c87800 20 remove_watcher() i=0 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.171+0000 7f3d70c87800 2 removed watcher, disabling cache 2024-04-24T01:24:43.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.171+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94450275074752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1849b0 con 0x55e6eb177360 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.172+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94450275074752] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.172+0000 7f3d70c87800 20 remove_watcher() i=1 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.172+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94450275080608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1842c0 con 0x55e6eb180700 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.173+0000 7f3d6df85640 1 -- 172.21.15.169:0/167112543 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94450275080608] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d60037040 con 0x55e6eb180700 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.173+0000 7f3d70c87800 20 remove_watcher() i=2 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.173+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94450275086880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1859a0 con 0x7f3d6003a3c0 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.174+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94450275086880] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x7f3d6003a3c0 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.174+0000 7f3d70c87800 20 remove_watcher() i=3 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.174+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94450275090432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1859a0 con 0x55e6eb177360 2024-04-24T01:24:43.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.176+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94450275090432] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d68032040 con 0x55e6eb177360 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.176+0000 7f3d70c87800 20 remove_watcher() i=4 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.176+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94450275094112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb188000 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.177+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94450275094112] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.177+0000 7f3d70c87800 20 remove_watcher() i=5 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.177+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94450275097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb1859a0 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.178+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94450275097664] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.178+0000 7f3d70c87800 20 remove_watcher() i=6 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.178+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94450275091488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e6eb188e60 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d6e786640 1 -- 172.21.15.169:0/167112543 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94450275091488] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d640b2030 con 0x55e6eb17bd50 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d70c87800 20 remove_watcher() i=7 2024-04-24T01:24:43.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb17bd50 msgr2=0x55e6eb17e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb17bd50 0x55e6eb17e140 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb177360 msgr2=0x55e6eb179820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.179+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb177360 0x55e6eb179820 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3d6003a3c0 msgr2=0x7f3d6003a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3d6003a3c0 0x7f3d6003a810 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55e6eb180700 msgr2=0x55e6eb182bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55e6eb180700 0x55e6eb182bc0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c38036890 msgr2=0x7f3c38038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c38036890 0x7f3c38038d50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6eb149580 tx=0x7f3d60023040 comp rx=0 tx=0).stop 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 msgr2=0x55e6eb16baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.206 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d6ef87640 1 -- 172.21.15.169:0/167112543 reap_dead start 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3d64007780 tx=0x7f3d64008310 comp rx=0 tx=0).stop 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 shutdown_connections 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/167112543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1646c0 0x55e6eb16baa0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 >> 172.21.15.169:0/167112543 conn(0x55e6eb1609d0 msgr2=0x55e6eb15e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 shutdown_connections 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/167112543 wait complete. 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 msgr2=0x7f3c48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 0x7f3c48038e10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x55e6eb13d2e0 tx=0x7f3d60006000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 msgr2=0x55e6eb157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f3d6408bb80 tx=0x7f3d64068a30 comp rx=0 tx=0).stop 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 shutdown_connections 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c48036950 0x7f3c48038e10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/861732431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb1575e0 0x55e6eb157a00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 >> 172.21.15.169:0/861732431 conn(0x55e6eb14b680 msgr2=0x55e6eb14ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 shutdown_connections 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/861732431 wait complete. 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb142690 msgr2=0x55e6eb144a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e6eb142690 0x55e6eb144a80 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb03d120 msgr2=0x55e6eb13fdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e6eb03d120 0x55e6eb13fdf0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55e6eb1465d0 msgr2=0x55e6eb148a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.180+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55e6eb1465d0 0x55e6eb148a20 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c54036950 msgr2=0x7f3c54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3c54036950 0x7f3c54038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3d60000c00 tx=0x7f3d600013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 msgr2=0x55e6eb138c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 --2- 172.21.15.169:0/1757043639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e6eb03c7c0 0x55e6eb138c50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3d64061040 tx=0x7f3d64002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d6ef87640 1 -- 172.21.15.169:0/1757043639 reap_dead start 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 shutdown_connections 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 >> 172.21.15.169:0/1757043639 conn(0x55e6eb038320 msgr2=0x55e6eb12b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 shutdown_connections 2024-04-24T01:24:43.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.181+0000 7f3d70c87800 1 -- 172.21.15.169:0/1757043639 wait complete. 2024-04-24T01:24:43.209 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:43.209 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:24:43.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-04-24T01:24:43.210 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-04-24T01:24:43.254 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:43.254 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:43.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.256 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe59780f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55594c3cb4c0 0x55594c3cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe59780f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55594c285d40 con 0x55594c3c79b0 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe59780f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55594c2584d0 con 0x55594c3cb4c0 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe58bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55594c3cb4c0 0x55594c3cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe58bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55594c3cb4c0 0x55594c3cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52186/0 (socket says 172.21.15.169:52186) 2024-04-24T01:24:43.257 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe592f6a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55594c3c79b0 0x55594c3c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39844/0 (socket says 172.21.15.169:39844) 2024-04-24T01:24:43.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.255+0000 7fe58bfff640 1 -- 172.21.15.169:0/2875553705 learned_addr learned my addr 172.21.15.169:0/2875553705 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.256+0000 7fe58bfff640 1 -- 172.21.15.169:0/2875553705 >> v1:172.21.15.142:6789/0 conn(0x55594c3c79b0 legacy=0x55594c3c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.256+0000 7fe592769640 1 -- 172.21.15.169:0/2875553705 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923783726 0 0) 0x55594c285d40 con 0x55594c3c79b0 2024-04-24T01:24:43.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.256+0000 7fe58bfff640 1 -- 172.21.15.169:0/2875553705 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c284590 con 0x55594c3cb4c0 2024-04-24T01:24:43.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe58bfff640 1 --2- 172.21.15.169:0/2875553705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3cb4c0 0x55594c3cd8b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a520 tx=0x7fe57c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b66c8ff84923cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe592769640 1 -- 172.21.15.169:0/2875553705 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c057070 con 0x55594c3cb4c0 2024-04-24T01:24:43.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe592769640 1 -- 172.21.15.169:0/2875553705 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c052570 con 0x55594c3cb4c0 2024-04-24T01:24:43.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe592769640 1 -- 172.21.15.169:0/2875553705 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe57c04ae60 con 0x55594c3cb4c0 2024-04-24T01:24:43.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 -- 172.21.15.169:0/2875553705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3cb4c0 msgr2=0x55594c3cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 --2- 172.21.15.169:0/2875553705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3cb4c0 0x55594c3cd8b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00a520 tx=0x7fe57c01d010 comp rx=0 tx=0).stop 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 -- 172.21.15.169:0/2875553705 shutdown_connections 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 --2- 172.21.15.169:0/2875553705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3cb4c0 0x55594c3cd8b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 -- 172.21.15.169:0/2875553705 >> 172.21.15.169:0/2875553705 conn(0x55594c3c1320 msgr2=0x55594c3c3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 -- 172.21.15.169:0/2875553705 shutdown_connections 2024-04-24T01:24:43.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.258+0000 7fe59780f800 1 -- 172.21.15.169:0/2875553705 wait complete. 2024-04-24T01:24:43.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe59780f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe59780f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594c3123b0 con 0x55594c3c79b0 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52202/0 (socket says 172.21.15.169:52202) 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.270+0000 7fe592f6a640 1 -- 172.21.15.169:0/3722072871 learned_addr learned my addr 172.21.15.169:0/3722072871 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.271+0000 7fe592f6a640 1 -- 172.21.15.169:0/3722072871 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c3c58b0 con 0x55594c3c79b0 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.271+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3722072871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b210 tx=0x7fe58400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b704d8586236f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.271+0000 7fe480e09640 1 -- 172.21.15.169:0/3722072871 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584008070 con 0x55594c3c79b0 2024-04-24T01:24:43.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.271+0000 7fe480e09640 1 -- 172.21.15.169:0/3722072871 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58400d500 con 0x55594c3c79b0 2024-04-24T01:24:43.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.271+0000 7fe480e09640 1 -- 172.21.15.169:0/3722072871 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58400d840 con 0x55594c3c79b0 2024-04-24T01:24:43.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- 172.21.15.169:0/3722072871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 msgr2=0x55594c3c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 --2- 172.21.15.169:0/3722072871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe58400b210 tx=0x7fe58400b6d0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- 172.21.15.169:0/3722072871 shutdown_connections 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 --2- 172.21.15.169:0/3722072871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c3c72f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- 172.21.15.169:0/3722072871 >> 172.21.15.169:0/3722072871 conn(0x55594c3c1320 msgr2=0x55594c4b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- 172.21.15.169:0/3722072871 shutdown_connections 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- 172.21.15.169:0/3722072871 wait complete. 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c4c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe59780f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594c3d0100 con 0x55594c3c79b0 2024-04-24T01:24:43.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.272+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c4c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c4c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52204/0 (socket says 172.21.15.169:52204) 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe592f6a640 1 -- 172.21.15.169:0/3465370323 learned_addr learned my addr 172.21.15.169:0/3465370323 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe592f6a640 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c4c2250 con 0x55594c3c79b0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c4c1d10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe584001e60 tx=0x7fe584000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe47f606640 1 -- 172.21.15.169:0/3465370323 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584019870 con 0x55594c3c79b0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe47f606640 1 -- 172.21.15.169:0/3465370323 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584019a10 con 0x55594c3c79b0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55594c4c24e0 con 0x55594c3c79b0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe47f606640 1 -- 172.21.15.169:0/3465370323 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584019cf0 con 0x55594c3c79b0 2024-04-24T01:24:43.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.273+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55594c4c5190 con 0x55594c3c79b0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe47f606640 1 -- 172.21.15.169:0/3465370323 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe584017040 con 0x55594c3c79b0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe47f606640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe478036950 0x7fe478038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe47f606640 1 -- 172.21.15.169:0/3465370323 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe584015020 con 0x55594c3c79b0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe478036950 0x7fe478038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c3cb4c0 0x55594c4c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c4c94d0 con 0x55594c3cb4c0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.274+0000 7fe59376b640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c3cb4c0 0x55594c4c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe478036950 0x7fe478038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe57c054000 tx=0x7fe57c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59376b640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c3cb4c0 0x55594c4c8f50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59376b640 1 -- 172.21.15.169:0/3465370323 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c3cb4c0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c4c6520 con 0x55594c3cb4c0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59376b640 1 -- 172.21.15.169:0/3465370323 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c3cb4c0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c4cb800 0x55594c4cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.275+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c4ce2e0 con 0x55594c4cb800 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.276+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c4cb800 0x55594c4cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.276+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c4cb800 0x55594c4cdbf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.276+0000 7fe592f6a640 1 -- 172.21.15.169:0/3465370323 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe58402d070 con 0x55594c4cb800 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.276+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c4ca7b0 con 0x55594c3cb4c0 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.276+0000 7fe59376b640 1 -- 172.21.15.169:0/3465370323 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c3cb4c0 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55594c4cf790 0x55594c4d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c4d2340 con 0x55594c4cf790 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55594c4cf790 0x55594c4d1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55594c4cf790 0x55594c4d1be0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe58bfff640 1 -- 172.21.15.169:0/3465370323 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe57c05a040 con 0x55594c4cf790 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.277+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe59780f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe59780f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594c2b86b0 con 0x55594c4e0730 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52208/0 (socket says 172.21.15.169:52208) 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe592f6a640 1 -- 172.21.15.169:0/4036127102 learned_addr learned my addr 172.21.15.169:0/4036127102 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe592f6a640 1 -- 172.21.15.169:0/4036127102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c4e1090 con 0x55594c4e0730 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe592f6a640 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e8f0 tx=0x7fe584018740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe47ce01640 1 -- 172.21.15.169:0/4036127102 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5840449d0 con 0x55594c4e0730 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe47ce01640 1 -- 172.21.15.169:0/4036127102 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584044b70 con 0x55594c4e0730 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55594c4e1b00 con 0x55594c4e0730 2024-04-24T01:24:43.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe47ce01640 1 -- 172.21.15.169:0/4036127102 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe584044e50 con 0x55594c4e0730 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.278+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55594c4e2000 con 0x55594c4e0730 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.279+0000 7fe47ce01640 1 -- 172.21.15.169:0/4036127102 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe58403f1b0 con 0x55594c4e0730 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.279+0000 7fe47ce01640 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.279+0000 7fe47ce01640 1 -- 172.21.15.169:0/4036127102 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe58403cd50 con 0x55594c4e0730 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.279+0000 7fe58bfff640 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe58bfff640 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 0x7fe46c038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55594c4c9db0 tx=0x7fe57c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe59780f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.312 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe59780f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594c3c5c30 con 0x55594c4eda50 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52224/0 (socket says 172.21.15.169:52224) 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe592f6a640 1 -- 172.21.15.169:0/2276332190 learned_addr learned my addr 172.21.15.169:0/2276332190 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe592f6a640 1 -- 172.21.15.169:0/2276332190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c4ee440 con 0x55594c4eda50 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe592f6a640 1 --2- 172.21.15.169:0/2276332190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe5840272d0 tx=0x7fe584026430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39ec188e8f07629 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe4767fc640 1 -- 172.21.15.169:0/2276332190 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5840267f0 con 0x55594c4eda50 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe4767fc640 1 -- 172.21.15.169:0/2276332190 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584027070 con 0x55594c4eda50 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.280+0000 7fe4767fc640 1 -- 172.21.15.169:0/2276332190 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58404b640 con 0x55594c4eda50 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- 172.21.15.169:0/2276332190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 msgr2=0x55594c4ede70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 --2- 172.21.15.169:0/2276332190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe5840272d0 tx=0x7fe584026430 comp rx=0 tx=0).stop 2024-04-24T01:24:43.313 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- 172.21.15.169:0/2276332190 shutdown_connections 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 --2- 172.21.15.169:0/2276332190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4ede70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- 172.21.15.169:0/2276332190 >> 172.21.15.169:0/2276332190 conn(0x55594c4e9db0 msgr2=0x55594c4e7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- 172.21.15.169:0/2276332190 shutdown_connections 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- 172.21.15.169:0/2276332190 wait complete. 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 Processor -- start 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- start start 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.281+0000 7fe59780f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594c4ee970 con 0x55594c4eda50 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe592f6a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52234/0 (socket says 172.21.15.169:52234) 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 learned_addr learned my addr 172.21.15.169:0/3250851651 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55594c4f5290 con 0x55594c4eda50 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe58400efd0 tx=0x7fe584027260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe474ff9640 1 -- 172.21.15.169:0/3250851651 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5840267f0 con 0x55594c4eda50 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe474ff9640 1 -- 172.21.15.169:0/3250851651 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe584040850 con 0x55594c4eda50 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55594c4f5290 con 0x55594c4eda50 2024-04-24T01:24:43.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe474ff9640 1 -- 172.21.15.169:0/3250851651 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58403f4a0 con 0x55594c4eda50 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.282+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55594c4f5290 con 0x55594c4eda50 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.283+0000 7fe474ff9640 1 -- 172.21.15.169:0/3250851651 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe584026c80 con 0x55594c4eda50 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.283+0000 7fe474ff9640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe45c0368b0 0x7fe45c038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.283+0000 7fe474ff9640 1 -- 172.21.15.169:0/3250851651 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe584072d50 con 0x55594c4eda50 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.283+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe45c0368b0 0x7fe45c038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe45c0368b0 0x7fe45c038d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe57c055040 tx=0x7fe57c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c500330 0x55594c5027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c502f40 con 0x55594c500330 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59376b640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c500330 0x55594c5027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59376b640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c500330 0x55594c5027f0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 realm 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c503350 con 0x55594c500330 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.284+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c503c20 con 0x55594c500330 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c504d20 0x55594c507110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c507720 con 0x55594c504d20 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c504d20 0x55594c507110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.285+0000 7fe592f6a640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c504d20 0x55594c507110 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe59780f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe59780f800 20 searching for the correct realm 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55594c5096d0 0x55594c50bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c50c260 con 0x55594c5096d0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55594c5096d0 0x55594c50bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55594c5096d0 0x55594c50bb90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe58bfff640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe57c082040 0x7fe57c083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.286+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c50c260 con 0x7fe57c082040 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.287+0000 7fe59376b640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe57c082040 0x7fe57c083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.287+0000 7fe59376b640 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe57c082040 0x7fe57c083430 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.287+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe57c082040 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.287+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.287+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.288+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x7fe57c082040 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x7fe57c082040 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.289+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c00a4a0 con 0x55594c500330 2024-04-24T01:24:43.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x7fe57c082040 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.290+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.291+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.292+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x7fe57c082040 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.293+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x7fe57c082040 2024-04-24T01:24:43.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c5096d0 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c504d20 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.294+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x55594c500330 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55594c503fc0 con 0x7fe57c082040 2024-04-24T01:24:43.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c507fe0 con 0x55594c500330 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c507fe0 con 0x55594c500330 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.295+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c507fe0 con 0x7fe57c082040 2024-04-24T01:24:43.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 zone default found 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 4 Realm: () 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 zonegroup default 2024-04-24T01:24:43.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c508880 con 0x55594c504d20 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c50e0c0 con 0x55594c5096d0 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.296+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c50e460 con 0x55594c5096d0 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.297+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.297+0000 7fe59780f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.297+0000 7fe59780f800 20 started sync module instance, tier type = 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.297+0000 7fe59780f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:43.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.297+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d560 con 0x7fe57c082040 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.298+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.298+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93842020817280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d560 con 0x7fe57c082040 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.298+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50ed10 con 0x55594c500330 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.299+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93842020817280] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.299+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.299+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93842020820992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d560 con 0x55594c500330 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.299+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50f760 con 0x55594c5096d0 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.300+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93842020820992] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.300+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.300+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93842020815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d4d0 con 0x55594c5096d0 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.300+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c510620 con 0x7fe57c082040 2024-04-24T01:24:43.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.301+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93842020815024] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.302+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.302+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93842020827504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c510a40 con 0x7fe57c082040 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.303+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c511400 con 0x55594c500330 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.303+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.303+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93842020831056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c511820 con 0x55594c500330 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.303+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c512280 con 0x55594c504d20 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.304+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93842020827504] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.304+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.304+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93842020828560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c512670 con 0x55594c504d20 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.305+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c513030 con 0x55594c504d20 2024-04-24T01:24:43.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.305+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93842020831056] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.306+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93842020828560] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.306+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.306+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93842020838272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c5133d0 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.306+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c513c80 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93842020838272] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93842020841328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c514070 con 0x55594c504d20 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=0 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=1 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=2 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=3 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=4 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=5 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.307+0000 7fe59780f800 20 add_watcher() i=6 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93842020841328] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe59780f800 20 add_watcher() i=7 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe59780f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c517500 con 0x55594c500330 2024-04-24T01:24:43.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.308+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93842020832112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c5148f0 con 0x55594c500330 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.309+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93842020832112] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 5 note: GC not initialized 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe3c3fff640 20 reqs_thread_entry: start 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 20 Filter name: none 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe3c1ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.310+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c54a780 con 0x55594c500330 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59780f800 20 rados_obj.operate() r=0 bl.length=403 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59780f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59780f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59780f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.311+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c550990 con 0x55594c500330 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59780f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59780f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59780f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93842021090304 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594c54f4e0 con 0x55594c500330 2024-04-24T01:24:43.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== watch-notify(notify (1) cookie 93842020831056 notify 146028888083 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fe58c018c40 con 0x55594c500330 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe4767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 93842020831056 notifier 4661 bl.length()=567 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe4767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe4767fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe4767fc640 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe458003ea0 con 0x55594c500330 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.312+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(64 notify.4 [notify cookie 93842021090304 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.313+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.313+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== watch-notify(notify_complete (2) cookie 93842021090304 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe58c018e10 con 0x55594c500330 2024-04-24T01:24:43.342 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-04-24T01:24:19.083859Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:24:19.083846Z","tags":[],"group_ids":[]} 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.314+0000 7fe4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.314+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93842020832112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c54fbf0 con 0x55594c500330 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.314+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93842020832112] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.315+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93842020817280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c511370 con 0x7fe57c082040 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.316+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93842020817280] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.316+0000 7fe59780f800 20 remove_watcher() i=0 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.316+0000 7fe59780f800 2 removed watcher, disabling cache 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.316+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93842020820992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c511370 con 0x55594c500330 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.317+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93842020820992] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.317+0000 7fe59780f800 20 remove_watcher() i=1 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.317+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93842020815024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c511370 con 0x55594c5096d0 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.318+0000 7fe58bfff640 1 -- 172.21.15.169:0/3250851651 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93842020815024] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe57c07f070 con 0x55594c5096d0 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.318+0000 7fe59780f800 20 remove_watcher() i=2 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.318+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93842020827504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d0b0 con 0x7fe57c082040 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.319+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93842020827504] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x7fe57c082040 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.319+0000 7fe59780f800 20 remove_watcher() i=3 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.319+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93842020831056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c510170 con 0x55594c500330 2024-04-24T01:24:43.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.320+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93842020831056] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c032040 con 0x55594c500330 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.320+0000 7fe59780f800 20 remove_watcher() i=4 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.320+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93842020828560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c50d0b0 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.321+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93842020828560] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.321+0000 7fe59780f800 20 remove_watcher() i=5 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.321+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93842020838272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c510f50 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.322+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93842020838272] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.322+0000 7fe59780f800 20 remove_watcher() i=6 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.322+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93842020841328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55594c510620 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe592f6a640 1 -- 172.21.15.169:0/3250851651 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93842020841328] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe584078070 con 0x55594c504d20 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 20 remove_watcher() i=7 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c504d20 msgr2=0x55594c507110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c504d20 0x55594c507110 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.351 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c500330 msgr2=0x55594c5027f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c500330 0x55594c5027f0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe57c082040 msgr2=0x7fe57c083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe57c082040 0x7fe57c083430 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55594c5096d0 msgr2=0x55594c50bb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55594c5096d0 0x55594c50bb90 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe45c0368b0 msgr2=0x7fe45c038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe45c0368b0 0x7fe45c038d70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe57c055040 tx=0x7fe57c04f000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59376b640 1 -- 172.21.15.169:0/3250851651 reap_dead start 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 msgr2=0x55594c4f4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe58400efd0 tx=0x7fe584027260 comp rx=0 tx=0).stop 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 shutdown_connections 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 --2- 172.21.15.169:0/3250851651 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4eda50 0x55594c4f4d50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 >> 172.21.15.169:0/3250851651 conn(0x55594c4e9db0 msgr2=0x55594c4e7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 shutdown_connections 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.323+0000 7fe59780f800 1 -- 172.21.15.169:0/3250851651 wait complete. 2024-04-24T01:24:43.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 msgr2=0x7fe46c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 0x7fe46c038dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55594c4c9db0 tx=0x7fe57c005ac0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 msgr2=0x55594c4e0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e8f0 tx=0x7fe584018740 comp rx=0 tx=0).stop 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 shutdown_connections 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe46c036900 0x7fe46c038dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/4036127102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c4e0730 0x55594c4e0b50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 >> 172.21.15.169:0/4036127102 conn(0x55594c4d47d0 msgr2=0x55594c4d4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 shutdown_connections 2024-04-24T01:24:43.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/4036127102 wait complete. 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c4cb800 msgr2=0x55594c4cdbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594c4cb800 0x55594c4cdbf0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c3cb4c0 msgr2=0x55594c4c8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594c3cb4c0 0x55594c4c8f50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55594c4cf790 msgr2=0x55594c4d1be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55594c4cf790 0x55594c4d1be0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe478036950 msgr2=0x7fe478038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe478036950 0x7fe478038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe57c054000 tx=0x7fe57c04e000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 msgr2=0x55594c4c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 --2- 172.21.15.169:0/3465370323 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594c3c79b0 0x55594c4c1d10 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe584001e60 tx=0x7fe584000ed0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59376b640 1 -- 172.21.15.169:0/3465370323 reap_dead start 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 shutdown_connections 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 >> 172.21.15.169:0/3465370323 conn(0x55594c3c1320 msgr2=0x55594c3c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 shutdown_connections 2024-04-24T01:24:43.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.324+0000 7fe59780f800 1 -- 172.21.15.169:0/3465370323 wait complete. 2024-04-24T01:24:43.356 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-04-24T01:24:19.083859Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:24:19.083846Z', 'tags': [], 'group_ids': []} 2024-04-24T01:24:43.371 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:43.371 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:43.371 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-04-24T01:24:43.371 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-04-24T01:24:43.413 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:24:43.414 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba1b133800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c978f71970 0x55c978f73d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba1b133800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c978e2fd40 con 0x55c978f742a0 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba1b133800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c978e024d0 con 0x55c978f71970 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba16df5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c978f71970 0x55c978f73d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba165f4640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c978f742a0 0x55c978f76690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:39852/0 (socket says 172.21.15.169:39852) 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.414+0000 7fba165f4640 1 -- 172.21.15.169:0/3191279543 learned_addr learned my addr 172.21.15.169:0/3191279543 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.415+0000 7fba16df5640 1 -- 172.21.15.169:0/3191279543 >> v1:172.21.15.142:6789/0 conn(0x55c978f742a0 legacy=0x55c978f76690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.415+0000 7fba16df5640 1 -- 172.21.15.169:0/3191279543 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c978e2e590 con 0x55c978f71970 2024-04-24T01:24:43.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.415+0000 7fba15df3640 1 -- 172.21.15.169:0/3191279543 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908536181 0 0) 0x55c978e2fd40 con 0x55c978f742a0 2024-04-24T01:24:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.416+0000 7fba16df5640 1 --2- 172.21.15.169:0/3191279543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f73d60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fba0800a470 tx=0x7fba0801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c52d21111721974 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba15df3640 1 -- 172.21.15.169:0/3191279543 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08057070 con 0x55c978f71970 2024-04-24T01:24:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba15df3640 1 -- 172.21.15.169:0/3191279543 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08052570 con 0x55c978f71970 2024-04-24T01:24:43.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba15df3640 1 -- 172.21.15.169:0/3191279543 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08052870 con 0x55c978f71970 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 -- 172.21.15.169:0/3191279543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 msgr2=0x55c978f73d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 --2- 172.21.15.169:0/3191279543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f73d60 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fba0800a470 tx=0x7fba0801ce90 comp rx=0 tx=0).stop 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 -- 172.21.15.169:0/3191279543 shutdown_connections 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 --2- 172.21.15.169:0/3191279543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f73d60 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 -- 172.21.15.169:0/3191279543 >> 172.21.15.169:0/3191279543 conn(0x55c978f6b320 msgr2=0x55c978f6d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 -- 172.21.15.169:0/3191279543 shutdown_connections 2024-04-24T01:24:43.418 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.417+0000 7fba1b133800 1 -- 172.21.15.169:0/3191279543 wait complete. 2024-04-24T01:24:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba1b133800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba1b133800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c978ebc3c0 con 0x55c978f71970 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52264/0 (socket says 172.21.15.169:52264) 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba16df5640 1 -- 172.21.15.169:0/2605430760 learned_addr learned my addr 172.21.15.169:0/2605430760 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.429+0000 7fba16df5640 1 -- 172.21.15.169:0/2605430760 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c978f6f870 con 0x55c978f71970 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba16df5640 1 --2- 172.21.15.169:0/2605430760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba08055040 tx=0x7fba0804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac2d2fdae49b6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fb904e09640 1 -- 172.21.15.169:0/2605430760 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08057070 con 0x55c978f71970 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fb904e09640 1 -- 172.21.15.169:0/2605430760 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08063070 con 0x55c978f71970 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fb904e09640 1 -- 172.21.15.169:0/2605430760 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08052720 con 0x55c978f71970 2024-04-24T01:24:43.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 -- 172.21.15.169:0/2605430760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 msgr2=0x55c978f712b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 --2- 172.21.15.169:0/2605430760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba08055040 tx=0x7fba0804c000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 -- 172.21.15.169:0/2605430760 shutdown_connections 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 --2- 172.21.15.169:0/2605430760 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c978f712b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 -- 172.21.15.169:0/2605430760 >> 172.21.15.169:0/2605430760 conn(0x55c978f6b320 msgr2=0x55c97905d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 -- 172.21.15.169:0/2605430760 shutdown_connections 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.430+0000 7fba1b133800 1 -- 172.21.15.169:0/2605430760 wait complete. 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba1b133800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c97906bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba1b133800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c978f7a0c0 con 0x55c978f71970 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c97906bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c97906bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52270/0 (socket says 172.21.15.169:52270) 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba16df5640 1 -- 172.21.15.169:0/3387468711 learned_addr learned my addr 172.21.15.169:0/3387468711 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba16df5640 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97906c090 con 0x55c978f71970 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.431+0000 7fba16df5640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c97906bb50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba08060040 tx=0x7fba08002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fb903606640 1 -- 172.21.15.169:0/3387468711 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08052e30 con 0x55c978f71970 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fb903606640 1 -- 172.21.15.169:0/3387468711 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0806c070 con 0x55c978f71970 2024-04-24T01:24:43.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97906c320 con 0x55c978f71970 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fb903606640 1 -- 172.21.15.169:0/3387468711 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba0805e5f0 con 0x55c978f71970 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97906efd0 con 0x55c978f71970 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.432+0000 7fb903606640 1 -- 172.21.15.169:0/3387468711 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba0805e790 con 0x55c978f71970 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fb903606640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8fc036950 0x7fb8fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fb903606640 1 -- 172.21.15.169:0/3387468711 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba0808e960 con 0x55c978f71970 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba165f4640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8fc036950 0x7fb8fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c978f742a0 0x55c979072d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790732d0 con 0x55c978f742a0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba175f6640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c978f742a0 0x55c979072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba165f4640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8fc036950 0x7fb8fc038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba0c000c00 tx=0x7fba0c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba175f6640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c978f742a0 0x55c979072d90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.433+0000 7fba175f6640 1 -- 172.21.15.169:0/3387468711 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c978f742a0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c979070340 con 0x55c978f742a0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba175f6640 1 -- 172.21.15.169:0/3387468711 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c978f742a0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790755c0 0x55c9790779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c979078080 con 0x55c9790755c0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba16df5640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790755c0 0x55c9790779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.434+0000 7fba16df5640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790755c0 0x55c9790779b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba16df5640 1 -- 172.21.15.169:0/3387468711 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba08071990 con 0x55c9790755c0 2024-04-24T01:24:43.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c979074570 con 0x55c978f742a0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba175f6640 1 -- 172.21.15.169:0/3387468711 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c978f742a0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c9790794c0 0x55c97907b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c97907c110 con 0x55c9790794c0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba165f4640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c9790794c0 0x55c97907b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.435+0000 7fba165f4640 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c9790794c0 0x55c97907b980 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba165f4640 1 -- 172.21.15.169:0/3387468711 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba0c00f670 con 0x55c9790794c0 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba1b133800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba1b133800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c978e626b0 con 0x55c97908a5c0 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52276/0 (socket says 172.21.15.169:52276) 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.436+0000 7fba16df5640 1 -- 172.21.15.169:0/1526997772 learned_addr learned my addr 172.21.15.169:0/1526997772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fba16df5640 1 -- 172.21.15.169:0/1526997772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97908af20 con 0x55c97908a5c0 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fba16df5640 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba0808cd50 tx=0x7fba08068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fb900e01640 1 -- 172.21.15.169:0/1526997772 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08092020 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fb900e01640 1 -- 172.21.15.169:0/1526997772 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08058040 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fb900e01640 1 -- 172.21.15.169:0/1526997772 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08002a70 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97908b990 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.437+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97908b990 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fb900e01640 1 -- 172.21.15.169:0/1526997772 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba08095020 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fb900e01640 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 0x7fb8f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fb900e01640 1 -- 172.21.15.169:0/1526997772 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba08098d20 con 0x55c97908a5c0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fba165f4640 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 0x7fb8f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fba165f4640 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 0x7fb8f0038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c979073760 tx=0x7fba0c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.438+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba1b133800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba1b133800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c978f6fb30 con 0x55c979097480 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52278/0 (socket says 172.21.15.169:52278) 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba16df5640 1 -- 172.21.15.169:0/363092359 learned_addr learned my addr 172.21.15.169:0/363092359 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba16df5640 1 -- 172.21.15.169:0/363092359 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c979097e70 con 0x55c979097480 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fba16df5640 1 --2- 172.21.15.169:0/363092359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba08002170 tx=0x7fba080022a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a7a088c19ee06 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fb8fa7fc640 1 -- 172.21.15.169:0/363092359 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08002620 con 0x55c979097480 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fb8fa7fc640 1 -- 172.21.15.169:0/363092359 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba080049d0 con 0x55c979097480 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.439+0000 7fb8fa7fc640 1 -- 172.21.15.169:0/363092359 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08004600 con 0x55c979097480 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- 172.21.15.169:0/363092359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 msgr2=0x55c9790978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 --2- 172.21.15.169:0/363092359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fba08002170 tx=0x7fba080022a0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- 172.21.15.169:0/363092359 shutdown_connections 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 --2- 172.21.15.169:0/363092359 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c9790978a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- 172.21.15.169:0/363092359 >> 172.21.15.169:0/363092359 conn(0x55c979093830 msgr2=0x55c979091890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- 172.21.15.169:0/363092359 shutdown_connections 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- 172.21.15.169:0/363092359 wait complete. 2024-04-24T01:24:43.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 Processor -- start 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- start start 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c97909e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba1b133800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c979098570 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c97909e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba16df5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c97909e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:52282/0 (socket says 172.21.15.169:52282) 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.440+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 learned_addr learned my addr 172.21.15.169:0/853708564 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c97909ee30 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fba16df5640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c97909e8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba08084fb0 tx=0x7fba08082f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fb8f8ff9640 1 -- 172.21.15.169:0/853708564 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba08004600 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fb8f8ff9640 1 -- 172.21.15.169:0/853708564 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba0808b550 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c97909ee30 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fb8f8ff9640 1 -- 172.21.15.169:0/853708564 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba080047a0 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.441+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c97909ee30 con 0x55c979097480 2024-04-24T01:24:43.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fb8f8ff9640 1 -- 172.21.15.169:0/853708564 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba080bd030 con 0x55c979097480 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fb8f8ff9640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8e0036900 0x7fb8e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fb8f8ff9640 1 -- 172.21.15.169:0/853708564 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fba080bb070 con 0x55c979097480 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fba165f4640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8e0036900 0x7fb8e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fba165f4640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8e0036900 0x7fb8e0038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55c97907c510 tx=0x7fba0c023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.442+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c9790a9fc0 0x55c9790ac480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790acbd0 con 0x55c9790a9fc0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba175f6640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c9790a9fc0 0x55c9790ac480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba175f6640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c9790a9fc0 0x55c9790ac480 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 20 realm 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790acfe0 con 0x55c9790a9fc0 2024-04-24T01:24:43.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.443+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790ad8b0 con 0x55c9790a9fc0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790ae9b0 0x55c9790b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b1360 con 0x55c9790ae9b0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba16df5640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790ae9b0 0x55c9790b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.444+0000 7fba16df5640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790ae9b0 0x55c9790b0da0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba1b133800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba1b133800 20 searching for the correct realm 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c9790b3310 0x55c9790b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b5ea0 con 0x55c9790b3310 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba165f4640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c9790b3310 0x55c9790b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.445+0000 7fba165f4640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c9790b3310 0x55c9790b57d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba165f4640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fba0c03a3c0 0x7fba0c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b5ea0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba175f6640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fba0c03a3c0 0x7fba0c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba175f6640 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fba0c03a3c0 0x7fba0c03a810 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.446+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.447+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x7fba0c03a3c0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.448+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba1000a4a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x7fba0c03a3c0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.449+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.450+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.451+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x7fba0c03a3c0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.452+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x7fba0c03a3c0 2024-04-24T01:24:43.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790b3310 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790ae9b0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.453+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x55c9790a9fc0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c9790adc50 con 0x7fba0c03a3c0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:24:43.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b1c20 con 0x55c9790a9fc0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b1c20 con 0x55c9790a9fc0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:24:43.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.454+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b1c20 con 0x7fba0c03a3c0 2024-04-24T01:24:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:24:43.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 zone default found 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 4 Realm: () 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 zonegroup default 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b24c0 con 0x55c9790ae9b0 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b7d00 con 0x55c9790b3310 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.455+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b80a0 con 0x55c9790b3310 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.456+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.456+0000 7fba1b133800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.456+0000 7fba1b133800 20 started sync module instance, tier type = 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.456+0000 7fba1b133800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.456+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b71a0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.457+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.457+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94323807581584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b71a0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.457+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b8a60 con 0x55c9790a9fc0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.458+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94323807581584] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.458+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.458+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94323807586192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b71a0 con 0x55c9790a9fc0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.458+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b94b0 con 0x55c9790b3310 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.459+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.459+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94323807588288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b9d80 con 0x55c9790b3310 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.459+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790ba820 con 0x7fba0c03a3c0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.459+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94323807586192] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.460+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94323807588288] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.460+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.460+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94323807590608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b6cf0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.460+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bb0c0 con 0x55c9790a9fc0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.461+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.461+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94323807595456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bb020 con 0x55c9790a9fc0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.461+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bc020 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.461+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94323807590608] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.462+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.462+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94323807593200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bc410 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.462+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bce10 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.462+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94323807595456] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.463+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94323807593200] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.464+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.464+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94323807597744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bd1b0 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.464+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bda00 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.464+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94323807597744] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94323807605168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bda80 con 0x55c9790ae9b0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=1 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=2 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=3 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=4 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=5 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba1b133800 20 add_watcher() i=6 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.465+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94323807605168] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.466+0000 7fba1b133800 20 add_watcher() i=7 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.466+0000 7fba1b133800 2 all 8 watchers are set, enabling cache 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.466+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0ea0 con 0x55c9790a9fc0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.466+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.466+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94323807619184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790bdc80 con 0x55c9790a9fc0 2024-04-24T01:24:43.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.467+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94323807619184] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.467+0000 7fb8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.467+0000 7fba1b133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.467+0000 7fba1b133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.467+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0040 con 0x55c9790a9fc0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.468+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.468+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c9f60 con 0x55c9790ae9b0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.469+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.469+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c9f60 con 0x55c9790b3310 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.470+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.470+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790ca980 con 0x55c9790a9fc0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.471+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'198 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.471+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c95d0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.472+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'74 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.472+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c95d0 con 0x55c9790b3310 2024-04-24T01:24:43.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.473+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'55 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.473+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cbb60 con 0x55c9790a9fc0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.474+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.474+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cbb60 con 0x55c9790ae9b0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.475+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'49 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.475+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cbb60 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.476+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.476+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cbbf0 con 0x55c9790b3310 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.477+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.477+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.478+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'75 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.478+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x55c9790ae9b0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.479+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.479+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.480+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.480+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x55c9790ae9b0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.481+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'62 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.481+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x55c9790a9fc0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.482+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'199 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.482+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc160 con 0x55c9790b3310 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.483+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.483+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc710 con 0x7fba0c03a3c0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.484+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'76 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.484+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.485+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'37 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.485+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790a9fc0 2024-04-24T01:24:43.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.487+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.487+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790a9fc0 2024-04-24T01:24:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.487+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'200 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.487+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.488+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.488+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x7fba0c03a3c0 2024-04-24T01:24:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.489+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.490+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.490+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.491+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.492+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'43 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.492+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.493+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.493+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.493+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'56 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.493+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790ae9b0 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.494+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.494+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.495+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.495+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790ae9b0 2024-04-24T01:24:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.496+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'50 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.496+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790b3310 2024-04-24T01:24:43.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.497+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.497+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x55c9790ae9b0 2024-04-24T01:24:43.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.499+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'63 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.499+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790cc410 con 0x7fba0c03a3c0 2024-04-24T01:24:43.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.499+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fb847fff640 20 reqs_thread_entry: start 2024-04-24T01:24:43.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fba1b133800 20 init_complete bucket index max shards: 11 2024-04-24T01:24:43.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fba1b133800 20 Filter name: none 2024-04-24T01:24:43.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fb845ffb640 20 reqs_thread_entry: start 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fba1b133800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fba1b133800 20 rados->read ofs=0 len=0 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.500+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790f72f0 con 0x55c9790a9fc0 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba1b133800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba1b133800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:24:43.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba1b133800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:24:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba1b133800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:24:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c9790f72b0 con 0x7fba0c03a3c0 2024-04-24T01:24:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.501+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.503 INFO:teuthology.orchestra.run.smithi169.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-04-24T01:24:43.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.502+0000 7fb8cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:24:43.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.502+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94323807619184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790ca4d0 con 0x55c9790a9fc0 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.503+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94323807619184] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.503+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94323807581584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0870 con 0x7fba0c03a3c0 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.504+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94323807581584] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.504+0000 7fba1b133800 20 remove_watcher() i=0 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.504+0000 7fba1b133800 2 removed watcher, disabling cache 2024-04-24T01:24:43.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.504+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94323807586192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0870 con 0x55c9790a9fc0 2024-04-24T01:24:43.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.505+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94323807586192] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.505+0000 7fba1b133800 20 remove_watcher() i=1 2024-04-24T01:24:43.506 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.505+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94323807588288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b8790 con 0x55c9790b3310 2024-04-24T01:24:43.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.506+0000 7fba165f4640 1 -- 172.21.15.169:0/853708564 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94323807588288] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba0c037040 con 0x55c9790b3310 2024-04-24T01:24:43.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.506+0000 7fba1b133800 20 remove_watcher() i=2 2024-04-24T01:24:43.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.506+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94323807590608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0870 con 0x7fba0c03a3c0 2024-04-24T01:24:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.507+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94323807590608] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x7fba0c03a3c0 2024-04-24T01:24:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.507+0000 7fba1b133800 20 remove_watcher() i=3 2024-04-24T01:24:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.507+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94323807595456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b98d0 con 0x55c9790a9fc0 2024-04-24T01:24:43.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.508+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94323807595456] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba10032040 con 0x55c9790a9fc0 2024-04-24T01:24:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.508+0000 7fba1b133800 20 remove_watcher() i=4 2024-04-24T01:24:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.508+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94323807593200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790c0870 con 0x55c9790ae9b0 2024-04-24T01:24:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.509+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94323807593200] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.509+0000 7fba1b133800 20 remove_watcher() i=5 2024-04-24T01:24:43.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.509+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94323807597744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790babc0 con 0x55c9790ae9b0 2024-04-24T01:24:43.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.510+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94323807597744] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.510+0000 7fba1b133800 20 remove_watcher() i=6 2024-04-24T01:24:43.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.510+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94323807605168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c9790b98d0 con 0x55c9790ae9b0 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba16df5640 1 -- 172.21.15.169:0/853708564 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94323807605168] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba08071990 con 0x55c9790ae9b0 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 20 remove_watcher() i=7 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790ae9b0 msgr2=0x55c9790b0da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790ae9b0 0x55c9790b0da0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c9790a9fc0 msgr2=0x55c9790ac480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c9790a9fc0 0x55c9790ac480 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fba0c03a3c0 msgr2=0x7fba0c03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fba0c03a3c0 0x7fba0c03a810 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c9790b3310 msgr2=0x55c9790b57d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.511+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c9790b3310 0x55c9790b57d0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8e0036900 msgr2=0x7fb8e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8e0036900 0x7fb8e0038dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55c97907c510 tx=0x7fba0c023040 comp rx=0 tx=0).stop 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 msgr2=0x55c97909e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/853708564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c979097480 0x55c97909e8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fba08084fb0 tx=0x7fba08082f40 comp rx=0 tx=0).stop 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 reap_dead start 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba175f6640 1 -- 172.21.15.169:0/853708564 reap_dead start 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 shutdown_connections 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 >> 172.21.15.169:0/853708564 conn(0x55c979093830 msgr2=0x55c979090e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 shutdown_connections 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/853708564 wait complete. 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 msgr2=0x7fb8f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 0x7fb8f0038dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c979073760 tx=0x7fba0c006000 comp rx=0 tx=0).stop 2024-04-24T01:24:43.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 msgr2=0x55c97908a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fba0808cd50 tx=0x7fba08068e30 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 shutdown_connections 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8f0036900 0x7fb8f0038dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/1526997772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c97908a5c0 0x55c97908a9e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 >> 172.21.15.169:0/1526997772 conn(0x55c97907e660 msgr2=0x55c97907ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 shutdown_connections 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/1526997772 wait complete. 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790755c0 msgr2=0x55c9790779b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c9790755c0 0x55c9790779b0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c978f742a0 msgr2=0x55c979072d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c978f742a0 0x55c979072d90 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c9790794c0 msgr2=0x55c97907b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.512+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c9790794c0 0x55c97907b980 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8fc036950 msgr2=0x7fb8fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb8fc036950 0x7fb8fc038e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba0c000c00 tx=0x7fba0c0013b0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 msgr2=0x55c97906bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 --2- 172.21.15.169:0/3387468711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c978f71970 0x55c97906bb50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fba08060040 tx=0x7fba08002fb0 comp rx=0 tx=0).stop 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba175f6640 1 -- 172.21.15.169:0/3387468711 reap_dead start 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 shutdown_connections 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 >> 172.21.15.169:0/3387468711 conn(0x55c978f6b320 msgr2=0x55c97905d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 shutdown_connections 2024-04-24T01:24:43.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:24:43.513+0000 7fba1b133800 1 -- 172.21.15.169:0/3387468711 wait complete. 2024-04-24T01:24:43.521 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:24:43.540 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:24:43.545 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-04-24T01:25:18.546 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-04-24T01:25:18.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-04-24T01:25:18.547 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-04-24T01:25:18.598 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:18.598 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35fc12800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55d5a196bf90 0x55d5a196c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35fc12800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5a182ad40 con 0x55d5a196d100 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35fc12800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55d5a17fd4d0 con 0x55d5a196bf90 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35b27d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55d5a196bf90 0x55d5a196c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35aa7c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55d5a196d100 0x55d5a196d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46464/0 (socket says 172.21.15.169:46464) 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35aa7c640 1 -- 172.21.15.169:0/799542565 learned_addr learned my addr 172.21.15.169:0/799542565 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.599+0000 7ff35b27d640 1 -- 172.21.15.169:0/799542565 >> v1:172.21.15.142:6789/0 conn(0x55d5a196d100 legacy=0x55d5a196d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.600+0000 7ff35b27d640 1 -- 172.21.15.169:0/799542565 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1829590 con 0x55d5a196bf90 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35b27d640 1 --2- 172.21.15.169:0/799542565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a196c3b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00a470 tx=0x7ff34c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67885a7033b326d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35a27b640 1 -- 172.21.15.169:0/799542565 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c057070 con 0x55d5a196bf90 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35a27b640 1 -- 172.21.15.169:0/799542565 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c052570 con 0x55d5a196bf90 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35a27b640 1 -- 172.21.15.169:0/799542565 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c052870 con 0x55d5a196bf90 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 -- 172.21.15.169:0/799542565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 msgr2=0x55d5a196c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 --2- 172.21.15.169:0/799542565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a196c3b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00a470 tx=0x7ff34c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 -- 172.21.15.169:0/799542565 shutdown_connections 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 --2- 172.21.15.169:0/799542565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a196c3b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 -- 172.21.15.169:0/799542565 >> 172.21.15.169:0/799542565 conn(0x55d5a1967530 msgr2=0x55d5a1969950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 -- 172.21.15.169:0/799542565 shutdown_connections 2024-04-24T01:25:18.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.602+0000 7ff35fc12800 1 -- 172.21.15.169:0/799542565 wait complete. 2024-04-24T01:25:18.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35fc12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35fc12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d5a18b73c0 con 0x55d5a196bf90 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44908/0 (socket says 172.21.15.169:44908) 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.616+0000 7ff35b27d640 1 -- 172.21.15.169:0/3987863803 learned_addr learned my addr 172.21.15.169:0/3987863803 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.617+0000 7ff35b27d640 1 -- 172.21.15.169:0/3987863803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a18dff60 con 0x55d5a196bf90 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.617+0000 7ff35b27d640 1 --2- 172.21.15.169:0/3987863803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff34c055040 tx=0x7ff34c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb5a98b2045c701 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.617+0000 7ff24960a640 1 -- 172.21.15.169:0/3987863803 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c057070 con 0x55d5a196bf90 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.617+0000 7ff24960a640 1 -- 172.21.15.169:0/3987863803 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c063070 con 0x55d5a196bf90 2024-04-24T01:25:18.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.617+0000 7ff24960a640 1 -- 172.21.15.169:0/3987863803 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c052720 con 0x55d5a196bf90 2024-04-24T01:25:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- 172.21.15.169:0/3987863803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 msgr2=0x55d5a18e19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3987863803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff34c055040 tx=0x7ff34c04c000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- 172.21.15.169:0/3987863803 shutdown_connections 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3987863803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a18e19a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- 172.21.15.169:0/3987863803 >> 172.21.15.169:0/3987863803 conn(0x55d5a1967530 msgr2=0x55d5a1a58ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- 172.21.15.169:0/3987863803 shutdown_connections 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- 172.21.15.169:0/3987863803 wait complete. 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.618+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35fc12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a1a67250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35fc12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d5a1975570 con 0x55d5a196bf90 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a1a67250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a1a67250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44924/0 (socket says 172.21.15.169:44924) 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35b27d640 1 -- 172.21.15.169:0/862527532 learned_addr learned my addr 172.21.15.169:0/862527532 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35b27d640 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1a67790 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff35b27d640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a1a67250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff34c060040 tx=0x7ff34c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff247e07640 1 -- 172.21.15.169:0/862527532 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c052c70 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.619+0000 7ff247e07640 1 -- 172.21.15.169:0/862527532 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c06c070 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.620+0000 7ff247e07640 1 -- 172.21.15.169:0/862527532 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c05e480 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.620+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a1a67a20 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.620+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a1a6a6d0 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.620+0000 7ff247e07640 1 -- 172.21.15.169:0/862527532 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff34c05e620 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff247e07640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff240036900 0x7ff240038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff247e07640 1 -- 172.21.15.169:0/862527532 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff34c08e810 con 0x55d5a196bf90 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff240036900 0x7ff240038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a196d100 0x55d5a1a6e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1a6ea60 con 0x55d5a196d100 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a196d100 0x55d5a1a6e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff240036900 0x7ff240038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f60 tx=0x7ff3500012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.621+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a196d100 0x55d5a1a6e490 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35ba7e640 1 -- 172.21.15.169:0/862527532 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a196d100 2024-04-24T01:25:18.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1a6ba40 con 0x55d5a196d100 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35ba7e640 1 -- 172.21.15.169:0/862527532 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a196d100 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1a70d90 0x55d5a1a73180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1a73820 con 0x55d5a1a70d90 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.622+0000 7ff35b27d640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1a70d90 0x55d5a1a73180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35b27d640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1a70d90 0x55d5a1a73180 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35b27d640 1 -- 172.21.15.169:0/862527532 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff34c009d10 con 0x55d5a1a70d90 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1a6fd40 con 0x55d5a196d100 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35ba7e640 1 -- 172.21.15.169:0/862527532 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a196d100 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55d5a1a74cd0 0x55d5a1a77120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1a77880 con 0x55d5a1a74cd0 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.623+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55d5a1a74cd0 0x55d5a1a77120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.624+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55d5a1a74cd0 0x55d5a1a77120 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.624+0000 7ff35aa7c640 1 -- 172.21.15.169:0/862527532 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1a74cd0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.624+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.624+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35fc12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35fc12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d5a185d6b0 con 0x55d5a1a85ce0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44930/0 (socket says 172.21.15.169:44930) 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35b27d640 1 -- 172.21.15.169:0/446110076 learned_addr learned my addr 172.21.15.169:0/446110076 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35b27d640 1 -- 172.21.15.169:0/446110076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1a86640 con 0x55d5a1a85ce0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35b27d640 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff34c068010 tx=0x7ff34c079460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff245602640 1 -- 172.21.15.169:0/446110076 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c081040 con 0x55d5a1a85ce0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff245602640 1 -- 172.21.15.169:0/446110076 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c058040 con 0x55d5a1a85ce0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.625+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a1a870b0 con 0x55d5a1a85ce0 2024-04-24T01:25:18.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.626+0000 7ff245602640 1 -- 172.21.15.169:0/446110076 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c08eb30 con 0x55d5a1a85ce0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.626+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a1a875b0 con 0x55d5a1a85ce0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.626+0000 7ff245602640 1 -- 172.21.15.169:0/446110076 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff34c095060 con 0x55d5a1a85ce0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.626+0000 7ff245602640 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 0x7ff234038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff245602640 1 -- 172.21.15.169:0/446110076 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff34c098d20 con 0x55d5a1a85ce0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 0x7ff234038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 0x7ff234038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff35000bf50 tx=0x7ff35000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35fc12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35fc12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d5a18e0220 con 0x55d5a1a92e00 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44934/0 (socket says 172.21.15.169:44934) 2024-04-24T01:25:18.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.627+0000 7ff35b27d640 1 -- 172.21.15.169:0/3102212972 learned_addr learned my addr 172.21.15.169:0/3102212972 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35b27d640 1 -- 172.21.15.169:0/3102212972 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1a937f0 con 0x55d5a1a92e00 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35b27d640 1 --2- 172.21.15.169:0/3102212972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff34c07d3b0 tx=0x7ff34c07d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3568dd18199e7cb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff23effd640 1 -- 172.21.15.169:0/3102212972 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c09d040 con 0x55d5a1a92e00 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff23effd640 1 -- 172.21.15.169:0/3102212972 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c079900 con 0x55d5a1a92e00 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff23effd640 1 -- 172.21.15.169:0/3102212972 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c073bc0 con 0x55d5a1a92e00 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 -- 172.21.15.169:0/3102212972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 msgr2=0x55d5a1a93220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3102212972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff34c07d3b0 tx=0x7ff34c07d4c0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 -- 172.21.15.169:0/3102212972 shutdown_connections 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3102212972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a93220 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 -- 172.21.15.169:0/3102212972 >> 172.21.15.169:0/3102212972 conn(0x55d5a1a8f160 msgr2=0x55d5a1a8d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 -- 172.21.15.169:0/3102212972 shutdown_connections 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.628+0000 7ff35fc12800 1 -- 172.21.15.169:0/3102212972 wait complete. 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35fc12800 1 Processor -- start 2024-04-24T01:25:18.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35fc12800 1 -- start start 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35fc12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35fc12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55d5a1a93ea0 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35b27d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44946/0 (socket says 172.21.15.169:44946) 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.629+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 learned_addr learned my addr 172.21.15.169:0/3537328801 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5a1a9a7b0 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff35b27d640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff34c07d3b0 tx=0x7ff34c07dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff23d7fa640 1 -- 172.21.15.169:0/3537328801 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c0b1070 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff23d7fa640 1 -- 172.21.15.169:0/3537328801 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34c0730c0 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5a1a9a7b0 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff23d7fa640 1 -- 172.21.15.169:0/3537328801 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34c0733c0 con 0x55d5a1a92e00 2024-04-24T01:25:18.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.630+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5a1a9a7b0 con 0x55d5a1a92e00 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff23d7fa640 1 -- 172.21.15.169:0/3537328801 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff34c0a9070 con 0x55d5a1a92e00 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff23d7fa640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff224036900 0x7ff224038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff23d7fa640 1 -- 172.21.15.169:0/3537328801 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7ff34c0a7020 con 0x55d5a1a92e00 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff224036900 0x7ff224038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a1aa5970 0x55d5a1aa7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa8580 con 0x55d5a1aa5970 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.631+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a1aa5970 0x55d5a1aa7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff224036900 0x7ff224038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff350001b60 tx=0x7ff350010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a1aa5970 0x55d5a1aa7e30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 20 realm 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa8990 con 0x55d5a1aa5970 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.632+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9260 con 0x55d5a1aa5970 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1aaa0f0 0x55d5a1aac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aacc40 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35b27d640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1aaa0f0 0x55d5a1aac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.633+0000 7ff35b27d640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1aaa0f0 0x55d5a1aac4e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35fc12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35fc12800 20 searching for the correct realm 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55d5a1aaecf0 0x55d5a1ab11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab1880 con 0x55d5a1aaecf0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55d5a1aaecf0 0x55d5a1ab11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.634+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55d5a1aaecf0 0x55d5a1ab11b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35aa7c640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff350038040 0x7ff35001bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab1880 con 0x7ff350038040 2024-04-24T01:25:18.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff350038040 0x7ff35001bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35ba7e640 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff350038040 0x7ff35001bab0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x7ff350038040 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.635+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.636+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x7ff350038040 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x7ff350038040 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.637+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35400a4a0 con 0x55d5a1aa5970 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x7ff350038040 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.638+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.639+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.640+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x7ff350038040 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.641+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.642+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x7ff350038040 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaecf0 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.643+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x55d5a1aa5970 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aa9600 con 0x7ff350038040 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:18.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aad5f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aad5f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.644+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aad5c0 con 0x7ff350038040 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 zone default found 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 4 Realm: () 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 zonegroup default 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aad9e0 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab36e0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.645+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab3a80 con 0x55d5a1aaecf0 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.646+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.646+0000 7ff35fc12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.646+0000 7ff35fc12800 20 started sync module instance, tier type = 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.646+0000 7ff35fc12800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.646+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aae250 con 0x7ff350038040 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.647+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.647+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94376028744656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab3e20 con 0x7ff350038040 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.647+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab4670 con 0x55d5a1aa5970 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.648+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94376028744656] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.648+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.648+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94376028749344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab46f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.648+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab4f80 con 0x55d5a1aaecf0 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.649+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94376028749344] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.650+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.650+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94376028750880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab5370 con 0x55d5a1aaecf0 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.650+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab5d90 con 0x7ff350038040 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.651+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94376028750880] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.651+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.651+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94376028756096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab6180 con 0x7ff350038040 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.651+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab6b80 con 0x55d5a1aa5970 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.652+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94376028756096] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.652+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.652+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94376028752064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab6b40 con 0x55d5a1aa5970 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.652+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab7590 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.653+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94376028752064] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.653+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.653+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94376028759696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab6ab0 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.653+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab8300 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.654+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.654+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94376028765744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab8ba0 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.654+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab9680 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.655+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94376028759696] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94376028770704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab9680 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=0 2024-04-24T01:25:18.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=1 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=2 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=3 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=4 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.656+0000 7ff35fc12800 20 add_watcher() i=5 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94376028765744] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35fc12800 20 add_watcher() i=6 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94376028770704] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35fc12800 20 add_watcher() i=7 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35fc12800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab86f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.657+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94376028764544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab86f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.658+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94376028764544] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.658+0000 7ff211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 5 note: GC not initialized 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff210fe1640 20 reqs_thread_entry: start 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 20 Filter name: none 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff18a7fc640 20 reqs_thread_entry: start 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aefee0 con 0x55d5a1aa5970 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.659+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aefea0 con 0x7ff350038040 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aefea0 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aefea0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af03b0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.660+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af07f0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af07f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af07f0 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af07f0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.678 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af0770 con 0x55d5a1aaecf0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.661+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af0750 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.662+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.662+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2220 con 0x55d5a1aa5970 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2220 con 0x7ff350038040 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2220 con 0x55d5a1aaecf0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2220 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.663+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2220 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af21d0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.664+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x55d5a1aa5970 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x55d5a1aaecf0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x7ff350038040 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.665+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2150 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.680 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af2130 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.666+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.681 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.667+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1af20e0 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.668+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.669+0000 7ff211fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.669+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94376028764544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1aedb10 con 0x55d5a1aa5970 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.670+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94376028764544] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.670+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94376028744656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab7980 con 0x7ff350038040 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.671+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94376028744656] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.671+0000 7ff35fc12800 20 remove_watcher() i=0 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.671+0000 7ff35fc12800 2 removed watcher, disabling cache 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.671+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94376028749344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab2bd0 con 0x55d5a1aa5970 2024-04-24T01:25:18.682 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.672+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94376028749344] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.672+0000 7ff35fc12800 20 remove_watcher() i=1 2024-04-24T01:25:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.672+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94376028750880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab2bd0 con 0x55d5a1aaecf0 2024-04-24T01:25:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.673+0000 7ff35aa7c640 1 -- 172.21.15.169:0/3537328801 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94376028750880] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350009050 con 0x55d5a1aaecf0 2024-04-24T01:25:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.673+0000 7ff35fc12800 20 remove_watcher() i=2 2024-04-24T01:25:18.683 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.673+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94376028756096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab4420 con 0x7ff350038040 2024-04-24T01:25:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.674+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94376028756096] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x7ff350038040 2024-04-24T01:25:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.674+0000 7ff35fc12800 20 remove_watcher() i=3 2024-04-24T01:25:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.674+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94376028752064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab2bd0 con 0x55d5a1aa5970 2024-04-24T01:25:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.675+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94376028752064] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff354032040 con 0x55d5a1aa5970 2024-04-24T01:25:18.687 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.675+0000 7ff35fc12800 20 remove_watcher() i=4 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.675+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94376028759696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab5880 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.676+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94376028759696] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.676+0000 7ff35fc12800 20 remove_watcher() i=5 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.676+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94376028765744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab2bd0 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.677+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94376028765744] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.677+0000 7ff35fc12800 20 remove_watcher() i=6 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.677+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94376028770704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55d5a1ab6690 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35b27d640 1 -- 172.21.15.169:0/3537328801 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94376028770704] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c0a0040 con 0x55d5a1aaa0f0 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35fc12800 20 remove_watcher() i=7 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1aaa0f0 msgr2=0x55d5a1aac4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1aaa0f0 0x55d5a1aac4e0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a1aa5970 msgr2=0x55d5a1aa7e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.688 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.678+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a1aa5970 0x55d5a1aa7e30 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff350038040 msgr2=0x7ff35001bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7ff350038040 0x7ff35001bab0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55d5a1aaecf0 msgr2=0x55d5a1ab11b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55d5a1aaecf0 0x55d5a1ab11b0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff224036900 msgr2=0x7ff224038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff224036900 0x7ff224038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff350001b60 tx=0x7ff350010000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 msgr2=0x55d5a1a9a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35ba7e640 1 -- 172.21.15.169:0/3537328801 reap_dead start 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff34c07d3b0 tx=0x7ff34c07dfa0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 shutdown_connections 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/3537328801 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a92e00 0x55d5a1a9a270 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 >> 172.21.15.169:0/3537328801 conn(0x55d5a1a8f160 msgr2=0x55d5a1a8c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 shutdown_connections 2024-04-24T01:25:18.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/3537328801 wait complete. 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 msgr2=0x7ff234038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 0x7ff234038dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff35000bf50 tx=0x7ff35000f000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 msgr2=0x55d5a1a86100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff34c068010 tx=0x7ff34c079460 comp rx=0 tx=0).stop 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 shutdown_connections 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff234036900 0x7ff234038dc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 --2- 172.21.15.169:0/446110076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a1a85ce0 0x55d5a1a86100 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 >> 172.21.15.169:0/446110076 conn(0x55d5a1a79d80 msgr2=0x55d5a1a7a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 shutdown_connections 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.679+0000 7ff35fc12800 1 -- 172.21.15.169:0/446110076 wait complete. 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1a70d90 msgr2=0x55d5a1a73180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55d5a1a70d90 0x55d5a1a73180 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a196d100 msgr2=0x55d5a1a6e490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55d5a196d100 0x55d5a1a6e490 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55d5a1a74cd0 msgr2=0x55d5a1a77120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55d5a1a74cd0 0x55d5a1a77120 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff240036900 msgr2=0x7ff240038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7ff240036900 0x7ff240038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff350000f60 tx=0x7ff3500012b0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 msgr2=0x55d5a1a67250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 --2- 172.21.15.169:0/862527532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5a196bf90 0x55d5a1a67250 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff34c060040 tx=0x7ff34c002fb0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35ba7e640 1 -- 172.21.15.169:0/862527532 reap_dead start 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 shutdown_connections 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 >> 172.21.15.169:0/862527532 conn(0x55d5a1967530 msgr2=0x55d5a1a58ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 shutdown_connections 2024-04-24T01:25:18.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.680+0000 7ff35fc12800 1 -- 172.21.15.169:0/862527532 wait complete. 2024-04-24T01:25:18.692 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T01:25:18.692 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:25:18.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-04-24T01:25:18.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-04-24T01:25:18.693 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-04-24T01:25:18.733 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:18.734 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334ff19800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559dc6ea51a0 0x559dc6ea7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334ff19800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559dc6d60d40 con 0x559dc6ea0d10 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334ff19800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x559dc6d334d0 con 0x559dc6ea51a0 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334d217640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559dc6ea51a0 0x559dc6ea7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334d217640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x559dc6ea51a0 0x559dc6ea7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44954/0 (socket says 172.21.15.169:44954) 2024-04-24T01:25:18.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334da18640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x559dc6ea0d10 0x559dc6ea1130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46478/0 (socket says 172.21.15.169:46478) 2024-04-24T01:25:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.734+0000 7f334d217640 1 -- 172.21.15.169:0/3716082457 learned_addr learned my addr 172.21.15.169:0/3716082457 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.735+0000 7f334d217640 1 -- 172.21.15.169:0/3716082457 >> v1:172.21.15.142:6789/0 conn(0x559dc6ea0d10 legacy=0x559dc6ea1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.735+0000 7f334d217640 1 -- 172.21.15.169:0/3716082457 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6d5f590 con 0x559dc6ea51a0 2024-04-24T01:25:18.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.736+0000 7f334d217640 1 --2- 172.21.15.169:0/3716082457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea51a0 0x559dc6ea7590 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f334400a520 tx=0x7f334401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57da4e8a9b4cf43f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ca16640 1 -- 172.21.15.169:0/3716082457 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3344057070 con 0x559dc6ea51a0 2024-04-24T01:25:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ca16640 1 -- 172.21.15.169:0/3716082457 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3344052570 con 0x559dc6ea51a0 2024-04-24T01:25:18.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ca16640 1 -- 172.21.15.169:0/3716082457 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334404ae60 con 0x559dc6ea51a0 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 -- 172.21.15.169:0/3716082457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea51a0 msgr2=0x559dc6ea7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 --2- 172.21.15.169:0/3716082457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea51a0 0x559dc6ea7590 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f334400a520 tx=0x7f334401d010 comp rx=0 tx=0).stop 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 -- 172.21.15.169:0/3716082457 shutdown_connections 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 --2- 172.21.15.169:0/3716082457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea51a0 0x559dc6ea7590 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 -- 172.21.15.169:0/3716082457 >> 172.21.15.169:0/3716082457 conn(0x559dc6e9c370 msgr2=0x559dc6e9e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 -- 172.21.15.169:0/3716082457 shutdown_connections 2024-04-24T01:25:18.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.737+0000 7f334ff19800 1 -- 172.21.15.169:0/3716082457 wait complete. 2024-04-24T01:25:18.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.751+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.751+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.751+0000 7f334ff19800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.751+0000 7f334ff19800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559dc6ded3b0 con 0x559dc6ea0d10 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.751+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44968/0 (socket says 172.21.15.169:44968) 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f334da18640 1 -- 172.21.15.169:0/4204729480 learned_addr learned my addr 172.21.15.169:0/4204729480 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f334da18640 1 -- 172.21.15.169:0/4204729480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6f92590 con 0x559dc6ea0d10 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f334da18640 1 --2- 172.21.15.169:0/4204729480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f334000d440 tx=0x7f334000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760b34d05b45b719 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f323be07640 1 -- 172.21.15.169:0/4204729480 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334000b750 con 0x559dc6ea0d10 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f323be07640 1 -- 172.21.15.169:0/4204729480 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3340006070 con 0x559dc6ea0d10 2024-04-24T01:25:18.753 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.752+0000 7f323be07640 1 -- 172.21.15.169:0/4204729480 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334000ba20 con 0x559dc6ea0d10 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 -- 172.21.15.169:0/4204729480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 msgr2=0x559dc6f91fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 --2- 172.21.15.169:0/4204729480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f334000d440 tx=0x7f334000d900 comp rx=0 tx=0).stop 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 -- 172.21.15.169:0/4204729480 shutdown_connections 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 --2- 172.21.15.169:0/4204729480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f91fc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 -- 172.21.15.169:0/4204729480 >> 172.21.15.169:0/4204729480 conn(0x559dc6e9c370 msgr2=0x559dc6f8d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 -- 172.21.15.169:0/4204729480 shutdown_connections 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.753+0000 7f334ff19800 1 -- 172.21.15.169:0/4204729480 wait complete. 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334ff19800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f98ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334ff19800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559dc6ea7e60 con 0x559dc6ea0d10 2024-04-24T01:25:18.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f98ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f98ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44972/0 (socket says 172.21.15.169:44972) 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.754+0000 7f334da18640 1 -- 172.21.15.169:0/979109172 learned_addr learned my addr 172.21.15.169:0/979109172 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f334da18640 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6f98ff0 con 0x559dc6ea0d10 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f334da18640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f98ab0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x559dc6f92d50 tx=0x7f3340000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f323a604640 1 -- 172.21.15.169:0/979109172 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3340025020 con 0x559dc6ea0d10 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f323a604640 1 -- 172.21.15.169:0/979109172 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334001c040 con 0x559dc6ea0d10 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dc6f99280 con 0x559dc6ea0d10 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f323a604640 1 -- 172.21.15.169:0/979109172 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3340017b10 con 0x559dc6ea0d10 2024-04-24T01:25:18.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.755+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc6fa0340 con 0x559dc6ea0d10 2024-04-24T01:25:18.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f323a604640 1 -- 172.21.15.169:0/979109172 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3340028020 con 0x559dc6ea0d10 2024-04-24T01:25:18.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f323a604640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3234036900 0x7f3234038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f323a604640 1 -- 172.21.15.169:0/979109172 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f334004c730 con 0x559dc6ea0d10 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f334d217640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3234036900 0x7f3234038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6ea51a0 0x559dc6fa4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f334e219640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6ea51a0 0x559dc6fa4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fa46d0 con 0x559dc6ea51a0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.756+0000 7f334d217640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3234036900 0x7f3234038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334e219640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6ea51a0 0x559dc6fa4100 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334e219640 1 -- 172.21.15.169:0/979109172 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6ea51a0 2024-04-24T01:25:18.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fa4f50 con 0x559dc6ea51a0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334e219640 1 -- 172.21.15.169:0/979109172 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6ea51a0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fa6860 0x559dc6fa8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.757+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fa9480 con 0x559dc6fa6860 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.758+0000 7f334da18640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fa6860 0x559dc6fa8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.758+0000 7f334da18640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fa6860 0x559dc6fa8cf0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.758+0000 7f334da18640 1 -- 172.21.15.169:0/979109172 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fa6860 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.758+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fa57d0 con 0x559dc6ea51a0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.759+0000 7f334e219640 1 -- 172.21.15.169:0/979109172 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6ea51a0 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.759+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559dc6faa930 0x559dc6facda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.759+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fad500 con 0x559dc6faa930 2024-04-24T01:25:18.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.759+0000 7f334d217640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559dc6faa930 0x559dc6facda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.760+0000 7f334d217640 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559dc6faa930 0x559dc6facda0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.760+0000 7f334d217640 1 -- 172.21.15.169:0/979109172 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f334405a040 con 0x559dc6faa930 2024-04-24T01:25:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.760+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.760+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334ff19800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334ff19800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559dc6d936b0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44976/0 (socket says 172.21.15.169:44976) 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334da18640 1 -- 172.21.15.169:0/2647020791 learned_addr learned my addr 172.21.15.169:0/2647020791 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334da18640 1 -- 172.21.15.169:0/2647020791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6f9cd10 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f334da18640 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f334000bff0 tx=0x7f3340029f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.761+0000 7f32337fe640 1 -- 172.21.15.169:0/2647020791 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3340014930 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.762+0000 7f32337fe640 1 -- 172.21.15.169:0/2647020791 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334004c0b0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.762+0000 7f32337fe640 1 -- 172.21.15.169:0/2647020791 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334004c3d0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.762+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dc6f9d7d0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.762+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc6f9dcd0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.762+0000 7f32337fe640 1 -- 172.21.15.169:0/2647020791 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f33400442c0 con 0x559dc6f9c3b0 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f32337fe640 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 0x7f3228038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f32337fe640 1 -- 172.21.15.169:0/2647020791 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3340043070 con 0x559dc6f9c3b0 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334d217640 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 0x7f3228038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334d217640 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 0x7f3228038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x559dc6fa15f0 tx=0x7f3344005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334ff19800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334ff19800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559dc6f92910 con 0x559dc6fcce10 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44980/0 (socket says 172.21.15.169:44980) 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.763+0000 7f334da18640 1 -- 172.21.15.169:0/2853679718 learned_addr learned my addr 172.21.15.169:0/2853679718 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.764+0000 7f334da18640 1 -- 172.21.15.169:0/2853679718 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6fcd800 con 0x559dc6fcce10 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.764+0000 7f334da18640 1 --2- 172.21.15.169:0/2853679718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3340034810 tx=0x7f3340034900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252de127b97af55a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.764+0000 7f32317fa640 1 -- 172.21.15.169:0/2853679718 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334003ee60 con 0x559dc6fcce10 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.764+0000 7f32317fa640 1 -- 172.21.15.169:0/2853679718 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3340049600 con 0x559dc6fcce10 2024-04-24T01:25:18.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.764+0000 7f32317fa640 1 -- 172.21.15.169:0/2853679718 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3340005050 con 0x559dc6fcce10 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- 172.21.15.169:0/2853679718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 msgr2=0x559dc6fcd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 --2- 172.21.15.169:0/2853679718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3340034810 tx=0x7f3340034900 comp rx=0 tx=0).stop 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- 172.21.15.169:0/2853679718 shutdown_connections 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 --2- 172.21.15.169:0/2853679718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fcd230 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- 172.21.15.169:0/2853679718 >> 172.21.15.169:0/2853679718 conn(0x559dc6fc9170 msgr2=0x559dc6fc71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- 172.21.15.169:0/2853679718 shutdown_connections 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- 172.21.15.169:0/2853679718 wait complete. 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 Processor -- start 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- start start 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fd4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.765+0000 7f334ff19800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x559dc6fcdeb0 con 0x559dc6fcce10 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.766+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fd4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.766+0000 7f334da18640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fd4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44990/0 (socket says 172.21.15.169:44990) 2024-04-24T01:25:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.766+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 learned_addr learned my addr 172.21.15.169:0/2918981734 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.766+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc6fd4780 con 0x559dc6fcce10 2024-04-24T01:25:18.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.766+0000 7f334da18640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fd4240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3340029d50 tx=0x7f3340029ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.767+0000 7f321f7fe640 1 -- 172.21.15.169:0/2918981734 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334003ec80 con 0x559dc6fcce10 2024-04-24T01:25:18.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.767+0000 7f321f7fe640 1 -- 172.21.15.169:0/2918981734 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334004cc60 con 0x559dc6fcce10 2024-04-24T01:25:18.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.767+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559dc6fd4780 con 0x559dc6fcce10 2024-04-24T01:25:18.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.767+0000 7f321f7fe640 1 -- 172.21.15.169:0/2918981734 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f334001d270 con 0x559dc6fcce10 2024-04-24T01:25:18.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.767+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc6fd4780 con 0x559dc6fcce10 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.768+0000 7f321f7fe640 1 -- 172.21.15.169:0/2918981734 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3340072060 con 0x559dc6fcce10 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.768+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.768+0000 7f321f7fe640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3218036950 0x7f3218038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f321f7fe640 1 -- 172.21.15.169:0/2918981734 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f334006cda0 con 0x559dc6fcce10 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334d217640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3218036950 0x7f3218038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6fdf9d0 0x559dc6fe1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe25e0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334e219640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6fdf9d0 0x559dc6fe1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334e219640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6fdf9d0 0x559dc6fe1e90 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334d217640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3218036950 0x7f3218038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3344000c00 tx=0x7f334404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.769+0000 7f334ff19800 20 realm 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe29f0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3290 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.770+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fe4390 0x559dc6fe6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe6cc0 con 0x559dc6fe4390 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334da18640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fe4390 0x559dc6fe6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334da18640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fe4390 0x559dc6fe6780 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334ff19800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334ff19800 20 searching for the correct realm 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559dc6fe8d40 0x559dc6feb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6feb8d0 con 0x559dc6fe8d40 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.771+0000 7f334d217640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559dc6fe8d40 0x559dc6feb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334d217640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559dc6fe8d40 0x559dc6feb200 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334d217640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3344074040 0x7f3344081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6feb8d0 con 0x7f3344074040 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334e219640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3344074040 0x7f3344081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.772+0000 7f334e219640 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3344074040 0x7f3344081410 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3344074040 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fe4390 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.773+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fe4390 2024-04-24T01:25:18.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x7f3344074040 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3344074040 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fe8d40 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.774+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fe4390 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fdf9d0 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x7f3344074040 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.775+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe3630 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe4390 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.776+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.777+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe4390 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x7f3344074040 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.778+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe4390 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe4390 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x7f3344074040 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.779+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe8d40 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fe4390 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f334408e040 con 0x7f3344074040 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:18.793 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.780+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe7640 con 0x559dc6fdf9d0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe7640 con 0x559dc6fdf9d0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.794 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe7640 con 0x7f3344074040 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 zone default found 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 4 Realm: () 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 zonegroup default 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.781+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe7a30 con 0x559dc6fe4390 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fed730 con 0x559dc6fe8d40 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fe7640 con 0x559dc6fe8d40 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 started sync module instance, tier type = 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.782+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fecbd0 con 0x7f3344074040 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.783+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.783+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94136136814800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fecbd0 con 0x7f3344074040 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.783+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fee150 con 0x559dc6fdf9d0 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.784+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94136136814800] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.785+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.785+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94136136817728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fecbd0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.785+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6feebe0 con 0x559dc6fe8d40 2024-04-24T01:25:18.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.786+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94136136817728] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.786+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.786+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94136136812320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fecb40 con 0x559dc6fe8d40 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.786+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fefaa0 con 0x7f3344074040 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.787+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94136136812320] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.787+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.788+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94136136824304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fefec0 con 0x7f3344074040 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.788+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff0880 con 0x559dc6fdf9d0 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.789+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.789+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94136136827856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff0ca0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.789+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff17a0 con 0x559dc6fe4390 2024-04-24T01:25:18.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.789+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94136136824304] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.790+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94136136827856] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.790+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.790+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94136136825360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff0ca0 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.790+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff2040 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.791+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94136136825360] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.791+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.791+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94136136828912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff2890 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.791+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff3250 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94136136839040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff3990 con 0x559dc6fe4390 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=0 2024-04-24T01:25:18.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=1 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=2 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=3 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=4 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=5 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94136136828912] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.792+0000 7f334ff19800 20 add_watcher() i=6 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94136136839040] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334ff19800 20 add_watcher() i=7 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334ff19800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff23e0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.793+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94136136836064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff3f40 con 0x559dc6fdf9d0 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.794+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94136136836064] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.811 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.794+0000 7f31ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 5 note: GC not initialized 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f31fe7fc640 20 reqs_thread_entry: start 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 20 Filter name: none 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f316ffff640 20 reqs_thread_entry: start 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a2f0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.795+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a2f0 con 0x7f3344074040 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a2b0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a2b0 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a770 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a770 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.796+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a770 con 0x559dc6fdf9d0 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a6b0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a670 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a670 con 0x559dc6fe8d40 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.797+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702a670 con 0x559dc6fe4390 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x7f3344074040 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.798+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.799+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.800+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x7f3344074040 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.801+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.802+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe8d40 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559dc702c3a0 con 0x559dc6fe4390 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.803+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.804+0000 7f31ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.804+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94136136836064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc70281c0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.805+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94136136836064] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.805+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94136136814800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6ff23e0 con 0x7f3344074040 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.806+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94136136814800] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.806+0000 7f334ff19800 20 remove_watcher() i=0 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.806+0000 7f334ff19800 2 removed watcher, disabling cache 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.806+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94136136817728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fed0d0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.808+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94136136817728] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.808+0000 7f334ff19800 20 remove_watcher() i=1 2024-04-24T01:25:18.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.808+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94136136812320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fed0d0 con 0x559dc6fe8d40 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.809+0000 7f334d217640 1 -- 172.21.15.169:0/2918981734 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94136136812320] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334407f070 con 0x559dc6fe8d40 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.809+0000 7f334ff19800 20 remove_watcher() i=2 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.809+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94136136824304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fec720 con 0x7f3344074040 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.810+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94136136824304] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x7f3344074040 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.810+0000 7f334ff19800 20 remove_watcher() i=3 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.810+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94136136827856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fed0d0 con 0x559dc6fdf9d0 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.811+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94136136827856] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3348032040 con 0x559dc6fdf9d0 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.811+0000 7f334ff19800 20 remove_watcher() i=4 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.811+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94136136825360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fef5f0 con 0x559dc6fe4390 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.812+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94136136825360] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.812+0000 7f334ff19800 20 remove_watcher() i=5 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.812+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94136136828912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fec720 con 0x559dc6fe4390 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.813+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94136136828912] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.813+0000 7f334ff19800 20 remove_watcher() i=6 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.813+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94136136839040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559dc6fed0d0 con 0x559dc6fe4390 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334da18640 1 -- 172.21.15.169:0/2918981734 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94136136839040] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f334002aa60 con 0x559dc6fe4390 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 20 remove_watcher() i=7 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fe4390 msgr2=0x559dc6fe6780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fe4390 0x559dc6fe6780 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6fdf9d0 msgr2=0x559dc6fe1e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6fdf9d0 0x559dc6fe1e90 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3344074040 msgr2=0x7f3344081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3344074040 0x7f3344081410 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559dc6fe8d40 msgr2=0x559dc6feb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x559dc6fe8d40 0x559dc6feb200 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3218036950 msgr2=0x7f3218038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3218036950 0x7f3218038e10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3344000c00 tx=0x7f334404f000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 msgr2=0x559dc6fd4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2918981734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6fcce10 0x559dc6fd4240 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3340029d50 tx=0x7f3340029ce0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 reap_dead start 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334e219640 1 -- 172.21.15.169:0/2918981734 reap_dead start 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 shutdown_connections 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 >> 172.21.15.169:0/2918981734 conn(0x559dc6fc9170 msgr2=0x559dc6fce610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 shutdown_connections 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2918981734 wait complete. 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 msgr2=0x7f3228038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 0x7f3228038dc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x559dc6fa15f0 tx=0x7f3344005ac0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 msgr2=0x559dc6f9c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f334000bff0 tx=0x7f3340029f80 comp rx=0 tx=0).stop 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 shutdown_connections 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3228036900 0x7f3228038dc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 --2- 172.21.15.169:0/2647020791 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6f9c3b0 0x559dc6f9c7d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.814+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 >> 172.21.15.169:0/2647020791 conn(0x559dc6faf990 msgr2=0x559dc6fafd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 shutdown_connections 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/2647020791 wait complete. 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fa6860 msgr2=0x559dc6fa8cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x559dc6fa6860 0x559dc6fa8cf0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6ea51a0 msgr2=0x559dc6fa4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x559dc6ea51a0 0x559dc6fa4100 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559dc6faa930 msgr2=0x559dc6facda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x559dc6faa930 0x559dc6facda0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3234036900 msgr2=0x7f3234038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3234036900 0x7f3234038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 msgr2=0x559dc6f98ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 --2- 172.21.15.169:0/979109172 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559dc6ea0d10 0x559dc6f98ab0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x559dc6f92d50 tx=0x7f3340000ed0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334e219640 1 -- 172.21.15.169:0/979109172 reap_dead start 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 shutdown_connections 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 >> 172.21.15.169:0/979109172 conn(0x559dc6e9c370 msgr2=0x559dc6f8c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 shutdown_connections 2024-04-24T01:25:18.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.815+0000 7f334ff19800 1 -- 172.21.15.169:0/979109172 wait complete. 2024-04-24T01:25:18.828 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T01:25:18.828 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T01:25:18.829 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T01:25:18.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T01:25:18.829 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T01:25:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:18.911 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:18.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.911+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.911+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42bf80f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555c186de330 0x555c186e0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42bf80f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c18598d40 con 0x555c186d9f90 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42bf80f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x555c1856b4d0 con 0x555c186de330 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42b2613640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555c186de330 0x555c186e0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42bae14640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x555c186d9f90 0x555c186da3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46484/0 (socket says 172.21.15.169:46484) 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42bae14640 1 -- 172.21.15.169:0/1945913389 learned_addr learned my addr 172.21.15.169:0/1945913389 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42ba613640 1 -- 172.21.15.169:0/1945913389 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138124852 0 0) 0x555c18598d40 con 0x555c186d9f90 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42ba613640 1 -- 172.21.15.169:0/1945913389 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a8001e10 con 0x555c186d9f90 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42b2613640 1 -- 172.21.15.169:0/1945913389 >> v1:172.21.15.142:6789/0 conn(0x555c186d9f90 legacy=0x555c186da3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.912+0000 7f42b2613640 1 -- 172.21.15.169:0/1945913389 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18597590 con 0x555c186de330 2024-04-24T01:25:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.914+0000 7f42b2613640 1 --2- 172.21.15.169:0/1945913389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186de330 0x555c186e0720 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f42a400a470 tx=0x7f42a401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af59a1568d7aa78f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.914+0000 7f42ba613640 1 -- 172.21.15.169:0/1945913389 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a4057070 con 0x555c186de330 2024-04-24T01:25:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.914+0000 7f42ba613640 1 -- 172.21.15.169:0/1945913389 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42a4052570 con 0x555c186de330 2024-04-24T01:25:18.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.914+0000 7f42ba613640 1 -- 172.21.15.169:0/1945913389 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42a4052870 con 0x555c186de330 2024-04-24T01:25:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 -- 172.21.15.169:0/1945913389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186de330 msgr2=0x555c186e0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1945913389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186de330 0x555c186e0720 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f42a400a470 tx=0x7f42a401cdb0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 -- 172.21.15.169:0/1945913389 shutdown_connections 2024-04-24T01:25:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1945913389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186de330 0x555c186e0720 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 -- 172.21.15.169:0/1945913389 >> 172.21.15.169:0/1945913389 conn(0x555c186d5530 msgr2=0x555c186d7950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 -- 172.21.15.169:0/1945913389 shutdown_connections 2024-04-24T01:25:18.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.915+0000 7f42bf80f800 1 -- 172.21.15.169:0/1945913389 wait complete. 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.926+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.926+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bf80f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bf80f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555c186253c0 con 0x555c186d9f90 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45014/0 (socket says 172.21.15.169:45014) 2024-04-24T01:25:18.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bae14640 1 -- 172.21.15.169:0/4133678818 learned_addr learned my addr 172.21.15.169:0/4133678818 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bae14640 1 -- 172.21.15.169:0/4133678818 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c1864df60 con 0x555c186d9f90 2024-04-24T01:25:18.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.927+0000 7f42bae14640 1 --2- 172.21.15.169:0/4133678818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f42ac001e30 tx=0x7f42ac00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00eadc5c72cfcf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f41a8e09640 1 -- 172.21.15.169:0/4133678818 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac012020 con 0x555c186d9f90 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f41a8e09640 1 -- 172.21.15.169:0/4133678818 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac00e5a0 con 0x555c186d9f90 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f41a8e09640 1 -- 172.21.15.169:0/4133678818 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac00e8e0 con 0x555c186d9f90 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 -- 172.21.15.169:0/4133678818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 msgr2=0x555c1864f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 --2- 172.21.15.169:0/4133678818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f42ac001e30 tx=0x7f42ac00b780 comp rx=0 tx=0).stop 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 -- 172.21.15.169:0/4133678818 shutdown_connections 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 --2- 172.21.15.169:0/4133678818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c1864f9a0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 -- 172.21.15.169:0/4133678818 >> 172.21.15.169:0/4133678818 conn(0x555c186d5530 msgr2=0x555c187c6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 -- 172.21.15.169:0/4133678818 shutdown_connections 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.928+0000 7f42bf80f800 1 -- 172.21.15.169:0/4133678818 wait complete. 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bf80f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c187d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bf80f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555c186e0ff0 con 0x555c186d9f90 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c187d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c187d4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45022/0 (socket says 172.21.15.169:45022) 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.929+0000 7f42bae14640 1 -- 172.21.15.169:0/1483450021 learned_addr learned my addr 172.21.15.169:0/1483450021 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f42bae14640 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c187d51d0 con 0x555c186d9f90 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f42bae14640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c187d4c90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f42ac001e30 tx=0x7f42ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f41a7606640 1 -- 172.21.15.169:0/1483450021 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac012030 con 0x555c186d9f90 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f41a7606640 1 -- 172.21.15.169:0/1483450021 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac001490 con 0x555c186d9f90 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c187d5460 con 0x555c186d9f90 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f41a7606640 1 -- 172.21.15.169:0/1483450021 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac01a8f0 con 0x555c186d9f90 2024-04-24T01:25:18.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.930+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c187d8110 con 0x555c186d9f90 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f41a7606640 1 -- 172.21.15.169:0/1483450021 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42ac015020 con 0x555c186d9f90 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f41a7606640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f41a0036950 0x7f41a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f41a7606640 1 -- 172.21.15.169:0/1483450021 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f42ac020030 con 0x555c186d9f90 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f42b2613640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f41a0036950 0x7f41a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c186de330 0x555c187dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c187dc410 con 0x555c186de330 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.931+0000 7f42bb615640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c186de330 0x555c187dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42b2613640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f41a0036950 0x7f41a0038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42a4054000 tx=0x7f42a404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bb615640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c186de330 0x555c187dbed0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bb615640 1 -- 172.21.15.169:0/1483450021 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c186de330 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c187d94a0 con 0x555c186de330 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bb615640 1 -- 172.21.15.169:0/1483450021 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c186de330 2024-04-24T01:25:18.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c187de760 0x555c187e0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.932+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c187e1240 con 0x555c187de760 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.933+0000 7f42bae14640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c187de760 0x555c187e0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.933+0000 7f42bae14640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c187de760 0x555c187e0b50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.933+0000 7f42bae14640 1 -- 172.21.15.169:0/1483450021 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42ac01ac70 con 0x555c187de760 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.933+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c187dd710 con 0x555c186de330 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.933+0000 7f42bb615640 1 -- 172.21.15.169:0/1483450021 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c186de330 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.934+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555c187e26f0 0x555c187e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.934+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c187e52a0 con 0x555c187e26f0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.934+0000 7f42b2613640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555c187e26f0 0x555c187e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.934+0000 7f42b2613640 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555c187e26f0 0x555c187e4b40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.934+0000 7f42b2613640 1 -- 172.21.15.169:0/1483450021 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f42a4052a40 con 0x555c187e26f0 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bf80f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bf80f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555c185cb6b0 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45036/0 (socket says 172.21.15.169:45036) 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bae14640 1 -- 172.21.15.169:0/1168879378 learned_addr learned my addr 172.21.15.169:0/1168879378 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bae14640 1 -- 172.21.15.169:0/1168879378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c187f4060 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f42bae14640 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42ac04adf0 tx=0x7f42ac016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f41a4e01640 1 -- 172.21.15.169:0/1168879378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac03b070 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.935+0000 7f41a4e01640 1 -- 172.21.15.169:0/1168879378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac017e40 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f41a4e01640 1 -- 172.21.15.169:0/1168879378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac00f1a0 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c187f4ad0 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c187f4ad0 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f41a4e01640 1 -- 172.21.15.169:0/1168879378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42ac03e070 con 0x555c187f3700 2024-04-24T01:25:18.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f41a4e01640 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 0x7f4194038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.936+0000 7f41a4e01640 1 -- 172.21.15.169:0/1168879378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f42ac048050 con 0x555c187f3700 2024-04-24T01:25:18.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42b2613640 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 0x7f4194038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42b2613640 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 0x7f4194038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x555c187dcd10 tx=0x7f42a4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bf80f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bf80f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555c1864e2e0 con 0x555c18800710 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45048/0 (socket says 172.21.15.169:45048) 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.937+0000 7f42bae14640 1 -- 172.21.15.169:0/1081932707 learned_addr learned my addr 172.21.15.169:0/1081932707 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bae14640 1 -- 172.21.15.169:0/1081932707 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18801100 con 0x555c18800710 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bae14640 1 --2- 172.21.15.169:0/1081932707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42ac037fd0 tx=0x7f42ac0492a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c48fbd2e61414 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f419e7fc640 1 -- 172.21.15.169:0/1081932707 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac00f340 con 0x555c18800710 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f419e7fc640 1 -- 172.21.15.169:0/1081932707 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac049480 con 0x555c18800710 2024-04-24T01:25:18.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f419e7fc640 1 -- 172.21.15.169:0/1081932707 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac00f520 con 0x555c18800710 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 -- 172.21.15.169:0/1081932707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 msgr2=0x555c18800b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1081932707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42ac037fd0 tx=0x7f42ac0492a0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 -- 172.21.15.169:0/1081932707 shutdown_connections 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1081932707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18800b30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 -- 172.21.15.169:0/1081932707 >> 172.21.15.169:0/1081932707 conn(0x555c187fc990 msgr2=0x555c187fa9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 -- 172.21.15.169:0/1081932707 shutdown_connections 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.938+0000 7f42bf80f800 1 -- 172.21.15.169:0/1081932707 wait complete. 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bf80f800 1 Processor -- start 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bf80f800 1 -- start start 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bf80f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bf80f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555c18801770 con 0x555c18800710 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bae14640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45050/0 (socket says 172.21.15.169:45050) 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 learned_addr learned my addr 172.21.15.169:0/2480061944 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.939+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c18807fd0 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f42bae14640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00bcd0 tx=0x7f42ac01df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f419cff9640 1 -- 172.21.15.169:0/2480061944 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac04f100 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f419cff9640 1 -- 172.21.15.169:0/2480061944 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42ac0498c0 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c18807fd0 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f419cff9640 1 -- 172.21.15.169:0/2480061944 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42ac04f2a0 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.940+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c18807fd0 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f419cff9640 1 -- 172.21.15.169:0/2480061944 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f42ac072020 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f419cff9640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4184036860 0x7f4184038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f419cff9640 1 -- 172.21.15.169:0/2480061944 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f42ac070020 con 0x555c18800710 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42b2613640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4184036860 0x7f4184038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c188131f0 0x555c18815690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c18815de0 con 0x555c188131f0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42bb615640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c188131f0 0x555c18815690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.941+0000 7f42b2613640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4184036860 0x7f4184038d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x555c187e56a0 tx=0x7f42a404f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bb615640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c188131f0 0x555c18815690 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 realm 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c188161f0 con 0x555c188131f0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c18816a90 con 0x555c188131f0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c18817b90 0x555c18819f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.942+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881a500 con 0x555c18817b90 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bae14640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c18817b90 0x555c18819f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bae14640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c18817b90 0x555c18819f80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bf80f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:18.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bf80f800 20 searching for the correct realm 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.943+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555c1881c550 0x555c1881ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c1881f0e0 con 0x555c1881c550 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42b2613640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555c1881c550 0x555c1881ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42b2613640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555c1881c550 0x555c1881ea10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42b2613640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f42a4076040 0x7f42a4083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c1881f0e0 con 0x7f42a4076040 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.944+0000 7f42bb615640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f42a4076040 0x7f42a4083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bb615640 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f42a4076040 0x7f42a4083410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x7f42a4076040 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c18817b90 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.945+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c18817b90 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x7f42a4076040 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x7f42a4076040 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c1881c550 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.946+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c18817b90 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c188131f0 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b400a4a0 con 0x555c188131f0 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.947+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x7f42a4076040 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555c18816e30 con 0x555c1881c550 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c18817b90 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.948+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c188131f0 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c188131f0 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.949+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c18817b90 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x7f42a4076040 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c188131f0 2024-04-24T01:25:18.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.950+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x7f42a4076040 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.951+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c1881c550 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x555c188131f0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f42a4090040 con 0x7f42a4076040 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.952+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ae50 con 0x555c188131f0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ae50 con 0x555c188131f0 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ae50 con 0x7f42a4076040 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 zone default found 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 4 Realm: () 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 zonegroup default 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.953+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881b240 con 0x555c18817b90 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c18820f40 con 0x555c1881c550 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ae30 con 0x555c1881c550 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 started sync module instance, tier type = 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.954+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c188203e0 con 0x7f42a4076040 2024-04-24T01:25:18.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.955+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.955+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93854036527408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c188203e0 con 0x7f42a4076040 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.955+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18821940 con 0x555c188131f0 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.956+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93854036527408] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.956+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.956+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93854036530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c188203e0 con 0x555c188131f0 2024-04-24T01:25:18.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.956+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18822350 con 0x555c1881c550 2024-04-24T01:25:18.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.957+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93854036530256] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.958+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.958+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93854036524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18820350 con 0x555c1881c550 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.958+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823210 con 0x7f42a4076040 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.959+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93854036524848] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.959+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.959+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93854036536672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823630 con 0x7f42a4076040 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.959+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823ff0 con 0x555c188131f0 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.960+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93854036536672] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.960+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.960+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93854036538208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823ff0 con 0x555c188131f0 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.960+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c188249b0 con 0x555c18817b90 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.961+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93854036538208] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.961+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.961+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93854036540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823f60 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.961+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18825870 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.962+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93854036540224] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.962+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.963+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93854036544848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c188260c0 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.963+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18826970 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.963+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93854036544848] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93854036548624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18826930 con 0x555c18817b90 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=0 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=1 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=2 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=3 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=4 2024-04-24T01:25:18.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=5 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=6 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93854036548624] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 20 add_watcher() i=7 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.964+0000 7f42bf80f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.965+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c18829e70 con 0x555c188131f0 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.965+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.965+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93854036550208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18827330 con 0x555c188131f0 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93854036550208] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f41717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f42bf80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f42bf80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f42bf80f800 5 note: GC not initialized 2024-04-24T01:25:18.980 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f40ebfff640 20 reqs_thread_entry: start 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.966+0000 7f42bf80f800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bf80f800 20 Filter name: none 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f40e9ffb640 20 reqs_thread_entry: start 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bf80f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1885ccc0 con 0x555c188131f0 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bf80f800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.967+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555c1885e210 con 0x555c18817b90 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.968+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.968+0000 7f41717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.968+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93854036550208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18826e40 con 0x555c188131f0 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.969+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93854036550208] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.969+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93854036527408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18826240 con 0x7f42a4076040 2024-04-24T01:25:18.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.970+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93854036527408] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.970+0000 7f42bf80f800 20 remove_watcher() i=0 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.970+0000 7f42bf80f800 2 removed watcher, disabling cache 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.970+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93854036530256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18820910 con 0x555c188131f0 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.971+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93854036530256] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.971+0000 7f42bf80f800 20 remove_watcher() i=1 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.971+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93854036524848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18821450 con 0x555c1881c550 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.972+0000 7f42b2613640 1 -- 172.21.15.169:0/2480061944 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93854036524848] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42a4081070 con 0x555c1881c550 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.972+0000 7f42bf80f800 20 remove_watcher() i=2 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.972+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93854036536672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ff30 con 0x7f42a4076040 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.973+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93854036536672] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x7f42a4076040 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.973+0000 7f42bf80f800 20 remove_watcher() i=3 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.973+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93854036538208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ff30 con 0x555c188131f0 2024-04-24T01:25:18.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.974+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93854036538208] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42b4032040 con 0x555c188131f0 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.974+0000 7f42bf80f800 20 remove_watcher() i=4 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.974+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93854036540224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823360 con 0x555c18817b90 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.976+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93854036540224] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.976+0000 7f42bf80f800 20 remove_watcher() i=5 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.976+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93854036544848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c1881ff30 con 0x555c18817b90 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.977+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93854036544848] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.977+0000 7f42bf80f800 20 remove_watcher() i=6 2024-04-24T01:25:18.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.977+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93854036548624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555c18823b40 con 0x555c18817b90 2024-04-24T01:25:18.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bae14640 1 -- 172.21.15.169:0/2480061944 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93854036548624] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42ac03d030 con 0x555c18817b90 2024-04-24T01:25:18.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 20 remove_watcher() i=7 2024-04-24T01:25:18.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c18817b90 msgr2=0x555c18819f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c18817b90 0x555c18819f80 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c188131f0 msgr2=0x555c18815690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c188131f0 0x555c18815690 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f42a4076040 msgr2=0x7f42a4083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f42a4076040 0x7f42a4083410 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555c1881c550 msgr2=0x555c1881ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555c1881c550 0x555c1881ea10 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4184036860 msgr2=0x7f4184038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4184036860 0x7f4184038d20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x555c187e56a0 tx=0x7f42a404f000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 msgr2=0x555c18807a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00bcd0 tx=0x7f42ac01df60 comp rx=0 tx=0).stop 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bb615640 1 -- 172.21.15.169:0/2480061944 reap_dead start 2024-04-24T01:25:18.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 shutdown_connections 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/2480061944 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c18800710 0x555c18807a90 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 >> 172.21.15.169:0/2480061944 conn(0x555c187fc990 msgr2=0x555c187f9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 shutdown_connections 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/2480061944 wait complete. 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 msgr2=0x7f4194038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 0x7f4194038e10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x555c187dcd10 tx=0x7f42a4005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 msgr2=0x555c187f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f42ac04adf0 tx=0x7f42ac016b00 comp rx=0 tx=0).stop 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 shutdown_connections 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4194036950 0x7f4194038e10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1168879378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c187f3700 0x555c187f3b20 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.978+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 >> 172.21.15.169:0/1168879378 conn(0x555c187e77a0 msgr2=0x555c187e7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 shutdown_connections 2024-04-24T01:25:18.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1168879378 wait complete. 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c187de760 msgr2=0x555c187e0b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555c187de760 0x555c187e0b50 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c186de330 msgr2=0x555c187dbed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555c186de330 0x555c187dbed0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555c187e26f0 msgr2=0x555c187e4b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555c187e26f0 0x555c187e4b40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f41a0036950 msgr2=0x7f41a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f41a0036950 0x7f41a0038e10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42a4054000 tx=0x7f42a404e000 comp rx=0 tx=0).stop 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 msgr2=0x555c187d4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 --2- 172.21.15.169:0/1483450021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c186d9f90 0x555c187d4c90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f42ac001e30 tx=0x7f42ac000ed0 comp rx=0 tx=0).stop 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bb615640 1 -- 172.21.15.169:0/1483450021 reap_dead start 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 shutdown_connections 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 >> 172.21.15.169:0/1483450021 conn(0x555c186d5530 msgr2=0x555c1864e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:18.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 shutdown_connections 2024-04-24T01:25:18.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:18.979+0000 7f42bf80f800 1 -- 172.21.15.169:0/1483450021 wait complete. 2024-04-24T01:25:18.990 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-04-24T01:25:18.991 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-04-24T01:25:18.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T01:25:18.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-04-24T01:25:18.991 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-04-24T01:25:19.077 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.078 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ec719800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5617a90abfb0 0x5617a90ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ec719800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617a8f6ad40 con 0x5617a90ad120 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ec719800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5617a8f3d4d0 con 0x5617a90abfb0 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ea218640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5617a90abfb0 0x5617a90ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39e3fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5617a90ad120 0x5617a90ad5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46488/0 (socket says 172.21.15.169:46488) 2024-04-24T01:25:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39e3fff640 1 -- 172.21.15.169:0/2410278243 learned_addr learned my addr 172.21.15.169:0/2410278243 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.078+0000 7f39ea218640 1 -- 172.21.15.169:0/2410278243 >> v1:172.21.15.142:6789/0 conn(0x5617a90ad120 legacy=0x5617a90ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.079+0000 7f39ea218640 1 -- 172.21.15.169:0/2410278243 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a8f69590 con 0x5617a90abfb0 2024-04-24T01:25:19.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.079+0000 7f39e9a17640 1 -- 172.21.15.169:0/2410278243 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459948615 0 0) 0x5617a8f6ad40 con 0x5617a90ad120 2024-04-24T01:25:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39ea218640 1 --2- 172.21.15.169:0/2410278243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90ac3d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00a470 tx=0x7f39dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ae4a9f4893fa35 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39e9a17640 1 -- 172.21.15.169:0/2410278243 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc057070 con 0x5617a90abfb0 2024-04-24T01:25:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39e9a17640 1 -- 172.21.15.169:0/2410278243 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc052570 con 0x5617a90abfb0 2024-04-24T01:25:19.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39e9a17640 1 -- 172.21.15.169:0/2410278243 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc052870 con 0x5617a90abfb0 2024-04-24T01:25:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39ec719800 1 -- 172.21.15.169:0/2410278243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 msgr2=0x5617a90ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.081+0000 7f39ec719800 1 --2- 172.21.15.169:0/2410278243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90ac3d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00a470 tx=0x7f39dc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:19.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.082+0000 7f39ec719800 1 -- 172.21.15.169:0/2410278243 shutdown_connections 2024-04-24T01:25:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.082+0000 7f39ec719800 1 --2- 172.21.15.169:0/2410278243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90ac3d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.082+0000 7f39ec719800 1 -- 172.21.15.169:0/2410278243 >> 172.21.15.169:0/2410278243 conn(0x5617a90a7550 msgr2=0x5617a90a9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.082+0000 7f39ec719800 1 -- 172.21.15.169:0/2410278243 shutdown_connections 2024-04-24T01:25:19.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.082+0000 7f39ec719800 1 -- 172.21.15.169:0/2410278243 wait complete. 2024-04-24T01:25:19.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.093+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.093+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.093+0000 7f39ec719800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.093+0000 7f39ec719800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5617a8ff73b0 con 0x5617a90abfb0 2024-04-24T01:25:19.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45068/0 (socket says 172.21.15.169:45068) 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f39ea218640 1 -- 172.21.15.169:0/2833530338 learned_addr learned my addr 172.21.15.169:0/2833530338 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f39ea218640 1 -- 172.21.15.169:0/2833530338 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a901ff80 con 0x5617a90abfb0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f39ea218640 1 --2- 172.21.15.169:0/2833530338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f39dc055040 tx=0x7f39dc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7584680ab98574f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f38d8608640 1 -- 172.21.15.169:0/2833530338 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc057070 con 0x5617a90abfb0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f38d8608640 1 -- 172.21.15.169:0/2833530338 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc063070 con 0x5617a90abfb0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.094+0000 7f38d8608640 1 -- 172.21.15.169:0/2833530338 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc052720 con 0x5617a90abfb0 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- 172.21.15.169:0/2833530338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 msgr2=0x5617a90219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 --2- 172.21.15.169:0/2833530338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f39dc055040 tx=0x7f39dc04c000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- 172.21.15.169:0/2833530338 shutdown_connections 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 --2- 172.21.15.169:0/2833530338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a90219c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- 172.21.15.169:0/2833530338 >> 172.21.15.169:0/2833530338 conn(0x5617a90a7550 msgr2=0x5617a9198d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- 172.21.15.169:0/2833530338 shutdown_connections 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- 172.21.15.169:0/2833530338 wait complete. 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a91a7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.095+0000 7f39ec719800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5617a90b55c0 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a91a7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a91a7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45084/0 (socket says 172.21.15.169:45084) 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ea218640 1 -- 172.21.15.169:0/2086216193 learned_addr learned my addr 172.21.15.169:0/2086216193 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ea218640 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a91a75a0 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ea218640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a91a7060 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f39dc060040 tx=0x7f39dc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f38d6e05640 1 -- 172.21.15.169:0/2086216193 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc052c70 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f38d6e05640 1 -- 172.21.15.169:0/2086216193 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc06c070 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617a91a7830 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.096+0000 7f38d6e05640 1 -- 172.21.15.169:0/2086216193 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc05e480 con 0x5617a90abfb0 2024-04-24T01:25:19.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.097+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617a91aa4e0 con 0x5617a90abfb0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.097+0000 7f38d6e05640 1 -- 172.21.15.169:0/2086216193 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39dc05e620 con 0x5617a90abfb0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.097+0000 7f38d6e05640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38d0036950 0x7f38d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.097+0000 7f38d6e05640 1 -- 172.21.15.169:0/2086216193 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39dc08e700 con 0x5617a90abfb0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38d0036950 0x7f38d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a90ad120 0x5617a91ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ae7e0 con 0x5617a90ad120 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39eaa19640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a90ad120 0x5617a91ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38d0036950 0x7f38d0038e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000c00 tx=0x7f39d40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39eaa19640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a90ad120 0x5617a91ae2a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39eaa19640 1 -- 172.21.15.169:0/2086216193 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a90ad120 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.098+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ab850 con 0x5617a90ad120 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.099+0000 7f39eaa19640 1 -- 172.21.15.169:0/2086216193 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a90ad120 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.099+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91b0af0 0x5617a91b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.099+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91b35b0 con 0x5617a91b0af0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.099+0000 7f39ea218640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91b0af0 0x5617a91b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.099+0000 7f39ea218640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91b0af0 0x5617a91b2ee0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39ea218640 1 -- 172.21.15.169:0/2086216193 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91b0af0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91afaa0 con 0x5617a90ad120 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39eaa19640 1 -- 172.21.15.169:0/2086216193 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a90ad120 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5617a91b49f0 0x5617a91b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91b7640 con 0x5617a91b49f0 2024-04-24T01:25:19.116 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5617a91b49f0 0x5617a91b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.100+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5617a91b49f0 0x5617a91b6eb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39e3fff640 1 -- 172.21.15.169:0/2086216193 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39d400f670 con 0x5617a91b49f0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ec719800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ec719800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5617a8f9d6b0 con 0x5617a91c5af0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45090/0 (socket says 172.21.15.169:45090) 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.101+0000 7f39ea218640 1 -- 172.21.15.169:0/2939050598 learned_addr learned my addr 172.21.15.169:0/2939050598 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f39ea218640 1 -- 172.21.15.169:0/2939050598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a91c6450 con 0x5617a91c5af0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f39ea218640 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f39dc08cab0 tx=0x7f39dc08ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f38cffff640 1 -- 172.21.15.169:0/2939050598 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc081040 con 0x5617a91c5af0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f38cffff640 1 -- 172.21.15.169:0/2939050598 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc058040 con 0x5617a91c5af0 2024-04-24T01:25:19.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617a91c6ec0 con 0x5617a91c5af0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f38cffff640 1 -- 172.21.15.169:0/2939050598 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc0799d0 con 0x5617a91c5af0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.102+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617a91c73c0 con 0x5617a91c5af0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f38cffff640 1 -- 172.21.15.169:0/2939050598 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39dc095060 con 0x5617a91c5af0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f38cffff640 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 0x7f38c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f38cffff640 1 -- 172.21.15.169:0/2939050598 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39dc04c0e0 con 0x5617a91c5af0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 0x7f38c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39e3fff640 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 0x7f38c4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5617a91aec90 tx=0x7f39d4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39ec719800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.103+0000 7f39ec719800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5617a9020240 con 0x5617a91d2ca0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45094/0 (socket says 172.21.15.169:45094) 2024-04-24T01:25:19.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f39ea218640 1 -- 172.21.15.169:0/1529430776 learned_addr learned my addr 172.21.15.169:0/1529430776 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f39ea218640 1 -- 172.21.15.169:0/1529430776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a91d3690 con 0x5617a91d2ca0 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f39ea218640 1 --2- 172.21.15.169:0/1529430776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39dc05efb0 tx=0x7f39dc071bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bee0bc882d8b869 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f38cdffb640 1 -- 172.21.15.169:0/1529430776 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc0a7070 con 0x5617a91d2ca0 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f38cdffb640 1 -- 172.21.15.169:0/1529430776 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc08e0b0 con 0x5617a91d2ca0 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.104+0000 7f38cdffb640 1 -- 172.21.15.169:0/1529430776 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc071470 con 0x5617a91d2ca0 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- 172.21.15.169:0/1529430776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 msgr2=0x5617a91d30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 --2- 172.21.15.169:0/1529430776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39dc05efb0 tx=0x7f39dc071bc0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- 172.21.15.169:0/1529430776 shutdown_connections 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 --2- 172.21.15.169:0/1529430776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91d30c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- 172.21.15.169:0/1529430776 >> 172.21.15.169:0/1529430776 conn(0x5617a91cefb0 msgr2=0x5617a91cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- 172.21.15.169:0/1529430776 shutdown_connections 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- 172.21.15.169:0/1529430776 wait complete. 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 Processor -- start 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- start start 2024-04-24T01:25:19.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ec719800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5617a91d3d20 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ea218640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45098/0 (socket says 172.21.15.169:45098) 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.105+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 learned_addr learned my addr 172.21.15.169:0/313676027 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617a91da630 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f39ea218640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39dc08b8d0 tx=0x7f39dc05aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f38bbfff640 1 -- 172.21.15.169:0/313676027 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc0b2020 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f38bbfff640 1 -- 172.21.15.169:0/313676027 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc08ec70 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617a91da630 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f38bbfff640 1 -- 172.21.15.169:0/313676027 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc0a7030 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.106+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617a91daad0 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f38bbfff640 1 -- 172.21.15.169:0/313676027 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39dc0b5020 con 0x5617a91d2ca0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f38bbfff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b4036950 0x7f38b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f38bbfff640 1 -- 172.21.15.169:0/313676027 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39dc0a8070 con 0x5617a91d2ca0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f39e3fff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b4036950 0x7f38b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a91e57b0 0x5617a91e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e83c0 con 0x5617a91e57b0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.107+0000 7f39eaa19640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a91e57b0 0x5617a91e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39e3fff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b4036950 0x7f38b4038e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5617a91b7a40 tx=0x7f39d4023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39eaa19640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a91e57b0 0x5617a91e7c70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 realm 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e87d0 con 0x5617a91e57b0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.121 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9070 con 0x5617a91e57b0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.108+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ec719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91ea170 0x5617a91ec560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ecae0 con 0x5617a91ea170 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ea218640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91ea170 0x5617a91ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.109+0000 7f39ea218640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91ea170 0x5617a91ec560 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.122 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39ec719800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39ec719800 20 searching for the correct realm 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5617a91eeb10 0x5617a91f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f16a0 con 0x5617a91eeb10 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39e3fff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5617a91eeb10 0x5617a91f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39e3fff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5617a91eeb10 0x5617a91f0fd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39e3fff640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39d403a3c0 0x7f39d403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.110+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f16a0 con 0x7f39d403a3c0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39eaa19640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39d403a3c0 0x7f39d403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39eaa19640 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39d403a3c0 0x7f39d403a810 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x7f39d403a3c0 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.111+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.112+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x7f39d403a3c0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x7f39d403a3c0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.113+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e400a4a0 con 0x5617a91e57b0 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x7f39d403a3c0 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.114+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.115+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x7f39d403a3c0 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.116+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.117+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x7f39d403a3c0 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91eeb10 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.118+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x5617a91e57b0 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5617a91e9410 con 0x7f39d403a3c0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ed430 con 0x5617a91e57b0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ed430 con 0x5617a91e57b0 2024-04-24T01:25:19.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.119+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ed400 con 0x7f39d403a3c0 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 zone default found 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 4 Realm: () 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 zonegroup default 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91ed820 con 0x5617a91ea170 2024-04-24T01:25:19.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f3500 con 0x5617a91eeb10 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f38a0 con 0x5617a91eeb10 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 started sync module instance, tier type = 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.120+0000 7f39ec719800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.121+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f29a0 con 0x7f39d403a3c0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.122+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.122+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94659621629328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f29a0 con 0x7f39d403a3c0 2024-04-24T01:25:19.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.122+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f40f0 con 0x5617a91e57b0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.123+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94659621629328] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.123+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.123+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94659621627600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f40f0 con 0x5617a91e57b0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.123+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f4ab0 con 0x5617a91eeb10 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.124+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.124+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94659621635584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f5350 con 0x5617a91eeb10 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.124+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f5db0 con 0x7f39d403a3c0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.124+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94659621627600] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.125+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.125+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94659621635584] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.125+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94659621637792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f5890 con 0x7f39d403a3c0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.125+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f6650 con 0x5617a91e57b0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.126+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94659621637792] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.126+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.126+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94659621633088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f6600 con 0x5617a91e57b0 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.126+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f7060 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.127+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94659621633088] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.127+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.127+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94659621642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f6570 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.127+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f7f20 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.128+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94659621642576] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.129+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.129+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94659621647360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f8770 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.129+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f8fc0 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94659621647360] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94659621652880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f9420 con 0x5617a91ea170 2024-04-24T01:25:19.142 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=0 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=1 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=2 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=3 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=4 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=5 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.130+0000 7f39ec719800 20 add_watcher() i=6 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94659621652880] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39ec719800 20 add_watcher() i=7 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39ec719800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f8380 con 0x5617a91e57b0 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.131+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94659621654192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f9d20 con 0x5617a91e57b0 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.132+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94659621654192] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.132+0000 7f38a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.132+0000 7f39ec719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.132+0000 7f39ec719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.132+0000 7f39ec719800 5 note: GC not initialized 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f381b7fe640 20 reqs_thread_entry: start 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 20 Filter name: none 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f38197fa640 20 reqs_thread_entry: start 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a922f2c0 con 0x5617a91e57b0 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.133+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5617a9230810 con 0x5617a91ea170 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.134+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.135+0000 7f38a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.135+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94659621654192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a922def0 con 0x5617a91e57b0 2024-04-24T01:25:19.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.136+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94659621654192] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.136+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94659621629328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f8e70 con 0x7f39d403a3c0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.137+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94659621629328] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.137+0000 7f39ec719800 20 remove_watcher() i=0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.137+0000 7f39ec719800 2 removed watcher, disabling cache 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.137+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94659621627600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f2d90 con 0x5617a91e57b0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.138+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94659621627600] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.138+0000 7f39ec719800 20 remove_watcher() i=1 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.138+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94659621635584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f2d90 con 0x5617a91eeb10 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.139+0000 7f39e3fff640 1 -- 172.21.15.169:0/313676027 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94659621635584] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4037040 con 0x5617a91eeb10 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.139+0000 7f39ec719800 20 remove_watcher() i=2 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.139+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94659621637792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f26d0 con 0x7f39d403a3c0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.140+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94659621637792] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x7f39d403a3c0 2024-04-24T01:25:19.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.140+0000 7f39ec719800 20 remove_watcher() i=3 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.140+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94659621633088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f4ea0 con 0x5617a91e57b0 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.141+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94659621633088] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39e4032040 con 0x5617a91e57b0 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.141+0000 7f39ec719800 20 remove_watcher() i=4 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.141+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94659621642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f4ea0 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.142+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94659621642576] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.142+0000 7f39ec719800 20 remove_watcher() i=5 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.142+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94659621647360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f4ea0 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.143+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94659621647360] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.143+0000 7f39ec719800 20 remove_watcher() i=6 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.143+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94659621652880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5617a91f4ea0 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ea218640 1 -- 172.21.15.169:0/313676027 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94659621652880] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc009d10 con 0x5617a91ea170 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 20 remove_watcher() i=7 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91ea170 msgr2=0x5617a91ec560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91ea170 0x5617a91ec560 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a91e57b0 msgr2=0x5617a91e7c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a91e57b0 0x5617a91e7c70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39d403a3c0 msgr2=0x7f39d403a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39d403a3c0 0x7f39d403a810 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5617a91eeb10 msgr2=0x5617a91f0fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.144+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5617a91eeb10 0x5617a91f0fd0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b4036950 msgr2=0x7f38b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b4036950 0x7f38b4038e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5617a91b7a40 tx=0x7f39d4023040 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 msgr2=0x5617a91da0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39eaa19640 1 -- 172.21.15.169:0/313676027 reap_dead start 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f39dc08b8d0 tx=0x7f39dc05aee0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 shutdown_connections 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/313676027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91d2ca0 0x5617a91da0f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 >> 172.21.15.169:0/313676027 conn(0x5617a91cefb0 msgr2=0x5617a91cc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 shutdown_connections 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/313676027 wait complete. 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 msgr2=0x7f38c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 0x7f38c4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x5617a91aec90 tx=0x7f39d4006000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 msgr2=0x5617a91c5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f39dc08cab0 tx=0x7f39dc08ce80 comp rx=0 tx=0).stop 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 shutdown_connections 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38c4036900 0x7f38c4038dc0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2939050598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a91c5af0 0x5617a91c5f10 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 >> 172.21.15.169:0/2939050598 conn(0x5617a91b9b90 msgr2=0x5617a91b9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 shutdown_connections 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2939050598 wait complete. 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91b0af0 msgr2=0x5617a91b2ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5617a91b0af0 0x5617a91b2ee0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a90ad120 msgr2=0x5617a91ae2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5617a90ad120 0x5617a91ae2a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5617a91b49f0 msgr2=0x5617a91b6eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.145+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5617a91b49f0 0x5617a91b6eb0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38d0036950 msgr2=0x7f38d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38d0036950 0x7f38d0038e10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39d4000c00 tx=0x7f39d40013b0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 msgr2=0x5617a91a7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 --2- 172.21.15.169:0/2086216193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617a90abfb0 0x5617a91a7060 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f39dc060040 tx=0x7f39dc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39eaa19640 1 -- 172.21.15.169:0/2086216193 reap_dead start 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 shutdown_connections 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 >> 172.21.15.169:0/2086216193 conn(0x5617a90a7550 msgr2=0x5617a9198920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 shutdown_connections 2024-04-24T01:25:19.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.146+0000 7f39ec719800 1 -- 172.21.15.169:0/2086216193 wait complete. 2024-04-24T01:25:19.155 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-04-24T01:25:19.156 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-04-24T01:25:19.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T01:25:19.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-04-24T01:25:19.156 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-04-24T01:25:19.200 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.200 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cf813800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56411d0ad9b0 0x56411d0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cf813800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56411cf6bd40 con 0x56411d0b02e0 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cf813800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x56411cf3e4d0 con 0x56411d0ad9b0 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cae21640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x56411d0ad9b0 0x56411d0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43c2620640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x56411d0b02e0 0x56411d0b26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46496/0 (socket says 172.21.15.169:46496) 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43c2620640 1 -- 172.21.15.169:0/233905660 learned_addr learned my addr 172.21.15.169:0/233905660 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.201+0000 7f43cae21640 1 -- 172.21.15.169:0/233905660 >> v1:172.21.15.142:6789/0 conn(0x56411d0b02e0 legacy=0x56411d0b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.202+0000 7f43cae21640 1 -- 172.21.15.169:0/233905660 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411cf6a590 con 0x56411d0ad9b0 2024-04-24T01:25:19.203 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.202+0000 7f43ca620640 1 -- 172.21.15.169:0/233905660 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681088930 0 0) 0x56411cf6bd40 con 0x56411d0b02e0 2024-04-24T01:25:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.203+0000 7f43cae21640 1 --2- 172.21.15.169:0/233905660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d0afda0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00a470 tx=0x7f43bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a0e5a72a097fff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43ca620640 1 -- 172.21.15.169:0/233905660 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc057070 con 0x56411d0ad9b0 2024-04-24T01:25:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43ca620640 1 -- 172.21.15.169:0/233905660 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc052570 con 0x56411d0ad9b0 2024-04-24T01:25:19.204 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43ca620640 1 -- 172.21.15.169:0/233905660 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc052870 con 0x56411d0ad9b0 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 -- 172.21.15.169:0/233905660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 msgr2=0x56411d0afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 --2- 172.21.15.169:0/233905660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d0afda0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00a470 tx=0x7f43bc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 -- 172.21.15.169:0/233905660 shutdown_connections 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 --2- 172.21.15.169:0/233905660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d0afda0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 -- 172.21.15.169:0/233905660 >> 172.21.15.169:0/233905660 conn(0x56411d0a7340 msgr2=0x56411d0a9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 -- 172.21.15.169:0/233905660 shutdown_connections 2024-04-24T01:25:19.205 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.204+0000 7f43cf813800 1 -- 172.21.15.169:0/233905660 wait complete. 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.216+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.216+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.216+0000 7f43cf813800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.216+0000 7f43cf813800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56411cff83b0 con 0x56411d0ad9b0 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.216+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45116/0 (socket says 172.21.15.169:45116) 2024-04-24T01:25:19.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f43cae21640 1 -- 172.21.15.169:0/3837755135 learned_addr learned my addr 172.21.15.169:0/3837755135 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f43cae21640 1 -- 172.21.15.169:0/3837755135 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411d19e560 con 0x56411d0ad9b0 2024-04-24T01:25:19.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f43cae21640 1 --2- 172.21.15.169:0/3837755135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f43bc055040 tx=0x7f43bc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b41a130d675fef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f42b8e09640 1 -- 172.21.15.169:0/3837755135 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc057070 con 0x56411d0ad9b0 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f42b8e09640 1 -- 172.21.15.169:0/3837755135 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc063070 con 0x56411d0ad9b0 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.217+0000 7f42b8e09640 1 -- 172.21.15.169:0/3837755135 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc052720 con 0x56411d0ad9b0 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- 172.21.15.169:0/3837755135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 msgr2=0x56411d19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 --2- 172.21.15.169:0/3837755135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f43bc055040 tx=0x7f43bc04c000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- 172.21.15.169:0/3837755135 shutdown_connections 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 --2- 172.21.15.169:0/3837755135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d19df90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- 172.21.15.169:0/3837755135 >> 172.21.15.169:0/3837755135 conn(0x56411d0a7340 msgr2=0x56411d1998b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.220 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- 172.21.15.169:0/3837755135 shutdown_connections 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- 172.21.15.169:0/3837755135 wait complete. 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d1a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.218+0000 7f43cf813800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56411d0b6100 con 0x56411d0ad9b0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d1a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d1a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45128/0 (socket says 172.21.15.169:45128) 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f43cae21640 1 -- 172.21.15.169:0/2191511952 learned_addr learned my addr 172.21.15.169:0/2191511952 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f43cae21640 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411d1a5f90 con 0x56411d0ad9b0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f43cae21640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d1a5a50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f43bc060040 tx=0x7f43bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.219+0000 7f42b7606640 1 -- 172.21.15.169:0/2191511952 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc052e30 con 0x56411d0ad9b0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.220+0000 7f42b7606640 1 -- 172.21.15.169:0/2191511952 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc06c070 con 0x56411d0ad9b0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.220+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411d1a6220 con 0x56411d0ad9b0 2024-04-24T01:25:19.221 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.220+0000 7f42b7606640 1 -- 172.21.15.169:0/2191511952 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc05e5f0 con 0x56411d0ad9b0 2024-04-24T01:25:19.222 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.220+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411d1a8e30 con 0x56411d0ad9b0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f42b7606640 1 -- 172.21.15.169:0/2191511952 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43bc05e790 con 0x56411d0ad9b0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f42b7606640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42b0036950 0x7f42b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f42b7606640 1 -- 172.21.15.169:0/2191511952 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43bc08e960 con 0x56411d0ad9b0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43c2620640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42b0036950 0x7f42b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d0b02e0 0x56411d1acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1ad130 con 0x56411d0b02e0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43cb622640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d0b02e0 0x56411d1acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43c2620640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42b0036950 0x7f42b0038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000c00 tx=0x7f43b40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.221+0000 7f43cb622640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d0b02e0 0x56411d1acbf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cb622640 1 -- 172.21.15.169:0/2191511952 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d0b02e0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1aa1a0 con 0x56411d0b02e0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cb622640 1 -- 172.21.15.169:0/2191511952 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d0b02e0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1af440 0x56411d1b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1b1f20 con 0x56411d1af440 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cae21640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1af440 0x56411d1b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.222+0000 7f43cae21640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1af440 0x56411d1b1830 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43cae21640 1 -- 172.21.15.169:0/2191511952 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1af440 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1ae3f0 con 0x56411d0b02e0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43cb622640 1 -- 172.21.15.169:0/2191511952 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d0b02e0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56411d1b33d0 0x56411d1b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1b5f80 con 0x56411d1b33d0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43c2620640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56411d1b33d0 0x56411d1b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.226 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.223+0000 7f43c2620640 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56411d1b33d0 0x56411d1b5820 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.224+0000 7f43c2620640 1 -- 172.21.15.169:0/2191511952 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f43b400f670 con 0x56411d1b33d0 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.224+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.224+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.224+0000 7f43cf813800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.224+0000 7f43cf813800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56411cf9e6b0 con 0x56411d1c43e0 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45140/0 (socket says 172.21.15.169:45140) 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cae21640 1 -- 172.21.15.169:0/2210132130 learned_addr learned my addr 172.21.15.169:0/2210132130 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cae21640 1 -- 172.21.15.169:0/2210132130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411d1c4d40 con 0x56411d1c43e0 2024-04-24T01:25:19.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cae21640 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f43bc08cd50 tx=0x7f43bc068e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f42b4e01640 1 -- 172.21.15.169:0/2210132130 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc092020 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f42b4e01640 1 -- 172.21.15.169:0/2210132130 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc058040 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f42b4e01640 1 -- 172.21.15.169:0/2210132130 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc002a70 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411d1c57b0 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.225+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411d1c57b0 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f42b4e01640 1 -- 172.21.15.169:0/2210132130 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43bc095020 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f42b4e01640 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 0x7f42a4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f42b4e01640 1 -- 172.21.15.169:0/2210132130 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43bc098d20 con 0x56411d1c43e0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f43c2620640 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 0x7f42a4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.226+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43c2620640 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 0x7f42a4038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x56411d1ad9f0 tx=0x7f43b4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cf813800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cf813800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56411d19e820 con 0x56411d1d1340 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45152/0 (socket says 172.21.15.169:45152) 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cae21640 1 -- 172.21.15.169:0/3540369737 learned_addr learned my addr 172.21.15.169:0/3540369737 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cae21640 1 -- 172.21.15.169:0/3540369737 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411d1d1d30 con 0x56411d1d1340 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f43cae21640 1 --2- 172.21.15.169:0/3540369737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f43bc002170 tx=0x7f43bc0022a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805d5c16611e2f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f42ae7fc640 1 -- 172.21.15.169:0/3540369737 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc002620 con 0x56411d1d1340 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.227+0000 7f42ae7fc640 1 -- 172.21.15.169:0/3540369737 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0049d0 con 0x56411d1d1340 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f42ae7fc640 1 -- 172.21.15.169:0/3540369737 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc004600 con 0x56411d1d1340 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- 172.21.15.169:0/3540369737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 msgr2=0x56411d1d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 --2- 172.21.15.169:0/3540369737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f43bc002170 tx=0x7f43bc0022a0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- 172.21.15.169:0/3540369737 shutdown_connections 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 --2- 172.21.15.169:0/3540369737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d1760 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- 172.21.15.169:0/3540369737 >> 172.21.15.169:0/3540369737 conn(0x56411d1cd650 msgr2=0x56411d1cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- 172.21.15.169:0/3540369737 shutdown_connections 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- 172.21.15.169:0/3540369737 wait complete. 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 Processor -- start 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- start start 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.228+0000 7f43cf813800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56411d1d23c0 con 0x56411d1d1340 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cae21640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45154/0 (socket says 172.21.15.169:45154) 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 learned_addr learned my addr 172.21.15.169:0/1178139780 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411d1d8c30 con 0x56411d1d1340 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cae21640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f43bc084fb0 tx=0x7f43bc082f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f42acff9640 1 -- 172.21.15.169:0/1178139780 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc004600 con 0x56411d1d1340 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56411d1d8c30 con 0x56411d1d1340 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f42acff9640 1 -- 172.21.15.169:0/1178139780 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0bb070 con 0x56411d1d1340 2024-04-24T01:25:19.242 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.229+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411d1d90d0 con 0x56411d1d1340 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f42acff9640 1 -- 172.21.15.169:0/1178139780 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f43bc08b550 con 0x56411d1d1340 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f42acff9640 1 -- 172.21.15.169:0/1178139780 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f43bc08b6f0 con 0x56411d1d1340 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f42acff9640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4294036900 0x7f4294038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f42acff9640 1 -- 172.21.15.169:0/1178139780 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f43bc0818b0 con 0x56411d1d1340 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.230+0000 7f43c2620640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4294036900 0x7f4294038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d1e3e00 0x56411d1e62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e6a10 con 0x56411d1e3e00 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cb622640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d1e3e00 0x56411d1e62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43c2620640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4294036900 0x7f4294038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43b400ffd0 tx=0x7f43b4023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cb622640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d1e3e00 0x56411d1e62c0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 20 realm 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e6e20 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.231+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e76c0 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1e87c0 0x56411d1eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1eb130 con 0x56411d1e87c0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.232+0000 7f43cae21640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1e87c0 0x56411d1eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cae21640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1e87c0 0x56411d1eabb0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cf813800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cf813800 20 searching for the correct realm 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56411d1ed180 0x56411d1ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1efd10 con 0x56411d1ed180 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43c2620640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56411d1ed180 0x56411d1ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43c2620640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56411d1ed180 0x56411d1ef640 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43c2620640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f43b402e910 0x7f43b403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.233+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1efd10 con 0x7f43b402e910 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cb622640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f43b402e910 0x7f43b403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cb622640 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f43b402e910 0x7f43b403a3c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x7f43b402e910 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.234+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.235+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x7f43b402e910 2024-04-24T01:25:19.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x7f43b402e910 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.236+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c400a4a0 con 0x56411d1e3e00 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x7f43b402e910 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.237+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.238+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.248 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x7f43b402e910 2024-04-24T01:25:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.249 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.239+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.240+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x7f43b402e910 2024-04-24T01:25:19.258 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1ed180 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e87c0 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.241+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x56411d1e3e00 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56411d1e7a60 con 0x7f43b402e910 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1eba80 con 0x56411d1e3e00 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1eba80 con 0x56411d1e3e00 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.242+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1eba80 con 0x7f43b402e910 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 zone default found 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 4 Realm: () 2024-04-24T01:25:19.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 zonegroup default 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1ebe70 con 0x56411d1e87c0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f1b70 con 0x56411d1ed180 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.243+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f1f10 con 0x56411d1ed180 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 20 started sync module instance, tier type = 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.244+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f1010 con 0x7f43b402e910 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.245+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.245+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837661438976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f1010 con 0x7f43b402e910 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.245+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f2760 con 0x56411d1e3e00 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.246+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837661438976] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.246+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.246+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837661437040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f2760 con 0x56411d1e3e00 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.246+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3030 con 0x56411d1ed180 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.247+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837661437040] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.247+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.247+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837661443216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3420 con 0x56411d1ed180 2024-04-24T01:25:19.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.247+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3de0 con 0x7f43b402e910 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.248+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837661443216] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.248+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.248+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837661448496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3d50 con 0x7f43b402e910 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.248+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f4bc0 con 0x56411d1e3e00 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.249+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837661448496] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.250+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.250+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837661450672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f4b80 con 0x56411d1e3e00 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.250+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f55d0 con 0x56411d1e87c0 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.251+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.251+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837661450672] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.251+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837661451728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f59c0 con 0x56411d1e87c0 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.251+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f63c0 con 0x56411d1e87c0 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.252+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837661451728] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.252+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.252+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837661454624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f6c60 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.252+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7620 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837661462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7a40 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=1 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=2 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=3 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=4 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=5 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837661454624] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.253+0000 7f43cf813800 20 add_watcher() i=6 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837661462896] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cf813800 20 add_watcher() i=7 2024-04-24T01:25:19.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cf813800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7a40 con 0x56411d1e3e00 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.254+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837661463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f79b0 con 0x56411d1e3e00 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.255+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837661463952] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.255+0000 7f42817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 5 note: GC not initialized 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f41fbfff640 20 reqs_thread_entry: start 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 Filter name: none 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f41f9ffb640 20 reqs_thread_entry: start 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d22d8d0 con 0x56411d1e3e00 2024-04-24T01:25:19.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:25:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.256+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56411d22ee20 con 0x56411d1e87c0 2024-04-24T01:25:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.257+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.258+0000 7f42817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.258+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837661463952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d22c4e0 con 0x56411d1e3e00 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.259+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94837661463952] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.259+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837661438976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7590 con 0x7f43b402e910 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.260+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94837661438976] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.260+0000 7f43cf813800 20 remove_watcher() i=0 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.260+0000 7f43cf813800 2 removed watcher, disabling cache 2024-04-24T01:25:19.271 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.260+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837661437040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7590 con 0x56411d1e3e00 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.261+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94837661437040] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.261+0000 7f43cf813800 20 remove_watcher() i=1 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.261+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837661443216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f0c70 con 0x56411d1ed180 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.262+0000 7f43c2620640 1 -- 172.21.15.169:0/1178139780 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94837661443216] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43b4037040 con 0x56411d1ed180 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.262+0000 7f43cf813800 20 remove_watcher() i=2 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.262+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837661448496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7590 con 0x7f43b402e910 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.263+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94837661448496] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x7f43b402e910 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.263+0000 7f43cf813800 20 remove_watcher() i=3 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.263+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837661450672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3930 con 0x56411d1e3e00 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.264+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94837661450672] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43c4032040 con 0x56411d1e3e00 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.264+0000 7f43cf813800 20 remove_watcher() i=4 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.264+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837661451728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f7590 con 0x56411d1e87c0 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.265+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94837661451728] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.272 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.265+0000 7f43cf813800 20 remove_watcher() i=5 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.265+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837661454624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f3930 con 0x56411d1e87c0 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.266+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94837661454624] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.266+0000 7f43cf813800 20 remove_watcher() i=6 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.266+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837661462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56411d1f4660 con 0x56411d1e87c0 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cae21640 1 -- 172.21.15.169:0/1178139780 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94837661462896] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f43bc071990 con 0x56411d1e87c0 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 20 remove_watcher() i=7 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1e87c0 msgr2=0x56411d1eabb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1e87c0 0x56411d1eabb0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d1e3e00 msgr2=0x56411d1e62c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d1e3e00 0x56411d1e62c0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f43b402e910 msgr2=0x7f43b403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f43b402e910 0x7f43b403a3c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56411d1ed180 msgr2=0x56411d1ef640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x56411d1ed180 0x56411d1ef640 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.273 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4294036900 msgr2=0x7f4294038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4294036900 0x7f4294038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43b400ffd0 tx=0x7f43b4023040 comp rx=0 tx=0).stop 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cb622640 1 -- 172.21.15.169:0/1178139780 reap_dead start 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 msgr2=0x56411d1d86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f43bc084fb0 tx=0x7f43bc082f40 comp rx=0 tx=0).stop 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 shutdown_connections 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 --2- 172.21.15.169:0/1178139780 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1d1340 0x56411d1d86f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 >> 172.21.15.169:0/1178139780 conn(0x56411d1cd650 msgr2=0x56411d1cacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 shutdown_connections 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.267+0000 7f43cf813800 1 -- 172.21.15.169:0/1178139780 wait complete. 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 msgr2=0x7f42a4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 0x7f42a4038dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x56411d1ad9f0 tx=0x7f43b4006000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 msgr2=0x56411d1c4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f43bc08cd50 tx=0x7f43bc068e30 comp rx=0 tx=0).stop 2024-04-24T01:25:19.274 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 shutdown_connections 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42a4036900 0x7f42a4038dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2210132130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d1c43e0 0x56411d1c4800 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 >> 172.21.15.169:0/2210132130 conn(0x56411d1b8480 msgr2=0x56411d1b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 shutdown_connections 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2210132130 wait complete. 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1af440 msgr2=0x56411d1b1830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x56411d1af440 0x56411d1b1830 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d0b02e0 msgr2=0x56411d1acbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56411d0b02e0 0x56411d1acbf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56411d1b33d0 msgr2=0x56411d1b5820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56411d1b33d0 0x56411d1b5820 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42b0036950 msgr2=0x7f42b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f42b0036950 0x7f42b0038e10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f43b4000c00 tx=0x7f43b40013b0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.275 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 msgr2=0x56411d1a5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 --2- 172.21.15.169:0/2191511952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56411d0ad9b0 0x56411d1a5a50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f43bc060040 tx=0x7f43bc002fb0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cb622640 1 -- 172.21.15.169:0/2191511952 reap_dead start 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 shutdown_connections 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 >> 172.21.15.169:0/2191511952 conn(0x56411d0a7340 msgr2=0x56411d1980b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 shutdown_connections 2024-04-24T01:25:19.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.268+0000 7f43cf813800 1 -- 172.21.15.169:0/2191511952 wait complete. 2024-04-24T01:25:19.277 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-04-24T01:25:19.277 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-04-24T01:25:19.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T01:25:19.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-04-24T01:25:19.277 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-04-24T01:25:19.321 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.322 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bfc16800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555e13e11300 0x555e13e19e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bfc16800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e13ccfd40 con 0x555e13e0f7c0 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bfc16800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x555e13ca24d0 con 0x555e13e11300 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bab5b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x555e13e11300 0x555e13e19e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bb35c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x555e13e0f7c0 0x555e13e0fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46510/0 (socket says 172.21.15.169:46510) 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.322+0000 7fc7bb35c640 1 -- 172.21.15.169:0/109713451 learned_addr learned my addr 172.21.15.169:0/109713451 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.323+0000 7fc7bab5b640 1 -- 172.21.15.169:0/109713451 >> v1:172.21.15.142:6789/0 conn(0x555e13e0f7c0 legacy=0x555e13e0fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.323+0000 7fc7bab5b640 1 -- 172.21.15.169:0/109713451 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13cce590 con 0x555e13e11300 2024-04-24T01:25:19.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.323+0000 7fc7ba35a640 1 -- 172.21.15.169:0/109713451 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587401521 0 0) 0x555e13ccfd40 con 0x555e13e0f7c0 2024-04-24T01:25:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/109713451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13e19e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000a470 tx=0x7fc7b001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54527b6694fe3aa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7ba35a640 1 -- 172.21.15.169:0/109713451 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0057070 con 0x555e13e11300 2024-04-24T01:25:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7ba35a640 1 -- 172.21.15.169:0/109713451 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7b0052440 con 0x555e13e11300 2024-04-24T01:25:19.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7ba35a640 1 -- 172.21.15.169:0/109713451 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7b0052740 con 0x555e13e11300 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 -- 172.21.15.169:0/109713451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 msgr2=0x555e13e19e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/109713451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13e19e00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc7b000a470 tx=0x7fc7b001ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 -- 172.21.15.169:0/109713451 shutdown_connections 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/109713451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13e19e00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 -- 172.21.15.169:0/109713451 >> 172.21.15.169:0/109713451 conn(0x555e13e0b320 msgr2=0x555e13e0d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 -- 172.21.15.169:0/109713451 shutdown_connections 2024-04-24T01:25:19.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.325+0000 7fc7bfc16800 1 -- 172.21.15.169:0/109713451 wait complete. 2024-04-24T01:25:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.337+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.337+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.337+0000 7fc7bfc16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.337+0000 7fc7bfc16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555e13d5c3b0 con 0x555e13e0f7c0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45180/0 (socket says 172.21.15.169:45180) 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc7bb35c640 1 -- 172.21.15.169:0/4205529021 learned_addr learned my addr 172.21.15.169:0/4205529021 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc7bb35c640 1 -- 172.21.15.169:0/4205529021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13f04990 con 0x555e13e0f7c0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/4205529021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b210 tx=0x7fc7ac00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0325e5fb4dce807 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc6a960a640 1 -- 172.21.15.169:0/4205529021 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac008070 con 0x555e13e0f7c0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc6a960a640 1 -- 172.21.15.169:0/4205529021 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00d500 con 0x555e13e0f7c0 2024-04-24T01:25:19.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.338+0000 7fc6a960a640 1 -- 172.21.15.169:0/4205529021 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac00d840 con 0x555e13e0f7c0 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- 172.21.15.169:0/4205529021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 msgr2=0x555e13f043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/4205529021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b210 tx=0x7fc7ac00b6d0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- 172.21.15.169:0/4205529021 shutdown_connections 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/4205529021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e0f7c0 0x555e13f043c0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- 172.21.15.169:0/4205529021 >> 172.21.15.169:0/4205529021 conn(0x555e13e0b320 msgr2=0x555e13effce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- 172.21.15.169:0/4205529021 shutdown_connections 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- 172.21.15.169:0/4205529021 wait complete. 2024-04-24T01:25:19.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13f0c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.339+0000 7fc7bfc16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555e13e1c620 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13f0c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13f0c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45186/0 (socket says 172.21.15.169:45186) 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3535728088 learned_addr learned my addr 172.21.15.169:0/3535728088 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13f0c6f0 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13f0c1b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b210 tx=0x7fc7ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc6a7e07640 1 -- 172.21.15.169:0/3535728088 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac00f8b0 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc6a7e07640 1 -- 172.21.15.169:0/3535728088 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac00fa50 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc6a7e07640 1 -- 172.21.15.169:0/3535728088 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac00fd90 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e13f0c980 con 0x555e13e11300 2024-04-24T01:25:19.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.340+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e13f0f5e0 con 0x555e13e11300 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc6a7e07640 1 -- 172.21.15.169:0/3535728088 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7ac017040 con 0x555e13e11300 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc6a7e07640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc6a0036950 0x7fc6a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc6a7e07640 1 -- 172.21.15.169:0/3535728088 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7ac015020 con 0x555e13e11300 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc6a0036950 0x7fc6a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f11390 0x555e13f13780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.341+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f13cc0 con 0x555e13f11390 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f11390 0x555e13f13780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc6a0036950 0x7fc6a0038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0054000 tx=0x7fc7b004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f11390 0x555e13f13780 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/3535728088 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f11390 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f10970 con 0x555e13f11390 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/3535728088 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f11390 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f15fd0 0x555e13f183c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.342+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f18ab0 con 0x555e13f15fd0 2024-04-24T01:25:19.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f15fd0 0x555e13f183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f15fd0 0x555e13f183c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3535728088 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f15fd0 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f14f80 con 0x555e13f11390 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/3535728088 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f11390 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555e13f19f60 0x555e13f1c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.343+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f1cb10 con 0x555e13f19f60 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.344+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555e13f19f60 0x555e13f1c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.344+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555e13f19f60 0x555e13f1c3b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.344+0000 7fc7bab5b640 1 -- 172.21.15.169:0/3535728088 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc7b00525f0 con 0x555e13f19f60 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.344+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.361 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.344+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bfc16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bfc16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555e13d026b0 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45194/0 (socket says 172.21.15.169:45194) 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3995292033 learned_addr learned my addr 172.21.15.169:0/3995292033 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3995292033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13f2b8d0 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac04b3a0 tx=0x7fc7ac01a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc6a5602640 1 -- 172.21.15.169:0/3995292033 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac0197b0 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc6a5602640 1 -- 172.21.15.169:0/3995292033 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac019950 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc6a5602640 1 -- 172.21.15.169:0/3995292033 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac044b70 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e13f2c340 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.345+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e13f2c840 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.346+0000 7fc6a5602640 1 -- 172.21.15.169:0/3995292033 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7ac044d10 con 0x555e13f2af70 2024-04-24T01:25:19.362 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.346+0000 7fc6a5602640 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 0x7fc694038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.346+0000 7fc6a5602640 1 -- 172.21.15.169:0/3995292033 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7ac041050 con 0x555e13f2af70 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.346+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 0x7fc694038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.346+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 0x7fc694038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x555e13f14580 tx=0x7fc7b0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bfc16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bfc16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555e13f04d10 con 0x555e13f38130 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45210/0 (socket says 172.21.15.169:45210) 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3369352614 learned_addr learned my addr 172.21.15.169:0/3369352614 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bb35c640 1 -- 172.21.15.169:0/3369352614 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13f38b20 con 0x555e13f38130 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/3369352614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac03bbf0 tx=0x7fc7ac03f260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc1e84073e7dcf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc69effd640 1 -- 172.21.15.169:0/3369352614 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac03b440 con 0x555e13f38130 2024-04-24T01:25:19.363 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc69effd640 1 -- 172.21.15.169:0/3369352614 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac03bc60 con 0x555e13f38130 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.347+0000 7fc69effd640 1 -- 172.21.15.169:0/3369352614 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac030450 con 0x555e13f38130 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3369352614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 msgr2=0x555e13f38550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3369352614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac03bbf0 tx=0x7fc7ac03f260 comp rx=0 tx=0).stop 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3369352614 shutdown_connections 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3369352614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f38550 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3369352614 >> 172.21.15.169:0/3369352614 conn(0x555e13f34450 msgr2=0x555e13f324b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3369352614 shutdown_connections 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3369352614 wait complete. 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 Processor -- start 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- start start 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f3f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bfc16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555e13f39240 con 0x555e13f38130 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f3f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.364 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bb35c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f3f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45220/0 (socket says 172.21.15.169:45220) 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.348+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 learned_addr learned my addr 172.21.15.169:0/2482636249 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e13f3fa90 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f3f550 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac03bbf0 tx=0x7fc7ac02ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc69d7fa640 1 -- 172.21.15.169:0/2482636249 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac03b440 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc69d7fa640 1 -- 172.21.15.169:0/2482636249 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac06a030 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e13f3fa90 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc69d7fa640 1 -- 172.21.15.169:0/2482636249 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc7ac030610 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.349+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e13f3ff30 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc69d7fa640 1 -- 172.21.15.169:0/2482636249 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc7ac05d030 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc69d7fa640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc684036900 0x7fc684038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc69d7fa640 1 -- 172.21.15.169:0/2482636249 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fc7ac05b070 con 0x555e13f38130 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc684036900 0x7fc684038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f4aaa0 0x555e13f4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.365 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4d6b0 con 0x555e13f4aaa0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f4aaa0 0x555e13f4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.350+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc684036900 0x7fc684038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000c00 tx=0x7fc7b004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f4aaa0 0x555e13f4cf60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 realm 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4dac0 con 0x555e13f4aaa0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e390 con 0x555e13f4aaa0 2024-04-24T01:25:19.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f4f220 0x555e13f51610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.351+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f51d70 con 0x555e13f4f220 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f4f220 0x555e13f51610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bb35c640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f4f220 0x555e13f51610 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bfc16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bfc16800 20 searching for the correct realm 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555e13f53e10 0x555e13f562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f569a0 con 0x555e13f53e10 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.352+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555e13f53e10 0x555e13f562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555e13f53e10 0x555e13f562d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bab5b640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc7b0076040 0x7fc7b0083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f569a0 con 0x7fc7b0076040 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc7b0076040 0x7fc7b0083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.353+0000 7fc7bbb5d640 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc7b0076040 0x7fc7b0083410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x7fc7b0076040 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4f220 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.354+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4f220 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x7fc7b0076040 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x7fc7b0076040 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f53e10 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.355+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4f220 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f4aaa0 2024-04-24T01:25:19.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b400a4a0 con 0x555e13f4aaa0 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x7fc7b0076040 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.356+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x555e13f4e730 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4f220 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.357+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4aaa0 2024-04-24T01:25:19.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4aaa0 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4f220 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.358+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x7fc7b0076040 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4aaa0 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.359+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4f220 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4f220 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x7fc7b0076040 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.360+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f53e10 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4f220 2024-04-24T01:25:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x555e13f4aaa0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fc7b0090040 con 0x7fc7b0076040 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.361+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f52710 con 0x555e13f4aaa0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f52710 con 0x555e13f4aaa0 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f52710 con 0x7fc7b0076040 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 zone default found 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 4 Realm: () 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 zonegroup default 2024-04-24T01:25:19.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.362+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f52b00 con 0x555e13f4f220 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f58800 con 0x555e13f53e10 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f58ba0 con 0x555e13f53e10 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 started sync module instance, tier type = 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.363+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f53370 con 0x7fc7b0076040 2024-04-24T01:25:19.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.365+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.365+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862550141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f583e0 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.365+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f595f0 con 0x555e13f4aaa0 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.366+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862550141184] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.366+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.366+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862550147296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f595b0 con 0x555e13f4aaa0 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.366+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5a050 con 0x555e13f53e10 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.367+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862550147296] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.367+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.367+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862550150016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5a470 con 0x555e13f53e10 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.367+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5ae70 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.368+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862550150016] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.368+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.368+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862550142544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5b260 con 0x7fc7b0076040 2024-04-24T01:25:19.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.368+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5bc60 con 0x555e13f4aaa0 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.369+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.369+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862550157168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5bbd0 con 0x555e13f4aaa0 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.369+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5cc30 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.369+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862550142544] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.370+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.370+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862550161184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5d020 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.370+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862550157168] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.370+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5da40 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.371+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862550161184] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.372+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.372+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862550164784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5dde0 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.372+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5e630 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862550164784] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862550168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5aa60 con 0x555e13f4f220 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=0 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=1 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=2 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=3 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=4 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=5 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=6 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862550168480] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 20 add_watcher() i=7 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.373+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f61e50 con 0x555e13f4aaa0 2024-04-24T01:25:19.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.374+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.374+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862550169600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5f300 con 0x555e13f4aaa0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862550169600] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 5 note: GC not initialized 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc670fe1640 20 reqs_thread_entry: start 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 20 Filter name: none 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc5ea7fc640 20 reqs_thread_entry: start 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.375+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f94cb0 con 0x555e13f4aaa0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.376+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.376+0000 7fc7bfc16800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.376+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x555e13f96200 con 0x555e13f4f220 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.377+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.377+0000 7fc671fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.377+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862550169600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f612e0 con 0x555e13f4aaa0 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.378+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93862550169600] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.378+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862550141184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5e800 con 0x7fc7b0076040 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.381+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93862550141184] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.381+0000 7fc7bfc16800 20 remove_watcher() i=0 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.381+0000 7fc7bfc16800 2 removed watcher, disabling cache 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.381+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862550147296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5e800 con 0x555e13f4aaa0 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.382+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93862550147296] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.382+0000 7fc7bfc16800 20 remove_watcher() i=1 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.382+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862550150016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5e800 con 0x555e13f53e10 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.383+0000 7fc7bab5b640 1 -- 172.21.15.169:0/2482636249 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93862550150016] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b0081070 con 0x555e13f53e10 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.383+0000 7fc7bfc16800 20 remove_watcher() i=2 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.383+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862550142544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f59b80 con 0x7fc7b0076040 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.384+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93862550142544] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x7fc7b0076040 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.384+0000 7fc7bfc16800 20 remove_watcher() i=3 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.384+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862550157168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f57900 con 0x555e13f4aaa0 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.385+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93862550157168] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7b4032040 con 0x555e13f4aaa0 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.385+0000 7fc7bfc16800 20 remove_watcher() i=4 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.385+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862550161184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f57900 con 0x555e13f4f220 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.386+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93862550161184] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.386+0000 7fc7bfc16800 20 remove_watcher() i=5 2024-04-24T01:25:19.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.386+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862550164784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5c720 con 0x555e13f4f220 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.387+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93862550164784] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.387+0000 7fc7bfc16800 20 remove_watcher() i=6 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.387+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862550168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555e13f5c720 con 0x555e13f4f220 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bb35c640 1 -- 172.21.15.169:0/2482636249 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93862550168480] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc7ac02d070 con 0x555e13f4f220 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 20 remove_watcher() i=7 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f4f220 msgr2=0x555e13f51610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f4f220 0x555e13f51610 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f4aaa0 msgr2=0x555e13f4cf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f4aaa0 0x555e13f4cf60 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc7b0076040 msgr2=0x7fc7b0083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fc7b0076040 0x7fc7b0083410 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555e13f53e10 msgr2=0x555e13f562d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.395 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x555e13f53e10 0x555e13f562d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc684036900 msgr2=0x7fc684038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc684036900 0x7fc684038dc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0000c00 tx=0x7fc7b004f000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 msgr2=0x555e13f3f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/2482636249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f38130 0x555e13f3f550 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac03bbf0 tx=0x7fc7ac02ff50 comp rx=0 tx=0).stop 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.388+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 reap_dead start 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/2482636249 reap_dead start 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 shutdown_connections 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 >> 172.21.15.169:0/2482636249 conn(0x555e13f34450 msgr2=0x555e13f31ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 shutdown_connections 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/2482636249 wait complete. 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 msgr2=0x7fc694038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 0x7fc694038dc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x555e13f14580 tx=0x7fc7b0005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 msgr2=0x555e13f2b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.396 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac04b3a0 tx=0x7fc7ac01a950 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 shutdown_connections 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc694036900 0x7fc694038dc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3995292033 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13f2af70 0x555e13f2b390 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 >> 172.21.15.169:0/3995292033 conn(0x555e13f1f010 msgr2=0x555e13f1f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 shutdown_connections 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3995292033 wait complete. 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f15fd0 msgr2=0x555e13f183c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x555e13f15fd0 0x555e13f183c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f11390 msgr2=0x555e13f13780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x555e13f11390 0x555e13f13780 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555e13f19f60 msgr2=0x555e13f1c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x555e13f19f60 0x555e13f1c3b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.397 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc6a0036950 msgr2=0x7fc6a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc6a0036950 0x7fc6a0038e10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc7b0054000 tx=0x7fc7b004e000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 msgr2=0x555e13f0c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bfc16800 1 --2- 172.21.15.169:0/3535728088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555e13e11300 0x555e13f0c1b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00b210 tx=0x7fc7ac000ed0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.389+0000 7fc7bbb5d640 1 -- 172.21.15.169:0/3535728088 reap_dead start 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.390+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 shutdown_connections 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.390+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 >> 172.21.15.169:0/3535728088 conn(0x555e13e0b320 msgr2=0x555e13f02db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.390+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 shutdown_connections 2024-04-24T01:25:19.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.390+0000 7fc7bfc16800 1 -- 172.21.15.169:0/3535728088 wait complete. 2024-04-24T01:25:19.399 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-04-24T01:25:19.399 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:25:19.399 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T01:25:19.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-04-24T01:25:19.400 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-04-24T01:25:19.444 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.445 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f9592834800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bb9bdca760 0x55bb9bdcab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f9592834800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb9bc8ad40 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f9592834800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55bb9bc5d4d0 con 0x55bb9bdca760 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f958dbc0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bb9bdca760 0x55bb9bdcab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f95853bf640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55bb9bdcb0c0 0x55bb9bdcb570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46512/0 (socket says 172.21.15.169:46512) 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.445+0000 7f95853bf640 1 -- 172.21.15.169:0/2390407354 learned_addr learned my addr 172.21.15.169:0/2390407354 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.446+0000 7f958d3bf640 1 -- 172.21.15.169:0/2390407354 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184073817 0 0) 0x55bb9bc8ad40 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.446+0000 7f958d3bf640 1 -- 172.21.15.169:0/2390407354 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957c001e10 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.446+0000 7f958dbc0640 1 -- 172.21.15.169:0/2390407354 >> v1:172.21.15.142:6789/0 conn(0x55bb9bdcb0c0 legacy=0x55bb9bdcb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.446+0000 7f958dbc0640 1 -- 172.21.15.169:0/2390407354 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9bc89590 con 0x55bb9bdca760 2024-04-24T01:25:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2390407354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bdcab80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f958000a470 tx=0x7f958001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40eb7b2f441bf1c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f958d3bf640 1 -- 172.21.15.169:0/2390407354 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580057070 con 0x55bb9bdca760 2024-04-24T01:25:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f958d3bf640 1 -- 172.21.15.169:0/2390407354 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958004acd0 con 0x55bb9bdca760 2024-04-24T01:25:19.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f958d3bf640 1 -- 172.21.15.169:0/2390407354 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580052440 con 0x55bb9bdca760 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 -- 172.21.15.169:0/2390407354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 msgr2=0x55bb9bdcab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 --2- 172.21.15.169:0/2390407354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bdcab80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f958000a470 tx=0x7f958001cdb0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 -- 172.21.15.169:0/2390407354 shutdown_connections 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 --2- 172.21.15.169:0/2390407354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bdcab80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 -- 172.21.15.169:0/2390407354 >> 172.21.15.169:0/2390407354 conn(0x55bb9bdc63a0 msgr2=0x55bb9bdc87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 -- 172.21.15.169:0/2390407354 shutdown_connections 2024-04-24T01:25:19.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.448+0000 7f9592834800 1 -- 172.21.15.169:0/2390407354 wait complete. 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f9592834800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f9592834800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bb9bd173b0 con 0x55bb9bdca760 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45250/0 (socket says 172.21.15.169:45250) 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f958dbc0640 1 -- 172.21.15.169:0/2830538799 learned_addr learned my addr 172.21.15.169:0/2830538799 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.460+0000 7f958dbc0640 1 -- 172.21.15.169:0/2830538799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9bebf7a0 con 0x55bb9bdca760 2024-04-24T01:25:19.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.461+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2830538799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9580055040 tx=0x7f958004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cf53abb1c209d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.461+0000 7f947be07640 1 -- 172.21.15.169:0/2830538799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580057040 con 0x55bb9bdca760 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.461+0000 7f947be07640 1 -- 172.21.15.169:0/2830538799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580063070 con 0x55bb9bdca760 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.461+0000 7f947be07640 1 -- 172.21.15.169:0/2830538799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958000a2a0 con 0x55bb9bdca760 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- 172.21.15.169:0/2830538799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 msgr2=0x55bb9bebf1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 --2- 172.21.15.169:0/2830538799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9580055040 tx=0x7f958004c000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- 172.21.15.169:0/2830538799 shutdown_connections 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 --2- 172.21.15.169:0/2830538799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bebf1d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- 172.21.15.169:0/2830538799 >> 172.21.15.169:0/2830538799 conn(0x55bb9bdc63a0 msgr2=0x55bb9bebaaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- 172.21.15.169:0/2830538799 shutdown_connections 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- 172.21.15.169:0/2830538799 wait complete. 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bec6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f9592834800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bb9bdcbf20 con 0x55bb9bdca760 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bec6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bec6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45264/0 (socket says 172.21.15.169:45264) 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.462+0000 7f958dbc0640 1 -- 172.21.15.169:0/2489137176 learned_addr learned my addr 172.21.15.169:0/2489137176 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f958dbc0640 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9bec71b0 con 0x55bb9bdca760 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bec6c70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9580060040 tx=0x7f9580002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f947a604640 1 -- 172.21.15.169:0/2489137176 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580057040 con 0x55bb9bdca760 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f947a604640 1 -- 172.21.15.169:0/2489137176 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f958005db00 con 0x55bb9bdca760 2024-04-24T01:25:19.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f947a604640 1 -- 172.21.15.169:0/2489137176 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958005de00 con 0x55bb9bdca760 2024-04-24T01:25:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9bec7440 con 0x55bb9bdca760 2024-04-24T01:25:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.463+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9beca0f0 con 0x55bb9bdca760 2024-04-24T01:25:19.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f947a604640 1 -- 172.21.15.169:0/2489137176 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9580076060 con 0x55bb9bdca760 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f947a604640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9474036950 0x7f9474038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f947a604640 1 -- 172.21.15.169:0/2489137176 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f958008dc00 con 0x55bb9bdca760 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f95853bf640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9474036950 0x7f9474038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bdcb0c0 0x55bb9becdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.464+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bece480 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bdcb0c0 0x55bb9becdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f95853bf640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9474036950 0x7f9474038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9578000f60 tx=0x7f95780010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bdcb0c0 0x55bb9becdeb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f958e3c1640 1 -- 172.21.15.169:0/2489137176 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9becb460 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f958e3c1640 1 -- 172.21.15.169:0/2489137176 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bed0790 0x55bb9bed2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.465+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bed3220 con 0x55bb9bed0790 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.466+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bed0790 0x55bb9bed2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.466+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bed0790 0x55bb9bed2b80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.466+0000 7f958dbc0640 1 -- 172.21.15.169:0/2489137176 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bed0790 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.466+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9becf740 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f958e3c1640 1 -- 172.21.15.169:0/2489137176 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bdcb0c0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bb9bed46d0 0x55bb9bed6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bed7280 con 0x55bb9bed46d0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f95853bf640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bb9bed46d0 0x55bb9bed6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f95853bf640 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bb9bed46d0 0x55bb9bed6b20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.467+0000 7f95853bf640 1 -- 172.21.15.169:0/2489137176 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bed46d0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f9592834800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f9592834800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bb9bcbd6b0 con 0x55bb9bee56e0 2024-04-24T01:25:19.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45266/0 (socket says 172.21.15.169:45266) 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f958dbc0640 1 -- 172.21.15.169:0/2012211147 learned_addr learned my addr 172.21.15.169:0/2012211147 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f958dbc0640 1 -- 172.21.15.169:0/2012211147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9bee6040 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.468+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9580053fd0 tx=0x7f958006eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f94737fe640 1 -- 172.21.15.169:0/2012211147 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9580066ca0 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f94737fe640 1 -- 172.21.15.169:0/2012211147 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580092070 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f94737fe640 1 -- 172.21.15.169:0/2012211147 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958006e730 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9bee6ab0 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9bee6fb0 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.469+0000 7f94737fe640 1 -- 172.21.15.169:0/2012211147 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f958006e8d0 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f94737fe640 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 0x7f9468038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f94737fe640 1 -- 172.21.15.169:0/2012211147 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9580089070 con 0x55bb9bee56e0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f95853bf640 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 0x7f9468038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f95853bf640 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 0x7f9468038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f957800bf90 tx=0x7f957800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f9592834800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.470+0000 7f9592834800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bb9bebfa60 con 0x55bb9bef27b0 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45274/0 (socket says 172.21.15.169:45274) 2024-04-24T01:25:19.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f958dbc0640 1 -- 172.21.15.169:0/3788451312 learned_addr learned my addr 172.21.15.169:0/3788451312 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f958dbc0640 1 -- 172.21.15.169:0/3788451312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9bef31a0 con 0x55bb9bef27b0 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f958dbc0640 1 --2- 172.21.15.169:0/3788451312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9580066fd0 tx=0x7f9580078b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ea68fd897c3076a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f94717fa640 1 -- 172.21.15.169:0/3788451312 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95800a6070 con 0x55bb9bef27b0 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f94717fa640 1 -- 172.21.15.169:0/3788451312 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9580078450 con 0x55bb9bef27b0 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f94717fa640 1 -- 172.21.15.169:0/3788451312 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958008d100 con 0x55bb9bef27b0 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.471+0000 7f9592834800 1 -- 172.21.15.169:0/3788451312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 msgr2=0x55bb9bef2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 --2- 172.21.15.169:0/3788451312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9580066fd0 tx=0x7f9580078b90 comp rx=0 tx=0).stop 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- 172.21.15.169:0/3788451312 shutdown_connections 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 --2- 172.21.15.169:0/3788451312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef2bd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- 172.21.15.169:0/3788451312 >> 172.21.15.169:0/3788451312 conn(0x55bb9beeeb10 msgr2=0x55bb9beecb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- 172.21.15.169:0/3788451312 shutdown_connections 2024-04-24T01:25:19.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- 172.21.15.169:0/3788451312 wait complete. 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 Processor -- start 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- start start 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f9592834800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bb9bef3850 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f958dbc0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45276/0 (socket says 172.21.15.169:45276) 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 learned_addr learned my addr 172.21.15.169:0/2007293984 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.472+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb9befa120 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f958008d4a0 tx=0x7f9580065f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f945f7fe640 1 -- 172.21.15.169:0/2007293984 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958008ab60 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f945f7fe640 1 -- 172.21.15.169:0/2007293984 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95800828f0 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f945f7fe640 1 -- 172.21.15.169:0/2007293984 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f958008d100 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb9befa120 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb9befa120 con 0x55bb9bef27b0 2024-04-24T01:25:19.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.473+0000 7f945f7fe640 1 -- 172.21.15.169:0/2007293984 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f95800bc020 con 0x55bb9bef27b0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f945f7fe640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9458036950 0x7f9458038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f945f7fe640 1 -- 172.21.15.169:0/2007293984 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f95800ba020 con 0x55bb9bef27b0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f95853bf640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9458036950 0x7f9458038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bf05280 0x55bb9bf07740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf07e90 con 0x55bb9bf05280 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bf05280 0x55bb9bf07740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f95853bf640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9458036950 0x7f9458038e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55bb9becb3a0 tx=0x7f9578010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.474+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bf05280 0x55bb9bf07740 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 realm 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf082a0 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08b70 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bf09a00 0x55bb9bf0bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf0c550 con 0x55bb9bf09a00 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.475+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bf09a00 0x55bb9bf0bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f958dbc0640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bf09a00 0x55bb9bf0bdf0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f9592834800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f9592834800 20 searching for the correct realm 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bb9bf0e600 0x55bb9bf10ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf11190 con 0x55bb9bf0e600 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f95853bf640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bb9bf0e600 0x55bb9bf10ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.476+0000 7f95853bf640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bb9bf0e600 0x55bb9bf10ac0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f95853bf640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9578037040 0x7f9578036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf11190 con 0x7f9578037040 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9578037040 0x7f9578036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f958e3c1640 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9578037040 0x7f9578036410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x7f9578037040 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.477+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.478+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x7f9578037040 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x7f9578037040 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.479+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958800a4a0 con 0x55bb9bf05280 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x7f9578037040 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.480+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.481+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.482+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x7f9578037040 2024-04-24T01:25:19.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.483+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x7f9578037040 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.484+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf0e600 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x55bb9bf05280 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf08f10 con 0x7f9578037040 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.485+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf0cf00 con 0x55bb9bf05280 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf0cf00 con 0x55bb9bf05280 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf0cf00 con 0x7f9578037040 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 zone default found 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 4 Realm: () 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 zonegroup default 2024-04-24T01:25:19.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.486+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf0d2f0 con 0x55bb9bf09a00 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf12ff0 con 0x55bb9bf0e600 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13390 con 0x55bb9bf0e600 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 started sync module instance, tier type = 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.487+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf12490 con 0x7f9578037040 2024-04-24T01:25:19.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.488+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.488+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94264263518384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf12490 con 0x7f9578037040 2024-04-24T01:25:19.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.488+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13be0 con 0x55bb9bf05280 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.489+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94264263518384] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.490+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.490+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94264263516400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13be0 con 0x55bb9bf05280 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.490+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf145a0 con 0x55bb9bf0e600 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.490+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94264263516400] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.491+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.491+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94264263522096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13b50 con 0x55bb9bf0e600 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.491+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf152e0 con 0x7f9578037040 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.492+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94264263522096] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.492+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.492+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94264263526720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf156d0 con 0x7f9578037040 2024-04-24T01:25:19.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.492+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf16110 con 0x55bb9bf05280 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.493+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.493+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94264263531488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf160d0 con 0x55bb9bf05280 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.493+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf17050 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.493+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94264263526720] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.494+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94264263531488] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.496+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.496+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94264263535488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf16500 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.496+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf178f0 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.497+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94264263535488] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.497+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.497+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94264263537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf17d10 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.497+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf186d0 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94264263541280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf18b30 con 0x55bb9bf09a00 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=0 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=1 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=2 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=3 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=4 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=5 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94264263537728] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.498+0000 7f9592834800 20 add_watcher() i=6 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94264263541280] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f9592834800 20 add_watcher() i=7 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f9592834800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf17860 con 0x55bb9bf05280 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.499+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94264263542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf17860 con 0x55bb9bf05280 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.500+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94264263542336] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.500+0000 7f943f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 5 note: GC not initialized 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f943e7fc640 20 reqs_thread_entry: start 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 Filter name: none 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f93affff640 20 reqs_thread_entry: start 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf4e9c0 con 0x55bb9bf05280 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.501+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf4ff10 con 0x55bb9bf09a00 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.502+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.503+0000 7f943f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.503+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94264263542336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf4d160 con 0x55bb9bf05280 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.504+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94264263542336] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.504+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94264263518384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf18640 con 0x7f9578037040 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.505+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94264263518384] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.505+0000 7f9592834800 20 remove_watcher() i=0 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.505+0000 7f9592834800 2 removed watcher, disabling cache 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.505+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94264263516400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf18640 con 0x55bb9bf05280 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.506+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94264263516400] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.506+0000 7f9592834800 20 remove_watcher() i=1 2024-04-24T01:25:19.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.506+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94264263522096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf120f0 con 0x55bb9bf0e600 2024-04-24T01:25:19.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.507+0000 7f95853bf640 1 -- 172.21.15.169:0/2007293984 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94264263522096] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9578009050 con 0x55bb9bf0e600 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.507+0000 7f9592834800 20 remove_watcher() i=2 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.507+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94264263526720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf18640 con 0x7f9578037040 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.508+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94264263526720] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x7f9578037040 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.508+0000 7f9592834800 20 remove_watcher() i=3 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.508+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94264263531488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13730 con 0x55bb9bf05280 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.510+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94264263531488] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9588032040 con 0x55bb9bf05280 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.510+0000 7f9592834800 20 remove_watcher() i=4 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.510+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94264263535488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf14940 con 0x55bb9bf09a00 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.511+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94264263535488] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.511+0000 7f9592834800 20 remove_watcher() i=5 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.511+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94264263537728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf18640 con 0x55bb9bf09a00 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.512+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94264263537728] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.512+0000 7f9592834800 20 remove_watcher() i=6 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.512+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94264263541280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb9bf13730 con 0x55bb9bf09a00 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.512+0000 7f958dbc0640 1 -- 172.21.15.169:0/2007293984 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94264263541280] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f958005a040 con 0x55bb9bf09a00 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 20 remove_watcher() i=7 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bf09a00 msgr2=0x55bb9bf0bdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bf09a00 0x55bb9bf0bdf0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bf05280 msgr2=0x55bb9bf07740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bf05280 0x55bb9bf07740 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9578037040 msgr2=0x7f9578036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f9578037040 0x7f9578036410 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bb9bf0e600 msgr2=0x55bb9bf10ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bb9bf0e600 0x55bb9bf10ac0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9458036950 msgr2=0x7f9458038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9458036950 0x7f9458038e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55bb9becb3a0 tx=0x7f9578010000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f958e3c1640 1 -- 172.21.15.169:0/2007293984 reap_dead start 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 msgr2=0x55bb9bef9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f958008d4a0 tx=0x7f9580065f80 comp rx=0 tx=0).stop 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 shutdown_connections 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2007293984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bef27b0 0x55bb9bef9be0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 >> 172.21.15.169:0/2007293984 conn(0x55bb9beeeb10 msgr2=0x55bb9beec170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 shutdown_connections 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2007293984 wait complete. 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 msgr2=0x7f9468038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 0x7f9468038dc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f957800bf90 tx=0x7f957800f000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 msgr2=0x55bb9bee5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9580053fd0 tx=0x7f958006eed0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 shutdown_connections 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9468036900 0x7f9468038dc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 --2- 172.21.15.169:0/2012211147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bee56e0 0x55bb9bee5b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 >> 172.21.15.169:0/2012211147 conn(0x55bb9bed9780 msgr2=0x55bb9bed9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 shutdown_connections 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.513+0000 7f9592834800 1 -- 172.21.15.169:0/2012211147 wait complete. 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bed0790 msgr2=0x55bb9bed2b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bb9bed0790 0x55bb9bed2b80 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bdcb0c0 msgr2=0x55bb9becdeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bb9bdcb0c0 0x55bb9becdeb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bb9bed46d0 msgr2=0x55bb9bed6b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bb9bed46d0 0x55bb9bed6b20 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9474036950 msgr2=0x7f9474038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9474036950 0x7f9474038e10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9578000f60 tx=0x7f95780010a0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 msgr2=0x55bb9bec6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 --2- 172.21.15.169:0/2489137176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bb9bdca760 0x55bb9bec6c70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9580060040 tx=0x7f9580002fb0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f958e3c1640 1 -- 172.21.15.169:0/2489137176 reap_dead start 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 shutdown_connections 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 >> 172.21.15.169:0/2489137176 conn(0x55bb9bdc63a0 msgr2=0x55bb9beb93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 shutdown_connections 2024-04-24T01:25:19.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.514+0000 7f9592834800 1 -- 172.21.15.169:0/2489137176 wait complete. 2024-04-24T01:25:19.522 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-04-24T01:00:00.000000Z","epoch":1713920400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-04-24T01:25:19.522 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T01:25:19.522 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T01:25:19.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-04-24T01:25:19.523 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-04-24T01:25:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.573 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.573+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.573+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0eb1a13800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55faab756d70 0x55faab757190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0eb1a13800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55faab616d40 con 0x55faab757fd0 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0eb1a13800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55faab5e94d0 con 0x55faab756d70 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0ead06e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55faab756d70 0x55faab757190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0eac86d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55faab757fd0 0x55faab758450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46524/0 (socket says 172.21.15.169:46524) 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0eac86d640 1 -- 172.21.15.169:0/2095771851 learned_addr learned my addr 172.21.15.169:0/2095771851 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0ead06e640 1 -- 172.21.15.169:0/2095771851 >> v1:172.21.15.142:6789/0 conn(0x55faab757fd0 legacy=0x55faab758450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0ead06e640 1 -- 172.21.15.169:0/2095771851 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab615590 con 0x55faab756d70 2024-04-24T01:25:19.575 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.574+0000 7f0e9ffff640 1 -- 172.21.15.169:0/2095771851 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918184783 0 0) 0x55faab616d40 con 0x55faab757fd0 2024-04-24T01:25:19.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.576+0000 7f0ead06e640 1 --2- 172.21.15.169:0/2095771851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab757190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0005fd0 tx=0x7f0ea001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f6dc55ee1f2c28 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.576+0000 7f0e9ffff640 1 -- 172.21.15.169:0/2095771851 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0052560 con 0x55faab756d70 2024-04-24T01:25:19.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.576+0000 7f0e9ffff640 1 -- 172.21.15.169:0/2095771851 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0052700 con 0x55faab756d70 2024-04-24T01:25:19.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.576+0000 7f0e9ffff640 1 -- 172.21.15.169:0/2095771851 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0052a20 con 0x55faab756d70 2024-04-24T01:25:19.577 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 -- 172.21.15.169:0/2095771851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 msgr2=0x55faab757190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/2095771851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab757190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0005fd0 tx=0x7f0ea001ccc0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 -- 172.21.15.169:0/2095771851 shutdown_connections 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/2095771851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab757190 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 -- 172.21.15.169:0/2095771851 >> 172.21.15.169:0/2095771851 conn(0x55faab7523d0 msgr2=0x55faab7547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 -- 172.21.15.169:0/2095771851 shutdown_connections 2024-04-24T01:25:19.578 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.577+0000 7f0eb1a13800 1 -- 172.21.15.169:0/2095771851 wait complete. 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.588+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.588+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0eb1a13800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0eb1a13800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55faab6a33e0 con 0x55faab756d70 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45296/0 (socket says 172.21.15.169:45296) 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0ead06e640 1 -- 172.21.15.169:0/881493990 learned_addr learned my addr 172.21.15.169:0/881493990 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0ead06e640 1 -- 172.21.15.169:0/881493990 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab8488f0 con 0x55faab756d70 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0ead06e640 1 --2- 172.21.15.169:0/881493990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0054040 tx=0x7f0ea004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1855ccccf09a74df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.589+0000 7f0d9b606640 1 -- 172.21.15.169:0/881493990 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea00529e0 con 0x55faab756d70 2024-04-24T01:25:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0d9b606640 1 -- 172.21.15.169:0/881493990 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0052b80 con 0x55faab756d70 2024-04-24T01:25:19.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0d9b606640 1 -- 172.21.15.169:0/881493990 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea005c430 con 0x55faab756d70 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 -- 172.21.15.169:0/881493990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 msgr2=0x55faab848320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/881493990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0054040 tx=0x7f0ea004c000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 -- 172.21.15.169:0/881493990 shutdown_connections 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/881493990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab848320 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 -- 172.21.15.169:0/881493990 >> 172.21.15.169:0/881493990 conn(0x55faab7523d0 msgr2=0x55faab843c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 -- 172.21.15.169:0/881493990 shutdown_connections 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.590+0000 7f0eb1a13800 1 -- 172.21.15.169:0/881493990 wait complete. 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0eb1a13800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab850e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0eb1a13800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55faab760470 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab850e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab850e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45308/0 (socket says 172.21.15.169:45308) 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0ead06e640 1 -- 172.21.15.169:0/1751755578 learned_addr learned my addr 172.21.15.169:0/1751755578 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0ead06e640 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab8513a0 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.591+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab850e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0044920 tx=0x7f0ea0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0d99e03640 1 -- 172.21.15.169:0/1751755578 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea005cce0 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0d99e03640 1 -- 172.21.15.169:0/1751755578 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0066410 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faab851630 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0d99e03640 1 -- 172.21.15.169:0/1751755578 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0066730 con 0x55faab756d70 2024-04-24T01:25:19.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faab8542e0 con 0x55faab756d70 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.592+0000 7f0d99e03640 1 -- 172.21.15.169:0/1751755578 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ea0078020 con 0x55faab756d70 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0d99e03640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d94036950 0x7f0d94038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0d99e03640 1 -- 172.21.15.169:0/1751755578 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ea008e880 con 0x55faab756d70 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d94036950 0x7f0d94038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab757fd0 0x55faab8580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8586c0 con 0x55faab757fd0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab757fd0 0x55faab8580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d94036950 0x7f0d94038e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000c00 tx=0x7f0ea40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab757fd0 0x55faab8580a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0ead86f640 1 -- 172.21.15.169:0/1751755578 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab757fd0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.593+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab855630 con 0x55faab757fd0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.594+0000 7f0ead86f640 1 -- 172.21.15.169:0/1751755578 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab757fd0 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.594+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab85a990 0x55faab85cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.594+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab85d450 con 0x55faab85a990 2024-04-24T01:25:19.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.594+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab85a990 0x55faab85cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.594+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab85a990 0x55faab85cd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0ead06e640 1 -- 172.21.15.169:0/1751755578 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0ea0071770 con 0x55faab85a990 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab859940 con 0x55faab757fd0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0ead86f640 1 -- 172.21.15.169:0/1751755578 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab757fd0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55faab85e8b0 0x55faab860d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8614b0 con 0x55faab85e8b0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55faab85e8b0 0x55faab860d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.595+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55faab85e8b0 0x55faab860d20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0eac86d640 1 -- 172.21.15.169:0/1751755578 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0ea400f670 con 0x55faab85e8b0 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0eb1a13800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0eb1a13800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55faab6496b0 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45324/0 (socket says 172.21.15.169:45324) 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.596+0000 7f0ead06e640 1 -- 172.21.15.169:0/3002502455 learned_addr learned my addr 172.21.15.169:0/3002502455 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0ead06e640 1 -- 172.21.15.169:0/3002502455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab8702c0 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0ead06e640 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ea008cbd0 tx=0x7f0ea0065f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0d92ffd640 1 -- 172.21.15.169:0/3002502455 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0070cb0 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0d92ffd640 1 -- 172.21.15.169:0/3002502455 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0070e50 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faab870d30 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0d92ffd640 1 -- 172.21.15.169:0/3002502455 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea008ec50 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.597+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faab871230 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0d92ffd640 1 -- 172.21.15.169:0/3002502455 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ea0083040 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0d92ffd640 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 0x7f0d84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0d92ffd640 1 -- 172.21.15.169:0/3002502455 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ea008a070 con 0x55faab86f960 2024-04-24T01:25:19.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eac86d640 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 0x7f0d84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eac86d640 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 0x7f0d84038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55faab85d820 tx=0x7f0ea4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eb1a13800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.598+0000 7f0eb1a13800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55faab848bb0 con 0x55faab87cb40 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45326/0 (socket says 172.21.15.169:45326) 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0ead06e640 1 -- 172.21.15.169:0/1890642636 learned_addr learned my addr 172.21.15.169:0/1890642636 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0ead06e640 1 -- 172.21.15.169:0/1890642636 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab87d530 con 0x55faab87cb40 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1890642636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0ea005cb00 tx=0x7f0ea0091fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84bf609a4dc30e39 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0d90ff9640 1 -- 172.21.15.169:0/1890642636 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea00a7070 con 0x55faab87cb40 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0d90ff9640 1 -- 172.21.15.169:0/1890642636 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0067260 con 0x55faab87cb40 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0d90ff9640 1 -- 172.21.15.169:0/1890642636 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea008edf0 con 0x55faab87cb40 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1890642636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 msgr2=0x55faab87cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.599+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1890642636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0ea005cb00 tx=0x7f0ea0091fe0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1890642636 shutdown_connections 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1890642636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab87cf60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1890642636 >> 172.21.15.169:0/1890642636 conn(0x55faab878ea0 msgr2=0x55faab876f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1890642636 shutdown_connections 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1890642636 wait complete. 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 Processor -- start 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- start start 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab883f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0eb1a13800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55faab87dbe0 con 0x55faab87cb40 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab883f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0ead06e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab883f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45340/0 (socket says 172.21.15.169:45340) 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.600+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 learned_addr learned my addr 172.21.15.169:0/1854633374 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55faab884440 con 0x55faab87cb40 2024-04-24T01:25:19.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab883f00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0ea005cb00 tx=0x7f0ea0054f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0d82ffd640 1 -- 172.21.15.169:0/1854633374 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea00bc070 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0d82ffd640 1 -- 172.21.15.169:0/1854633374 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea008e6b0 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55faab884440 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0d82ffd640 1 -- 172.21.15.169:0/1854633374 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ea0067df0 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.601+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55faab884440 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0d82ffd640 1 -- 172.21.15.169:0/1854633374 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0ea00bf070 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0d82ffd640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d78036860 0x7f0d78038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0d82ffd640 1 -- 172.21.15.169:0/1854633374 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0ea00b4070 con 0x55faab87cb40 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d78036860 0x7f0d78038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d78036860 0x7f0d78038d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400ffd0 tx=0x7f0ea4023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab88f500 0x55faab8919c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab892110 con 0x55faab88f500 2024-04-24T01:25:19.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.602+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab88f500 0x55faab8919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab88f500 0x55faab8919c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab88f500 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 realm 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab892520 con 0x55faab88f500 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab88f500 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab88f500 2024-04-24T01:25:19.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.603+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab893190 con 0x55faab88f500 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab88f500 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab893b50 0x55faab895f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab896550 con 0x55faab893b50 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab893b50 0x55faab895f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0ead06e640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab893b50 0x55faab895f40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 20 searching for the correct realm 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55faab898500 0x55faab89a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.604+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab89b090 con 0x55faab898500 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55faab898500 0x55faab89a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55faab898500 0x55faab89a9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0eac86d640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0ea402e910 0x7f0ea403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab89b090 con 0x7f0ea402e910 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.605+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0ea402e910 0x7f0ea403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0ea402e910 0x7f0ea403a3c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea80083e0 con 0x7f0ea402e910 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea80083e0 con 0x55faab88f500 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.606+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x7f0ea402e910 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x7f0ea402e910 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.607+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.608+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x7f0ea402e910 2024-04-24T01:25:19.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0ea8026040 con 0x7f0ea402e910 2024-04-24T01:25:19.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.609+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.610+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x7f0ea402e910 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x7f0ea402e910 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.611+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.612+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x7f0ea402e910 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8026040 con 0x7f0ea402e910 2024-04-24T01:25:19.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab898500 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab893b50 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x55faab88f500 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ea8026040 con 0x55faab88f500 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.613+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55faab892df0 con 0x7f0ea402e910 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab896e10 con 0x55faab88f500 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab896e10 con 0x55faab88f500 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.614+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab896e10 con 0x7f0ea402e910 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 zone default found 2024-04-24T01:25:19.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 4 Realm: () 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 zonegroup default 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab897700 con 0x55faab893b50 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab89cef0 con 0x55faab898500 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab89d290 con 0x55faab898500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 started sync module instance, tier type = 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.615+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89c390 con 0x7f0ea402e910 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.617+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.617+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94535108118704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89c390 con 0x7f0ea402e910 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.617+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89dc50 con 0x55faab88f500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.618+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.618+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94535108118704] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.618+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94535108122528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89e0d0 con 0x55faab88f500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.618+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89bf20 con 0x55faab898500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.619+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94535108122528] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.619+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.619+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94535108123584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89eb70 con 0x55faab898500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.619+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89f530 con 0x7f0ea402e910 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.620+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94535108123584] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.620+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.620+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94535108128896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89f950 con 0x7f0ea402e910 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.620+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a0310 con 0x55faab88f500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.621+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94535108128896] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.621+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.621+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94535108129952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a0310 con 0x55faab88f500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.621+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a0d10 con 0x55faab893b50 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.622+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94535108129952] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.622+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.622+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94535108132448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a0280 con 0x55faab893b50 2024-04-24T01:25:19.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.622+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a1aa0 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.623+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94535108132448] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.623+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.623+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94535108137136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a1e90 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.623+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a2890 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94535108137136] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94535108141984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a27c0 con 0x55faab893b50 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=0 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=1 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=2 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=3 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=4 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=5 2024-04-24T01:25:19.640 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.624+0000 7f0eb1a13800 20 add_watcher() i=6 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.625+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94535108141984] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.625+0000 7f0eb1a13800 20 add_watcher() i=7 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.625+0000 7f0eb1a13800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.625+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a15c0 con 0x55faab88f500 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.626+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.626+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94535108144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8a3550 con 0x55faab88f500 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94535108144256] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 5 note: GC not initialized 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0d627e4640 20 reqs_thread_entry: start 2024-04-24T01:25:19.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 20 Filter name: none 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0cd3fff640 20 reqs_thread_entry: start 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.627+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8d9080 con 0x55faab893b50 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8d7820 con 0x55faab88f500 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.628+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8d80f0 con 0x55faab893b50 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0eb1a13800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0eb1a13800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0eb1a13800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94535108361280 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8dc670 con 0x55faab893b50 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== watch-notify(notify (1) cookie 94535108141984 notify 146028888084 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55faab8d8ad0 con 0x55faab893b50 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0d90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94535108141984 notifier 4724 bl.length()=556 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(65 notify.7 [notify cookie 94535108361280 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0d90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.629+0000 7f0d90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.630+0000 7f0d90ff9640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0d70003ea0 con 0x55faab893b50 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.630+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.630+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== watch-notify(notify_complete (2) cookie 94535108361280 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55faab8702c0 con 0x55faab893b50 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.630+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab8d80f0 con 0x55faab88f500 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0eb1a13800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0eb1a13800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0eb1a13800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94535108361280 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55faab8d8060 con 0x55faab893b50 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== watch-notify(notify (1) cookie 94535108132448 notify 146028888085 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55faab8702c0 con 0x55faab893b50 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0d90ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94535108132448 notifier 4724 bl.length()=177 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0d90ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0d90ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:25:19.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(68 notify.5 [notify cookie 94535108361280 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.631+0000 7f0d90ff9640 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0d70003ea0 con 0x55faab893b50 2024-04-24T01:25:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.632+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== watch-notify(notify_complete (2) cookie 94535108361280 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55faab8542e0 con 0x55faab893b50 2024-04-24T01:25:19.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.632+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.645 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T01:25:19.629321Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:25:19.629307Z","tags":[],"group_ids":[]} 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.632+0000 7f0d637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.632+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94535108144256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab888d50 con 0x55faab88f500 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.633+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94535108144256] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.633+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94535108118704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab888d50 con 0x7f0ea402e910 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.634+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94535108118704] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.634+0000 7f0eb1a13800 20 remove_watcher() i=0 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.634+0000 7f0eb1a13800 2 removed watcher, disabling cache 2024-04-24T01:25:19.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.634+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94535108122528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89c890 con 0x55faab88f500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.635+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94535108122528] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.635+0000 7f0eb1a13800 20 remove_watcher() i=1 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.635+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94535108123584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89d7a0 con 0x55faab898500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.636+0000 7f0eac86d640 1 -- 172.21.15.169:0/1854633374 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94535108123584] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea4037040 con 0x55faab898500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.636+0000 7f0eb1a13800 20 remove_watcher() i=2 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.636+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94535108128896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89c890 con 0x7f0ea402e910 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.637+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94535108128896] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x7f0ea402e910 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.637+0000 7f0eb1a13800 20 remove_watcher() i=3 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.637+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94535108129952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89f080 con 0x55faab88f500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.638+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94535108129952] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea8035040 con 0x55faab88f500 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.638+0000 7f0eb1a13800 20 remove_watcher() i=4 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.638+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94535108132448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89c890 con 0x55faab893b50 2024-04-24T01:25:19.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.640+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94535108132448] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.640+0000 7f0eb1a13800 20 remove_watcher() i=5 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.640+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94535108137136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89fe60 con 0x55faab893b50 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.641+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94535108137136] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.641+0000 7f0eb1a13800 20 remove_watcher() i=6 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.641+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94535108141984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55faab89fe60 con 0x55faab893b50 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0ead06e640 1 -- 172.21.15.169:0/1854633374 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94535108141984] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ea00be030 con 0x55faab893b50 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 20 remove_watcher() i=7 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab893b50 msgr2=0x55faab895f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab893b50 0x55faab895f40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab88f500 msgr2=0x55faab8919c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab88f500 0x55faab8919c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0ea402e910 msgr2=0x7f0ea403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0ea402e910 0x7f0ea403a3c0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55faab898500 msgr2=0x55faab89a9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55faab898500 0x55faab89a9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d78036860 msgr2=0x7f0d78038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d78036860 0x7f0d78038d20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0ea400ffd0 tx=0x7f0ea4023040 comp rx=0 tx=0).stop 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 msgr2=0x55faab883f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1854633374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab87cb40 0x55faab883f00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0ea005cb00 tx=0x7f0ea0054f20 comp rx=0 tx=0).stop 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 reap_dead start 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0ead86f640 1 -- 172.21.15.169:0/1854633374 reap_dead start 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 shutdown_connections 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 >> 172.21.15.169:0/1854633374 conn(0x55faab878ea0 msgr2=0x55faab876500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 shutdown_connections 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1854633374 wait complete. 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 msgr2=0x7f0d84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 0x7f0d84038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55faab85d820 tx=0x7f0ea4006000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 msgr2=0x55faab86fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0ea008cbd0 tx=0x7f0ea0065f00 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 shutdown_connections 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d84036950 0x7f0d84038e10 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/3002502455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab86f960 0x55faab86fd80 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 >> 172.21.15.169:0/3002502455 conn(0x55faab863a00 msgr2=0x55faab863e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 shutdown_connections 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.642+0000 7f0eb1a13800 1 -- 172.21.15.169:0/3002502455 wait complete. 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab85a990 msgr2=0x55faab85cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55faab85a990 0x55faab85cd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab757fd0 msgr2=0x55faab8580a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55faab757fd0 0x55faab8580a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55faab85e8b0 msgr2=0x55faab860d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55faab85e8b0 0x55faab860d20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d94036950 msgr2=0x7f0d94038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0d94036950 0x7f0d94038e10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000c00 tx=0x7f0ea40013b0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 msgr2=0x55faab850e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 --2- 172.21.15.169:0/1751755578 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faab756d70 0x55faab850e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0044920 tx=0x7f0ea0003330 comp rx=0 tx=0).stop 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0ead86f640 1 -- 172.21.15.169:0/1751755578 reap_dead start 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 shutdown_connections 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 >> 172.21.15.169:0/1751755578 conn(0x55faab7523d0 msgr2=0x55faab846f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 shutdown_connections 2024-04-24T01:25:19.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.643+0000 7f0eb1a13800 1 -- 172.21.15.169:0/1751755578 wait complete. 2024-04-24T01:25:19.656 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T01:25:19.629321Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:25:19.629307Z', 'tags': [], 'group_ids': []} 2024-04-24T01:25:19.670 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:25:19.675 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-04-24T01:25:19.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T01:25:19.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-04-24T01:25:19.675 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-04-24T01:25:19.720 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:19.720 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.720+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.720+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.720+0000 7f2862096800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5635f3df6fb0 0x5635f3df73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f2862096800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5635f3cb5d40 con 0x5635f3df8120 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f2862096800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5635f3c884d0 con 0x5635f3df6fb0 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f285fb95640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5635f3df6fb0 0x5635f3df73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f2857394640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5635f3df8120 0x5635f3df85a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:46540/0 (socket says 172.21.15.169:46540) 2024-04-24T01:25:19.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f2857394640 1 -- 172.21.15.169:0/3616786524 learned_addr learned my addr 172.21.15.169:0/3616786524 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:19.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f285fb95640 1 -- 172.21.15.169:0/3616786524 >> v1:172.21.15.142:6789/0 conn(0x5635f3df8120 legacy=0x5635f3df85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f285f394640 1 -- 172.21.15.169:0/3616786524 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403045987 0 0) 0x5635f3cb5d40 con 0x5635f3df8120 2024-04-24T01:25:19.722 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.721+0000 7f285fb95640 1 -- 172.21.15.169:0/3616786524 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3cb4590 con 0x5635f3df6fb0 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.723+0000 7f285fb95640 1 --2- 172.21.15.169:0/3616786524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3df73d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f285000a470 tx=0x7f285001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43770ccd6bf7e60e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.723+0000 7f285f394640 1 -- 172.21.15.169:0/3616786524 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850057070 con 0x5635f3df6fb0 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.723+0000 7f285f394640 1 -- 172.21.15.169:0/3616786524 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850052570 con 0x5635f3df6fb0 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.723+0000 7f285f394640 1 -- 172.21.15.169:0/3616786524 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850052870 con 0x5635f3df6fb0 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 -- 172.21.15.169:0/3616786524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 msgr2=0x5635f3df73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 --2- 172.21.15.169:0/3616786524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3df73d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f285000a470 tx=0x7f285001ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:19.724 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 -- 172.21.15.169:0/3616786524 shutdown_connections 2024-04-24T01:25:19.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 --2- 172.21.15.169:0/3616786524 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3df73d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 -- 172.21.15.169:0/3616786524 >> 172.21.15.169:0/3616786524 conn(0x5635f3df2550 msgr2=0x5635f3df4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 -- 172.21.15.169:0/3616786524 shutdown_connections 2024-04-24T01:25:19.725 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.724+0000 7f2862096800 1 -- 172.21.15.169:0/3616786524 wait complete. 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.735+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.735+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f2862096800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f2862096800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5635f3d423b0 con 0x5635f3df6fb0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45352/0 (socket says 172.21.15.169:45352) 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f285fb95640 1 -- 172.21.15.169:0/1048910520 learned_addr learned my addr 172.21.15.169:0/1048910520 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f285fb95640 1 -- 172.21.15.169:0/1048910520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3ee89b0 con 0x5635f3df6fb0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f285fb95640 1 --2- 172.21.15.169:0/1048910520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2850055040 tx=0x7f285004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d589ef634f6288ca server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f274de0b640 1 -- 172.21.15.169:0/1048910520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850057070 con 0x5635f3df6fb0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.736+0000 7f274de0b640 1 -- 172.21.15.169:0/1048910520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850063070 con 0x5635f3df6fb0 2024-04-24T01:25:19.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f274de0b640 1 -- 172.21.15.169:0/1048910520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850052720 con 0x5635f3df6fb0 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 -- 172.21.15.169:0/1048910520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 msgr2=0x5635f3ee83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 --2- 172.21.15.169:0/1048910520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2850055040 tx=0x7f285004c000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 -- 172.21.15.169:0/1048910520 shutdown_connections 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 --2- 172.21.15.169:0/1048910520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3ee83e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 -- 172.21.15.169:0/1048910520 >> 172.21.15.169:0/1048910520 conn(0x5635f3df2550 msgr2=0x5635f3ee3d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 -- 172.21.15.169:0/1048910520 shutdown_connections 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.737+0000 7f2862096800 1 -- 172.21.15.169:0/1048910520 wait complete. 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f2862096800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3eefe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f2862096800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5635f3e005c0 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3eefe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3eefe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45366/0 (socket says 172.21.15.169:45366) 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f285fb95640 1 -- 172.21.15.169:0/1899938731 learned_addr learned my addr 172.21.15.169:0/1899938731 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f285fb95640 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3ef0350 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.738+0000 7f285fb95640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3eefe10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2850060040 tx=0x7f2850002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2747fff640 1 -- 172.21.15.169:0/1899938731 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850052c70 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2747fff640 1 -- 172.21.15.169:0/1899938731 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f285006c070 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635f3ef05e0 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2747fff640 1 -- 172.21.15.169:0/1899938731 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285005e480 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f3ef3290 con 0x5635f3df6fb0 2024-04-24T01:25:19.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2747fff640 1 -- 172.21.15.169:0/1899938731 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f285005e620 con 0x5635f3df6fb0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.739+0000 7f2747fff640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2748036900 0x7f2748038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2747fff640 1 -- 172.21.15.169:0/1899938731 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f285008e810 con 0x5635f3df6fb0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2857394640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2748036900 0x7f2748038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3df8120 0x5635f3ef7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3ef7620 con 0x5635f3df8120 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2860396640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3df8120 0x5635f3ef7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2857394640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2748036900 0x7f2748038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2848000c00 tx=0x7f28480013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2860396640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3df8120 0x5635f3ef7050 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2860396640 1 -- 172.21.15.169:0/1899938731 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3df8120 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.740+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3ef4600 con 0x5635f3df8120 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f2860396640 1 -- 172.21.15.169:0/1899938731 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3df8120 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3ef9910 0x5635f3efbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3efc3a0 con 0x5635f3ef9910 2024-04-24T01:25:19.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f285fb95640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3ef9910 0x5635f3efbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f285fb95640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3ef9910 0x5635f3efbd00 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f285fb95640 1 -- 172.21.15.169:0/1899938731 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2850009d10 con 0x5635f3ef9910 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.741+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3ef88c0 con 0x5635f3df8120 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2860396640 1 -- 172.21.15.169:0/1899938731 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3df8120 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5635f3efd850 0x5635f3effca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f00400 con 0x5635f3efd850 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2857394640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5635f3efd850 0x5635f3effca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2857394640 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5635f3efd850 0x5635f3effca0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.742+0000 7f2857394640 1 -- 172.21.15.169:0/1899938731 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f284800f670 con 0x5635f3efd850 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f2862096800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f2862096800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5635f3ce86b0 con 0x5635f3f0e860 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45380/0 (socket says 172.21.15.169:45380) 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.743+0000 7f285fb95640 1 -- 172.21.15.169:0/2376862620 learned_addr learned my addr 172.21.15.169:0/2376862620 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f285fb95640 1 -- 172.21.15.169:0/2376862620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3f0f1c0 con 0x5635f3f0e860 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f285fb95640 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2850068010 tx=0x7f2850079460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f27457fa640 1 -- 172.21.15.169:0/2376862620 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850081040 con 0x5635f3f0e860 2024-04-24T01:25:19.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f27457fa640 1 -- 172.21.15.169:0/2376862620 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850058040 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635f3f0fc30 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f27457fa640 1 -- 172.21.15.169:0/2376862620 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285008eb30 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.744+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f3f10130 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f27457fa640 1 -- 172.21.15.169:0/2376862620 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2850095060 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f27457fa640 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 0x7f2738038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f27457fa640 1 -- 172.21.15.169:0/2376862620 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2850098d20 con 0x5635f3f0e860 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2857394640 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 0x7f2738038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2857394640 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 0x7f2738038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5635f3ef4540 tx=0x7f2848006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2862096800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.745+0000 7f2862096800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5635f3ee8c70 con 0x5635f3f1ba10 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45384/0 (socket says 172.21.15.169:45384) 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f285fb95640 1 -- 172.21.15.169:0/2619836255 learned_addr learned my addr 172.21.15.169:0/2619836255 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f285fb95640 1 -- 172.21.15.169:0/2619836255 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3f1c400 con 0x5635f3f1ba10 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f285fb95640 1 --2- 172.21.15.169:0/2619836255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f28500796b0 tx=0x7f2850073820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51715d690d93157d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f273effd640 1 -- 172.21.15.169:0/2619836255 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28500a6020 con 0x5635f3f1ba10 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f273effd640 1 -- 172.21.15.169:0/2619836255 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850073a70 con 0x5635f3f1ba10 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f273effd640 1 -- 172.21.15.169:0/2619836255 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f285009d040 con 0x5635f3f1ba10 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f2862096800 1 -- 172.21.15.169:0/2619836255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 msgr2=0x5635f3f1be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.746+0000 7f2862096800 1 --2- 172.21.15.169:0/2619836255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f28500796b0 tx=0x7f2850073820 comp rx=0 tx=0).stop 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- 172.21.15.169:0/2619836255 shutdown_connections 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 --2- 172.21.15.169:0/2619836255 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f1be30 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- 172.21.15.169:0/2619836255 >> 172.21.15.169:0/2619836255 conn(0x5635f3f17d20 msgr2=0x5635f3f15d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- 172.21.15.169:0/2619836255 shutdown_connections 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- 172.21.15.169:0/2619836255 wait complete. 2024-04-24T01:25:19.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 Processor -- start 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- start start 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f2862096800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5635f3f1ca90 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f285fb95640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:45396/0 (socket says 172.21.15.169:45396) 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 learned_addr learned my addr 172.21.15.169:0/2270072205 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.747+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635f3f23310 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f285fb95640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2850067f00 tx=0x7f285007dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f273d7fa640 1 -- 172.21.15.169:0/2270072205 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28500730c0 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5635f3f23310 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f273d7fa640 1 -- 172.21.15.169:0/2270072205 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2850073260 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635f3f23310 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.748+0000 7f273d7fa640 1 -- 172.21.15.169:0/2270072205 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2850067550 con 0x5635f3f1ba10 2024-04-24T01:25:19.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f273d7fa640 1 -- 172.21.15.169:0/2270072205 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f28500a9020 con 0x5635f3f1ba10 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f273d7fa640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f273d7fa640 1 -- 172.21.15.169:0/2270072205 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f28500b01e0 con 0x5635f3f1ba10 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2857394640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3f2e460 0x5635f3f30920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f31070 con 0x5635f3f2e460 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2857394640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f284800ffd0 tx=0x7f2848023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.749+0000 7f2860396640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3f2e460 0x5635f3f30920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2860396640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3f2e460 0x5635f3f30920 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 realm 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f31480 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f31d50 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.750+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3f32e50 0x5635f3f35240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f35850 con 0x5635f3f32e50 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f285fb95640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3f32e50 0x5635f3f35240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f285fb95640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3f32e50 0x5635f3f35240 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 20 searching for the correct realm 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5635f3f377e0 0x5635f3f39ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.751+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3a370 con 0x5635f3f377e0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2857394640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5635f3f377e0 0x5635f3f39ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2857394640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5635f3f377e0 0x5635f3f39ca0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2857394640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f284802e910 0x7f284803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3a370 con 0x7f284802e910 2024-04-24T01:25:19.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.752+0000 7f2860396640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f284802e910 0x7f284803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f2860396640 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f284802e910 0x7f284803a3c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x7f284802e910 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.753+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x7f284802e910 2024-04-24T01:25:19.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x7f284802e910 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.754+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f285800a4a0 con 0x5635f3f2e460 2024-04-24T01:25:19.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x7f284802e910 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.755+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.756+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.757+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x7f284802e910 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.758+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x7f284802e910 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f377e0 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.759+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f32e50 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x5635f3f2e460 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f320f0 con 0x7f284802e910 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f36110 con 0x5635f3f2e460 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.760+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f36110 con 0x5635f3f2e460 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f36110 con 0x7f284802e910 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 zone default found 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 4 Realm: () 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 zonegroup default 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f369b0 con 0x5635f3f32e50 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.761+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3c1d0 con 0x5635f3f377e0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3c570 con 0x5635f3f377e0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 20 started sync module instance, tier type = 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.762+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3b670 con 0x7f284802e910 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.763+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.763+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94789726092224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3b670 con 0x7f284802e910 2024-04-24T01:25:19.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.763+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3cf30 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.764+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94789726092224] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.764+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.764+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94789726096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3b670 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.764+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3d980 con 0x5635f3f377e0 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.765+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94789726096480] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.766+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.766+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94789726089664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3b5e0 con 0x5635f3f377e0 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.766+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3e840 con 0x7f284802e910 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.767+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94789726089664] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.767+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.767+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94789726102416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3ec60 con 0x7f284802e910 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.767+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3f530 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.768+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.768+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94789726104672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3f080 con 0x5635f3f2e460 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.768+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f404e0 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.768+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94789726102416] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.769+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.769+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94789726103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f408d0 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.769+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f412f0 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.769+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94789726104672] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.770+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94789726103472] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.770+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.770+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94789726113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f3ffc0 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.770+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f41b90 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94789726113248] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94789726107936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f41b90 con 0x5635f3f32e50 2024-04-24T01:25:19.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=0 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=1 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=2 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=3 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=4 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=5 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.772+0000 7f2862096800 20 add_watcher() i=6 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94789726107936] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f2862096800 20 add_watcher() i=7 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f2862096800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f44fc0 con 0x5635f3f2e460 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.773+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94789726116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f42470 con 0x5635f3f2e460 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.774+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94789726116016] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.774+0000 7f2715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.774+0000 7f2862096800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.774+0000 7f2862096800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.774+0000 7f2862096800 5 note: GC not initialized 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2714fe1640 20 reqs_thread_entry: start 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 20 Filter name: none 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f268e7fc640 20 reqs_thread_entry: start 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f782e0 con 0x5635f3f32e50 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-04-24T01:25:19.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.775+0000 7f2862096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:19.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.776+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7c650 con 0x7f284802e910 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f2862096800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f2862096800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94789726355472 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7d2c0 con 0x5635f3f32e50 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== watch-notify(notify (1) cookie 94789726103472 notify 146028888087 ret 0) ==== 424+0+0 (crc 0 0 0) 0x5635f3f0fc30 con 0x5635f3f32e50 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f273effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94789726103472 notifier 4731 bl.length()=382 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(64 notify.5 [notify cookie 94789726355472 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f273effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f273effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:19.795 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.777+0000 7f273effd640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2724003ea0 con 0x5635f3f32e50 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify_complete (2) cookie 94789726355472 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3f0f1c0 con 0x5635f3f32e50 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7c010 con 0x5635f3f2e460 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f2862096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 : miss 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f2862096800 20 rados->read ofs=0 len=0 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.778+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:67 8.e 8:746b6bee:root::.bucket.meta.myfoo6%3af341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7a700 con 0x5635f3f32e50 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(67 .bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:25:19.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.779+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:68 8.e 8:746b6bee:root::.bucket.meta.myfoo6%3af341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f84210 con 0x5635f3f32e50 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(68 .bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9, ofs0, ns] 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify cookie 94789726349056 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7e700 con 0x5635f3f32e50 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== watch-notify(notify (1) cookie 94789726103472 notify 146028888088 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5635f3f7d4d0 con 0x5635f3f32e50 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f273effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94789726103472 notifier 4731 bl.length()=748 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(69 notify.5 [notify cookie 94789726349056 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f273effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f273effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f273effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:25:19.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f273effd640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2724003ea0 con 0x5635f3f32e50 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(70 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== watch-notify(notify_complete (2) cookie 94789726349056 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3f0f1c0 con 0x5635f3f32e50 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): orig_sources= new_sources= 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): potential sources added=[] removed=[] 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): orig_dests= new_dests= 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): potential dests added=[] removed=[] 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.780+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f83a00 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.781+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.781+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f83a00 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.782+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.782+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f83a00 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.783+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.783+0000 7f2862096800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T01:25:19.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.783+0000 7f2862096800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.783+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.783+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94789726349056 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7e960 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== watch-notify(notify (1) cookie 94789726102416 notify 146028888079 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5635f3f7c120 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f273effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94789726102416 notifier 4731 bl.length()=316 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f273effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f273effd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(74 notify.3 [notify cookie 94789726349056 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f273effd640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2724003ea0 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== watch-notify(notify_complete (2) cookie 94789726349056 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2858018aa0 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2862096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 : hit (requested=0x17, cached=0x17) 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2862096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.784+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 8.e 8:746b6bee:root::.bucket.meta.myfoo6%3af341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f81e40 con 0x5635f3f32e50 2024-04-24T01:25:19.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(76 .bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'6 uv6 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f2862096800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f2862096800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f2862096800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9, ofs0, ns] 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.785+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94789726349056 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7ee10 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== watch-notify(notify (1) cookie 94789726103472 notify 146028888089 ret 0) ==== 790+0+0 (crc 0 0 0) 0x5635f3f0f1c0 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f273effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94789726103472 notifier 4731 bl.length()=748 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(77 notify.5 [notify cookie 94789726349056 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f273effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f273effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f273effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f273effd640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2724003ea0 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== watch-notify(notify_complete (2) cookie 94789726349056 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3ef3290 con 0x5635f3f32e50 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): orig_sources= new_sources= 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): potential sources added=[] removed=[] 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): orig_dests= new_dests= 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 20 handle_bi_update(): bucket=:myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]): potential dests added=[] removed=[] 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:79 4.36 4:6d66b69d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f82370 con 0x5635f3f2e460 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(79 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.786+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:80 4.d 4:b2990e99:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f82370 con 0x7f284802e910 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(80 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:81 4.3a 4:5f636b84:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f82370 con 0x5635f3f377e0 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(81 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:82 4.26 4:65a25d45:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7a700 con 0x5635f3f32e50 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(82 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.787+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:83 4.10 4:09844f2a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7a700 con 0x5635f3f377e0 2024-04-24T01:25:19.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(83 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 4.5 4:a1b61e24:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f377e0 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(84 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:85 4.1a 4:58751e17:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x7f284802e910 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(85 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2858032040 con 0x7f284802e910 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.788+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:86 4.33 4:cecf32bf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f32e50 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.789+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(86 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.789+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:87 4.22 4:4427cc59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.789+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(87 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.789+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:88 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.789+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(88 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [call out=377b] v0'0 uv5 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:89 4.2f 4:f4aa6d37:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(89 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.802 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 get_obj_state: octx=0x5635f3f7ac70 obj=myfoo6:thirteen state=0x5635f3f7d8d8 s->prefetch_data=0 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:90 3.1ds0 3:b8d1344f:::f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b280 con 0x5635f3f377e0 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(90 f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 10 manifest: total_size = 8 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.8481717332017680191 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.acl 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.content_type 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.etag 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.idtag 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.manifest 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 get_obj_state: octx=0x5635f3f7ac70 obj=myfoo6:thirteen state=0x5635f3f7d8d8 s->prefetch_data=0 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 : hit (requested=0x17, cached=0x17) 2024-04-24T01:25:19.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.790+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:91 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f81e90 con 0x5635f3f2e460 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.791+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(91 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2858032040 con 0x5635f3f2e460 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.791+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:92 3.1ds0 3:b8d1344f:::f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f85e10 con 0x5635f3f377e0 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.793+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(92 f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.793+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:93 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f85d30 con 0x5635f3f2e460 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:1 objects processed in :myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9]). Next marker thirteen 2024-04-24T01:25:19.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.793+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f87a90 con 0x7f284802e910 2024-04-24T01:25:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(93 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f285805a040 con 0x5635f3f2e460 2024-04-24T01:25:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f273effd640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T01:25:19.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f285805a040 con 0x7f284802e910 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2862096800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2862096800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.795+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94789726395696 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b770 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== watch-notify(notify (1) cookie 94789726103472 notify 146028888090 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5635f3ef3290 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(95 notify.5 [notify cookie 94789726395696 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f273e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94789726103472 notifier 4731 bl.length()=556 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f273e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f273e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f273e7fc640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f2694003430 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== watch-notify(notify_complete (2) cookie 94789726395696 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3ef05e0 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.796+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f85d30 con 0x5635f3f2e460 2024-04-24T01:25:19.808 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.797+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f285805a040 con 0x5635f3f2e460 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.797+0000 7f2862096800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.797+0000 7f2862096800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.797+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.797+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94789726395696 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b770 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== watch-notify(notify (1) cookie 94789726103472 notify 146028888091 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5635f3ef05e0 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f273e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 94789726103472 notifier 4731 bl.length()=177 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(98 notify.5 [notify cookie 94789726395696 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f273e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f273e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f273e7fc640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f26940033f0 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== watch-notify(notify_complete (2) cookie 94789726395696 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3ef0350 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f2862096800 10 removing user index: bar 2024-04-24T01:25:19.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.798+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f85d30 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(100 bar [delete] v34'7 uv7 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f2862096800 10 removing default.rgw.meta+users.uid+bar from cache 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f2862096800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94789726395696 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f7b770 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== watch-notify(notify (1) cookie 94789726107936 notify 146028888092 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5635f3ef0350 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f273e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94789726107936 notifier 4731 bl.length()=152 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(101 notify.7 [notify cookie 94789726395696 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.799+0000 7f273e7fc640 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f26940033f0 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.800+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.800+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== watch-notify(notify_complete (2) cookie 94789726395696 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5635f3ee89b0 con 0x5635f3f32e50 2024-04-24T01:25:19.810 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-04-24T01:25:19.629321Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:25:19.629307Z","tags":[],"group_ids":[]} 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.801+0000 7f2715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.801+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94789726116016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f2e460 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.802+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94789726116016] v34'219 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f285805a040 con 0x5635f3f2e460 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.802+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94789726092224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x7f284802e910 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.803+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94789726092224] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285805a040 con 0x7f284802e910 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.803+0000 7f2862096800 20 remove_watcher() i=0 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.803+0000 7f2862096800 2 removed watcher, disabling cache 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.803+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94789726096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f2e460 2024-04-24T01:25:19.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.804+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94789726096480] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285805a040 con 0x5635f3f2e460 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.804+0000 7f2862096800 20 remove_watcher() i=1 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.804+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94789726089664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f377e0 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.805+0000 7f2857394640 1 -- 172.21.15.169:0/2270072205 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94789726089664] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848037040 con 0x5635f3f377e0 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.805+0000 7f2862096800 20 remove_watcher() i=2 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.805+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94789726102416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x7f284802e910 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.806+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94789726102416] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285805a040 con 0x7f284802e910 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.806+0000 7f2862096800 20 remove_watcher() i=3 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.806+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94789726104672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f2e460 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.807+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94789726104672] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f285805a040 con 0x5635f3f2e460 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.807+0000 7f2862096800 20 remove_watcher() i=4 2024-04-24T01:25:19.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.807+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94789726103472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.809+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94789726103472] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.809+0000 7f2862096800 20 remove_watcher() i=5 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.809+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94789726113248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.810+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94789726113248] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.810+0000 7f2862096800 20 remove_watcher() i=6 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.810+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94789726107936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5635f3f60d80 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.810+0000 7f285fb95640 1 -- 172.21.15.169:0/2270072205 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94789726107936] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f28500a0040 con 0x5635f3f32e50 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.810+0000 7f2862096800 20 remove_watcher() i=7 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3f32e50 msgr2=0x5635f3f35240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3f32e50 0x5635f3f35240 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3f2e460 msgr2=0x5635f3f30920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3f2e460 0x5635f3f30920 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f284802e910 msgr2=0x7f284803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f284802e910 0x7f284803a3c0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5635f3f377e0 msgr2=0x5635f3f39ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5635f3f377e0 0x5635f3f39ca0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 msgr2=0x7f2728038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f284800ffd0 tx=0x7f2848023040 comp rx=0 tx=0).stop 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2860396640 1 -- 172.21.15.169:0/2270072205 reap_dead start 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 msgr2=0x5635f3f22dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2850067f00 tx=0x7f285007dfa0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 shutdown_connections 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2270072205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f1ba10 0x5635f3f22dd0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 >> 172.21.15.169:0/2270072205 conn(0x5635f3f17d20 msgr2=0x5635f3f15380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 shutdown_connections 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2270072205 wait complete. 2024-04-24T01:25:19.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 msgr2=0x7f2738038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 0x7f2738038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x5635f3ef4540 tx=0x7f2848006000 comp rx=0 tx=0).stop 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 msgr2=0x5635f3f0ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2850068010 tx=0x7f2850079460 comp rx=0 tx=0).stop 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 shutdown_connections 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2738036950 0x7f2738038e10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 --2- 172.21.15.169:0/2376862620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3f0e860 0x5635f3f0ec80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 >> 172.21.15.169:0/2376862620 conn(0x5635f3f02900 msgr2=0x5635f3f02d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 shutdown_connections 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.811+0000 7f2862096800 1 -- 172.21.15.169:0/2376862620 wait complete. 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3ef9910 msgr2=0x5635f3efbd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5635f3ef9910 0x5635f3efbd00 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3df8120 msgr2=0x5635f3ef7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5635f3df8120 0x5635f3ef7050 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5635f3efd850 msgr2=0x5635f3effca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5635f3efd850 0x5635f3effca0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2748036900 msgr2=0x7f2748038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2748036900 0x7f2748038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2848000c00 tx=0x7f28480013b0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 msgr2=0x5635f3eefe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 --2- 172.21.15.169:0/1899938731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635f3df6fb0 0x5635f3eefe10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2850060040 tx=0x7f2850002fb0 comp rx=0 tx=0).stop 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2860396640 1 -- 172.21.15.169:0/1899938731 reap_dead start 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 shutdown_connections 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 >> 172.21.15.169:0/1899938731 conn(0x5635f3df2550 msgr2=0x5635f3ee2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 shutdown_connections 2024-04-24T01:25:19.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:19.812+0000 7f2862096800 1 -- 172.21.15.169:0/1899938731 wait complete. 2024-04-24T01:25:19.822 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-04-24T01:25:19.629321Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:25:19.629307Z', 'tags': [], 'group_ids': []} 2024-04-24T01:25:24.830 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:25:24.831 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:25:24.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T01:25:24.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-04-24T01:25:24.831 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-04-24T01:25:24.888 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:24.888 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:24.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.888+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.888+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c801f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562e70ed13c0 0x562e70ed37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c801f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562e70d8bd40 con 0x562e70ecb150 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c801f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x562e70d5e4d0 con 0x562e70ed13c0 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c531d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x562e70ed13c0 0x562e70ed37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c5b1e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x562e70ecb150 0x562e70ecb570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:60178/0 (socket says 172.21.15.169:60178) 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3774982365 learned_addr learned my addr 172.21.15.169:0/3774982365 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c531d640 1 -- 172.21.15.169:0/3774982365 >> v1:172.21.15.142:6789/0 conn(0x562e70ecb150 legacy=0x562e70ecb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c531d640 1 -- 172.21.15.169:0/3774982365 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70d8a590 con 0x562e70ed13c0 2024-04-24T01:25:24.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.889+0000 7f04c4b1c640 1 -- 172.21.15.169:0/3774982365 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236677567 0 0) 0x562e70d8bd40 con 0x562e70ecb150 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.891+0000 7f04c531d640 1 --2- 172.21.15.169:0/3774982365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ed37b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00a470 tx=0x7f04bc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d460fecc066f754e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c4b1c640 1 -- 172.21.15.169:0/3774982365 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc057070 con 0x562e70ed13c0 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c4b1c640 1 -- 172.21.15.169:0/3774982365 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04bc052570 con 0x562e70ed13c0 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c4b1c640 1 -- 172.21.15.169:0/3774982365 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc052870 con 0x562e70ed13c0 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 -- 172.21.15.169:0/3774982365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 msgr2=0x562e70ed37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 --2- 172.21.15.169:0/3774982365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ed37b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00a470 tx=0x7f04bc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 -- 172.21.15.169:0/3774982365 shutdown_connections 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 --2- 172.21.15.169:0/3774982365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ed37b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 -- 172.21.15.169:0/3774982365 >> 172.21.15.169:0/3774982365 conn(0x562e70ec6b50 msgr2=0x562e70ec8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 -- 172.21.15.169:0/3774982365 shutdown_connections 2024-04-24T01:25:24.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.892+0000 7f04c801f800 1 -- 172.21.15.169:0/3774982365 wait complete. 2024-04-24T01:25:24.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c801f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c801f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562e70e183e0 con 0x562e70ecb150 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59640/0 (socket says 172.21.15.169:59640) 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.906+0000 7f04c5b1e640 1 -- 172.21.15.169:0/2499611349 learned_addr learned my addr 172.21.15.169:0/2499611349 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.907+0000 7f04c5b1e640 1 -- 172.21.15.169:0/2499611349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70fbe5b0 con 0x562e70ecb150 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.907+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/2499611349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f04b8001660 tx=0x7f04b8001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd51df6f9f05c30 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.907+0000 7f03b3e07640 1 -- 172.21.15.169:0/2499611349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b8003450 con 0x562e70ecb150 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.907+0000 7f03b3e07640 1 -- 172.21.15.169:0/2499611349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8003610 con 0x562e70ecb150 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.907+0000 7f03b3e07640 1 -- 172.21.15.169:0/2499611349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b80039b0 con 0x562e70ecb150 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- 172.21.15.169:0/2499611349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 msgr2=0x562e70fbdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 --2- 172.21.15.169:0/2499611349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f04b8001660 tx=0x7f04b8001b20 comp rx=0 tx=0).stop 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- 172.21.15.169:0/2499611349 shutdown_connections 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 --2- 172.21.15.169:0/2499611349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ecb150 0x562e70fbdfe0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- 172.21.15.169:0/2499611349 >> 172.21.15.169:0/2499611349 conn(0x562e70ec6b50 msgr2=0x562e70fb9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- 172.21.15.169:0/2499611349 shutdown_connections 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- 172.21.15.169:0/2499611349 wait complete. 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.908+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c801f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ecda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c801f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562e70ed3ff0 con 0x562e70ed13c0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ecda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ecda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59652/0 (socket says 172.21.15.169:59652) 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c5b1e640 1 -- 172.21.15.169:0/1467081816 learned_addr learned my addr 172.21.15.169:0/1467081816 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c5b1e640 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70ecdfa0 con 0x562e70ed13c0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.909+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ecda60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x562e70fbed70 tx=0x7f04b8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f03b2604640 1 -- 172.21.15.169:0/1467081816 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b8025070 con 0x562e70ed13c0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f03b2604640 1 -- 172.21.15.169:0/1467081816 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8019040 con 0x562e70ed13c0 2024-04-24T01:25:24.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e70ecc1a0 con 0x562e70ed13c0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f03b2604640 1 -- 172.21.15.169:0/1467081816 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b8013890 con 0x562e70ed13c0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e70ecc720 con 0x562e70ed13c0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.910+0000 7f03b2604640 1 -- 172.21.15.169:0/1467081816 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04b8010070 con 0x562e70ed13c0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f03b2604640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03ac036900 0x7f03ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f03b2604640 1 -- 172.21.15.169:0/1467081816 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f04b804bd40 con 0x562e70ed13c0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c531d640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03ac036900 0x7f03ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e70fcd1b0 0x562e70fcf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e70fcfb20 con 0x562e70fcd1b0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c631f640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e70fcd1b0 0x562e70fcf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c531d640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03ac036900 0x7f03ac038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04bc054000 tx=0x7f04bc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.911+0000 7f04c631f640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e70fcd1b0 0x562e70fcf5a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c631f640 1 -- 172.21.15.169:0/1467081816 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c00083e0 con 0x562e70fcd1b0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e70eccc00 con 0x562e70fcd1b0 2024-04-24T01:25:24.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c631f640 1 -- 172.21.15.169:0/1467081816 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04c00083e0 con 0x562e70fcd1b0 2024-04-24T01:25:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e70fd1e30 0x562e70fd4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e70fd4910 con 0x562e70fd1e30 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.912+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e70fd1e30 0x562e70fd4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e70fd1e30 0x562e70fd4220 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c5b1e640 1 -- 172.21.15.169:0/1467081816 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04b800f030 con 0x562e70fd1e30 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e70fd0de0 con 0x562e70fcd1b0 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c631f640 1 -- 172.21.15.169:0/1467081816 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04c00083e0 con 0x562e70fcd1b0 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562e70fd5dc0 0x562e70fd81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e70fd8980 con 0x562e70fd5dc0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.913+0000 7f04c531d640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562e70fd5dc0 0x562e70fd81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.914+0000 7f04c531d640 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562e70fd5dc0 0x562e70fd81f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.914+0000 7f04c531d640 1 -- 172.21.15.169:0/1467081816 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04bc052940 con 0x562e70fd5dc0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.914+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.914+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c801f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c801f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562e70dbe6b0 con 0x562e70fe6de0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59658/0 (socket says 172.21.15.169:59658) 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c5b1e640 1 -- 172.21.15.169:0/2526385234 learned_addr learned my addr 172.21.15.169:0/2526385234 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c5b1e640 1 -- 172.21.15.169:0/2526385234 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70fe7740 con 0x562e70fe6de0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.915+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04b804a330 tx=0x7f04b801dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.926 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f03ab7fe640 1 -- 172.21.15.169:0/2526385234 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b80431d0 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f03ab7fe640 1 -- 172.21.15.169:0/2526385234 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8043370 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e70fe81b0 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f03ab7fe640 1 -- 172.21.15.169:0/2526385234 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b80286e0 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e70fe86b0 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.916+0000 7f03ab7fe640 1 -- 172.21.15.169:0/2526385234 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04b8028880 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f03ab7fe640 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 0x7f03a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f03ab7fe640 1 -- 172.21.15.169:0/2526385234 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f04b8043e00 con 0x562e70fe6de0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c531d640 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 0x7f03a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c531d640 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 0x7f03a0038e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562e70fcffd0 tx=0x7f04bc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c801f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c801f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562e70fbe8d0 con 0x562e70ff40e0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59666/0 (socket says 172.21.15.169:59666) 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.917+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3132166003 learned_addr learned my addr 172.21.15.169:0/3132166003 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3132166003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70ff4ad0 con 0x562e70ff40e0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/3132166003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f04b8001330 tx=0x7f04b803ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8599e80f603f15eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f03a97fa640 1 -- 172.21.15.169:0/3132166003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b805c070 con 0x562e70ff40e0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f03a97fa640 1 -- 172.21.15.169:0/3132166003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8010750 con 0x562e70ff40e0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f03a97fa640 1 -- 172.21.15.169:0/3132166003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b8037030 con 0x562e70ff40e0 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f04c801f800 1 -- 172.21.15.169:0/3132166003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 msgr2=0x562e70ff4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.918+0000 7f04c801f800 1 --2- 172.21.15.169:0/3132166003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f04b8001330 tx=0x7f04b803ef70 comp rx=0 tx=0).stop 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- 172.21.15.169:0/3132166003 shutdown_connections 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 --2- 172.21.15.169:0/3132166003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ff4500 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- 172.21.15.169:0/3132166003 >> 172.21.15.169:0/3132166003 conn(0x562e70ff0440 msgr2=0x562e70fee4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- 172.21.15.169:0/3132166003 shutdown_connections 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- 172.21.15.169:0/3132166003 wait complete. 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 Processor -- start 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- start start 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c801f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x562e70ff5180 con 0x562e70ff40e0 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c5b1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59668/0 (socket says 172.21.15.169:59668) 2024-04-24T01:25:24.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.919+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 learned_addr learned my addr 172.21.15.169:0/3287936156 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e70ffba50 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f04b8012c00 tx=0x7f04b803f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f03977fe640 1 -- 172.21.15.169:0/3287936156 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b805c040 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f03977fe640 1 -- 172.21.15.169:0/3287936156 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8067020 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f03977fe640 1 -- 172.21.15.169:0/3287936156 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04b803e510 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562e70ffba50 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.920+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e70ffba50 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.921+0000 7f03977fe640 1 -- 172.21.15.169:0/3287936156 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04b803e8a0 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.921+0000 7f03977fe640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0390036900 0x7f0390038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.921+0000 7f03977fe640 1 -- 172.21.15.169:0/3287936156 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f04b8068030 con 0x562e70ff40e0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.921+0000 7f04c531d640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0390036900 0x7f0390038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c531d640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0390036900 0x7f0390038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f04bc052fd0 tx=0x7f04bc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e71006c60 0x562e71009120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71009870 con 0x562e71006c60 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c631f640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e71006c60 0x562e71009120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c631f640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e71006c60 0x562e71009120 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c00083e0 con 0x562e71006c60 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 20 realm 2024-04-24T01:25:24.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.922+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71009c80 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c00083e0 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c00083e0 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a8f0 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04c00083e0 con 0x562e71006c60 2024-04-24T01:25:24.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e7100b2b0 0x562e7100d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100dcf0 con 0x562e7100b2b0 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.923+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e7100b2b0 0x562e7100d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c5b1e640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e7100b2b0 0x562e7100d6a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c801f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c801f800 20 searching for the correct realm 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562e7100fc80 0x562e71012140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.924+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e71012810 con 0x562e7100fc80 2024-04-24T01:25:24.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c531d640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562e7100fc80 0x562e71012140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c531d640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562e7100fc80 0x562e71012140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c531d640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f04bc076040 0x7f04bc083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e71012810 con 0x7f04bc076040 2024-04-24T01:25:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.925+0000 7f04c631f640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f04bc076040 0x7f04bc083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:24.952 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c631f640 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f04bc076040 0x7f04bc083410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c00083e0 con 0x7f04bc076040 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e7100b2b0 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c00083e0 con 0x562e71006c60 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.926+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e7100b2b0 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x7f04bc076040 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.927+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e7100fc80 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e7100b2b0 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.928+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e71006c60 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x7f04bc076040 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x562e7100a550 con 0x562e7100fc80 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.929+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100b2b0 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e71006c60 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.930+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e71006c60 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100b2b0 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.931+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x7f04bc076040 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e71006c60 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100b2b0 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.932+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100b2b0 2024-04-24T01:25:24.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x7f04bc076040 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100fc80 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.933+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e7100b2b0 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x562e71006c60 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f04bc090040 con 0x7f04bc076040 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.934+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100e090 con 0x562e71006c60 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100e090 con 0x562e71006c60 2024-04-24T01:25:24.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:24.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100e090 con 0x7f04bc076040 2024-04-24T01:25:24.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 zone default found 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 4 Realm: () 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 zonegroup default 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.935+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7100e930 con 0x562e7100b2b0 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71014670 con 0x562e7100fc80 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71014a10 con 0x562e7100fc80 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 started sync module instance, tier type = 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.936+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71013b10 con 0x7f04bc076040 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.937+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.938+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94757464391776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71013b10 con 0x7f04bc076040 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.938+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71015280 con 0x562e71006c60 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.939+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94757464391776] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.939+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.939+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94757464395184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71013b10 con 0x562e71006c60 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.939+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71015d20 con 0x562e7100fc80 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.940+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94757464395184] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.941+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.941+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94757464389216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71013a80 con 0x562e7100fc80 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.941+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71016ad0 con 0x7f04bc076040 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.942+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.942+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94757464401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71017370 con 0x7f04bc076040 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.942+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71017e30 con 0x562e71006c60 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.942+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94757464389216] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.943+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94757464401344] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.943+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.943+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94757464406272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71016dd0 con 0x562e71006c60 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.943+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e710186d0 con 0x562e7100b2b0 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.944+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.944+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94757464408608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71016dd0 con 0x562e7100b2b0 2024-04-24T01:25:24.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.944+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e710195b0 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.944+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94757464406272] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.945+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94757464408608] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.946+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.946+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94757464400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71019950 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.946+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e7101a200 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94757464400144] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94757464412352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e7101a3e0 con 0x562e7100b2b0 2024-04-24T01:25:24.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=0 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=1 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=2 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=3 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=4 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=5 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.947+0000 7f04c801f800 20 add_watcher() i=6 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94757464412352] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c801f800 20 add_watcher() i=7 2024-04-24T01:25:24.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c801f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7101d7b0 con 0x562e71006c60 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.948+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94757464416976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e7101abd0 con 0x562e71006c60 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.949+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94757464416976] v34'220 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.949+0000 7f03777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.949+0000 7f04c801f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.949+0000 7f04c801f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 5 note: GC not initialized 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f03767fc640 20 reqs_thread_entry: start 2024-04-24T01:25:24.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 20 Filter name: none 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f02ebfff640 20 reqs_thread_entry: start 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.950+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71050970 con 0x562e7100b2b0 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:25:24.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e7104f110 con 0x562e7100b2b0 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-04-24T01:25:24.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.951+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e7104f9e0 con 0x562e7100b2b0 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'8 uv8 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c801f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c801f800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c801f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94757464634672 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e71053f60 con 0x562e7100b2b0 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.952+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify (1) cookie 94757464408608 notify 146028888093 ret 0) ==== 598+0+0 (crc 0 0 0) 0x562e710503c0 con 0x562e7100b2b0 2024-04-24T01:25:24.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f03a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94757464408608 notifier 4738 bl.length()=556 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(65 notify.5 [notify cookie 94757464634672 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f03a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f03a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f03a97fa640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0388003ea0 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== watch-notify(notify_complete (2) cookie 94757464634672 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e70fe81b0 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.953+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e7104f960 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c801f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c801f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:25:24.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c801f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94757464634544 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x562e710540c0 con 0x562e7100fc80 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 94757464389216 notify 146028888085 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f04bc08a040 con 0x562e7100fc80 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [notify cookie 94757464634544 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f03a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94757464389216 notifier 4738 bl.length()=177 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f03a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f03a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-04-24T01:25:24.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.954+0000 7f03a97fa640 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0388003ea0 con 0x562e7100fc80 2024-04-24T01:25:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.955+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== watch-notify(notify_complete (2) cookie 94757464634544 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562e70d8a590 con 0x562e7100fc80 2024-04-24T01:25:24.977 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.955+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.977 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-04-24T01:25:24.952257Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:25:24.952240Z","tags":[],"group_ids":[]} 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.955+0000 7f03777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.955+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94757464416976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71003610 con 0x562e71006c60 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.957+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94757464416976] v34'221 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.957+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94757464391776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71003610 con 0x7f04bc076040 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.958+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94757464391776] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.958+0000 7f04c801f800 20 remove_watcher() i=0 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.958+0000 7f04c801f800 2 removed watcher, disabling cache 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.958+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94757464395184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71014040 con 0x562e71006c60 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.959+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94757464395184] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.959+0000 7f04c801f800 20 remove_watcher() i=1 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.959+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94757464389216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71014db0 con 0x562e7100fc80 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.960+0000 7f04c531d640 1 -- 172.21.15.169:0/3287936156 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94757464389216] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04bc081070 con 0x562e7100fc80 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.960+0000 7f04c801f800 20 remove_watcher() i=2 2024-04-24T01:25:24.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.960+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94757464401344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71014db0 con 0x7f04bc076040 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.961+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94757464401344] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x7f04bc076040 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.961+0000 7f04c801f800 20 remove_watcher() i=3 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.961+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94757464406272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71014db0 con 0x562e71006c60 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.962+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94757464406272] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c0026040 con 0x562e71006c60 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.962+0000 7f04c801f800 20 remove_watcher() i=4 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.962+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94757464408608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71017900 con 0x562e7100b2b0 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.963+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94757464408608] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.963+0000 7f04c801f800 20 remove_watcher() i=5 2024-04-24T01:25:24.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.963+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94757464400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71014db0 con 0x562e7100b2b0 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.964+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94757464400144] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.964+0000 7f04c801f800 20 remove_watcher() i=6 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.964+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94757464412352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x562e71017900 con 0x562e7100b2b0 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c5b1e640 1 -- 172.21.15.169:0/3287936156 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94757464412352] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04b805f070 con 0x562e7100b2b0 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 20 remove_watcher() i=7 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e7100b2b0 msgr2=0x562e7100d6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e7100b2b0 0x562e7100d6a0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e71006c60 msgr2=0x562e71009120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e71006c60 0x562e71009120 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f04bc076040 msgr2=0x7f04bc083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f04bc076040 0x7f04bc083410 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562e7100fc80 msgr2=0x562e71012140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x562e7100fc80 0x562e71012140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0390036900 msgr2=0x7f0390038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.965+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0390036900 0x7f0390038dc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f04bc052fd0 tx=0x7f04bc04f000 comp rx=0 tx=0).stop 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c631f640 1 -- 172.21.15.169:0/3287936156 reap_dead start 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 msgr2=0x562e70ffb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f04b8012c00 tx=0x7f04b803f590 comp rx=0 tx=0).stop 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 shutdown_connections 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/3287936156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ff40e0 0x562e70ffb510 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 >> 172.21.15.169:0/3287936156 conn(0x562e70ff0440 msgr2=0x562e70fedaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 shutdown_connections 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/3287936156 wait complete. 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 msgr2=0x7f03a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 0x7f03a0038e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x562e70fcffd0 tx=0x7f04bc005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 msgr2=0x562e70fe7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04b804a330 tx=0x7f04b801dd40 comp rx=0 tx=0).stop 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 shutdown_connections 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03a0036950 0x7f03a0038e10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/2526385234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70fe6de0 0x562e70fe7200 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 >> 172.21.15.169:0/2526385234 conn(0x562e70fdae80 msgr2=0x562e70fdb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 shutdown_connections 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/2526385234 wait complete. 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e70fd1e30 msgr2=0x562e70fd4220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x562e70fd1e30 0x562e70fd4220 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e70fcd1b0 msgr2=0x562e70fcf5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x562e70fcd1b0 0x562e70fcf5a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562e70fd5dc0 msgr2=0x562e70fd81f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x562e70fd5dc0 0x562e70fd81f0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03ac036900 msgr2=0x7f03ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.966+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f03ac036900 0x7f03ac038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f04bc054000 tx=0x7f04bc04e000 comp rx=0 tx=0).stop 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 msgr2=0x562e70ecda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 --2- 172.21.15.169:0/1467081816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e70ed13c0 0x562e70ecda60 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x562e70fbed70 tx=0x7f04b8001250 comp rx=0 tx=0).stop 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c631f640 1 -- 172.21.15.169:0/1467081816 reap_dead start 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 shutdown_connections 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 >> 172.21.15.169:0/1467081816 conn(0x562e70ec6b50 msgr2=0x562e70fb8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:24.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 shutdown_connections 2024-04-24T01:25:24.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:24.967+0000 7f04c801f800 1 -- 172.21.15.169:0/1467081816 wait complete. 2024-04-24T01:25:24.994 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-04-24T01:25:24.952257Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:25:24.952240Z', 'tags': [], 'group_ids': []} 2024-04-24T01:25:25.012 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:25:25.018 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-04-24T01:25:25.018 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T01:25:25.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-04-24T01:25:25.019 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-04-24T01:25:25.064 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:25.064 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.064+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.064+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d1872f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560636c24300 0x560636c2ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d1872f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560636ae2d40 con 0x560636c227c0 2024-04-24T01:25:25.065 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d1872f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x560636ab54d0 con 0x560636c24300 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d0bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560636c24300 0x560636c2ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d143b5640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x560636c227c0 0x560636c22be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:60180/0 (socket says 172.21.15.169:60180) 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d0bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560636c24300 0x560636c2ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59678/0 (socket says 172.21.15.169:59678) 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d143b5640 1 -- 172.21.15.169:0/3756284732 learned_addr learned my addr 172.21.15.169:0/3756284732 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d0bfff640 1 -- 172.21.15.169:0/3756284732 >> v1:172.21.15.142:6789/0 conn(0x560636c227c0 legacy=0x560636c22be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.065+0000 7f0d0bfff640 1 -- 172.21.15.169:0/3756284732 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636ae1590 con 0x560636c24300 2024-04-24T01:25:25.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.067+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/3756284732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c24300 0x560636c2ce00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00a470 tx=0x7f0cfc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c737a2a50e67537 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.067+0000 7f0d13bb4640 1 -- 172.21.15.169:0/3756284732 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cfc057070 con 0x560636c24300 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.067+0000 7f0d13bb4640 1 -- 172.21.15.169:0/3756284732 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cfc052440 con 0x560636c24300 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.067+0000 7f0d13bb4640 1 -- 172.21.15.169:0/3756284732 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0cfc052740 con 0x560636c24300 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 -- 172.21.15.169:0/3756284732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c24300 msgr2=0x560636c2ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3756284732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c24300 0x560636c2ce00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00a470 tx=0x7f0cfc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 -- 172.21.15.169:0/3756284732 shutdown_connections 2024-04-24T01:25:25.070 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3756284732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c24300 0x560636c2ce00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 -- 172.21.15.169:0/3756284732 >> 172.21.15.169:0/3756284732 conn(0x560636c1e340 msgr2=0x560636c20760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 -- 172.21.15.169:0/3756284732 shutdown_connections 2024-04-24T01:25:25.071 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.068+0000 7f0d1872f800 1 -- 172.21.15.169:0/3756284732 wait complete. 2024-04-24T01:25:25.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.079+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.079+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d1872f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d1872f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560636b6f3b0 con 0x560636c227c0 2024-04-24T01:25:25.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59680/0 (socket says 172.21.15.169:59680) 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d143b5640 1 -- 172.21.15.169:0/1814761575 learned_addr learned my addr 172.21.15.169:0/1814761575 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d143b5640 1 -- 172.21.15.169:0/1814761575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636d17aa0 con 0x560636c227c0 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.080+0000 7f0d143b5640 1 --2- 172.21.15.169:0/1814761575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001d50 tx=0x7f0d0400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe153f9fd1ef85b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0c0260c640 1 -- 172.21.15.169:0/1814761575 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04013030 con 0x560636c227c0 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0c0260c640 1 -- 172.21.15.169:0/1814761575 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0400e470 con 0x560636c227c0 2024-04-24T01:25:25.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0c0260c640 1 -- 172.21.15.169:0/1814761575 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0400e810 con 0x560636c227c0 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 -- 172.21.15.169:0/1814761575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 msgr2=0x560636d174d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 --2- 172.21.15.169:0/1814761575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0d04001d50 tx=0x7f0d0400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 -- 172.21.15.169:0/1814761575 shutdown_connections 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 --2- 172.21.15.169:0/1814761575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d174d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 -- 172.21.15.169:0/1814761575 >> 172.21.15.169:0/1814761575 conn(0x560636c1e340 msgr2=0x560636d12df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 -- 172.21.15.169:0/1814761575 shutdown_connections 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.081+0000 7f0d1872f800 1 -- 172.21.15.169:0/1814761575 wait complete. 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d1872f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d1f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d1872f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560636c2f620 con 0x560636c227c0 2024-04-24T01:25:25.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d1f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.366 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-04-24T01:25:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d1f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59684/0 (socket says 172.21.15.169:59684) 2024-04-24T01:25:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d143b5640 1 -- 172.21.15.169:0/2686418559 learned_addr learned my addr 172.21.15.169:0/2686418559 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d143b5640 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636d1f5b0 con 0x560636c227c0 2024-04-24T01:25:25.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.082+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d1f070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004000 tx=0x7f0d04000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0c00e09640 1 -- 172.21.15.169:0/2686418559 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04027070 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0c00e09640 1 -- 172.21.15.169:0/2686418559 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d040013d0 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560636d1f840 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0c00e09640 1 -- 172.21.15.169:0/2686418559 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04019ac0 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560636d224f0 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.083+0000 7f0c00e09640 1 -- 172.21.15.169:0/2686418559 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d0402a070 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0c00e09640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bfc036900 0x7f0bfc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0c00e09640 1 -- 172.21.15.169:0/2686418559 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d0401f070 con 0x560636c227c0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bfc036900 0x7f0bfc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636c24300 0x560636d262b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d26840 con 0x560636c24300 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636c24300 0x560636d262b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bfc036900 0x7f0bfc038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc054000 tx=0x7f0cfc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.084+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636c24300 0x560636d262b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2686418559 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636c24300 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d23880 con 0x560636c24300 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2686418559 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636c24300 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d28b90 0x560636d2af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d2b670 con 0x560636d28b90 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d28b90 0x560636d2af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.085+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d28b90 0x560636d2af80 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d143b5640 1 -- 172.21.15.169:0/2686418559 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d04029030 con 0x560636d28b90 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d27b40 con 0x560636c24300 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2686418559 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636c24300 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560636d2cb20 0x560636d2ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d2f6d0 con 0x560636d2cb20 2024-04-24T01:25:25.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560636d2cb20 0x560636d2ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.086+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560636d2cb20 0x560636d2ef70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2686418559 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0cfc052930 con 0x560636d2cb20 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d1872f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d1872f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560636b156b0 con 0x560636d3db30 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59700/0 (socket says 172.21.15.169:59700) 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.087+0000 7f0d143b5640 1 -- 172.21.15.169:0/3343838013 learned_addr learned my addr 172.21.15.169:0/3343838013 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0d143b5640 1 -- 172.21.15.169:0/3343838013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636d3e490 con 0x560636d3db30 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0d143b5640 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0d0404aad0 tx=0x7f0d04044500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0bf9ffb640 1 -- 172.21.15.169:0/3343838013 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0404c5b0 con 0x560636d3db30 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0bf9ffb640 1 -- 172.21.15.169:0/3343838013 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d04044890 con 0x560636d3db30 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560636d3ef00 con 0x560636d3db30 2024-04-24T01:25:25.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0bf9ffb640 1 -- 172.21.15.169:0/3343838013 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04044bb0 con 0x560636d3db30 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.088+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560636d3f400 con 0x560636d3db30 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0bf9ffb640 1 -- 172.21.15.169:0/3343838013 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d04033020 con 0x560636d3db30 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0bf9ffb640 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 0x7f0bec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0bf9ffb640 1 -- 172.21.15.169:0/3343838013 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d04014070 con 0x560636d3db30 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 0x7f0bec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 0x7f0bec038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x560636d27140 tx=0x7f0cfc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d1872f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.089+0000 7f0d1872f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560636d17e20 con 0x560636d4ac90 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59704/0 (socket says 172.21.15.169:59704) 2024-04-24T01:25:25.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0d143b5640 1 -- 172.21.15.169:0/3025242346 learned_addr learned my addr 172.21.15.169:0/3025242346 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0d143b5640 1 -- 172.21.15.169:0/3025242346 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636d4b680 con 0x560636d4ac90 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0d143b5640 1 --2- 172.21.15.169:0/3025242346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0d04019690 tx=0x7f0d04036e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac7e69aa8cb6def server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0bf37fe640 1 -- 172.21.15.169:0/3025242346 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0405c070 con 0x560636d4ac90 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0bf37fe640 1 -- 172.21.15.169:0/3025242346 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d04044d50 con 0x560636d4ac90 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.090+0000 7f0bf37fe640 1 -- 172.21.15.169:0/3025242346 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04053040 con 0x560636d4ac90 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- 172.21.15.169:0/3025242346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 msgr2=0x560636d4b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3025242346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f0d04019690 tx=0x7f0d04036e50 comp rx=0 tx=0).stop 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- 172.21.15.169:0/3025242346 shutdown_connections 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3025242346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d4b0b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- 172.21.15.169:0/3025242346 >> 172.21.15.169:0/3025242346 conn(0x560636d46f60 msgr2=0x560636d44fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- 172.21.15.169:0/3025242346 shutdown_connections 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- 172.21.15.169:0/3025242346 wait complete. 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 Processor -- start 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- start start 2024-04-24T01:25:25.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d1872f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560636d4bce0 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d143b5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59714/0 (socket says 172.21.15.169:59714) 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.091+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 learned_addr learned my addr 172.21.15.169:0/2553833139 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560636d52490 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0d04049920 tx=0x7f0d0400a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0bf1ffb640 1 -- 172.21.15.169:0/2553833139 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d04067020 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0bf1ffb640 1 -- 172.21.15.169:0/2553833139 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d0401b230 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0bf1ffb640 1 -- 172.21.15.169:0/2553833139 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d0405c040 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560636d52490 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.092+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560636d52490 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0bf1ffb640 1 -- 172.21.15.169:0/2553833139 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d0406a020 con 0x560636d4ac90 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0bf1ffb640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0be4036900 0x7f0be4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0bf1ffb640 1 -- 172.21.15.169:0/2553833139 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f0d0406dd20 con 0x560636d4ac90 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0be4036900 0x7f0be4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636d5d700 0x560636d5fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d60310 con 0x560636d5d700 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.093+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0be4036900 0x7f0be4038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc055040 tx=0x7f0cfc04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636d5d700 0x560636d5fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636d5d700 0x560636d5fbc0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 realm 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d60720 con 0x560636d5d700 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d60ff0 con 0x560636d5d700 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.094+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d1872f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d620f0 0x560636d644e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d64af0 con 0x560636d620f0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d620f0 0x560636d644e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.095+0000 7f0d143b5640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d620f0 0x560636d644e0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d1872f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d1872f800 20 searching for the correct realm 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560636d66aa0 0x560636d68f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d69630 con 0x560636d66aa0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560636d66aa0 0x560636d68f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560636d66aa0 0x560636d68f60 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d0bfff640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0cfc076040 0x7f0cfc083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d69630 con 0x7f0cfc076040 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.096+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0cfc076040 0x7f0cfc083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.097+0000 7f0d14bb6640 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0cfc076040 0x7f0cfc083410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.097+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x7f0cfc076040 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.097+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d620f0 2024-04-24T01:25:25.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.097+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.097+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d620f0 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.098+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x7f0cfc076040 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x7f0cfc076040 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d66aa0 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.099+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d620f0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d5d700 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c00a4a0 con 0x560636d5d700 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x7f0cfc076040 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560636d61390 con 0x560636d66aa0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.100+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d620f0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d5d700 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.101+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d5d700 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d620f0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.102+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x7f0cfc076040 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d5d700 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.103+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x7f0cfc076040 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d66aa0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.104+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.379 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x560636d5d700 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f0cfc090040 con 0x7f0cfc076040 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d653b0 con 0x560636d5d700 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.380 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.105+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d653b0 con 0x560636d5d700 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d653b0 con 0x7f0cfc076040 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 zone default found 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 4 Realm: () 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 zonegroup default 2024-04-24T01:25:25.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d65ca0 con 0x560636d620f0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d6b490 con 0x560636d66aa0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.106+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d6b830 con 0x560636d66aa0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.107+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.107+0000 7f0d1872f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.107+0000 7f0d1872f800 20 started sync module instance, tier type = 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.107+0000 7f0d1872f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:25.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.107+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6a930 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.108+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.108+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94584689831552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6a930 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.108+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6c1f0 con 0x560636d5d700 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.109+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94584689831552] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.109+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.109+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94584689829472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6c1f0 con 0x560636d5d700 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.109+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6cbb0 con 0x560636d66aa0 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.110+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94584689829472] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.111+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.111+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94584689835328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6c160 con 0x560636d66aa0 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.111+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6da70 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.112+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94584689835328] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.112+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.112+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94584689841600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6de90 con 0x7f0cfc076040 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.112+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6e850 con 0x560636d5d700 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.113+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.113+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94584689841600] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.113+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94584689845152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6ec70 con 0x560636d5d700 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.113+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6da20 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.114+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.114+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94584689848800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6fab0 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.114+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d704f0 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.114+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94584689845152] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.115+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.115+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94584689852352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d708e0 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.115+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d712e0 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.115+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94584689848800] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94584689852352] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94584689846208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d70df0 con 0x560636d620f0 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=0 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=1 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=2 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=3 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=4 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=5 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.116+0000 7f0d1872f800 20 add_watcher() i=6 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94584689846208] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d1872f800 20 add_watcher() i=7 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d1872f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636d742d0 con 0x560636d5d700 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.117+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94584689855984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d716c0 con 0x560636d5d700 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.118+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94584689855984] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.118+0000 7f0bcafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.118+0000 7f0d1872f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.118+0000 7f0d1872f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.118+0000 7f0d1872f800 5 note: GC not initialized 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0bc9fe3640 20 reqs_thread_entry: start 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 20 Filter name: none 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0bc2ffd640 20 reqs_thread_entry: start 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560636da7510 con 0x7f0cfc076040 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.119+0000 7f0d1872f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.120+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636dab890 con 0x560636d620f0 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.121+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'9 uv8 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.122+0000 7f0bcafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.122+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94584689855984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d59e90 con 0x560636d5d700 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.123+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94584689855984] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.123+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94584689831552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d70df0 con 0x7f0cfc076040 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.124+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94584689831552] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.124+0000 7f0d1872f800 20 remove_watcher() i=0 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.124+0000 7f0d1872f800 2 removed watcher, disabling cache 2024-04-24T01:25:25.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.124+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94584689829472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6ae60 con 0x560636d5d700 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.125+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94584689829472] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.125+0000 7f0d1872f800 20 remove_watcher() i=1 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.125+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94584689835328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6a660 con 0x560636d66aa0 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.126+0000 7f0d0bfff640 1 -- 172.21.15.169:0/2553833139 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94584689835328] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0cfc081070 con 0x560636d66aa0 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.126+0000 7f0d1872f800 20 remove_watcher() i=2 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.126+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94584689841600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6bd40 con 0x7f0cfc076040 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.127+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94584689841600] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x7f0cfc076040 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.127+0000 7f0d1872f800 20 remove_watcher() i=3 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.127+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94584689845152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6bd40 con 0x560636d5d700 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.128+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94584689845152] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d0c032040 con 0x560636d5d700 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.128+0000 7f0d1872f800 20 remove_watcher() i=4 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.128+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94584689848800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6bd40 con 0x560636d620f0 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.129+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94584689848800] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.129+0000 7f0d1872f800 20 remove_watcher() i=5 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.129+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94584689852352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6f1e0 con 0x560636d620f0 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.130+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94584689852352] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.130+0000 7f0d1872f800 20 remove_watcher() i=6 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.130+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94584689846208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560636d6bd40 con 0x560636d620f0 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d143b5640 1 -- 172.21.15.169:0/2553833139 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94584689846208] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d04029030 con 0x560636d620f0 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 20 remove_watcher() i=7 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d620f0 msgr2=0x560636d644e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d620f0 0x560636d644e0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636d5d700 msgr2=0x560636d5fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636d5d700 0x560636d5fbc0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0cfc076040 msgr2=0x7f0cfc083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f0cfc076040 0x7f0cfc083410 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560636d66aa0 msgr2=0x560636d68f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560636d66aa0 0x560636d68f60 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0be4036900 msgr2=0x7f0be4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0be4036900 0x7f0be4038dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc055040 tx=0x7f0cfc04f000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 msgr2=0x560636d51f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f0d04049920 tx=0x7f0d0400a940 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2553833139 reap_dead start 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 shutdown_connections 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2553833139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d4ac90 0x560636d51f50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.131+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 >> 172.21.15.169:0/2553833139 conn(0x560636d46f60 msgr2=0x560636d445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 shutdown_connections 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2553833139 wait complete. 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 msgr2=0x7f0bec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 0x7f0bec038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x560636d27140 tx=0x7f0cfc005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 msgr2=0x560636d3df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0d0404aad0 tx=0x7f0d04044500 comp rx=0 tx=0).stop 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 shutdown_connections 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bec036900 0x7f0bec038dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/3343838013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636d3db30 0x560636d3df50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 >> 172.21.15.169:0/3343838013 conn(0x560636d31bd0 msgr2=0x560636d31fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 shutdown_connections 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/3343838013 wait complete. 2024-04-24T01:25:25.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d28b90 msgr2=0x560636d2af80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560636d28b90 0x560636d2af80 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636c24300 msgr2=0x560636d262b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560636c24300 0x560636d262b0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560636d2cb20 msgr2=0x560636d2ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560636d2cb20 0x560636d2ef70 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bfc036900 msgr2=0x7f0bfc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f0bfc036900 0x7f0bfc038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc054000 tx=0x7f0cfc04e000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 msgr2=0x560636d1f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 --2- 172.21.15.169:0/2686418559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560636c227c0 0x560636d1f070 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0d04004000 tx=0x7f0d04000bc0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d14bb6640 1 -- 172.21.15.169:0/2686418559 reap_dead start 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 shutdown_connections 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.132+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 >> 172.21.15.169:0/2686418559 conn(0x560636c1e340 msgr2=0x560636d115f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.133+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 shutdown_connections 2024-04-24T01:25:25.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.133+0000 7f0d1872f800 1 -- 172.21.15.169:0/2686418559 wait complete. 2024-04-24T01:25:25.450 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:25:25.451 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:25:25.476 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-04-24T01:25:25.477 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-04-24T01:25:25.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T01:25:25.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-04-24T01:25:25.478 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-04-24T01:25:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.532 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f987bd21800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564e59f0f3e0 0x564e59f117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f987bd21800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e59dc9d40 con 0x564e59f0b8d0 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f987bd21800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x564e59d9c4d0 con 0x564e59f0f3e0 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f9877258640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564e59f0f3e0 0x564e59f117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f9877a59640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x564e59f0b8d0 0x564e59f0dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:60184/0 (socket says 172.21.15.169:60184) 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f9877258640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x564e59f0f3e0 0x564e59f117d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59720/0 (socket says 172.21.15.169:59720) 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.531+0000 7f9877a59640 1 -- 172.21.15.169:0/3378599985 learned_addr learned my addr 172.21.15.169:0/3378599985 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.532+0000 7f9877258640 1 -- 172.21.15.169:0/3378599985 >> v1:172.21.15.142:6789/0 conn(0x564e59f0b8d0 legacy=0x564e59f0dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.533 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.532+0000 7f9877258640 1 -- 172.21.15.169:0/3378599985 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e59dc8590 con 0x564e59f0f3e0 2024-04-24T01:25:25.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f9877258640 1 --2- 172.21.15.169:0/3378599985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0f3e0 0x564e59f117d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f986c00a470 tx=0x7f986c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aca9ca28cebe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f9876a57640 1 -- 172.21.15.169:0/3378599985 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986c057070 con 0x564e59f0f3e0 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f9876a57640 1 -- 172.21.15.169:0/3378599985 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986c052570 con 0x564e59f0f3e0 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f9876a57640 1 -- 172.21.15.169:0/3378599985 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986c052870 con 0x564e59f0f3e0 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 -- 172.21.15.169:0/3378599985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0f3e0 msgr2=0x564e59f117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 --2- 172.21.15.169:0/3378599985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0f3e0 0x564e59f117d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f986c00a470 tx=0x7f986c01ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 -- 172.21.15.169:0/3378599985 shutdown_connections 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 --2- 172.21.15.169:0/3378599985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0f3e0 0x564e59f117d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 -- 172.21.15.169:0/3378599985 >> 172.21.15.169:0/3378599985 conn(0x564e59f053a0 msgr2=0x564e59f077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 -- 172.21.15.169:0/3378599985 shutdown_connections 2024-04-24T01:25:25.536 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.534+0000 7f987bd21800 1 -- 172.21.15.169:0/3378599985 wait complete. 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.546+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.546+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.546+0000 7f987bd21800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.546+0000 7f987bd21800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e59e563b0 con 0x564e59f0b8d0 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59730/0 (socket says 172.21.15.169:59730) 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9877a59640 1 -- 172.21.15.169:0/310041397 learned_addr learned my addr 172.21.15.169:0/310041397 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9877a59640 1 -- 172.21.15.169:0/310041397 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e59f097d0 con 0x564e59f0b8d0 2024-04-24T01:25:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9877a59640 1 --2- 172.21.15.169:0/310041397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9868001de0 tx=0x7f986800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a22742faf86346 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9765e0b640 1 -- 172.21.15.169:0/310041397 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868012020 con 0x564e59f0b8d0 2024-04-24T01:25:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9765e0b640 1 -- 172.21.15.169:0/310041397 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986800e5a0 con 0x564e59f0b8d0 2024-04-24T01:25:25.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.547+0000 7f9765e0b640 1 -- 172.21.15.169:0/310041397 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986800e8c0 con 0x564e59f0b8d0 2024-04-24T01:25:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 -- 172.21.15.169:0/310041397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 msgr2=0x564e59f0b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 --2- 172.21.15.169:0/310041397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9868001de0 tx=0x7f986800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.554 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 -- 172.21.15.169:0/310041397 shutdown_connections 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 --2- 172.21.15.169:0/310041397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e59f0b210 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 -- 172.21.15.169:0/310041397 >> 172.21.15.169:0/310041397 conn(0x564e59f053a0 msgr2=0x564e59ff7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 -- 172.21.15.169:0/310041397 shutdown_connections 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 -- 172.21.15.169:0/310041397 wait complete. 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.548+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.555 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f987bd21800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e5a005e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f987bd21800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e59f12010 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e5a005e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e5a005e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59732/0 (socket says 172.21.15.169:59732) 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f9877a59640 1 -- 172.21.15.169:0/301402081 learned_addr learned my addr 172.21.15.169:0/301402081 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f9877a59640 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5a0063a0 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.549+0000 7f9877a59640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e5a005e60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f986800c010 tx=0x7f9868000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f975ffff640 1 -- 172.21.15.169:0/301402081 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868012070 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f975ffff640 1 -- 172.21.15.169:0/301402081 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986801a7a0 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e5a006630 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f975ffff640 1 -- 172.21.15.169:0/301402081 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986801aa80 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5a0092e0 con 0x564e59f0b8d0 2024-04-24T01:25:25.556 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.550+0000 7f975ffff640 1 -- 172.21.15.169:0/301402081 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9868015020 con 0x564e59f0b8d0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f975ffff640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9760036950 0x7f9760038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f975ffff640 1 -- 172.21.15.169:0/301402081 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9868020070 con 0x564e59f0b8d0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f9877258640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9760036950 0x7f9760038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e59f0f3e0 0x564e5a00d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a00d620 con 0x564e59f0f3e0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987825a640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e59f0f3e0 0x564e5a00d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f9877258640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9760036950 0x7f9760038e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f986c054000 tx=0x7f986c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987825a640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e59f0f3e0 0x564e5a00d0a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987825a640 1 -- 172.21.15.169:0/301402081 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f987000a4a0 con 0x564e59f0f3e0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.551+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a00a670 con 0x564e59f0f3e0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.552+0000 7f987825a640 1 -- 172.21.15.169:0/301402081 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f987000a4a0 con 0x564e59f0f3e0 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.552+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a00f980 0x564e5a011d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.557 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.552+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a012410 con 0x564e5a00f980 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.552+0000 7f9877a59640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a00f980 0x564e5a011d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.552+0000 7f9877a59640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a00f980 0x564e5a011d70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f9877a59640 1 -- 172.21.15.169:0/301402081 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f986802b070 con 0x564e5a00f980 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a00e930 con 0x564e59f0f3e0 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f987825a640 1 -- 172.21.15.169:0/301402081 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f987000a4a0 con 0x564e59f0f3e0 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564e5a0138c0 0x564e5a015d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a016470 con 0x564e5a0138c0 2024-04-24T01:25:25.558 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.553+0000 7f9877258640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564e5a0138c0 0x564e5a015d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f9877258640 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564e5a0138c0 0x564e5a015d10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f9877258640 1 -- 172.21.15.169:0/301402081 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f986c052a40 con 0x564e5a0138c0 2024-04-24T01:25:25.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.582 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f987bd21800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.554+0000 7f987bd21800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e59dfc6b0 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59740/0 (socket says 172.21.15.169:59740) 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f9877a59640 1 -- 172.21.15.169:0/1506222092 learned_addr learned my addr 172.21.15.169:0/1506222092 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f9877a59640 1 -- 172.21.15.169:0/1506222092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5a0251a0 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f9877a59640 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f986804aa30 tx=0x7f986802caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f975d7fa640 1 -- 172.21.15.169:0/1506222092 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986804acc0 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f975d7fa640 1 -- 172.21.15.169:0/1506222092 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98680490e0 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f975d7fa640 1 -- 172.21.15.169:0/1506222092 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986804ae60 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e5a025c10 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.555+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5a026110 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.556+0000 7f975d7fa640 1 -- 172.21.15.169:0/1506222092 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f98680493c0 con 0x564e5a024840 2024-04-24T01:25:25.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.556+0000 7f975d7fa640 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 0x7f9750038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.556+0000 7f975d7fa640 1 -- 172.21.15.169:0/1506222092 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f986803ad10 con 0x564e5a024840 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.556+0000 7f9877258640 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 0x7f9750038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877258640 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 0x7f9750038e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564e5a00a590 tx=0x7f986c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f987bd21800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f987bd21800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e59f09b50 con 0x564e5a031a40 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59756/0 (socket says 172.21.15.169:59756) 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877a59640 1 -- 172.21.15.169:0/3364857256 learned_addr learned my addr 172.21.15.169:0/3364857256 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877a59640 1 -- 172.21.15.169:0/3364857256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5a032430 con 0x564e5a031a40 2024-04-24T01:25:25.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.557+0000 7f9877a59640 1 --2- 172.21.15.169:0/3364857256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f986802cb70 tx=0x7f986803e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc223bf1e695feb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f9756ffd640 1 -- 172.21.15.169:0/3364857256 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868022be0 con 0x564e5a031a40 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f9756ffd640 1 -- 172.21.15.169:0/3364857256 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f986800d750 con 0x564e5a031a40 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f9756ffd640 1 -- 172.21.15.169:0/3364857256 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986802e450 con 0x564e5a031a40 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- 172.21.15.169:0/3364857256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 msgr2=0x564e5a031e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 --2- 172.21.15.169:0/3364857256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f986802cb70 tx=0x7f986803e430 comp rx=0 tx=0).stop 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- 172.21.15.169:0/3364857256 shutdown_connections 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 --2- 172.21.15.169:0/3364857256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a031e60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- 172.21.15.169:0/3364857256 >> 172.21.15.169:0/3364857256 conn(0x564e5a02dd10 msgr2=0x564e5a02bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- 172.21.15.169:0/3364857256 shutdown_connections 2024-04-24T01:25:25.585 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- 172.21.15.169:0/3364857256 wait complete. 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 Processor -- start 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- start start 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.558+0000 7f987bd21800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x564e5a032b00 con 0x564e5a031a40 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f9877a59640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59758/0 (socket says 172.21.15.169:59758) 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 learned_addr learned my addr 172.21.15.169:0/3230077790 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e5a0393a0 con 0x564e5a031a40 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f9877a59640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f98680497a0 tx=0x7f9868004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f97557fa640 1 -- 172.21.15.169:0/3230077790 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9868030c50 con 0x564e5a031a40 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f97557fa640 1 -- 172.21.15.169:0/3230077790 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9868030e10 con 0x564e5a031a40 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e5a0393a0 con 0x564e5a031a40 2024-04-24T01:25:25.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f97557fa640 1 -- 172.21.15.169:0/3230077790 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f986803e7d0 con 0x564e5a031a40 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.559+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e5a0393a0 con 0x564e5a031a40 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.560+0000 7f97557fa640 1 -- 172.21.15.169:0/3230077790 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9868060070 con 0x564e5a031a40 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.560+0000 7f97557fa640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9740036900 0x7f9740038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f97557fa640 1 -- 172.21.15.169:0/3230077790 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f986805e020 con 0x564e5a031a40 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f9877258640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9740036900 0x7f9740038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f9877258640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9740036900 0x7f9740038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f986c052fd0 tx=0x7f986c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e5a044570 0x564e5a046a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a047180 con 0x564e5a044570 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f987825a640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e5a044570 0x564e5a046a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.561+0000 7f987825a640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e5a044570 0x564e5a046a30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 realm 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a047590 con 0x564e5a044570 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a047e60 con 0x564e5a044570 2024-04-24T01:25:25.588 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a048f60 0x564e5a04b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.562+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a04b960 con 0x564e5a048f60 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f9877a59640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a048f60 0x564e5a04b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f9877a59640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a048f60 0x564e5a04b350 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f987bd21800 20 searching for the correct realm 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564e5a04d910 0x564e5a04fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0504a0 con 0x564e5a04d910 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.563+0000 7f9877258640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564e5a04d910 0x564e5a04fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f9877258640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564e5a04d910 0x564e5a04fdd0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f9877258640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f986c076040 0x7f986c083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0504a0 con 0x7f986c076040 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f987825a640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f986c076040 0x7f986c083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.564+0000 7f987825a640 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f986c076040 0x7f986c083410 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x7f986c076040 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a048f60 2024-04-24T01:25:25.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.565+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a048f60 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x7f986c076040 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x7f986c076040 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a04d910 2024-04-24T01:25:25.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.566+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a048f60 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a044570 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f987000a4a0 con 0x564e5a044570 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x7f986c076040 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.567+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e5a048200 con 0x564e5a04d910 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a048f60 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.568+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a044570 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a044570 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a048f60 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.569+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x7f986c076040 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a044570 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.570+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a048f60 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.594 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a048f60 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x7f986c076040 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.571+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a04d910 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a048f60 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x564e5a044570 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.595 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f986c090040 con 0x7f986c076040 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.572+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a04c220 con 0x564e5a044570 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.596 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a04c220 con 0x564e5a044570 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a04c220 con 0x7f986c076040 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 zone default found 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 4 Realm: () 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:25.597 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 zonegroup default 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.573+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a04cac0 con 0x564e5a048f60 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a052300 con 0x564e5a04d910 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.598 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0526a0 con 0x564e5a04d910 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 started sync module instance, tier type = 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.574+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0517a0 con 0x7f986c076040 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.575+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.575+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94894517722000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0517a0 con 0x7f986c076040 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.575+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a052ef0 con 0x564e5a044570 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.576+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94894517722000] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.577+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.577+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94894517726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0517a0 con 0x564e5a044570 2024-04-24T01:25:25.599 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.577+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a053940 con 0x564e5a04d910 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.578+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.578+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94894517726240] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.578+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94894517719792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a053d30 con 0x564e5a04d910 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.578+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a054750 con 0x7f986c076040 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.579+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.579+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94894517731904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a054ff0 con 0x7f986c076040 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.579+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94894517719792] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.600 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.579+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a053490 con 0x564e5a044570 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.580+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.580+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94894517736832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a053490 con 0x564e5a044570 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.581+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a056470 con 0x564e5a048f60 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.581+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94894517731904] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.582+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.582+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94894517739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a056860 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.582+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a057260 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.582+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94894517736832] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.583+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.583+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94894517737888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a057b00 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.583+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0584c0 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.583+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94894517739456] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94894517737888] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94894517745152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a057a20 con 0x564e5a048f60 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=0 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=1 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=2 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=3 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=4 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=5 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.584+0000 7f987bd21800 20 add_watcher() i=6 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94894517745152] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f987bd21800 20 add_watcher() i=7 2024-04-24T01:25:25.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f987bd21800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a05b4f0 con 0x564e5a044570 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.585+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94894517747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0588e0 con 0x564e5a044570 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.586+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94894517747728] v34'224 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.586+0000 7f972dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.586+0000 7f987bd21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:25.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.586+0000 7f987bd21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.586+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a063c30 con 0x564e5a044570 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.588+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'58 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.588+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a064300 con 0x564e5a048f60 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.589+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.589+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a064300 con 0x564e5a04d910 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.590+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.590+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a064da0 con 0x564e5a044570 2024-04-24T01:25:25.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.591+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'225 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.591+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a061a70 con 0x7f986c076040 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.592+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'77 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.592+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a061a70 con 0x564e5a04d910 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.593+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'57 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.593+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a065b20 con 0x564e5a044570 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.594+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.594+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a065fd0 con 0x564e5a048f60 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.595+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'51 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.595+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a065fd0 con 0x7f986c076040 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.596+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.596+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a065fd0 con 0x564e5a04d910 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.597+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.597+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060b50 con 0x7f986c076040 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.598+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'78 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.598+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060b50 con 0x564e5a048f60 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.600+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.600+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060af0 con 0x7f986c076040 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.601+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.601+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0603e0 con 0x564e5a048f60 2024-04-24T01:25:25.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.602+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'64 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.602+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a80 con 0x564e5a044570 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.603+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'226 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.603+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a80 con 0x564e5a04d910 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.604+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'68 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.604+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a80 con 0x7f986c076040 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.605+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'79 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.605+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a80 con 0x564e5a04d910 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.606+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'38 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.606+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a80 con 0x564e5a044570 2024-04-24T01:25:25.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.608+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.608+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0609b0 con 0x564e5a044570 2024-04-24T01:25:25.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.609+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'227 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.609+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0609b0 con 0x564e5a04d910 2024-04-24T01:25:25.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.610+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'69 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.610+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x7f986c076040 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.611+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'42 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.611+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.611+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.611+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.612+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'44 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.612+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.613+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.613+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.614+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'58 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.614+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a048f60 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.616+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.616+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.617+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.617+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a048f60 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.618+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'52 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.618+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a04d910 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.619+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'70 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.619+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a30 con 0x564e5a048f60 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.620+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'65 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.620+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a060a50 con 0x7f986c076040 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.621+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f972cfe1640 20 reqs_thread_entry: start 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 20 Filter name: none 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f96a67fc640 20 reqs_thread_entry: start 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091420 con 0x7f986c076040 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0939e0 con 0x564e5a044570 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.622+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 : miss 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:96 8.e 8:746b6bee:root::.bucket.meta.myfoo6%3af341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a093e40 con 0x564e5a048f60 2024-04-24T01:25:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(96 .bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv6 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:25.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x17 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.623+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 4.36 4:6d66b69d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a110fd0 con 0x564e5a044570 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(97 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 4.d 4:b2990e99:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a110fd0 con 0x7f986c076040 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(98 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 4.3a 4:5f636b84:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a110fd0 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(99 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.624+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 4.26 4:65a25d45:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a111050 con 0x564e5a048f60 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(100 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 4.10 4:09844f2a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a111070 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(101 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 4.5 4:a1b61e24:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(102 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.625+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:103 4.1a 4:58751e17:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x7f986c076040 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.626+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(103 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.626+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 4.33 4:cecf32bf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x564e5a048f60 2024-04-24T01:25:25.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.626+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(104 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.626+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 4.22 4:4427cc59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(105 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:106 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(106 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [call out=289b] v0'0 uv7 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987bd21800 10 cls_bucket_list_unordered: got thirteen 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:107 4.2f 4:f4aa6d37:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1116c0 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(107 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987bd21800 20 get_obj_state: octx=0x7f9868035f40 obj=myfoo6:thirteen state=0x564e5a10f078 s->prefetch_data=0 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.627+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:108 3.1ds0 3:b8d1344f:::f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a10fea0 con 0x564e5a04d910 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(108 f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 10 manifest: total_size = 8 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 20 get_obj_state: setting s->obj_tag to _s27T9LF-mhabk6sZ2k8X59biAoJgGKa 2024-04-24T01:25:25.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 20 get_obj_state: octx=0x7f9868035f40 obj=myfoo6:thirteen state=0x564e5a10f078 s->prefetch_data=0 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 20 prepare_atomic_modification: state is not atomic. state=0x564e5a10f078 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.628+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:109 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1107e0 con 0x564e5a044570 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.629+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(109 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.629+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:110 3.1ds0 3:b8d1344f:::f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a1107e0 con 0x564e5a04d910 2024-04-24T01:25:25.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(110 f341815c-ea59-4c61-b01b-010b058e6023.4227.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:111 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a098330 con 0x564e5a044570 2024-04-24T01:25:25.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:112 4.36 4:6d66b69d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a098330 con 0x564e5a044570 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:113 4.d 4:b2990e99:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09c620 con 0x7f986c076040 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:114 4.3a 4:5f636b84:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a098330 con 0x564e5a04d910 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.630+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:115 4.26 4:65a25d45:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a1450 con 0x564e5a048f60 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:116 4.10 4:09844f2a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a3d40 con 0x564e5a04d910 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(112 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(113 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:117 4.5 4:a1b61e24:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09a150 con 0x564e5a04d910 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:118 4.1a 4:58751e17:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a4680 con 0x7f986c076040 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:119 4.33 4:cecf32bf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a70d0 con 0x564e5a048f60 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:120 4.22 4:4427cc59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a4680 con 0x564e5a044570 2024-04-24T01:25:25.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(114 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:121 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09a150 con 0x564e5a044570 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(115 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:122 4.2f 4:f4aa6d37:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a0010 con 0x564e5a044570 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(118 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.631+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(119 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(120 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(122 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(116 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(111 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(117 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f9756ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(121 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:25:25.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[f341815c-ea59-4c61-b01b-010b058e6023.4227.9])"; uploads.size()=0; is_truncated=0 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:123 4.36 4:6d66b69d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a4660 con 0x564e5a044570 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:124 4.d 4:b2990e99:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09a150 con 0x7f986c076040 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:125 4.3a 4:5f636b84:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a2c80 con 0x564e5a04d910 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:126 4.26 4:65a25d45:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a4660 con 0x564e5a048f60 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:127 4.10 4:09844f2a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a3100 con 0x564e5a04d910 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:128 4.5 4:a1b61e24:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a39d0 con 0x564e5a04d910 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:129 4.1a 4:58751e17:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09a150 con 0x7f986c076040 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:130 4.33 4:cecf32bf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a09ff90 con 0x564e5a048f60 2024-04-24T01:25:25.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:131 4.22 4:4427cc59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0aa920 con 0x564e5a044570 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:132 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0ad580 con 0x564e5a044570 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:133 4.2f 4:f4aa6d37:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0b02a0 con 0x564e5a044570 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(123 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.632+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(126 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(131 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(125 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(130 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(124 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(127 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(129 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(133 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(132 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(128 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.633+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a3100 con 0x564e5a044570 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a3100 con 0x564e5a044570 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 20 rados_obj.operate() r=0 bl.length=166 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.634+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a2610 con 0x564e5a044570 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.635+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.635+0000 7f987bd21800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.635+0000 7f987bd21800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.635+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94894518059440 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a35b0 con 0x7f986c076040 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== watch-notify(notify (1) cookie 94894517731904 notify 146028888082 ret 0) ==== 192+0+0 (crc 0 0 0) 0x564e5a0617e0 con 0x7f986c076040 2024-04-24T01:25:25.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f9756ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94894517731904 notifier 4752 bl.length()=150 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(137 notify.3 [notify cookie 94894518059440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f9756ffd640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f973c003d60 con 0x7f986c076040 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== watch-notify(notify_complete (2) cookie 94894518059440 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564e5a061e10 con 0x7f986c076040 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.636+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:139 8.e 8:746b6bee:root::.bucket.meta.myfoo6%3af341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a2610 con 0x564e5a048f60 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.637+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(139 .bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [call,call,delete] v34'10 uv10 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.637+0000 7f987bd21800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9 from cache 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.637+0000 7f987bd21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:f341815c-ea59-4c61-b01b-010b058e6023.4227.9, ofs0, ns] 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.637+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94894518059440 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a3100 con 0x564e5a048f60 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== watch-notify(notify (1) cookie 94894517739456 notify 146028888094 ret 0) ==== 249+0+0 (crc 0 0 0) 0x564e5a092f60 con 0x564e5a048f60 2024-04-24T01:25:25.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9756ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94894517739456 notifier 4752 bl.length()=207 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(140 notify.5 [notify cookie 94894518059440 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9756ffd640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f973c003d60 con 0x564e5a048f60 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== watch-notify(notify_complete (2) cookie 94894518059440 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564e5a0251a0 con 0x564e5a048f60 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:142 4.36 4:6d66b69d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0932d0 con 0x564e5a044570 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 4.d 4:b2990e99:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a35b0 con 0x7f986c076040 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:144 4.3a 4:5f636b84:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0b0100 con 0x564e5a04d910 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:145 4.26 4:65a25d45:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0921e0 con 0x564e5a048f60 2024-04-24T01:25:25.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:146 4.10 4:09844f2a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0925c0 con 0x564e5a04d910 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:147 4.5 4:a1b61e24:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a35b0 con 0x564e5a04d910 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.638+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:148 4.1a 4:58751e17:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0b0100 con 0x7f986c076040 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.639+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:149 4.33 4:cecf32bf:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0921e0 con 0x564e5a048f60 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.639+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:150 4.22 4:4427cc59:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0b0100 con 0x564e5a044570 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.639+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:151 4.12 4:48cb4207:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a35b0 con 0x564e5a044570 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.639+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:152 4.2f 4:f4aa6d37:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0925c0 con 0x564e5a044570 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.640+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(148 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.6 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.640+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(142 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.0 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.640+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(144 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.2 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.640+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(145 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.3 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.640+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(147 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.655 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.641+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(143 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.1 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.641+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(146 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.4 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.641+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(149 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.7 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(150 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.8 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(151 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.9 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 49 ==== osd_op_reply(152 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.9.10 [delete] v34'5 uv5 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987bd21800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/f341815c-ea59-4c61-b01b-010b058e6023.4227.9 : miss 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987bd21800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.643+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:153 6.6 6:6232d547:::pubsub..bucket.myfoo6%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a41b0 con 0x564e5a04d910 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.644+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(153 pubsub..bucket.myfoo6/f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.644+0000 7f987bd21800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.644+0000 7f987bd21800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/f341815c-ea59-4c61-b01b-010b058e6023.4227.9 info.flags=0x0 2024-04-24T01:25:25.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.644+0000 7f987bd21800 10 adding default.rgw.log++pubsub..bucket.myfoo6/f341815c-ea59-4c61-b01b-010b058e6023.4227.9 to cache LRU end 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.644+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:154 6.6 6:6232d547:::pubsub..bucket.myfoo6%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a41b0 con 0x564e5a04d910 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.645+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(154 pubsub..bucket.myfoo6/f341815c-ea59-4c61-b01b-010b058e6023.4227.9 [delete] v34'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.645+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a41b0 con 0x564e5a044570 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.646+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 50 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.646+0000 7f987bd21800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.646+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a41b0 con 0x564e5a044570 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 51 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f987bd21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94894517990096 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a048f60 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== watch-notify(notify (1) cookie 94894517739456 notify 146028888095 ret 0) ==== 212+0+0 (crc 0 0 0) 0x564e5a0251a0 con 0x564e5a048f60 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(157 notify.5 [notify cookie 94894517990096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f97567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94894517739456 notifier 4752 bl.length()=170 2024-04-24T01:25:25.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.647+0000 7f97567fc640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f96ac0032c0 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.648+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== watch-notify(notify_complete (2) cookie 94894517990096 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564e5a0092e0 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.648+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.648+0000 7f987bd21800 10 removing email index: 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.648+0000 7f987bd21800 10 removing user buckets index 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.648+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0a41b0 con 0x564e5a044570 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 52 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f987bd21800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94894517990096 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== watch-notify(notify (1) cookie 94894517737888 notify 146028888096 ret 0) ==== 202+0+0 (crc 0 0 0) 0x564e5a0092e0 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f97567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94894517737888 notifier 4752 bl.length()=160 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(160 notify.6 [notify cookie 94894517990096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.649+0000 7f97567fc640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f96ac0032c0 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.650+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== watch-notify(notify_complete (2) cookie 94894517990096 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9868099020 con 0x564e5a048f60 2024-04-24T01:25:25.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.650+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.650+0000 7f987bd21800 10 removing user index: bud 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.650+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x7f986c076040 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.651+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(162 bud [call,call,delete] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.651+0000 7f987bd21800 10 removing default.rgw.meta+users.uid+bud from cache 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.651+0000 7f987bd21800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.651+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94894517990096 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== watch-notify(notify (1) cookie 94894517739456 notify 146028888097 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f9868099020 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f97567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94894517739456 notifier 4752 bl.length()=152 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(163 notify.5 [notify cookie 94894517990096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f97567fc640 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f96ac0032c0 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== watch-notify(notify_complete (2) cookie 94894517990096 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564e5a006630 con 0x564e5a048f60 2024-04-24T01:25:25.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.652+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.653+0000 7f972dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.653+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94894517747728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a044570 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.654+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 53 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94894517747728] v34'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.654+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94894517722000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x7f986c076040 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.657+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94894517722000] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.657+0000 7f987bd21800 20 remove_watcher() i=0 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.657+0000 7f987bd21800 2 removed watcher, disabling cache 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.657+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94894517726240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a044570 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.658+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 54 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94894517726240] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.658+0000 7f987bd21800 20 remove_watcher() i=1 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.659+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94894517719792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a04d910 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.660+0000 7f9877258640 1 -- 172.21.15.169:0/3230077790 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94894517719792] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f986c081070 con 0x564e5a04d910 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.660+0000 7f987bd21800 20 remove_watcher() i=2 2024-04-24T01:25:25.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.660+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94894517731904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x7f986c076040 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.661+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94894517731904] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x7f986c076040 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.661+0000 7f987bd21800 20 remove_watcher() i=3 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.661+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94894517736832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a044570 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.662+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 <== osd.1 v2:172.21.15.169:6800/461208471 55 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94894517736832] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9870032040 con 0x564e5a044570 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.662+0000 7f987bd21800 20 remove_watcher() i=4 2024-04-24T01:25:25.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.662+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94894517739456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a091510 con 0x564e5a048f60 2024-04-24T01:25:25.672 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.663+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94894517739456] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.663+0000 7f987bd21800 20 remove_watcher() i=5 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.663+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94894517737888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a052c20 con 0x564e5a048f60 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.664+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 51 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94894517737888] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.664+0000 7f987bd21800 20 remove_watcher() i=6 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.664+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94894517745152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e5a0512f0 con 0x564e5a048f60 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f9877a59640 1 -- 172.21.15.169:0/3230077790 <== osd.0 v2:172.21.15.142:6800/3255114084 52 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94894517745152] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9868077070 con 0x564e5a048f60 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 20 remove_watcher() i=7 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a048f60 msgr2=0x564e5a04b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a048f60 0x564e5a04b350 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e5a044570 msgr2=0x564e5a046a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e5a044570 0x564e5a046a30 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f986c076040 msgr2=0x7f986c083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.673 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f986c076040 0x7f986c083410 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564e5a04d910 msgr2=0x564e5a04fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x564e5a04d910 0x564e5a04fdd0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9740036900 msgr2=0x7f9740038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9740036900 0x7f9740038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f986c052fd0 tx=0x7f986c04f000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 msgr2=0x564e5a038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f98680497a0 tx=0x7f9868004ee0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987825a640 1 -- 172.21.15.169:0/3230077790 reap_dead start 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 shutdown_connections 2024-04-24T01:25:25.674 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/3230077790 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a031a40 0x564e5a038e60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 >> 172.21.15.169:0/3230077790 conn(0x564e5a02dd10 msgr2=0x564e5a02b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 shutdown_connections 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/3230077790 wait complete. 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 msgr2=0x7f9750038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 0x7f9750038e30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x564e5a00a590 tx=0x7f986c005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 msgr2=0x564e5a024c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.666+0000 7f987bd21800 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f986804aa30 tx=0x7f986802caa0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 shutdown_connections 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9750036970 0x7f9750038e30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/1506222092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e5a024840 0x564e5a024c60 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.675 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 >> 172.21.15.169:0/1506222092 conn(0x564e5a0188e0 msgr2=0x564e5a018ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 shutdown_connections 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/1506222092 wait complete. 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a00f980 msgr2=0x564e5a011d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x564e5a00f980 0x564e5a011d70 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e59f0f3e0 msgr2=0x564e5a00d0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x564e59f0f3e0 0x564e5a00d0a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564e5a0138c0 msgr2=0x564e5a015d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x564e5a0138c0 0x564e5a015d10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9760036950 msgr2=0x7f9760038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9760036950 0x7f9760038e10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f986c054000 tx=0x7f986c04e000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 msgr2=0x564e5a005e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 --2- 172.21.15.169:0/301402081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564e59f0b8d0 0x564e5a005e60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f986800c010 tx=0x7f9868000ed0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.676 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987825a640 1 -- 172.21.15.169:0/301402081 reap_dead start 2024-04-24T01:25:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 shutdown_connections 2024-04-24T01:25:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 >> 172.21.15.169:0/301402081 conn(0x564e59f053a0 msgr2=0x564e59f0a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 shutdown_connections 2024-04-24T01:25:25.677 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.667+0000 7f987bd21800 1 -- 172.21.15.169:0/301402081 wait complete. 2024-04-24T01:25:25.678 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T01:25:25.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-04-24T01:25:25.678 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-04-24T01:25:25.765 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:25:25.765 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:25:25.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a983f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619056532c0 0x56190565bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a983f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561905511d40 con 0x561905651780 2024-04-24T01:25:25.766 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a983f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5619054e44d0 con 0x5619056532c0 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.765+0000 7f73a6b3d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619056532c0 0x56190565bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.766+0000 7f73a733e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x561905651780 0x561905651ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:60196/0 (socket says 172.21.15.169:60196) 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.766+0000 7f73a6b3d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5619056532c0 0x56190565bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59768/0 (socket says 172.21.15.169:59768) 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.766+0000 7f73a733e640 1 -- 172.21.15.169:0/2080581385 learned_addr learned my addr 172.21.15.169:0/2080581385 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.766+0000 7f73a6b3d640 1 -- 172.21.15.169:0/2080581385 >> v1:172.21.15.142:6789/0 conn(0x561905651780 legacy=0x561905651ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.766+0000 7f73a6b3d640 1 -- 172.21.15.169:0/2080581385 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561905510590 con 0x5619056532c0 2024-04-24T01:25:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/2080581385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619056532c0 0x56190565bdc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f739000a470 tx=0x7f739001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4042c4eabe1233cc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a633c640 1 -- 172.21.15.169:0/2080581385 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7390057070 con 0x5619056532c0 2024-04-24T01:25:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a633c640 1 -- 172.21.15.169:0/2080581385 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7390052440 con 0x5619056532c0 2024-04-24T01:25:25.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a633c640 1 -- 172.21.15.169:0/2080581385 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7390052740 con 0x5619056532c0 2024-04-24T01:25:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 -- 172.21.15.169:0/2080581385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619056532c0 msgr2=0x56190565bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 --2- 172.21.15.169:0/2080581385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619056532c0 0x56190565bdc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f739000a470 tx=0x7f739001ce90 comp rx=0 tx=0).stop 2024-04-24T01:25:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 -- 172.21.15.169:0/2080581385 shutdown_connections 2024-04-24T01:25:25.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 --2- 172.21.15.169:0/2080581385 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5619056532c0 0x56190565bdc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 -- 172.21.15.169:0/2080581385 >> 172.21.15.169:0/2080581385 conn(0x56190564d3a0 msgr2=0x56190564f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 -- 172.21.15.169:0/2080581385 shutdown_connections 2024-04-24T01:25:25.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.768+0000 7f73a983f800 1 -- 172.21.15.169:0/2080581385 wait complete. 2024-04-24T01:25:25.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.780+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.780+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.780+0000 7f73a983f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.780+0000 7f73a983f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56190559e3b0 con 0x561905651780 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59776/0 (socket says 172.21.15.169:59776) 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f73a733e640 1 -- 172.21.15.169:0/2079331522 learned_addr learned my addr 172.21.15.169:0/2079331522 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f73a733e640 1 -- 172.21.15.169:0/2079331522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561905746a70 con 0x561905651780 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f73a733e640 1 --2- 172.21.15.169:0/2079331522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7398001610 tx=0x7f7398006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321d593501229f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f729560a640 1 -- 172.21.15.169:0/2079331522 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398004520 con 0x561905651780 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f729560a640 1 -- 172.21.15.169:0/2079331522 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980046e0 con 0x561905651780 2024-04-24T01:25:25.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.781+0000 7f729560a640 1 -- 172.21.15.169:0/2079331522 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398004a80 con 0x561905651780 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- 172.21.15.169:0/2079331522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 msgr2=0x5619057464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 --2- 172.21.15.169:0/2079331522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f7398001610 tx=0x7f7398006f90 comp rx=0 tx=0).stop 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- 172.21.15.169:0/2079331522 shutdown_connections 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 --2- 172.21.15.169:0/2079331522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x5619057464a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- 172.21.15.169:0/2079331522 >> 172.21.15.169:0/2079331522 conn(0x56190564d3a0 msgr2=0x561905741dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- 172.21.15.169:0/2079331522 shutdown_connections 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- 172.21.15.169:0/2079331522 wait complete. 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.782+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a983f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x56190574e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a983f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56190565e5e0 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x56190574e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x56190574e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59778/0 (socket says 172.21.15.169:59778) 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a733e640 1 -- 172.21.15.169:0/952146457 learned_addr learned my addr 172.21.15.169:0/952146457 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a733e640 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190574e590 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a733e640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x56190574e050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f739800f000 tx=0x7f7398000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f7293e07640 1 -- 172.21.15.169:0/952146457 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398022030 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f7293e07640 1 -- 172.21.15.169:0/952146457 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7398019040 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56190574e820 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f7293e07640 1 -- 172.21.15.169:0/952146457 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398014af0 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.783+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619057514d0 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.784+0000 7f7293e07640 1 -- 172.21.15.169:0/952146457 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7398025070 con 0x561905651780 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.784+0000 7f7293e07640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f728c036950 0x7f728c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.784+0000 7f7293e07640 1 -- 172.21.15.169:0/952146457 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7398023070 con 0x561905651780 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f728c036950 0x7f728c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619056532c0 0x561905755290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905755860 con 0x5619056532c0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619056532c0 0x561905755290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f728c036950 0x7f728c038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7390054000 tx=0x7f739004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619056532c0 0x561905755290 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a7b3f640 1 -- 172.21.15.169:0/952146457 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00083e0 con 0x5619056532c0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.785+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905752840 con 0x5619056532c0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.786+0000 7f73a7b3f640 1 -- 172.21.15.169:0/952146457 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73a00083e0 con 0x5619056532c0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.786+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561905757b70 0x561905759f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.786+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190575a650 con 0x561905757b70 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.786+0000 7f73a733e640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561905757b70 0x561905759f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.786+0000 7f73a733e640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561905757b70 0x561905759f60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a733e640 1 -- 172.21.15.169:0/952146457 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f739800f030 con 0x561905757b70 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905756af0 con 0x5619056532c0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a7b3f640 1 -- 172.21.15.169:0/952146457 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73a00083e0 con 0x5619056532c0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56190575bab0 0x56190575df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190575e690 con 0x56190575bab0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56190575bab0 0x56190575df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.787+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56190575bab0 0x56190575df00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a6b3d640 1 -- 172.21.15.169:0/952146457 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7390052610 con 0x56190575bab0 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a983f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a983f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5619055446b0 con 0x56190576ca80 2024-04-24T01:25:25.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59794/0 (socket says 172.21.15.169:59794) 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.788+0000 7f73a733e640 1 -- 172.21.15.169:0/4047389098 learned_addr learned my addr 172.21.15.169:0/4047389098 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f73a733e640 1 -- 172.21.15.169:0/4047389098 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190576d3e0 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f73a733e640 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f739801d520 tx=0x7f73980263b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f7291602640 1 -- 172.21.15.169:0/4047389098 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398044930 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f7291602640 1 -- 172.21.15.169:0/4047389098 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7398044ad0 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56190576de50 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f7291602640 1 -- 172.21.15.169:0/4047389098 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398044dd0 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.789+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56190576de50 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f7291602640 1 -- 172.21.15.169:0/4047389098 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7398010070 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f7291602640 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 0x7f7280038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f7291602640 1 -- 172.21.15.169:0/4047389098 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7398043050 con 0x56190576ca80 2024-04-24T01:25:25.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 0x7f7280038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.790+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 0x7f7280038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561905755d10 tx=0x7f7390005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a983f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a983f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x561905746df0 con 0x561905779a10 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59800/0 (socket says 172.21.15.169:59800) 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a733e640 1 -- 172.21.15.169:0/2525739157 learned_addr learned my addr 172.21.15.169:0/2525739157 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a733e640 1 -- 172.21.15.169:0/2525739157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56190577a3e0 con 0x561905779a10 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f73a733e640 1 --2- 172.21.15.169:0/2525739157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7398006fb0 tx=0x7f7398012bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21180d50dfc4b003 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f728affd640 1 -- 172.21.15.169:0/2525739157 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73980128d0 con 0x561905779a10 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f728affd640 1 -- 172.21.15.169:0/2525739157 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f739805c070 con 0x561905779a10 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.791+0000 7f728affd640 1 -- 172.21.15.169:0/2525739157 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398029440 con 0x561905779a10 2024-04-24T01:25:25.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- 172.21.15.169:0/2525739157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 msgr2=0x561905779e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 --2- 172.21.15.169:0/2525739157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7398006fb0 tx=0x7f7398012bb0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- 172.21.15.169:0/2525739157 shutdown_connections 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 --2- 172.21.15.169:0/2525739157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905779e10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- 172.21.15.169:0/2525739157 >> 172.21.15.169:0/2525739157 conn(0x561905775ce0 msgr2=0x561905773d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- 172.21.15.169:0/2525739157 shutdown_connections 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- 172.21.15.169:0/2525739157 wait complete. 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 Processor -- start 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- start start 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905780e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a983f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x56190577aad0 con 0x561905779a10 2024-04-24T01:25:25.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905780e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a733e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905780e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:59810/0 (socket says 172.21.15.169:59810) 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.792+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 learned_addr learned my addr 172.21.15.169:0/4282911256 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561905781360 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f73a733e640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905780e20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7398015d70 tx=0x7f7398008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f72897fa640 1 -- 172.21.15.169:0/4282911256 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7398011830 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f72897fa640 1 -- 172.21.15.169:0/4282911256 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73980119d0 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f72897fa640 1 -- 172.21.15.169:0/4282911256 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73980123c0 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561905781360 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.793+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561905781360 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f72897fa640 1 -- 172.21.15.169:0/4282911256 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7398012560 con 0x561905779a10 2024-04-24T01:25:25.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f72897fa640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7270036900 0x7f7270038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f72897fa640 1 -- 172.21.15.169:0/4282911256 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f7398069070 con 0x561905779a10 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7270036900 0x7f7270038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56190578c370 0x56190578e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190578ef80 con 0x56190578c370 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7270036900 0x7f7270038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7390052fd0 tx=0x7f739004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.794+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56190578c370 0x56190578e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56190578c370 0x56190578e830 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00083e0 con 0x56190578c370 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 realm 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190578f390 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00083e0 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a00083e0 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.795+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905790000 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f73a00083e0 con 0x56190578c370 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619057909c0 0x561905792db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905793400 con 0x5619057909c0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a733e640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619057909c0 0x561905792db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a733e640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619057909c0 0x561905792db0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.796+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a983f800 20 searching for the correct realm 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561905795390 0x561905797850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561905797f20 con 0x561905795390 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561905795390 0x561905797850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561905795390 0x561905797850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a6b3d640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7390076040 0x7f7390083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x561905797f20 con 0x7f7390076040 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.797+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7390076040 0x7f7390083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:25:25.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.798+0000 7f73a7b3f640 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7390076040 0x7f7390083410 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.798+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00083e0 con 0x7f7390076040 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.798+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x5619057909c0 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a00083e0 con 0x56190578c370 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.826 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.799+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x5619057909c0 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x7f7390076040 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x561905795390 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.800+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x5619057909c0 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x56190578c370 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x7f7390076040 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.801+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56190578fc60 con 0x561905795390 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x5619057909c0 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.802+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x56190578c370 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x56190578c370 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.803+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x5619057909c0 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x7f7390076040 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x56190578c370 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.804+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x5619057909c0 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x5619057909c0 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x7f7390076040 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.805+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x561905795390 2024-04-24T01:25:25.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x5619057909c0 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x56190578c370 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.806+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f7390090040 con 0x7f7390076040 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.832 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057937a0 con 0x56190578c370 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057937a0 con 0x56190578c370 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057937a0 con 0x7f7390076040 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 zone default found 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 4 Realm: () 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:25:25.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 zonegroup default 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.807+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905794040 con 0x5619057909c0 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905799d80 con 0x561905795390 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190579a120 con 0x561905795390 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 started sync module instance, tier type = 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.808+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561905799220 con 0x7f7390076040 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.810+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.810+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94665466025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561905799220 con 0x7f7390076040 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.810+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579a970 con 0x56190578c370 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.811+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94665466025488] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.811+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.811+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94665466023760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579a970 con 0x56190578c370 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.811+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579b390 con 0x561905795390 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.813+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94665466023760] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.813+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.813+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94665466029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579a8e0 con 0x561905795390 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.813+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579c250 con 0x7f7390076040 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.814+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.814+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94665466036128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579caf0 con 0x7f7390076040 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.814+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579d570 con 0x56190578c370 2024-04-24T01:25:25.836 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.814+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94665466029248] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.842 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.815+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94665466036128] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.815+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.815+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94665466040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579c540 con 0x56190578c370 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.816+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579de40 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.817+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.817+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94665466040448] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.817+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94665466034048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579c520 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.817+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579e460 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.818+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94665466034048] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.818+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.843 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.818+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94665466042768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579e460 con 0x5619057909c0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.818+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579eea0 con 0x5619057909c0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94665466042768] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94665466046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579f310 con 0x5619057909c0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=0 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=1 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=2 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=3 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=4 2024-04-24T01:25:25.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=5 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.819+0000 7f73a983f800 20 add_watcher() i=6 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94665466046832] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a983f800 20 add_watcher() i=7 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a983f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56190579f310 con 0x56190578c370 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.820+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94665466048096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56190579f2f0 con 0x56190578c370 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.823+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94665466048096] v34'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.823+0000 7f725dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.823+0000 7f73a983f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:25:25.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.823+0000 7f73a983f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.823+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057aac70 con 0x56190578c370 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.824+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'59 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.824+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ab340 con 0x5619057909c0 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.825+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.825+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ab340 con 0x561905795390 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.826+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.826+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057abe00 con 0x56190578c370 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.827+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'230 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.827+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8af0 con 0x7f7390076040 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.828+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'80 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.828+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8a90 con 0x561905795390 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.829+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'59 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.829+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ac960 con 0x56190578c370 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.830+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.830+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ac960 con 0x5619057909c0 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.832+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'53 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.832+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ac960 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.833+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.833+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ac960 con 0x561905795390 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.834+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.834+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.835+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'81 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.835+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x5619057909c0 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.836+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.836+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.837+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.837+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x5619057909c0 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.838+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'66 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.838+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x56190578c370 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.839+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'231 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.839+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x561905795390 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.840+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'71 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.840+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x7f7390076040 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.841+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'82 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.841+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x561905795390 2024-04-24T01:25:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.842+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'39 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.842+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x56190578c370 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.844+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.844+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x56190578c370 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.845+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'232 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.845+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.846+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'72 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.846+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x7f7390076040 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.847+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.847+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ace10 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.848+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.848+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057acfe0 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.849+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'45 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.849+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x561905795390 2024-04-24T01:25:25.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.850+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.850+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x561905795390 2024-04-24T01:25:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.851+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'60 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.851+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x5619057909c0 2024-04-24T01:25:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.852+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.852+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x561905795390 2024-04-24T01:25:25.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.853+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.854 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.853+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x5619057909c0 2024-04-24T01:25:25.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.854+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'54 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.855 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.854+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x561905795390 2024-04-24T01:25:25.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.855+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'73 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.856 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.855+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x5619057909c0 2024-04-24T01:25:25.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.857+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'67 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.857+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057a8410 con 0x7f7390076040 2024-04-24T01:25:25.859 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f725cfe1640 20 reqs_thread_entry: start 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a983f800 20 init_complete bucket index max shards: 11 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a983f800 20 Filter name: none 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f71d67fc640 20 reqs_thread_entry: start 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a983f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.858+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057d7df0 con 0x5619057909c0 2024-04-24T01:25:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=380 2024-04-24T01:25:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a983f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-04-24T01:25:25.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a983f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a983f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.859+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057da6e0 con 0x5619057909c0 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 : miss 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:96 8.f 8:f5152267:root::.bucket.meta.myfoo7%3af341815c-ea59-4c61-b01b-010b058e6023.4227.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057da5c0 con 0x561905795390 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=382 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 info.flags=0x17 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 to cache LRU end 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 2024-04-24T01:25:25.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.860+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 4.c 4:32c29575:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857ad0 con 0x56190578c370 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(97 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 4.13 4:c829e0bb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857ad0 con 0x7f7390076040 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(98 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 4.36 4:6c72a101:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857ad0 con 0x56190578c370 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(99 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0026040 con 0x56190578c370 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.861+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:100 4.d 4:b1f142ec:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857ad0 con 0x7f7390076040 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(100 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0026040 con 0x7f7390076040 2024-04-24T01:25:25.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:101 4.2a 4:57f3b9fa:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857580 con 0x56190578c370 2024-04-24T01:25:25.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(101 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619058575c0 con 0x561905795390 2024-04-24T01:25:25.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(102 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [call out=378b] v0'0 uv5 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a983f800 10 cls_bucket_list_unordered: got fourteen 2024-04-24T01:25:25.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.862+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:103 4.21 4:87e3d5e2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619058575c0 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.863+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(103 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.863+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:104 4.11 4:8956f3fb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619058575c0 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.864+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(104 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.864+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:105 4.11 4:8a1444a3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619058575c0 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.864+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(105 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.864+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:106 4.18 4:19086861:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857540 con 0x7f7390076040 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.865+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(106 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.865+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 4.e 4:70bbc91c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905857540 con 0x7f7390076040 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.865+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(107 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.865+0000 7f73a983f800 20 get_obj_state: octx=0x7f739801dc70 obj=myfoo7:fourteen state=0x561905855b78 s->prefetch_data=0 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.865+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:108 3.36s0 3:6d6ba8c3:::f341815c-ea59-4c61-b01b-010b058e6023.4227.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619058564f0 con 0x7f7390076040 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(108 f341815c-ea59-4c61-b01b-010b058e6023.4227.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 10 manifest: total_size = 8 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.13522668190986795565 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 20 get_obj_state: octx=0x7f739801dc70 obj=myfoo7:fourteen state=0x561905855b78 s->prefetch_data=0 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 20 prepare_atomic_modification: state is not atomic. state=0x561905855b78 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.866+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561905856d70 con 0x561905795390 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.867+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(109 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.867+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:110 3.36s0 3:6d6ba8c3:::f341815c-ea59-4c61-b01b-010b058e6023.4227.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561905856d70 con 0x7f7390076040 2024-04-24T01:25:25.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(110 f341815c-ea59-4c61-b01b-010b058e6023.4227.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:111 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x561905856cc0 con 0x561905795390 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a983f800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a983f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:112 4.c 4:32c29575:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905856cc0 con 0x56190578c370 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.868+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:113 4.13 4:c829e0bb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057e2fc0 con 0x7f7390076040 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:114 4.36 4:6c72a101:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057e5900 con 0x56190578c370 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:115 4.d 4:b1f142ec:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057e8660 con 0x7f7390076040 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:116 4.2a 4:57f3b9fa:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057eb480 con 0x56190578c370 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:117 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057ee2b0 con 0x561905795390 2024-04-24T01:25:25.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:118 4.21 4:87e3d5e2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f0c70 con 0x5619057909c0 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:119 4.11 4:8956f3fb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x5619057909c0 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:120 4.11 4:8a1444a3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f64a0 con 0x5619057909c0 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:121 4.18 4:19086861:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f9320 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:122 4.e 4:70bbc91c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057fc150 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(112 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(118 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(119 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(114 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(113 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(115 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(121 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(122 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.869+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(116 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.877 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(120 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f739800f030 con 0x5619057909c0 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(111 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f728a7fc640 20 handle_completion(): completion ok for obj=fourteen 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(117 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[f341815c-ea59-4c61-b01b-010b058e6023.4227.10])"; uploads.size()=0; is_truncated=0 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:123 4.c 4:32c29575:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905856c90 con 0x56190578c370 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:124 4.13 4:c829e0bb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x7f7390076040 2024-04-24T01:25:25.878 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:125 4.36 4:6c72a101:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f6420 con 0x56190578c370 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:126 4.d 4:b1f142ec:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905856c90 con 0x7f7390076040 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:127 4.2a 4:57f3b9fa:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x56190578c370 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:128 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905856c90 con 0x561905795390 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:129 4.21 4:87e3d5e2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x5619057909c0 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:130 4.11 4:8956f3fb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f6420 con 0x5619057909c0 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:131 4.11 4:8a1444a3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f8e90 con 0x5619057909c0 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:132 4.18 4:19086861:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057eb480 con 0x7f7390076040 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(123 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(124 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:133 4.e 4:70bbc91c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x561905856c90 con 0x7f7390076040 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(128 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.870+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(126 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(125 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.879 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(129 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(127 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(132 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(130 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(133 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(131 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.871+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x5619057909c0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(134 fud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x7f7390076040 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 20 rados_obj.operate() r=0 bl.length=168 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-04-24T01:25:25.880 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.872+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.873+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.873+0000 7f73a983f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a983f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94665466417952 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== watch-notify(notify (1) cookie 94665466036128 notify 146028888083 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5619057ac960 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f728a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888083 cookie 94665466036128 notifier 4759 bl.length()=150 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== osd_op_reply(137 notify.3 [notify cookie 94665466417952 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f728a7fc640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f71dc003380 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== watch-notify(notify_complete (2) cookie 94665466417952 notify 146028888083 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619057aa600 con 0x7f7390076040 2024-04-24T01:25:25.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.874+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:139 8.f 8:f5152267:root::.bucket.meta.myfoo7%3af341815c-ea59-4c61-b01b-010b058e6023.4227.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x561905795390 2024-04-24T01:25:25.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.875+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(139 .bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 [call,call,delete] v34'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.875+0000 7f73a983f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10 from cache 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.875+0000 7f73a983f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:f341815c-ea59-4c61-b01b-010b058e6023.4227.10, ofs0, ns] 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.875+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94665466417952 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f3620 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== watch-notify(notify (1) cookie 94665466025488 notify 146028888084 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5619057aa600 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f728a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94665466025488 notifier 4759 bl.length()=208 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f728a7fc640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f71dc003380 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== osd_op_reply(140 notify.0 [notify cookie 94665466417952 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 42 ==== watch-notify(notify_complete (2) cookie 94665466417952 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619057ab010 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:142 4.c 4:32c29575:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f9320 con 0x56190578c370 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 4.13 4:c829e0bb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x7f7390076040 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:144 4.36 4:6c72a101:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057e8ad0 con 0x56190578c370 2024-04-24T01:25:25.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:145 4.d 4:b1f142ec:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057e9360 con 0x7f7390076040 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:146 4.2a 4:57f3b9fa:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ea140 con 0x56190578c370 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:147 4.19 4:98de113a:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057d8870 con 0x561905795390 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:148 4.21 4:87e3d5e2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f9320 con 0x5619057909c0 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:149 4.11 4:8956f3fb:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057e8ad0 con 0x5619057909c0 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:150 4.11 4:8a1444a3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057eb930 con 0x5619057909c0 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:151 4.18 4:19086861:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057ea140 con 0x7f7390076040 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.876+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:152 4.e 4:70bbc91c:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f9320 con 0x7f7390076040 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.877+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(142 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.0 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(149 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.7 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 43 ==== osd_op_reply(145 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.3 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(147 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.5 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(144 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.2 [delete] v34'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 44 ==== osd_op_reply(143 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.1 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.878+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(146 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.4 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.879+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 45 ==== osd_op_reply(152 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.10 [delete] v34'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.879+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(148 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.6 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.880+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(150 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.8 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.880+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 46 ==== osd_op_reply(151 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.10.9 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.880+0000 7f73a983f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/f341815c-ea59-4c61-b01b-010b058e6023.4227.10 : miss 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.880+0000 7f73a983f800 20 rados->read ofs=0 len=0 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.880+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:153 6.d 6:b6f99670:::pubsub..bucket.myfoo7%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f92e0 con 0x56190578c370 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.881+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(153 pubsub..bucket.myfoo7/f341815c-ea59-4c61-b01b-010b058e6023.4227.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.881+0000 7f73a983f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.881+0000 7f73a983f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/f341815c-ea59-4c61-b01b-010b058e6023.4227.10 info.flags=0x0 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.881+0000 7f73a983f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/f341815c-ea59-4c61-b01b-010b058e6023.4227.10 to cache LRU end 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.881+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:154 6.d 6:b6f99670:::pubsub..bucket.myfoo7%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x56190578c370 2024-04-24T01:25:25.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.882+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(154 pubsub..bucket.myfoo7/f341815c-ea59-4c61-b01b-010b058e6023.4227.10 [delete] v34'36 uv29 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.882+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.883+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(155 fud.buckets [call] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.883+0000 7f73a983f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.883+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f73a983f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94665466405584 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057eda80 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== watch-notify(notify (1) cookie 94665466029248 notify 146028888086 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5619057d9ae0 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f728affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94665466029248 notifier 4759 bl.length()=170 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(157 notify.2 [notify cookie 94665466405584 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.884+0000 7f728affd640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f726c003d60 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.885+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.885+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== watch-notify(notify_complete (2) cookie 94665466405584 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619057a8e30 con 0x561905795390 2024-04-24T01:25:25.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.885+0000 7f73a983f800 10 removing email index: 2024-04-24T01:25:25.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.885+0000 7f73a983f800 10 removing user buckets index 2024-04-24T01:25:25.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.885+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(159 fud.buckets [delete] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a983f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-04-24T01:25:25.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94665466291504 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057eda80 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== watch-notify(notify (1) cookie 94665466042768 notify 146028888098 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5619057acd00 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f728a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888098 cookie 94665466042768 notifier 4759 bl.length()=160 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f728a7fc640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f71dc003380 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(160 notify.6 [notify cookie 94665466291504 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.886+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.887+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== watch-notify(notify_complete (2) cookie 94665466291504 notify 146028888098 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5619057514d0 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.887+0000 7f73a983f800 10 removing user index: fud 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.887+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(162 fud [call,call,delete] v34'11 uv11 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a983f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a983f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94665466291504 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== watch-notify(notify (1) cookie 94665466034048 notify 146028888099 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5619057514d0 con 0x5619057909c0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f728affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888099 cookie 94665466034048 notifier 4759 bl.length()=152 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== osd_op_reply(163 notify.5 [notify cookie 94665466291504 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f728affd640 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f726c003d60 con 0x5619057909c0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== watch-notify(notify_complete (2) cookie 94665466291504 notify 146028888099 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f739802c030 con 0x5619057909c0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.888+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.889+0000 7f725dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.889+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94665466048096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x56190578c370 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.890+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94665466048096] v34'233 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.890+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94665466025488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x7f7390076040 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.891+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 47 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94665466025488] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.891+0000 7f73a983f800 20 remove_watcher() i=0 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.891+0000 7f73a983f800 2 removed watcher, disabling cache 2024-04-24T01:25:25.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.891+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94665466023760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x56190578c370 2024-04-24T01:25:25.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.893+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94665466023760] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.893+0000 7f73a983f800 20 remove_watcher() i=1 2024-04-24T01:25:25.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.893+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94665466029248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x561905795390 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.894+0000 7f73a6b3d640 1 -- 172.21.15.169:0/4282911256 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94665466029248] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7390081070 con 0x561905795390 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.894+0000 7f73a983f800 20 remove_watcher() i=2 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.894+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94665466036128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x7f7390076040 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.895+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.2 v2:172.21.15.169:6808/1447817104 48 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94665466036128] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x7f7390076040 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.895+0000 7f73a983f800 20 remove_watcher() i=3 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.895+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94665466040448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x56190578c370 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.896+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94665466040448] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f73a0040060 con 0x56190578c370 2024-04-24T01:25:25.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.896+0000 7f73a983f800 20 remove_watcher() i=4 2024-04-24T01:25:25.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.896+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94665466034048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.897+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 51 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94665466034048] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.897+0000 7f73a983f800 20 remove_watcher() i=5 2024-04-24T01:25:25.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.897+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94665466042768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.898+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 52 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94665466042768] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.898+0000 7f73a983f800 20 remove_watcher() i=6 2024-04-24T01:25:25.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.898+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94665466046832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5619057f62d0 con 0x5619057909c0 2024-04-24T01:25:25.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.899+0000 7f73a733e640 1 -- 172.21.15.169:0/4282911256 <== osd.0 v2:172.21.15.142:6800/3255114084 53 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94665466046832] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7398094040 con 0x5619057909c0 2024-04-24T01:25:25.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.899+0000 7f73a983f800 20 remove_watcher() i=7 2024-04-24T01:25:25.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.899+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619057909c0 msgr2=0x561905792db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.899+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5619057909c0 0x561905792db0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56190578c370 msgr2=0x56190578e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x56190578c370 0x56190578e830 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7390076040 msgr2=0x7f7390083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f7390076040 0x7f7390083410 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561905795390 msgr2=0x561905797850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x561905795390 0x561905797850 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7270036900 msgr2=0x7f7270038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7270036900 0x7f7270038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7390052fd0 tx=0x7f739004f000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 msgr2=0x561905780e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4282911256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905779a10 0x561905780e20 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7398015d70 tx=0x7f7398008f40 comp rx=0 tx=0).stop 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 reap_dead start 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a7b3f640 1 -- 172.21.15.169:0/4282911256 reap_dead start 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 shutdown_connections 2024-04-24T01:25:25.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 >> 172.21.15.169:0/4282911256 conn(0x561905775ce0 msgr2=0x561905773340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 shutdown_connections 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4282911256 wait complete. 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 msgr2=0x7f7280038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 0x7f7280038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x561905755d10 tx=0x7f7390005a00 comp rx=0 tx=0).stop 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 msgr2=0x56190576cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f739801d520 tx=0x7f73980263b0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 shutdown_connections 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f7280036900 0x7f7280038dc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 --2- 172.21.15.169:0/4047389098 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56190576ca80 0x56190576cea0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 >> 172.21.15.169:0/4047389098 conn(0x561905760b20 msgr2=0x561905760f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 shutdown_connections 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/4047389098 wait complete. 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.900+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561905757b70 msgr2=0x561905759f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x561905757b70 0x561905759f60 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619056532c0 msgr2=0x561905755290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5619056532c0 0x561905755290 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56190575bab0 msgr2=0x56190575df00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x56190575bab0 0x56190575df00 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f728c036950 msgr2=0x7f728c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f728c036950 0x7f728c038e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7390054000 tx=0x7f739004e000 comp rx=0 tx=0).stop 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 msgr2=0x56190574e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 --2- 172.21.15.169:0/952146457 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561905651780 0x56190574e050 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f739800f000 tx=0x7f7398000f40 comp rx=0 tx=0).stop 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a7b3f640 1 -- 172.21.15.169:0/952146457 reap_dead start 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 shutdown_connections 2024-04-24T01:25:25.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 >> 172.21.15.169:0/952146457 conn(0x56190564d3a0 msgr2=0x561905740620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:25:25.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 shutdown_connections 2024-04-24T01:25:25.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:25:25.901+0000 7f73a983f800 1 -- 172.21.15.169:0/952146457 wait complete. 2024-04-24T01:26:05.911 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-04-24T01:26:05.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-04-24T01:26:05.912 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-04-24T01:26:05.962 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:05.962 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:05.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.962+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:05.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:05.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f3693a12800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bfe4f2ef90 0x55bfe4f2f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f3693a12800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bfe4dedd40 con 0x55bfe4f30100 2024-04-24T01:26:05.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f3693a12800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55bfe4dc04d0 con 0x55bfe4f2ef90 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f368f15c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55bfe4f2ef90 0x55bfe4f2f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f368e95b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55bfe4f30100 0x55bfe4f30580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50622/0 (socket says 172.21.15.169:50622) 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.963+0000 7f368e95b640 1 -- 172.21.15.169:0/2563409675 learned_addr learned my addr 172.21.15.169:0/2563409675 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.964+0000 7f368f15c640 1 -- 172.21.15.169:0/2563409675 >> v1:172.21.15.142:6789/0 conn(0x55bfe4f30100 legacy=0x55bfe4f30580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.964+0000 7f368f15c640 1 -- 172.21.15.169:0/2563409675 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe4dec590 con 0x55bfe4f2ef90 2024-04-24T01:26:05.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.964+0000 7f368e15a640 1 -- 172.21.15.169:0/2563409675 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038683346 0 0) 0x55bfe4dedd40 con 0x55bfe4f30100 2024-04-24T01:26:05.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f368f15c640 1 --2- 172.21.15.169:0/2563409675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe4f2f3b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3680005fd0 tx=0x7f368001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed74dce770e80a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f368e15a640 1 -- 172.21.15.169:0/2563409675 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680052560 con 0x55bfe4f2ef90 2024-04-24T01:26:05.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f368e15a640 1 -- 172.21.15.169:0/2563409675 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680052700 con 0x55bfe4f2ef90 2024-04-24T01:26:05.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f368e15a640 1 -- 172.21.15.169:0/2563409675 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680052a20 con 0x55bfe4f2ef90 2024-04-24T01:26:05.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f3693a12800 1 -- 172.21.15.169:0/2563409675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 msgr2=0x55bfe4f2f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:05.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f3693a12800 1 --2- 172.21.15.169:0/2563409675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe4f2f3b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f3680005fd0 tx=0x7f368001ccc0 comp rx=0 tx=0).stop 2024-04-24T01:26:05.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f3693a12800 1 -- 172.21.15.169:0/2563409675 shutdown_connections 2024-04-24T01:26:05.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f3693a12800 1 --2- 172.21.15.169:0/2563409675 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe4f2f3b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:05.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.966+0000 7f3693a12800 1 -- 172.21.15.169:0/2563409675 >> 172.21.15.169:0/2563409675 conn(0x55bfe4f2a530 msgr2=0x55bfe4f2c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:05.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.967+0000 7f3693a12800 1 -- 172.21.15.169:0/2563409675 shutdown_connections 2024-04-24T01:26:05.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.967+0000 7f3693a12800 1 -- 172.21.15.169:0/2563409675 wait complete. 2024-04-24T01:26:05.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.980+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:05.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.980+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:05.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f3693a12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f3693a12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bfe4e7a3c0 con 0x55bfe4f2ef90 2024-04-24T01:26:05.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43370/0 (socket says 172.21.15.169:43370) 2024-04-24T01:26:05.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f368f15c640 1 -- 172.21.15.169:0/2280972484 learned_addr learned my addr 172.21.15.169:0/2280972484 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:05.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.981+0000 7f368f15c640 1 -- 172.21.15.169:0/2280972484 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe50208c0 con 0x55bfe4f2ef90 2024-04-24T01:26:05.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f368f15c640 1 --2- 172.21.15.169:0/2280972484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f368000a3f0 tx=0x7f368004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29ea9be32bbfeeb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f357d60a640 1 -- 172.21.15.169:0/2280972484 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36800528b0 con 0x55bfe4f2ef90 2024-04-24T01:26:05.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f357d60a640 1 -- 172.21.15.169:0/2280972484 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680052c10 con 0x55bfe4f2ef90 2024-04-24T01:26:05.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f357d60a640 1 -- 172.21.15.169:0/2280972484 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f368005c430 con 0x55bfe4f2ef90 2024-04-24T01:26:05.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f3693a12800 1 -- 172.21.15.169:0/2280972484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 msgr2=0x55bfe50202f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.982+0000 7f3693a12800 1 --2- 172.21.15.169:0/2280972484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f368000a3f0 tx=0x7f368004c000 comp rx=0 tx=0).stop 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- 172.21.15.169:0/2280972484 shutdown_connections 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 --2- 172.21.15.169:0/2280972484 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f2ef90 0x55bfe50202f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- 172.21.15.169:0/2280972484 >> 172.21.15.169:0/2280972484 conn(0x55bfe4f2a530 msgr2=0x55bfe501bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- 172.21.15.169:0/2280972484 shutdown_connections 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- 172.21.15.169:0/2280972484 wait complete. 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 0x55bfe5027f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f3693a12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bfe4f385a0 con 0x55bfe4f30100 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 0x55bfe5027f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 0x55bfe5027f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43380/0 (socket says 172.21.15.169:43380) 2024-04-24T01:26:05.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.983+0000 7f368f15c640 1 -- 172.21.15.169:0/2961738003 learned_addr learned my addr 172.21.15.169:0/2961738003 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f368f15c640 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe50284a0 con 0x55bfe4f30100 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f368f15c640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 0x55bfe5027f60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36800526d0 tx=0x7f3680003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f357be07640 1 -- 172.21.15.169:0/2961738003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680074070 con 0x55bfe4f30100 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f357be07640 1 -- 172.21.15.169:0/2961738003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368005dba0 con 0x55bfe4f30100 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bfe5028730 con 0x55bfe4f30100 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f357be07640 1 -- 172.21.15.169:0/2961738003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f368006f410 con 0x55bfe4f30100 2024-04-24T01:26:05.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.984+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe502b3e0 con 0x55bfe4f30100 2024-04-24T01:26:05.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.985+0000 7f357be07640 1 -- 172.21.15.169:0/2961738003 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3680077070 con 0x55bfe4f30100 2024-04-24T01:26:05.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f357be07640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3574036900 0x7f3574038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f357be07640 1 -- 172.21.15.169:0/2961738003 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f368006c070 con 0x55bfe4f30100 2024-04-24T01:26:05.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f368e95b640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3574036900 0x7f3574038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe502d190 0x55bfe502f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe502fac0 con 0x55bfe502d190 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f368f95d640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe502d190 0x55bfe502f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f368e95b640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3574036900 0x7f3574038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3684000c00 tx=0x7f36840013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.986+0000 7f368f95d640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe502d190 0x55bfe502f580 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f368f95d640 1 -- 172.21.15.169:0/2961738003 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe502d190 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe502c730 con 0x55bfe502d190 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f368f95d640 1 -- 172.21.15.169:0/2961738003 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe502d190 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe5031df0 0x55bfe50341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50348b0 con 0x55bfe5031df0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.987+0000 7f368f15c640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe5031df0 0x55bfe50341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f368f15c640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe5031df0 0x55bfe50341e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f368f15c640 1 -- 172.21.15.169:0/2961738003 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3680076030 con 0x55bfe5031df0 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5030da0 con 0x55bfe502d190 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f368f95d640 1 -- 172.21.15.169:0/2961738003 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe502d190 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bfe5035d60 0x55bfe5038190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.988+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5038920 con 0x55bfe5035d60 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.989+0000 7f368e95b640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bfe5035d60 0x55bfe5038190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.989+0000 7f368e95b640 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bfe5035d60 0x55bfe5038190 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.989+0000 7f368e95b640 1 -- 172.21.15.169:0/2961738003 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f368400f670 con 0x55bfe5035d60 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f3693a12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f3693a12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bfe4e206b0 con 0x55bfe4ea4c00 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:05.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43386/0 (socket says 172.21.15.169:43386) 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f368f15c640 1 -- 172.21.15.169:0/3704091534 learned_addr learned my addr 172.21.15.169:0/3704091534 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f368f15c640 1 -- 172.21.15.169:0/3704091534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe4ea35b0 con 0x55bfe4ea4c00 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.990+0000 7f368f15c640 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f368008c780 tx=0x7f368005b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3579602640 1 -- 172.21.15.169:0/3704091534 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680077490 con 0x55bfe4ea4c00 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3579602640 1 -- 172.21.15.169:0/3704091534 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680077c80 con 0x55bfe4ea4c00 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bfe4ea37e0 con 0x55bfe4ea4c00 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3579602640 1 -- 172.21.15.169:0/3704091534 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f368008b020 con 0x55bfe4ea4c00 2024-04-24T01:26:05.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe4ea3ce0 con 0x55bfe4ea4c00 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.991+0000 7f3579602640 1 -- 172.21.15.169:0/3704091534 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f368008b1c0 con 0x55bfe4ea4c00 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3579602640 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 0x7f3568038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3579602640 1 -- 172.21.15.169:0/3704091534 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3680087050 con 0x55bfe4ea4c00 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f368e95b640 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 0x7f3568038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f368e95b640 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 0x7f3568038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55bfe502ff50 tx=0x7f3684006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3693a12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.009 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.992+0000 7f3693a12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bfe5020b80 con 0x55bfe5056100 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43390/0 (socket says 172.21.15.169:43390) 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f368f15c640 1 -- 172.21.15.169:0/1548655500 learned_addr learned my addr 172.21.15.169:0/1548655500 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f368f15c640 1 -- 172.21.15.169:0/1548655500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe5056af0 con 0x55bfe5056100 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f368f15c640 1 --2- 172.21.15.169:0/1548655500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3680078fd0 tx=0x7f368008e830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c215c62541a789 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f3572ffd640 1 -- 172.21.15.169:0/1548655500 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36800ab070 con 0x55bfe5056100 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.993+0000 7f3572ffd640 1 -- 172.21.15.169:0/1548655500 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368006f5b0 con 0x55bfe5056100 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3572ffd640 1 -- 172.21.15.169:0/1548655500 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3680079b90 con 0x55bfe5056100 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- 172.21.15.169:0/1548655500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 msgr2=0x55bfe5056520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 --2- 172.21.15.169:0/1548655500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3680078fd0 tx=0x7f368008e830 comp rx=0 tx=0).stop 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- 172.21.15.169:0/1548655500 shutdown_connections 2024-04-24T01:26:06.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 --2- 172.21.15.169:0/1548655500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe5056520 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- 172.21.15.169:0/1548655500 >> 172.21.15.169:0/1548655500 conn(0x55bfe50523d0 msgr2=0x55bfe5050430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- 172.21.15.169:0/1548655500 shutdown_connections 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- 172.21.15.169:0/1548655500 wait complete. 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 Processor -- start 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.994+0000 7f3693a12800 1 -- start start 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f3693a12800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f3693a12800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55bfe5057150 con 0x55bfe5056100 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f368f15c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43402/0 (socket says 172.21.15.169:43402) 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 learned_addr learned my addr 172.21.15.169:0/3677631138 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe505d930 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f368f15c640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f368006f760 tx=0x7f368008e320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f35717fa640 1 -- 172.21.15.169:0/3677631138 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36800b5020 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f35717fa640 1 -- 172.21.15.169:0/3677631138 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3680066aa0 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bfe505d930 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f35717fa640 1 -- 172.21.15.169:0/3677631138 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36800ab040 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.995+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe505d930 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.996+0000 7f35717fa640 1 -- 172.21.15.169:0/3677631138 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f36800b8020 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.996+0000 7f35717fa640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f35580368b0 0x7f3558038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.996+0000 7f35717fa640 1 -- 172.21.15.169:0/3677631138 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36800bbd20 con 0x55bfe5056100 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.996+0000 7f368e95b640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f35580368b0 0x7f3558038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe50689c0 0x55bfe506ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506b5d0 con 0x55bfe50689c0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f368e95b640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f35580368b0 0x7f3558038d70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f368400ffd0 tx=0x7f3684023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f368f95d640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe50689c0 0x55bfe506ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.997+0000 7f368f95d640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe50689c0 0x55bfe506ae80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe50689c0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 realm 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506b9e0 con 0x55bfe50689c0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe50689c0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe50689c0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c650 con 0x55bfe50689c0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe50689c0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe506d010 0x55bfe506f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.998+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506fa50 con 0x55bfe506d010 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.999+0000 7f368f15c640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe506d010 0x55bfe506f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.999+0000 7f368f15c640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe506d010 0x55bfe506f400 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.999+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.999+0000 7f3693a12800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:05.999+0000 7f3693a12800 20 searching for the correct realm 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bfe50719e0 0x55bfe5073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5074570 con 0x55bfe50719e0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f368e95b640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bfe50719e0 0x55bfe5073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f368e95b640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bfe50719e0 0x55bfe5073ea0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f368e95b640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f368402e910 0x7f368403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.000+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5074570 con 0x7f368402e910 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.001+0000 7f368f95d640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f368402e910 0x7f368403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.001+0000 7f368f95d640 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f368402e910 0x7f368403a3c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.001+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36880083e0 con 0x7f368402e910 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.001+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36880083e0 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.002+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x7f368402e910 2024-04-24T01:26:06.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x7f368402e910 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.003+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.004+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x7f368402e910 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3688026040 con 0x7f368402e910 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.005+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.006+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.007+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.007+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.007+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.007+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x7f368402e910 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x7f368402e910 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.008+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.009+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.009+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.009+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.009+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x7f368402e910 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688026040 con 0x7f368402e910 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50719e0 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.010+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe506d010 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x55bfe50689c0 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3688026040 con 0x55bfe50689c0 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506c2b0 con 0x7f368402e910 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506fdf0 con 0x55bfe50689c0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.011+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506fdf0 con 0x55bfe50689c0 2024-04-24T01:26:06.032 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe506fdf0 con 0x7f368402e910 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 zone default found 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 4 Realm: () 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 zonegroup default 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5070690 con 0x55bfe506d010 2024-04-24T01:26:06.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.012+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50763d0 con 0x55bfe50719e0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5076770 con 0x55bfe50719e0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 20 started sync module instance, tier type = 2024-04-24T01:26:06.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.013+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5075870 con 0x7f368402e910 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.014+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.014+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94282669579664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5075870 con 0x7f368402e910 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.014+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5077130 con 0x55bfe50689c0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.015+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94282669579664] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.016+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.016+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94282669577632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5077130 con 0x55bfe50689c0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.016+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5077af0 con 0x55bfe50719e0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.017+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94282669577632] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.017+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.017+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94282669583488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50770a0 con 0x55bfe50719e0 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.017+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5078960 con 0x7f368402e910 2024-04-24T01:26:06.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.019+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.019+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94282669590160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50790a0 con 0x7f368402e910 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.019+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94282669583488] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.019+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5079bc0 con 0x55bfe50689c0 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.020+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94282669590160] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.020+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.020+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94282669588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5078af0 con 0x55bfe50689c0 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.020+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507a030 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.021+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94282669588192] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.021+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.021+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94282669595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507a3d0 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.021+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507adf0 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.022+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94282669595520] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.024+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.024+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94282669594256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507b6c0 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.024+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507c080 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.025+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94282669594256] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94282669601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507c080 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=0 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=1 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=2 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=3 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=4 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=5 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=6 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94282669601600] v34'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 20 add_watcher() i=7 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.026+0000 7f3693a12800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.027+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507f390 con 0x55bfe50689c0 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.027+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.027+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94282669604160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507c610 con 0x55bfe50689c0 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94282669604160] v34'234 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f3545fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f3693a12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f3693a12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f3693a12800 5 note: GC not initialized 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.028+0000 7f3544fe1640 20 reqs_thread_entry: start 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:06.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 20 Filter name: none 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f34be7fc640 20 reqs_thread_entry: start 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50b2730 con 0x55bfe50689c0 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:06.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.029+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50b51c0 con 0x55bfe506d010 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.031+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call] v34'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.031+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50b51c0 con 0x55bfe506d010 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.032+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 usage.10 [call] v34'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.033+0000 7f3545fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.033+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94282669604160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507ea40 con 0x55bfe50689c0 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.034+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94282669604160] v34'235 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.034+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94282669579664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe507bd40 con 0x7f368402e910 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.035+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94282669579664] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.035+0000 7f3693a12800 20 remove_watcher() i=0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.035+0000 7f3693a12800 2 removed watcher, disabling cache 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.035+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94282669577632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50b22d0 con 0x55bfe50689c0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.036+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94282669577632] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.036+0000 7f3693a12800 20 remove_watcher() i=1 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.036+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94282669583488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe50b22d0 con 0x55bfe50719e0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.037+0000 7f368e95b640 1 -- 172.21.15.169:0/3677631138 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94282669583488] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3684037040 con 0x55bfe50719e0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.037+0000 7f3693a12800 20 remove_watcher() i=2 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.037+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94282669590160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5076c80 con 0x7f368402e910 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.038+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94282669590160] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x7f368402e910 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.038+0000 7f3693a12800 20 remove_watcher() i=3 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.038+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94282669588192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5078690 con 0x55bfe50689c0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.040+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94282669588192] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3688035040 con 0x55bfe50689c0 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.040+0000 7f3693a12800 20 remove_watcher() i=4 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.040+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94282669595520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5076c80 con 0x55bfe506d010 2024-04-24T01:26:06.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.041+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94282669595520] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.041+0000 7f3693a12800 20 remove_watcher() i=5 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.041+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94282669594256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5079b80 con 0x55bfe506d010 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.042+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94282669594256] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.042+0000 7f3693a12800 20 remove_watcher() i=6 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.042+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94282669601600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bfe5076c80 con 0x55bfe506d010 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f368f15c640 1 -- 172.21.15.169:0/3677631138 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94282669601600] v34'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3680076030 con 0x55bfe506d010 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 20 remove_watcher() i=7 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe506d010 msgr2=0x55bfe506f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe506d010 0x55bfe506f400 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe50689c0 msgr2=0x55bfe506ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe50689c0 0x55bfe506ae80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f368402e910 msgr2=0x7f368403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f368402e910 0x7f368403a3c0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bfe50719e0 msgr2=0x55bfe5073ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55bfe50719e0 0x55bfe5073ea0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f35580368b0 msgr2=0x7f3558038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f35580368b0 0x7f3558038d70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f368400ffd0 tx=0x7f3684023040 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 msgr2=0x55bfe505d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f368f95d640 1 -- 172.21.15.169:0/3677631138 reap_dead start 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f368006f760 tx=0x7f368008e320 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 shutdown_connections 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3677631138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe5056100 0x55bfe505d3f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 >> 172.21.15.169:0/3677631138 conn(0x55bfe50523d0 msgr2=0x55bfe504fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 shutdown_connections 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3677631138 wait complete. 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 msgr2=0x7f3568038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 0x7f3568038e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55bfe502ff50 tx=0x7f3684006000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 msgr2=0x55bfe4ea3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.043+0000 7f3693a12800 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f368008c780 tx=0x7f368005b400 comp rx=0 tx=0).stop 2024-04-24T01:26:06.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 shutdown_connections 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3568036950 0x7f3568038e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/3704091534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4ea4c00 0x55bfe4ea3070 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 >> 172.21.15.169:0/3704091534 conn(0x55bfe503ae20 msgr2=0x55bfe503b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 shutdown_connections 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/3704091534 wait complete. 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe5031df0 msgr2=0x55bfe50341e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55bfe5031df0 0x55bfe50341e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe502d190 msgr2=0x55bfe502f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55bfe502d190 0x55bfe502f580 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bfe5035d60 msgr2=0x55bfe5038190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55bfe5035d60 0x55bfe5038190 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3574036900 msgr2=0x7f3574038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3574036900 0x7f3574038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3684000c00 tx=0x7f36840013b0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 msgr2=0x55bfe5027f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 --2- 172.21.15.169:0/2961738003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bfe4f30100 0x55bfe5027f60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f36800526d0 tx=0x7f3680003330 comp rx=0 tx=0).stop 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f368f95d640 1 -- 172.21.15.169:0/2961738003 reap_dead start 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 shutdown_connections 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 >> 172.21.15.169:0/2961738003 conn(0x55bfe4f2a530 msgr2=0x55bfe501a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 shutdown_connections 2024-04-24T01:26:06.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.044+0000 7f3693a12800 1 -- 172.21.15.169:0/2961738003 wait complete. 2024-04-24T01:26:06.052 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-04-24T01:26:06.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-04-24T01:26:06.053 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-04-24T01:26:06.096 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.096 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f3562a16800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55efaad94100 0x55efaad94520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f3562a16800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55efaac54d40 con 0x55efaad97140 2024-04-24T01:26:06.097 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f3562a16800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55efaac274d0 con 0x55efaad94100 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f355e084640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55efaad94100 0x55efaad94520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f355d883640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55efaad97140 0x55efaad975f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50628/0 (socket says 172.21.15.169:50628) 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.096+0000 7f355d883640 1 -- 172.21.15.169:0/1109830240 learned_addr learned my addr 172.21.15.169:0/1109830240 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.097+0000 7f355e084640 1 -- 172.21.15.169:0/1109830240 >> v1:172.21.15.142:6789/0 conn(0x55efaad97140 legacy=0x55efaad975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.097+0000 7f355e084640 1 -- 172.21.15.169:0/1109830240 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaac53590 con 0x55efaad94100 2024-04-24T01:26:06.098 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.097+0000 7f355d082640 1 -- 172.21.15.169:0/1109830240 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787622008 0 0) 0x55efaac54d40 con 0x55efaad97140 2024-04-24T01:26:06.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.098+0000 7f355e084640 1 --2- 172.21.15.169:0/1109830240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaad94520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f355000a470 tx=0x7f355001ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c9cdc5fca2232f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f355d082640 1 -- 172.21.15.169:0/1109830240 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550057070 con 0x55efaad94100 2024-04-24T01:26:06.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f355d082640 1 -- 172.21.15.169:0/1109830240 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355004ad80 con 0x55efaad94100 2024-04-24T01:26:06.099 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f355d082640 1 -- 172.21.15.169:0/1109830240 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550052590 con 0x55efaad94100 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 -- 172.21.15.169:0/1109830240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 msgr2=0x55efaad94520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 --2- 172.21.15.169:0/1109830240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaad94520 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f355000a470 tx=0x7f355001ce50 comp rx=0 tx=0).stop 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 -- 172.21.15.169:0/1109830240 shutdown_connections 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 --2- 172.21.15.169:0/1109830240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaad94520 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 -- 172.21.15.169:0/1109830240 >> 172.21.15.169:0/1109830240 conn(0x55efaad8fb00 msgr2=0x55efaad91f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 -- 172.21.15.169:0/1109830240 shutdown_connections 2024-04-24T01:26:06.100 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.099+0000 7f3562a16800 1 -- 172.21.15.169:0/1109830240 wait complete. 2024-04-24T01:26:06.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.111+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.111+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.111+0000 7f3562a16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.111+0000 7f3562a16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55efaace13c0 con 0x55efaad94100 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43422/0 (socket says 172.21.15.169:43422) 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f355e084640 1 -- 172.21.15.169:0/1182325247 learned_addr learned my addr 172.21.15.169:0/1182325247 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f355e084640 1 -- 172.21.15.169:0/1182325247 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaae87a20 con 0x55efaad94100 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f355e084640 1 --2- 172.21.15.169:0/1182325247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3550055040 tx=0x7f355004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4975a4476f13651e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f344c608640 1 -- 172.21.15.169:0/1182325247 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550057040 con 0x55efaad94100 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f344c608640 1 -- 172.21.15.169:0/1182325247 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550062070 con 0x55efaad94100 2024-04-24T01:26:06.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.112+0000 7f344c608640 1 -- 172.21.15.169:0/1182325247 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f355005d470 con 0x55efaad94100 2024-04-24T01:26:06.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- 172.21.15.169:0/1182325247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 msgr2=0x55efaae87450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 --2- 172.21.15.169:0/1182325247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3550055040 tx=0x7f355004c000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- 172.21.15.169:0/1182325247 shutdown_connections 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 --2- 172.21.15.169:0/1182325247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae87450 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- 172.21.15.169:0/1182325247 >> 172.21.15.169:0/1182325247 conn(0x55efaad8fb00 msgr2=0x55efaae82d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- 172.21.15.169:0/1182325247 shutdown_connections 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- 172.21.15.169:0/1182325247 wait complete. 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.113+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f3562a16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae8eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f3562a16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55efaad9f5b0 con 0x55efaad94100 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae8eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae8eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43436/0 (socket says 172.21.15.169:43436) 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f355e084640 1 -- 172.21.15.169:0/1776372474 learned_addr learned my addr 172.21.15.169:0/1776372474 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f355e084640 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaae8f3e0 con 0x55efaad94100 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f355e084640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae8eea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f355001ce20 tx=0x7f3550002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f344ae05640 1 -- 172.21.15.169:0/1776372474 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f355006b070 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f344ae05640 1 -- 172.21.15.169:0/1776372474 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355005d8f0 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.114+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efaae8f670 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.115+0000 7f344ae05640 1 -- 172.21.15.169:0/1776372474 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550057070 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.115+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efaae92320 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.115+0000 7f344ae05640 1 -- 172.21.15.169:0/1776372474 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f355005dbd0 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.115+0000 7f344ae05640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3444036950 0x7f3444038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.115+0000 7f344ae05640 1 -- 172.21.15.169:0/1776372474 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f355008e1e0 con 0x55efaad94100 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f355d883640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3444036950 0x7f3444038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaad97140 0x55efaae960e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaae96620 con 0x55efaad97140 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f355e885640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaad97140 0x55efaae960e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f355d883640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3444036950 0x7f3444038e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3554000c00 tx=0x7f35540013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f355e885640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaad97140 0x55efaae960e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f355e885640 1 -- 172.21.15.169:0/1776372474 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaad97140 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.116+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaae93690 con 0x55efaad97140 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.117+0000 7f355e885640 1 -- 172.21.15.169:0/1776372474 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaad97140 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.117+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaae988f0 0x55efaae9ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.117+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaae9b3b0 con 0x55efaae988f0 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.117+0000 7f355e084640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaae988f0 0x55efaae9ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.120 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.117+0000 7f355e084640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaae988f0 0x55efaae9ace0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.118+0000 7f355e084640 1 -- 172.21.15.169:0/1776372474 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f355005a040 con 0x55efaae988f0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.118+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaae978a0 con 0x55efaad97140 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.118+0000 7f355e885640 1 -- 172.21.15.169:0/1776372474 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaad97140 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.118+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55efaae9c7f0 0x55efaae9ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.118+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaae9f440 con 0x55efaae9c7f0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.119+0000 7f355d883640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55efaae9c7f0 0x55efaae9ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.119+0000 7f355d883640 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55efaae9c7f0 0x55efaae9ecb0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.119+0000 7f355d883640 1 -- 172.21.15.169:0/1776372474 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f355400f670 con 0x55efaae9c7f0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.119+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.119+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3562a16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3562a16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55efaac876b0 con 0x55efaaead8f0 2024-04-24T01:26:06.132 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43438/0 (socket says 172.21.15.169:43438) 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f355e084640 1 -- 172.21.15.169:0/2097412437 learned_addr learned my addr 172.21.15.169:0/2097412437 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f355e084640 1 -- 172.21.15.169:0/2097412437 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaaeae250 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f355e084640 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3550066710 tx=0x7f3550072e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3443fff640 1 -- 172.21.15.169:0/2097412437 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550093070 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3443fff640 1 -- 172.21.15.169:0/2097412437 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550066cf0 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efaaeaecc0 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.120+0000 7f3443fff640 1 -- 172.21.15.169:0/2097412437 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550089070 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.121+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efaaeaecc0 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.121+0000 7f3443fff640 1 -- 172.21.15.169:0/2097412437 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3550096070 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.121+0000 7f3443fff640 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 0x7f3438038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.121+0000 7f3443fff640 1 -- 172.21.15.169:0/2097412437 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3550099d60 con 0x55efaaead8f0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355d883640 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 0x7f3438038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355d883640 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 0x7f3438038d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55efaae96a90 tx=0x7f3554006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f3562a16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f3562a16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55efaae87ce0 con 0x55efaaeba8b0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43454/0 (socket says 172.21.15.169:43454) 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355e084640 1 -- 172.21.15.169:0/981890126 learned_addr learned my addr 172.21.15.169:0/981890126 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.122+0000 7f355e084640 1 -- 172.21.15.169:0/981890126 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaaebb2a0 con 0x55efaaeba8b0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f355e084640 1 --2- 172.21.15.169:0/981890126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3550064f90 tx=0x7f355008ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2352bbb38bf7c3eb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3441ffb640 1 -- 172.21.15.169:0/981890126 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550070460 con 0x55efaaeba8b0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3441ffb640 1 -- 172.21.15.169:0/981890126 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355008cbb0 con 0x55efaaeba8b0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3441ffb640 1 -- 172.21.15.169:0/981890126 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550070600 con 0x55efaaeba8b0 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 -- 172.21.15.169:0/981890126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 msgr2=0x55efaaebacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 --2- 172.21.15.169:0/981890126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f3550064f90 tx=0x7f355008ec10 comp rx=0 tx=0).stop 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 -- 172.21.15.169:0/981890126 shutdown_connections 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 --2- 172.21.15.169:0/981890126 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaebacd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 -- 172.21.15.169:0/981890126 >> 172.21.15.169:0/981890126 conn(0x55efaaeb6b80 msgr2=0x55efaaeb4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 -- 172.21.15.169:0/981890126 shutdown_connections 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.123+0000 7f3562a16800 1 -- 172.21.15.169:0/981890126 wait complete. 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f3562a16800 1 Processor -- start 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f3562a16800 1 -- start start 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f3562a16800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaec1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f3562a16800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55efaaebb900 con 0x55efaaeba8b0 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaec1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f355e084640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaec1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43456/0 (socket says 172.21.15.169:43456) 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 learned_addr learned my addr 172.21.15.169:0/1730382795 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efaaec21d0 con 0x55efaaeba8b0 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.124+0000 7f355e084640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaec1c90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3550064f90 tx=0x7f3550083f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f342ffff640 1 -- 172.21.15.169:0/1730382795 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3550085b40 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f342ffff640 1 -- 172.21.15.169:0/1730382795 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550085ce0 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55efaaec21d0 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f342ffff640 1 -- 172.21.15.169:0/1730382795 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f355005b600 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efaaec21d0 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.125+0000 7f342ffff640 1 -- 172.21.15.169:0/1730382795 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f355005b7f0 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f342ffff640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3428036900 0x7f3428038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f342ffff640 1 -- 172.21.15.169:0/1730382795 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f35500bbd10 con 0x55efaaeba8b0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f355d883640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3428036900 0x7f3428038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaaecd3d0 0x55efaaecf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaecffc0 con 0x55efaaecd3d0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f355e885640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaaecd3d0 0x55efaaecf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f355d883640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3428036900 0x7f3428038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55efaae9f840 tx=0x7f3554023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f355e885640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaaecd3d0 0x55efaaecf870 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 20 realm 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.126+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed03d0 con 0x55efaaecd3d0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed0c70 con 0x55efaaecd3d0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaaed1d70 0x55efaaed4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed46e0 con 0x55efaaed1d70 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.127+0000 7f355e084640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaaed1d70 0x55efaaed4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f355e084640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaaed1d70 0x55efaaed4160 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f3562a16800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f3562a16800 20 searching for the correct realm 2024-04-24T01:26:06.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55efaaed6730 0x55efaaed8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed92c0 con 0x55efaaed6730 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f355d883640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55efaaed6730 0x55efaaed8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.128+0000 7f355d883640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55efaaed6730 0x55efaaed8bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355d883640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f355403a3c0 0x7f355403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed92c0 con 0x7f355403a3c0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355e885640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f355403a3c0 0x7f355403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355e885640 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f355403a3c0 0x7f355403a7e0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x7f355403a3c0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.129+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.130+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x7f355403a3c0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x7f355403a3c0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.131+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f355800a4a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x7f355403a3c0 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.132+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.133+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.134+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x7f355403a3c0 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.135+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x7f355403a3c0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.136+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed6730 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaed1d70 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x55efaaecd3d0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed1010 con 0x7f355403a3c0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.137+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed5030 con 0x55efaaecd3d0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed5030 con 0x55efaaecd3d0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed5030 con 0x7f355403a3c0 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 zone default found 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 4 Realm: () 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 zonegroup default 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaed5420 con 0x55efaaed1d70 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.138+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedb120 con 0x55efaaed6730 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedb4c0 con 0x55efaaed6730 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 started sync module instance, tier type = 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.139+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaeda5c0 con 0x7f355403a3c0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.140+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.140+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94487853246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaeda5c0 con 0x7f355403a3c0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.140+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedbd10 con 0x55efaaecd3d0 2024-04-24T01:26:06.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.141+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94487853246896] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.142+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.142+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94487853244960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedbd10 con 0x55efaaecd3d0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.142+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedc6d0 con 0x55efaaed6730 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.143+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94487853244960] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.144+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.144+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94487853250656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedbc80 con 0x55efaaed6730 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.144+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedd540 con 0x7f355403a3c0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.145+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.145+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94487853257328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaeddc80 con 0x7f355403a3c0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.145+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaede7a0 con 0x55efaaecd3d0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.145+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94487853250656] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.146+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94487853257328] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.146+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.146+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94487853261424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaede760 con 0x55efaaecd3d0 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.146+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedf040 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.148+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.148+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94487853261424] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.148+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94487853255280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaede760 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.148+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedfa00 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.149+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94487853255280] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.149+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.149+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94487853263760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee02a0 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.149+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee0c60 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94487853263760] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94487853270960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee1080 con 0x55efaaed1d70 2024-04-24T01:26:06.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=0 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=1 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=2 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=3 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=4 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=5 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.150+0000 7f3562a16800 20 add_watcher() i=6 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94487853270960] v34'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f3562a16800 20 add_watcher() i=7 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f3562a16800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee40b0 con 0x55efaaecd3d0 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.151+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94487853272016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee1570 con 0x55efaaecd3d0 2024-04-24T01:26:06.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.152+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94487853272016] v34'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.152+0000 7f3414fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.152+0000 7f3562a16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.152+0000 7f3562a16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.152+0000 7f3562a16800 5 note: GC not initialized 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f338f7fe640 20 reqs_thread_entry: start 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 20 Filter name: none 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f338d7fa640 20 reqs_thread_entry: start 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaf16d60 con 0x55efaaecd3d0 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.153+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55efaaf182b0 con 0x55efaaed1d70 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.154+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.155+0000 7f3414fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.155+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94487853272016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee1500 con 0x55efaaecd3d0 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.156+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94487853272016] v34'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.156+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94487853246896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee0bd0 con 0x7f355403a3c0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.157+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94487853246896] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.157+0000 7f3562a16800 20 remove_watcher() i=0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.157+0000 7f3562a16800 2 removed watcher, disabling cache 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.157+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94487853244960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee0bd0 con 0x55efaaecd3d0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.158+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94487853244960] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.158+0000 7f3562a16800 20 remove_watcher() i=1 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.158+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94487853250656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaeda220 con 0x55efaaed6730 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.159+0000 7f355d883640 1 -- 172.21.15.169:0/1730382795 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94487853250656] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3554037040 con 0x55efaaed6730 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.159+0000 7f3562a16800 20 remove_watcher() i=2 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.159+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94487853257328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee0bd0 con 0x7f355403a3c0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.160+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94487853257328] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x7f355403a3c0 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.160+0000 7f3562a16800 20 remove_watcher() i=3 2024-04-24T01:26:06.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.160+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94487853261424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedb860 con 0x55efaaecd3d0 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.161+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94487853261424] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3558032040 con 0x55efaaecd3d0 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.161+0000 7f3562a16800 20 remove_watcher() i=4 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.161+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94487853255280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaee0bd0 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.162+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94487853255280] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.162+0000 7f3562a16800 20 remove_watcher() i=5 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.162+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94487853263760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedb860 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.163+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94487853263760] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.164+0000 7f3562a16800 20 remove_watcher() i=6 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.164+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94487853270960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55efaaedca70 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.164+0000 7f355e084640 1 -- 172.21.15.169:0/1730382795 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94487853270960] v34'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35500a4070 con 0x55efaaed1d70 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 20 remove_watcher() i=7 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaaed1d70 msgr2=0x55efaaed4160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaaed1d70 0x55efaaed4160 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaaecd3d0 msgr2=0x55efaaecf870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaaecd3d0 0x55efaaecf870 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f355403a3c0 msgr2=0x7f355403a7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f355403a3c0 0x7f355403a7e0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55efaaed6730 msgr2=0x55efaaed8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55efaaed6730 0x55efaaed8bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3428036900 msgr2=0x7f3428038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3428036900 0x7f3428038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55efaae9f840 tx=0x7f3554023040 comp rx=0 tx=0).stop 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 msgr2=0x55efaaec1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/1730382795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaeba8b0 0x55efaaec1c90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3550064f90 tx=0x7f3550083f70 comp rx=0 tx=0).stop 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 reap_dead start 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f355e885640 1 -- 172.21.15.169:0/1730382795 reap_dead start 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 shutdown_connections 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 >> 172.21.15.169:0/1730382795 conn(0x55efaaeb6b80 msgr2=0x55efaaeb41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.172 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 shutdown_connections 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/1730382795 wait complete. 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 msgr2=0x7f3438038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 0x7f3438038d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55efaae96a90 tx=0x7f3554006000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 msgr2=0x55efaaeadd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f3550066710 tx=0x7f3550072e40 comp rx=0 tx=0).stop 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 shutdown_connections 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34380368b0 0x7f3438038d70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 --2- 172.21.15.169:0/2097412437 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaaead8f0 0x55efaaeadd10 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 >> 172.21.15.169:0/2097412437 conn(0x55efaaea1990 msgr2=0x55efaaea1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 shutdown_connections 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.165+0000 7f3562a16800 1 -- 172.21.15.169:0/2097412437 wait complete. 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaae988f0 msgr2=0x55efaae9ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55efaae988f0 0x55efaae9ace0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaad97140 msgr2=0x55efaae960e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55efaad97140 0x55efaae960e0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55efaae9c7f0 msgr2=0x55efaae9ecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55efaae9c7f0 0x55efaae9ecb0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3444036950 msgr2=0x7f3444038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3444036950 0x7f3444038e10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3554000c00 tx=0x7f35540013b0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 msgr2=0x55efaae8eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 --2- 172.21.15.169:0/1776372474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efaad94100 0x55efaae8eea0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f355001ce20 tx=0x7f3550002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f355e885640 1 -- 172.21.15.169:0/1776372474 reap_dead start 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 shutdown_connections 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 >> 172.21.15.169:0/1776372474 conn(0x55efaad8fb00 msgr2=0x55efaae815f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 shutdown_connections 2024-04-24T01:26:06.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.166+0000 7f3562a16800 1 -- 172.21.15.169:0/1776372474 wait complete. 2024-04-24T01:26:06.175 INFO:teuthology.orchestra.run.smithi169.stdout:{"entries":[],"summary":[]} 2024-04-24T01:26:06.176 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-04-24T01:26:06.176 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T01:26:06.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-04-24T01:26:06.176 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-04-24T01:26:06.260 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.260 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.260+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.260+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.260+0000 7fa559d33800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c4398583e0 0x55c43985a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.260+0000 7fa559d33800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c439712d40 con 0x55c4398548d0 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.260+0000 7fa559d33800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c4396e54d0 con 0x55c4398583e0 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa54ffff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c4398583e0 0x55c43985a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa5559d1640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c4398548d0 0x55c439856cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50640/0 (socket says 172.21.15.169:50640) 2024-04-24T01:26:06.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa5559d1640 1 -- 172.21.15.169:0/497029504 learned_addr learned my addr 172.21.15.169:0/497029504 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa5551d0640 1 -- 172.21.15.169:0/497029504 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492966312 0 0) 0x55c439712d40 con 0x55c4398548d0 2024-04-24T01:26:06.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa5551d0640 1 -- 172.21.15.169:0/497029504 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa544001e10 con 0x55c4398548d0 2024-04-24T01:26:06.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa54ffff640 1 -- 172.21.15.169:0/497029504 >> v1:172.21.15.142:6789/0 conn(0x55c4398548d0 legacy=0x55c439856cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.261+0000 7fa54ffff640 1 -- 172.21.15.169:0/497029504 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c439711590 con 0x55c4398583e0 2024-04-24T01:26:06.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.263+0000 7fa54ffff640 1 --2- 172.21.15.169:0/497029504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398583e0 0x55c43985a7d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa54000a470 tx=0x7fa54001cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180d91106527ba98 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.263+0000 7fa5551d0640 1 -- 172.21.15.169:0/497029504 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa540057070 con 0x55c4398583e0 2024-04-24T01:26:06.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.263+0000 7fa5551d0640 1 -- 172.21.15.169:0/497029504 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa540052570 con 0x55c4398583e0 2024-04-24T01:26:06.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.263+0000 7fa5551d0640 1 -- 172.21.15.169:0/497029504 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa540052870 con 0x55c4398583e0 2024-04-24T01:26:06.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 -- 172.21.15.169:0/497029504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398583e0 msgr2=0x55c43985a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 --2- 172.21.15.169:0/497029504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398583e0 0x55c43985a7d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa54000a470 tx=0x7fa54001cdb0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 -- 172.21.15.169:0/497029504 shutdown_connections 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 --2- 172.21.15.169:0/497029504 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398583e0 0x55c43985a7d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 -- 172.21.15.169:0/497029504 >> 172.21.15.169:0/497029504 conn(0x55c43984e3a0 msgr2=0x55c4398507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 -- 172.21.15.169:0/497029504 shutdown_connections 2024-04-24T01:26:06.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.264+0000 7fa559d33800 1 -- 172.21.15.169:0/497029504 wait complete. 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.275+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.275+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.275+0000 7fa559d33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa559d33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c43979f3b0 con 0x55c4398548d0 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43466/0 (socket says 172.21.15.169:43466) 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa5559d1640 1 -- 172.21.15.169:0/4196836607 learned_addr learned my addr 172.21.15.169:0/4196836607 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa5559d1640 1 -- 172.21.15.169:0/4196836607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4398527d0 con 0x55c4398548d0 2024-04-24T01:26:06.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa5559d1640 1 --2- 172.21.15.169:0/4196836607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa548001de0 tx=0x7fa54800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc031ae88faf6ac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.276+0000 7fa443e07640 1 -- 172.21.15.169:0/4196836607 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548012020 con 0x55c4398548d0 2024-04-24T01:26:06.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa443e07640 1 -- 172.21.15.169:0/4196836607 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54800e5a0 con 0x55c4398548d0 2024-04-24T01:26:06.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa443e07640 1 -- 172.21.15.169:0/4196836607 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54800e900 con 0x55c4398548d0 2024-04-24T01:26:06.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 -- 172.21.15.169:0/4196836607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 msgr2=0x55c439854210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 --2- 172.21.15.169:0/4196836607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa548001de0 tx=0x7fa54800b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 -- 172.21.15.169:0/4196836607 shutdown_connections 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 --2- 172.21.15.169:0/4196836607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c439854210 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 -- 172.21.15.169:0/4196836607 >> 172.21.15.169:0/4196836607 conn(0x55c43984e3a0 msgr2=0x55c439940810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 -- 172.21.15.169:0/4196836607 shutdown_connections 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.277+0000 7fa559d33800 1 -- 172.21.15.169:0/4196836607 wait complete. 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa559d33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c43994ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa559d33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c43985b010 con 0x55c4398548d0 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c43994ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c43994ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43474/0 (socket says 172.21.15.169:43474) 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa5559d1640 1 -- 172.21.15.169:0/3408706099 learned_addr learned my addr 172.21.15.169:0/3408706099 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa5559d1640 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c43994f170 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.278+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c43994ec30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c010 tx=0x7fa548000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa442604640 1 -- 172.21.15.169:0/3408706099 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548012030 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa442604640 1 -- 172.21.15.169:0/3408706099 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54801a7a0 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c43994f400 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa442604640 1 -- 172.21.15.169:0/3408706099 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54801a950 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4399520b0 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.279+0000 7fa442604640 1 -- 172.21.15.169:0/3408706099 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa548015020 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa442604640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa43c036950 0x7fa43c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa442604640 1 -- 172.21.15.169:0/3408706099 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa548020030 con 0x55c4398548d0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa43c036950 0x7fa43c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c4398583e0 0x55c439955e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399563b0 con 0x55c4398583e0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c4398583e0 0x55c439955e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa43c036950 0x7fa43c038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa540054000 tx=0x7fa54004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c4398583e0 0x55c439955e70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.280+0000 7fa5561d2640 1 -- 172.21.15.169:0/3408706099 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c4398583e0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.281+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439953440 con 0x55c4398583e0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.281+0000 7fa5561d2640 1 -- 172.21.15.169:0/3408706099 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c4398583e0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.281+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439958700 0x55c43995aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.281+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c43995b1e0 con 0x55c439958700 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.281+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439958700 0x55c43995aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439958700 0x55c43995aaf0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa5559d1640 1 -- 172.21.15.169:0/3408706099 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa54800dcd0 con 0x55c439958700 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399576b0 con 0x55c4398583e0 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa5561d2640 1 -- 172.21.15.169:0/3408706099 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c4398583e0 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c43995c690 0x55c43995eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c43995f240 con 0x55c43995c690 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.282+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c43995c690 0x55c43995eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c43995c690 0x55c43995eae0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa54ffff640 1 -- 172.21.15.169:0/3408706099 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa540052a40 con 0x55c43995c690 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa559d33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.283+0000 7fa559d33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c4397456b0 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43484/0 (socket says 172.21.15.169:43484) 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa5559d1640 1 -- 172.21.15.169:0/1866141817 learned_addr learned my addr 172.21.15.169:0/1866141817 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa5559d1640 1 -- 172.21.15.169:0/1866141817 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c43996e000 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa5559d1640 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa54804aca0 tx=0x7fa548016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa43b7fe640 1 -- 172.21.15.169:0/1866141817 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548040040 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c43996ea70 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa43b7fe640 1 -- 172.21.15.169:0/1866141817 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548044450 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa43b7fe640 1 -- 172.21.15.169:0/1866141817 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548044730 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.284+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c43996ef70 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.285+0000 7fa43b7fe640 1 -- 172.21.15.169:0/1866141817 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa54800c540 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.285+0000 7fa43b7fe640 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 0x7fa430038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.285+0000 7fa43b7fe640 1 -- 172.21.15.169:0/1866141817 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa548046030 con 0x55c43996d6a0 2024-04-24T01:26:06.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.285+0000 7fa54ffff640 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 0x7fa430038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa54ffff640 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 0x7fa430038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c439956cb0 tx=0x7fa540005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa559d33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa559d33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c439852b50 con 0x55c43997a7c0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43500/0 (socket says 172.21.15.169:43500) 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa5559d1640 1 -- 172.21.15.169:0/1254669885 learned_addr learned my addr 172.21.15.169:0/1254669885 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa5559d1640 1 -- 172.21.15.169:0/1254669885 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c43997b1b0 con 0x55c43997a7c0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa5559d1640 1 --2- 172.21.15.169:0/1254669885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa54804c8b0 tx=0x7fa54800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e716b1bd698aaf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa4397fa640 1 -- 172.21.15.169:0/1254669885 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54802d910 con 0x55c43997a7c0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.286+0000 7fa4397fa640 1 -- 172.21.15.169:0/1254669885 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54805d070 con 0x55c43997a7c0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa4397fa640 1 -- 172.21.15.169:0/1254669885 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54802d3f0 con 0x55c43997a7c0 2024-04-24T01:26:06.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- 172.21.15.169:0/1254669885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 msgr2=0x55c43997abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 --2- 172.21.15.169:0/1254669885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa54804c8b0 tx=0x7fa54800cc00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- 172.21.15.169:0/1254669885 shutdown_connections 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 --2- 172.21.15.169:0/1254669885 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c43997abe0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- 172.21.15.169:0/1254669885 >> 172.21.15.169:0/1254669885 conn(0x55c439976a90 msgr2=0x55c439974af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- 172.21.15.169:0/1254669885 shutdown_connections 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- 172.21.15.169:0/1254669885 wait complete. 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 Processor -- start 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- start start 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c439981b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.287+0000 7fa559d33800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c43997b880 con 0x55c43997a7c0 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c439981b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa5559d1640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c439981b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43516/0 (socket says 172.21.15.169:43516) 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 learned_addr learned my addr 172.21.15.169:0/3037815413 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c439982050 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c439981b10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa548016bd0 tx=0x7fa548029f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa4277fe640 1 -- 172.21.15.169:0/3037815413 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa54804ca80 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa4277fe640 1 -- 172.21.15.169:0/3037815413 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54804cc20 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c439982050 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa4277fe640 1 -- 172.21.15.169:0/3037815413 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa548034580 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.288+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c439982050 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.289+0000 7fa4277fe640 1 -- 172.21.15.169:0/3037815413 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa548034720 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.289+0000 7fa4277fe640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa420036900 0x7fa420038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.289+0000 7fa4277fe640 1 -- 172.21.15.169:0/3037815413 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa54806fd60 con 0x55c43997a7c0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.289+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa420036900 0x7fa420038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c43998d2d0 0x55c43998f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa420036900 0x7fa420038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c43995f640 tx=0x7fa54004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c43998fee0 con 0x55c43998d2d0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c43998d2d0 0x55c43998f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c43998d2d0 0x55c43998f790 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 20 realm 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.290+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399902f0 con 0x55c43998d2d0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439990bc0 con 0x55c43998d2d0 2024-04-24T01:26:06.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439991cc0 0x55c4399940b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399946c0 con 0x55c439991cc0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.291+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439991cc0 0x55c4399940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa5559d1640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439991cc0 0x55c4399940b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa559d33800 20 searching for the correct realm 2024-04-24T01:26:06.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c439996670 0x55c439998b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439999200 con 0x55c439996670 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.292+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c439996670 0x55c439998b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c439996670 0x55c439998b30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa54ffff640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa540076040 0x7fa540083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439999200 con 0x7fa540076040 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa540076040 0x7fa540083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.293+0000 7fa5561d2640 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa540076040 0x7fa540083410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x7fa540076040 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c439991cc0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.294+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c439991cc0 2024-04-24T01:26:06.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x7fa540076040 2024-04-24T01:26:06.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x7fa540076040 2024-04-24T01:26:06.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c439996670 2024-04-24T01:26:06.314 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.295+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c439991cc0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c43998d2d0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa55000a4a0 con 0x55c43998d2d0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x7fa540076040 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.296+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c439990f60 con 0x55c439996670 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439991cc0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.315 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.297+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c43998d2d0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c43998d2d0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439991cc0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.298+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x7fa540076040 2024-04-24T01:26:06.316 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c43998d2d0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.299+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x7fa540076040 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.300+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439996670 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x55c43998d2d0 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fa540090040 con 0x7fa540076040 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.301+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439994f80 con 0x55c43998d2d0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439994f80 con 0x55c43998d2d0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439994f80 con 0x7fa540076040 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 zone default found 2024-04-24T01:26:06.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 4 Realm: () 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 zonegroup default 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439995820 con 0x55c439991cc0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.302+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c43999b060 con 0x55c439996670 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c43999b400 con 0x55c439996670 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 started sync module instance, tier type = 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.303+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a500 con 0x7fa540076040 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.304+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.304+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94301268322592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a500 con 0x7fa540076040 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.304+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999bcb0 con 0x55c43998d2d0 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.305+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94301268322592] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.306+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.306+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94301268326304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a500 con 0x55c43998d2d0 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.306+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999c700 con 0x55c439996670 2024-04-24T01:26:06.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.307+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.307+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94301268326304] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.307+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94301268328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999cfa0 con 0x55c439996670 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.307+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a070 con 0x7fa540076040 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.308+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.308+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94301268328976] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.308+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94301268333792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999d900 con 0x7fa540076040 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.308+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999e2c0 con 0x55c43998d2d0 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.309+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.309+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94301268336144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999e230 con 0x55c43998d2d0 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.309+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999f230 con 0x55c439991cc0 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.309+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94301268333792] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.310+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.310+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94301268339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999f620 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.310+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a0020 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.310+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94301268336144] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.311+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94301268339968] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.311+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.311+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94301268338352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a0410 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.311+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a0ca0 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94301268338352] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94301268343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a0870 con 0x55c439991cc0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=0 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=1 2024-04-24T01:26:06.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=2 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=3 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=4 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=5 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.312+0000 7fa559d33800 20 add_watcher() i=6 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.313+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94301268343600] v34'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.313+0000 7fa559d33800 20 add_watcher() i=7 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.313+0000 7fa559d33800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.313+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a4120 con 0x55c43998d2d0 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.314+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.314+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94301268346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a1640 con 0x55c43998d2d0 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.315+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94301268346256] v34'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.315+0000 7fa4077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.315+0000 7fa559d33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.315+0000 7fa559d33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.315+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399acab0 con 0x55c43998d2d0 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.316+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.316+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399ad100 con 0x55c439991cc0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.318+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.318+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399ad100 con 0x55c439996670 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.319+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.319+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399adbe0 con 0x55c43998d2d0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.320+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'239 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.320+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aa940 con 0x7fa540076040 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.321+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'83 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.321+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aa910 con 0x55c439996670 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.322+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'61 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.322+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399ae910 con 0x55c43998d2d0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.323+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.323+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aa890 con 0x55c439991cc0 2024-04-24T01:26:06.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.324+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'55 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.324+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aedc0 con 0x7fa540076040 2024-04-24T01:26:06.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.325+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.325+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aedc0 con 0x55c439996670 2024-04-24T01:26:06.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.326+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.326+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x7fa540076040 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.328+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'84 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.328+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x55c439991cc0 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.329+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.329+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x7fa540076040 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.330+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.330+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x55c439991cc0 2024-04-24T01:26:06.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.331+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'68 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.331+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x55c43998d2d0 2024-04-24T01:26:06.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.332+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'240 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.332+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399aee50 con 0x55c439996670 2024-04-24T01:26:06.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.333+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'74 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.334+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x7fa540076040 2024-04-24T01:26:06.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.335+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'85 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.335+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.336+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'40 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.336+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c43998d2d0 2024-04-24T01:26:06.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.337+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.337+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c43998d2d0 2024-04-24T01:26:06.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.338+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'241 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.338 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.338+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.339+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'75 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.339 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.339+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x7fa540076040 2024-04-24T01:26:06.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.340+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'44 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.340 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.340+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.341+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.341 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.341+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.342+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'46 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.342+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.343+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.343+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.344+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'62 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.344+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439991cc0 2024-04-24T01:26:06.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.345+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.345+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.346+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.346+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439991cc0 2024-04-24T01:26:06.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.347+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'56 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.347 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.347+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439996670 2024-04-24T01:26:06.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.348+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'76 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.348 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.348+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x55c439991cc0 2024-04-24T01:26:06.349 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.349+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'69 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.350 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.349+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399af460 con 0x7fa540076040 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa4067fc640 20 reqs_thread_entry: start 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 20 Filter name: none 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa377fff640 20 reqs_thread_entry: start 2024-04-24T01:26:06.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399da130 con 0x55c43998d2d0 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=391 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.351+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399da0f0 con 0x7fa540076040 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 : miss 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:96 8.8 8:1037a9d5:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399dc880 con 0x55c43998d2d0 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(96 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=379 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 info.flags=0x17 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 to cache LRU end 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.352+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 4.2e 4:74dc5db6:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59f20 con 0x55c439996670 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(97 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:98 4.34 4:2e5c5170:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59f60 con 0x7fa540076040 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(98 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:99 4.2f 4:f5d32f64:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59f60 con 0x55c43998d2d0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(99 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.353+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:100 4.b 4:d09b89f3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59f60 con 0x7fa540076040 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.354+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(100 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.354+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59f60 con 0x55c439996670 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.354+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(101 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [call out=425b] v0'0 uv5 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.354+0000 7fa559d33800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.354+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:102 4.1e 4:78115dd2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x55c439991cc0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(102 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 4.36 4:6d9f88dd:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x55c43998d2d0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(103 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 4.a 4:530bffd3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x7fa540076040 2024-04-24T01:26:06.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(104 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.355+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:105 4.1c 4:3a4b4ce9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x55c439991cc0 2024-04-24T01:26:06.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.356+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(105 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.356+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:106 4.6 4:63aa6231:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.356+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(106 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.356+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:107 4.3b 4:dfcbf57d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a5a560 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(107 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 20 get_obj_state: octx=0x7fa548015f40 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c439a58198 s->prefetch_data=0 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:108 3.39s0 3:9ee60f65:::f341815c-ea59-4c61-b01b-010b058e6023.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a59170 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(108 f341815c-ea59-4c61-b01b-010b058e6023.4227.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 10 manifest: total_size = 6 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 20 get_obj_state: setting s->obj_tag to f341815c-ea59-4c61-b01b-010b058e6023.4227.2618687133206387051 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 20 get_obj_state: octx=0x7fa548015f40 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55c439a58198 s->prefetch_data=0 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 20 prepare_atomic_modification: state is not atomic. state=0x55c439a58198 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 20 bucket index object: :.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.357+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e0f60 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.358+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(109 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.358+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:110 3.39s0 3:9ee60f65:::f341815c-ea59-4c61-b01b-010b058e6023.4227.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399def40 con 0x55c439996670 2024-04-24T01:26:06.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(110 f341815c-ea59-4c61-b01b-010b058e6023.4227.7_15f6f8dc036519d7fe15b39338f6e5db [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:111 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e1540 con 0x55c439996670 2024-04-24T01:26:06.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 20 list_objects_ordered: starting attempt 1 2024-04-24T01:26:06.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-04-24T01:26:06.366 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:112 4.2e 4:74dc5db6:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e14e0 con 0x55c439996670 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:113 4.34 4:2e5c5170:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e57f0 con 0x7fa540076040 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:114 4.2f 4:f5d32f64:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e57f0 con 0x55c43998d2d0 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(113 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.360+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:115 4.b 4:d09b89f3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e37d0 con 0x7fa540076040 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(112 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:116 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e3c40 con 0x55c439996670 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:117 4.1e 4:78115dd2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e57e0 con 0x55c439991cc0 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(114 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(115 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:118 4.36 4:6d9f88dd:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e3320 con 0x55c43998d2d0 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:119 4.a 4:530bffd3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb740 con 0x7fa540076040 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:120 4.1c 4:3a4b4ce9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399ee1c0 con 0x55c439991cc0 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 4.6 4:63aa6231:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f1000 con 0x55c439996670 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:122 4.3b 4:dfcbf57d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f3c80 con 0x55c439996670 2024-04-24T01:26:06.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(111 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa4397fa640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(116 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(120 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.361+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(121 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(117 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(122 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(118 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x55c43998d2d0 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(119 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550032040 con 0x7fa540076040 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[f341815c-ea59-4c61-b01b-010b058e6023.4227.7])"; uploads.size()=0; is_truncated=0 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:123 4.2e 4:74dc5db6:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e3c40 con 0x55c439996670 2024-04-24T01:26:06.368 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:124 4.34 4:2e5c5170:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb270 con 0x7fa540076040 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:125 4.2f 4:f5d32f64:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c43998d2d0 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:126 4.b 4:d09b89f3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e3c40 con 0x7fa540076040 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:127 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb270 con 0x55c439996670 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:128 4.1e 4:78115dd2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e3c40 con 0x55c439991cc0 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:129 4.36 4:6d9f88dd:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f0fd0 con 0x55c43998d2d0 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:130 4.a 4:530bffd3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f3af0 con 0x7fa540076040 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:131 4.1c 4:3a4b4ce9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f41d0 con 0x55c439991cc0 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:132 4.6 4:63aa6231:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f6b30 con 0x55c439996670 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:133 4.3b 4:dfcbf57d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c439996670 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(123 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(124 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1 [call out=85b] v0'0 uv9 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(127 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(125 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(129 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(132 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(131 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(130 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.370 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(128 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(126 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(133 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.362+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.363+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(134 foo.buckets [call] v34'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.363+0000 7fa559d33800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.363+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.363+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.364+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.364+0000 7fa559d33800 20 rados_obj.operate() r=0 bl.length=165 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.364+0000 7fa559d33800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.364+0000 7fa559d33800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.364+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(136 myfoo [call,call,delete] v34'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.371 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa559d33800 10 removing default.rgw.meta+root+myfoo from cache 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94301269104032 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== watch-notify(notify (1) cookie 94301268338352 notify 146028888100 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55c4399aa4b0 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa4397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888100 cookie 94301268338352 notifier 4780 bl.length()=149 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(137 notify.6 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa4397fa640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa418003d60 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.365+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.366+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888100 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c43996e000 con 0x55c439991cc0 2024-04-24T01:26:06.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.366+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:139 8.8 8:1037a9d5:root::.bucket.meta.myfoo%3af341815c-ea59-4c61-b01b-010b058e6023.4227.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c43998d2d0 2024-04-24T01:26:06.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(139 .bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.375 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7 from cache 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:f341815c-ea59-4c61-b01b-010b058e6023.4227.7, ofs0, ns] 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94301269104032 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== watch-notify(notify (1) cookie 94301268328976 notify 146028888087 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55c4399ae910 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94301268328976 notifier 4780 bl.length()=206 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa438ff9640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa3800032c0 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 43 ==== osd_op_reply(140 notify.2 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 44 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4399ae740 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 45 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:142 4.2e 4:74dc5db6:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 4.34 4:2e5c5170:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e51b0 con 0x7fa540076040 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.367+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:144 4.2f 4:f5d32f64:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399f3ad0 con 0x55c43998d2d0 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:145 4.b 4:d09b89f3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x7fa540076040 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:146 4.3a 4:5d7f6562:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399dad50 con 0x55c439996670 2024-04-24T01:26:06.376 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:147 4.1e 4:78115dd2:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e51b0 con 0x55c439991cc0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:148 4.36 4:6d9f88dd:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb690 con 0x55c43998d2d0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:149 4.a 4:530bffd3:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e44b0 con 0x7fa540076040 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:150 4.1c 4:3a4b4ce9:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x55c439991cc0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:151 4.6 4:63aa6231:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a584c0 con 0x55c439996670 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.368+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:152 4.3b 4:dfcbf57d:::.dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399e51b0 con 0x55c439996670 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.369+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(147 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.5 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.369+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(145 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.3 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.370+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(144 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.369+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 46 ==== osd_op_reply(151 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.370+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(150 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.8 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.370+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 47 ==== osd_op_reply(152 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.10 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.372+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(143 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.1 [delete] v34'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.372+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(149 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.7 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.372+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 48 ==== osd_op_reply(142 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.0 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.377 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.372+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 49 ==== osd_op_reply(146 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.4 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.374+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(148 .dir.f341815c-ea59-4c61-b01b-010b058e6023.4227.7.6 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.374+0000 7fa559d33800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.7 : miss 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.374+0000 7fa559d33800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:153 6.e 6:718cc984:::pubsub..bucket.myfoo%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x55c43998d2d0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(153 pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa559d33800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa559d33800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.7 info.flags=0x0 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa559d33800 10 adding default.rgw.log++pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.7 to cache LRU end 2024-04-24T01:26:06.378 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.375+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:154 6.e 6:718cc984:::pubsub..bucket.myfoo%2ff341815c-ea59-4c61-b01b-010b058e6023.4227.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x55c43998d2d0 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.376+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(154 pubsub..bucket.myfoo/f341815c-ea59-4c61-b01b-010b058e6023.4227.7 [delete] v34'37 uv29 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.376+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.377+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== osd_op_reply(155 foo.buckets [call] v34'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.377+0000 7fa559d33800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.377+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x55c439991cc0 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.378+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v34'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.378+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.378+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94301269104032 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== watch-notify(notify (1) cookie 94301268333792 notify 146028888085 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55c4399dbd60 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa4397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94301268333792 notifier 4780 bl.length()=170 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa4397fa640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa418003d60 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(157 notify.3 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4399aace0 con 0x7fa540076040 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa559d33800 10 removing email index: foo@foo.com 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.379+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x55c43998d2d0 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(159 foo@foo.com [delete] v34'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94301269104032 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x7fa540076040 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== watch-notify(notify (1) cookie 94301268333792 notify 146028888086 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55c4399aace0 con 0x7fa540076040 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94301268333792 notifier 4780 bl.length()=162 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(160 notify.3 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.380+0000 7fa438ff9640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa3800032a0 con 0x7fa540076040 2024-04-24T01:26:06.384 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.381+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 42 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4399aa290 con 0x7fa540076040 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.381+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 43 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.381+0000 7fa559d33800 10 removing user buckets index 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.381+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c439a57aa0 con 0x7fa540076040 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 44 ==== osd_op_reply(162 foo.buckets [delete] v34'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94301269104032 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399dc740 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== watch-notify(notify (1) cookie 94301268339968 notify 146028888101 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55c43996e000 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa4397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94301268339968 notifier 4780 bl.length()=160 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(163 notify.5 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.382+0000 7fa4397fa640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa418003d60 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.383+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4399520b0 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.383+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.385 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.383+0000 7fa559d33800 10 removing user index: foo 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.383+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399eb480 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(165 foo [call,call,delete] v34'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa559d33800 10 removing default.rgw.meta+users.uid+foo from cache 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa559d33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94301269104032 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c4399dc740 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== watch-notify(notify (1) cookie 94301268336144 notify 146028888084 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c4399aa290 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa438ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 94301268336144 notifier 4780 bl.length()=152 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(166 notify.4 [notify cookie 94301269104032 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa438ff9640 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fa3800032a0 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.386 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.384+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== watch-notify(notify_complete (2) cookie 94301269104032 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c4399ac650 con 0x55c43998d2d0 2024-04-24T01:26:06.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.385+0000 7fa4077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.387 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.385+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94301268346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a9620 con 0x55c43998d2d0 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.386+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94301268346256] v34'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.386+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94301268322592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c4399a9620 con 0x7fa540076040 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.387+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 45 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94301268322592] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.387+0000 7fa559d33800 20 remove_watcher() i=0 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.387+0000 7fa559d33800 2 removed watcher, disabling cache 2024-04-24T01:26:06.388 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.387+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94301268326304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a920 con 0x55c43998d2d0 2024-04-24T01:26:06.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.389+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94301268326304] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.389+0000 7fa559d33800 20 remove_watcher() i=1 2024-04-24T01:26:06.389 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.389+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94301268328976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a920 con 0x55c439996670 2024-04-24T01:26:06.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.390+0000 7fa54ffff640 1 -- 172.21.15.169:0/3037815413 <== osd.3 v2:172.21.15.169:6816/1313458488 50 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94301268328976] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa540081070 con 0x55c439996670 2024-04-24T01:26:06.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.390+0000 7fa559d33800 20 remove_watcher() i=2 2024-04-24T01:26:06.390 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.390+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94301268333792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999a920 con 0x7fa540076040 2024-04-24T01:26:06.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.391+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.2 v2:172.21.15.169:6808/1447817104 46 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94301268333792] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x7fa540076040 2024-04-24T01:26:06.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.391+0000 7fa559d33800 20 remove_watcher() i=3 2024-04-24T01:26:06.391 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.391+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94301268336144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999d4e0 con 0x55c43998d2d0 2024-04-24T01:26:06.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.392+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 <== osd.1 v2:172.21.15.169:6800/461208471 49 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94301268336144] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa550059040 con 0x55c43998d2d0 2024-04-24T01:26:06.392 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.392+0000 7fa559d33800 20 remove_watcher() i=4 2024-04-24T01:26:06.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.392+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94301268339968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999de10 con 0x55c439991cc0 2024-04-24T01:26:06.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.393+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94301268339968] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.393+0000 7fa559d33800 20 remove_watcher() i=5 2024-04-24T01:26:06.393 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.393+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94301268338352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999d4e0 con 0x55c439991cc0 2024-04-24T01:26:06.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.394+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94301268338352] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.394+0000 7fa559d33800 20 remove_watcher() i=6 2024-04-24T01:26:06.394 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.394+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94301268343600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c43999de10 con 0x55c439991cc0 2024-04-24T01:26:06.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa5559d1640 1 -- 172.21.15.169:0/3037815413 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94301268343600] v34'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa548055040 con 0x55c439991cc0 2024-04-24T01:26:06.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 20 remove_watcher() i=7 2024-04-24T01:26:06.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439991cc0 msgr2=0x55c4399940b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439991cc0 0x55c4399940b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.398 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c43998d2d0 msgr2=0x55c43998f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c43998d2d0 0x55c43998f790 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa540076040 msgr2=0x7fa540083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fa540076040 0x7fa540083410 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c439996670 msgr2=0x55c439998b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.395+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c439996670 0x55c439998b30 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa420036900 msgr2=0x7fa420038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa420036900 0x7fa420038dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c43995f640 tx=0x7fa54004f000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 msgr2=0x55c439981b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3037815413 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43997a7c0 0x55c439981b10 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa548016bd0 tx=0x7fa548029f20 comp rx=0 tx=0).stop 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 reap_dead start 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa5561d2640 1 -- 172.21.15.169:0/3037815413 reap_dead start 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 shutdown_connections 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 >> 172.21.15.169:0/3037815413 conn(0x55c439976a90 msgr2=0x55c4399740f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 shutdown_connections 2024-04-24T01:26:06.399 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3037815413 wait complete. 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 msgr2=0x7fa430038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 0x7fa430038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55c439956cb0 tx=0x7fa540005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 msgr2=0x55c43996dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa54804aca0 tx=0x7fa548016b00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 shutdown_connections 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa430036900 0x7fa430038dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/1866141817 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43996d6a0 0x55c43996dac0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 >> 172.21.15.169:0/1866141817 conn(0x55c439961740 msgr2=0x55c439961b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 shutdown_connections 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/1866141817 wait complete. 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439958700 msgr2=0x55c43995aaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c439958700 0x55c43995aaf0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c4398583e0 msgr2=0x55c439955e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c4398583e0 0x55c439955e70 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.400 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c43995c690 msgr2=0x55c43995eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c43995c690 0x55c43995eae0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa43c036950 msgr2=0x7fa43c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa43c036950 0x7fa43c038e10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa540054000 tx=0x7fa54004e000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 msgr2=0x55c43994ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa559d33800 1 --2- 172.21.15.169:0/3408706099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c4398548d0 0x55c43994ec30 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c010 tx=0x7fa548000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.396+0000 7fa5561d2640 1 -- 172.21.15.169:0/3408706099 reap_dead start 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.397+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 shutdown_connections 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.397+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 >> 172.21.15.169:0/3408706099 conn(0x55c43984e3a0 msgr2=0x55c4398530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.397+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 shutdown_connections 2024-04-24T01:26:06.401 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.397+0000 7fa559d33800 1 -- 172.21.15.169:0/3408706099 wait complete. 2024-04-24T01:26:06.405 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-04-24T01:26:06.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-04-24T01:26:06.405 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-04-24T01:26:06.447 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.448 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f2852d28800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55dbf39a32c0 0x55dbf39abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f2852d28800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbf3861d40 con 0x55dbf39a1780 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f2852d28800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55dbf38344d0 con 0x55dbf39a32c0 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f284e25f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55dbf39a32c0 0x55dbf39abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f284ea60640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55dbf39a1780 0x55dbf39a1ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50654/0 (socket says 172.21.15.169:50654) 2024-04-24T01:26:06.449 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.448+0000 7f284ea60640 1 -- 172.21.15.169:0/1153720349 learned_addr learned my addr 172.21.15.169:0/1153720349 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.449+0000 7f284e25f640 1 -- 172.21.15.169:0/1153720349 >> v1:172.21.15.142:6789/0 conn(0x55dbf39a1780 legacy=0x55dbf39a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.449+0000 7f284da5e640 1 -- 172.21.15.169:0/1153720349 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573554809 0 0) 0x55dbf3861d40 con 0x55dbf39a1780 2024-04-24T01:26:06.450 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.449+0000 7f284e25f640 1 -- 172.21.15.169:0/1153720349 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3860590 con 0x55dbf39a32c0 2024-04-24T01:26:06.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f284e25f640 1 --2- 172.21.15.169:0/1153720349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a32c0 0x55dbf39abdc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f284400a470 tx=0x7f284401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c531070216c56756 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f284da5e640 1 -- 172.21.15.169:0/1153720349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844057070 con 0x55dbf39a32c0 2024-04-24T01:26:06.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f284da5e640 1 -- 172.21.15.169:0/1153720349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284404adc0 con 0x55dbf39a32c0 2024-04-24T01:26:06.451 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f284da5e640 1 -- 172.21.15.169:0/1153720349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2844052590 con 0x55dbf39a32c0 2024-04-24T01:26:06.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 -- 172.21.15.169:0/1153720349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a32c0 msgr2=0x55dbf39abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 --2- 172.21.15.169:0/1153720349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a32c0 0x55dbf39abdc0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f284400a470 tx=0x7f284401ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:06.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 -- 172.21.15.169:0/1153720349 shutdown_connections 2024-04-24T01:26:06.452 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 --2- 172.21.15.169:0/1153720349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a32c0 0x55dbf39abdc0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 -- 172.21.15.169:0/1153720349 >> 172.21.15.169:0/1153720349 conn(0x55dbf399d300 msgr2=0x55dbf399f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 -- 172.21.15.169:0/1153720349 shutdown_connections 2024-04-24T01:26:06.453 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.451+0000 7f2852d28800 1 -- 172.21.15.169:0/1153720349 wait complete. 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.463+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.463+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.463+0000 7f2852d28800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.463+0000 7f2852d28800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55dbf38ee3c0 con 0x55dbf39a1780 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43536/0 (socket says 172.21.15.169:43536) 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f284ea60640 1 -- 172.21.15.169:0/2590384960 learned_addr learned my addr 172.21.15.169:0/2590384960 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f284ea60640 1 -- 172.21.15.169:0/2590384960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3a96a30 con 0x55dbf39a1780 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f284ea60640 1 --2- 172.21.15.169:0/2590384960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f284000b210 tx=0x7f284000b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f7db6ca2f15078 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f273ce09640 1 -- 172.21.15.169:0/2590384960 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2840008070 con 0x55dbf39a1780 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f273ce09640 1 -- 172.21.15.169:0/2590384960 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284000d500 con 0x55dbf39a1780 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.464+0000 7f273ce09640 1 -- 172.21.15.169:0/2590384960 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284000d840 con 0x55dbf39a1780 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- 172.21.15.169:0/2590384960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 msgr2=0x55dbf3a96460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 --2- 172.21.15.169:0/2590384960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f284000b210 tx=0x7f284000b6d0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- 172.21.15.169:0/2590384960 shutdown_connections 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 --2- 172.21.15.169:0/2590384960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a96460 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- 172.21.15.169:0/2590384960 >> 172.21.15.169:0/2590384960 conn(0x55dbf399d300 msgr2=0x55dbf3a91d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- 172.21.15.169:0/2590384960 shutdown_connections 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- 172.21.15.169:0/2590384960 wait complete. 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.465+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f2852d28800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a9e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f2852d28800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55dbf39ae5e0 con 0x55dbf39a1780 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a9e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43552/0 (socket says 172.21.15.169:43552) 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f284ea60640 1 -- 172.21.15.169:0/44519499 learned_addr learned my addr 172.21.15.169:0/44519499 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f284ea60640 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3a9e540 con 0x55dbf39a1780 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.466+0000 7f284ea60640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a9e000 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f284000b210 tx=0x7f2840000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f273b606640 1 -- 172.21.15.169:0/44519499 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284000f950 con 0x55dbf39a1780 2024-04-24T01:26:06.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f273b606640 1 -- 172.21.15.169:0/44519499 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284000faf0 con 0x55dbf39a1780 2024-04-24T01:26:06.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbf3a9e7d0 con 0x55dbf39a1780 2024-04-24T01:26:06.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f273b606640 1 -- 172.21.15.169:0/44519499 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284000fdd0 con 0x55dbf39a1780 2024-04-24T01:26:06.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf3aa1480 con 0x55dbf39a1780 2024-04-24T01:26:06.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.467+0000 7f273b606640 1 -- 172.21.15.169:0/44519499 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2840017040 con 0x55dbf39a1780 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f273b606640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2734036900 0x7f2734038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f273b606640 1 -- 172.21.15.169:0/44519499 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2840015020 con 0x55dbf39a1780 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f284e25f640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2734036900 0x7f2734038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf39a32c0 0x55dbf3aa5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aa5780 con 0x55dbf39a32c0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f284f261640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf39a32c0 0x55dbf3aa5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f284e25f640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2734036900 0x7f2734038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2844054000 tx=0x7f284404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f284f261640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf39a32c0 0x55dbf3aa5240 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f284f261640 1 -- 172.21.15.169:0/44519499 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf39a32c0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.468+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aa27f0 con 0x55dbf39a32c0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.469+0000 7f284f261640 1 -- 172.21.15.169:0/44519499 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf39a32c0 2024-04-24T01:26:06.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.469+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3aa7a20 0x55dbf3aa9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.469+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aaa500 con 0x55dbf3aa7a20 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.469+0000 7f284ea60640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3aa7a20 0x55dbf3aa9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.469+0000 7f284ea60640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3aa7a20 0x55dbf3aa9e10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f284ea60640 1 -- 172.21.15.169:0/44519499 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f284002d070 con 0x55dbf3aa7a20 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aa69d0 con 0x55dbf39a32c0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f284f261640 1 -- 172.21.15.169:0/44519499 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf39a32c0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55dbf3aab9b0 0x55dbf3aade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aae560 con 0x55dbf3aab9b0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f284e25f640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55dbf3aab9b0 0x55dbf3aade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.470+0000 7f284e25f640 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55dbf3aab9b0 0x55dbf3aade00 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f284e25f640 1 -- 172.21.15.169:0/44519499 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f284405a040 con 0x55dbf3aab9b0 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f2852d28800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f2852d28800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55dbf38946b0 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43562/0 (socket says 172.21.15.169:43562) 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.471+0000 7f284ea60640 1 -- 172.21.15.169:0/3404638959 learned_addr learned my addr 172.21.15.169:0/3404638959 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f284ea60640 1 -- 172.21.15.169:0/3404638959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3abd320 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f284ea60640 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f284004b450 tx=0x7f284001aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f2738e01640 1 -- 172.21.15.169:0/3404638959 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284001acb0 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f2738e01640 1 -- 172.21.15.169:0/3404638959 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284001ae50 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f2738e01640 1 -- 172.21.15.169:0/3404638959 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f28400195a0 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbf3abdd90 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.472+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf3abe290 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f2738e01640 1 -- 172.21.15.169:0/3404638959 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2840019740 con 0x55dbf3abc9c0 2024-04-24T01:26:06.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f2738e01640 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f2738e01640 1 -- 172.21.15.169:0/3404638959 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f284003ad50 con 0x55dbf3abc9c0 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f284e25f640 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.473+0000 7f284e25f640 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55dbf3aa5fd0 tx=0x7f2844005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f2852d28800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f2852d28800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55dbf3a96db0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43576/0 (socket says 172.21.15.169:43576) 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f284ea60640 1 -- 172.21.15.169:0/2804917632 learned_addr learned my addr 172.21.15.169:0/2804917632 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f284ea60640 1 -- 172.21.15.169:0/2804917632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3aca6b0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f284ea60640 1 --2- 172.21.15.169:0/2804917632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f284002be90 tx=0x7f28400268b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32925a330276e2ea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f27327fc640 1 -- 172.21.15.169:0/2804917632 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284004bda0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f27327fc640 1 -- 172.21.15.169:0/2804917632 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2840040c80 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.474+0000 7f27327fc640 1 -- 172.21.15.169:0/2804917632 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284001ca40 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- 172.21.15.169:0/2804917632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 msgr2=0x55dbf3aca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 --2- 172.21.15.169:0/2804917632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f284002be90 tx=0x7f28400268b0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- 172.21.15.169:0/2804917632 shutdown_connections 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 --2- 172.21.15.169:0/2804917632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3aca0e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- 172.21.15.169:0/2804917632 >> 172.21.15.169:0/2804917632 conn(0x55dbf3ac6020 msgr2=0x55dbf3ac4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- 172.21.15.169:0/2804917632 shutdown_connections 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- 172.21.15.169:0/2804917632 wait complete. 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 Processor -- start 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- start start 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3ad1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f2852d28800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55dbf3acad60 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3ad1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f284ea60640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3ad1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43586/0 (socket says 172.21.15.169:43586) 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.475+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 learned_addr learned my addr 172.21.15.169:0/3321467857 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbf3ad15d0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f284ea60640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3ad1090 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f284001c9d0 tx=0x7f284002fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f2730ff9640 1 -- 172.21.15.169:0/3321467857 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284006e070 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f2730ff9640 1 -- 172.21.15.169:0/3321467857 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f284003f250 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbf3ad15d0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f2730ff9640 1 -- 172.21.15.169:0/3321467857 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284003f570 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.476+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbf3ad15d0 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2730ff9640 1 -- 172.21.15.169:0/3321467857 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2840071070 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2730ff9640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2718036900 0x7f2718038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2730ff9640 1 -- 172.21.15.169:0/3321467857 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2840059070 con 0x55dbf3ac9cc0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f284e25f640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2718036900 0x7f2718038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf3adc670 0x55dbf3adeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3adf250 con 0x55dbf3adc670 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.477+0000 7f284f261640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf3adc670 0x55dbf3adeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f284e25f640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2718036900 0x7f2718038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f284f261640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf3adc670 0x55dbf3adeb00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 realm 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3adf660 con 0x55dbf3adc670 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:06.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3adff00 con 0x55dbf3adc670 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.478+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3ae1000 0x55dbf3ae33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae3970 con 0x55dbf3ae1000 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f284ea60640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3ae1000 0x55dbf3ae33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f284ea60640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3ae1000 0x55dbf3ae33f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.496 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 20 searching for the correct realm 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55dbf3ae59c0 0x55dbf3ae7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.479+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae8550 con 0x55dbf3ae59c0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284e25f640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55dbf3ae59c0 0x55dbf3ae7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284e25f640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55dbf3ae59c0 0x55dbf3ae7e80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284e25f640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2844052b30 0x7f2844080930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae8550 con 0x7f2844052b30 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284f261640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2844052b30 0x7f2844080930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.480+0000 7f284f261640 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2844052b30 0x7f2844080930 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x7f2844052b30 2024-04-24T01:26:06.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.481+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x7f2844052b30 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x7f2844052b30 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.482+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f284800a4a0 con 0x55dbf3adc670 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x7f2844052b30 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.483+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.484+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.485+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x7f2844052b30 2024-04-24T01:26:06.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.486+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x7f2844052b30 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.487+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x55dbf3adc670 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae02a0 con 0x7f2844052b30 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae42c0 con 0x55dbf3adc670 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae42c0 con 0x55dbf3adc670 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.488+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae42c0 con 0x7f2844052b30 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 zone default found 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 4 Realm: () 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:06.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 zonegroup default 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae46b0 con 0x55dbf3ae1000 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae42a0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.489+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aea3b0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.490+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.490+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.490+0000 7f2852d28800 20 started sync module instance, tier type = 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.490+0000 7f2852d28800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.490+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae9850 con 0x7f2844052b30 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.491+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.491+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94403174505808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae9850 con 0x7f2844052b30 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.491+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aead70 con 0x55dbf3adc670 2024-04-24T01:26:06.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.492+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94403174505808] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.492+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.492+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94403174509216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae9850 con 0x55dbf3adc670 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.492+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aeb7c0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.494+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94403174509216] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.494+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.494+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94403174503328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae97c0 con 0x55dbf3ae59c0 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.494+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aec580 con 0x7f2844052b30 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.495+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.495+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94403174503328] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.495+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94403174514832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aece20 con 0x7f2844052b30 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.495+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aebbe0 con 0x55dbf3adc670 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.496+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94403174514832] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.496+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.496+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94403174516864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aed3b0 con 0x55dbf3adc670 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.496+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aeddb0 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.497+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.497+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94403174521024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aee650 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.497+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aef0d0 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.497+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94403174516864] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.498+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94403174521024] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.498+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.498+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94403174525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aef4c0 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.498+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aefd10 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94403174525888] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94403174528112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aefd40 con 0x55dbf3ae1000 2024-04-24T01:26:06.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=0 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=1 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=2 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=3 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=4 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=5 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.499+0000 7f2852d28800 20 add_watcher() i=6 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94403174528112] v34'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f2852d28800 20 add_watcher() i=7 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f2852d28800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3af3080 con 0x55dbf3adc670 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.500+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94403174529536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3af02d0 con 0x55dbf3adc670 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94403174529536] v34'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.515 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f27057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 5 note: GC not initialized 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f267ffff640 20 reqs_thread_entry: start 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 20 Filter name: none 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f267dffb640 20 reqs_thread_entry: start 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 20 rados->read ofs=0 len=0 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.502+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3b25f70 con 0x55dbf3adc670 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.503+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.503+0000 7f2852d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:could not fetch user info: no user info saved 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.503+0000 7f27057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:06.516 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.503+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94403174529536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3b25f30 con 0x55dbf3adc670 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.504+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94403174529536] v34'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.504+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94403174505808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3b25f30 con 0x7f2844052b30 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.505+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94403174505808] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.505+0000 7f2852d28800 20 remove_watcher() i=0 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.505+0000 7f2852d28800 2 removed watcher, disabling cache 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.505+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94403174509216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3b25f30 con 0x55dbf3adc670 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.507+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94403174509216] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.507+0000 7f2852d28800 20 remove_watcher() i=1 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.507+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94403174503328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3b25f30 con 0x55dbf3ae59c0 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.508+0000 7f284e25f640 1 -- 172.21.15.169:0/3321467857 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94403174503328] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2844070070 con 0x55dbf3ae59c0 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.508+0000 7f2852d28800 20 remove_watcher() i=2 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.508+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94403174514832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aeaaa0 con 0x7f2844052b30 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.509+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94403174514832] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x7f2844052b30 2024-04-24T01:26:06.517 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.509+0000 7f2852d28800 20 remove_watcher() i=3 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.509+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94403174516864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae93a0 con 0x55dbf3adc670 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.510+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94403174516864] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2848032040 con 0x55dbf3adc670 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.510+0000 7f2852d28800 20 remove_watcher() i=4 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.510+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94403174521024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aeaaa0 con 0x55dbf3ae1000 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.511+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94403174521024] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.511+0000 7f2852d28800 20 remove_watcher() i=5 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.511+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94403174525888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3aec880 con 0x55dbf3ae1000 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.512+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94403174525888] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.512+0000 7f2852d28800 20 remove_watcher() i=6 2024-04-24T01:26:06.518 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.512+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94403174528112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55dbf3ae93a0 con 0x55dbf3ae1000 2024-04-24T01:26:06.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f284ea60640 1 -- 172.21.15.169:0/3321467857 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94403174528112] v34'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2840070030 con 0x55dbf3ae1000 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 20 remove_watcher() i=7 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3ae1000 msgr2=0x55dbf3ae33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3ae1000 0x55dbf3ae33f0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf3adc670 msgr2=0x55dbf3adeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf3adc670 0x55dbf3adeb00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2844052b30 msgr2=0x7f2844080930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f2844052b30 0x7f2844080930 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55dbf3ae59c0 msgr2=0x55dbf3ae7e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55dbf3ae59c0 0x55dbf3ae7e80 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2718036900 msgr2=0x7f2718038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2718036900 0x7f2718038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2844000c00 tx=0x7f2844060040 comp rx=0 tx=0).stop 2024-04-24T01:26:06.522 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 msgr2=0x55dbf3ad1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 --2- 172.21.15.169:0/3321467857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3ac9cc0 0x55dbf3ad1090 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f284001c9d0 tx=0x7f284002fe90 comp rx=0 tx=0).stop 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 reap_dead start 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f284f261640 1 -- 172.21.15.169:0/3321467857 reap_dead start 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 shutdown_connections 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.513+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 >> 172.21.15.169:0/3321467857 conn(0x55dbf3ac6020 msgr2=0x55dbf3ac3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 shutdown_connections 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3321467857 wait complete. 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 msgr2=0x7f2728038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55dbf3aa5fd0 tx=0x7f2844005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 msgr2=0x55dbf3abcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f284004b450 tx=0x7f284001aaf0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 shutdown_connections 2024-04-24T01:26:06.523 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2728036900 0x7f2728038dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/3404638959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf3abc9c0 0x55dbf3abcde0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 >> 172.21.15.169:0/3404638959 conn(0x55dbf3ab0a60 msgr2=0x55dbf3ab0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 shutdown_connections 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/3404638959 wait complete. 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3aa7a20 msgr2=0x55dbf3aa9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55dbf3aa7a20 0x55dbf3aa9e10 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf39a32c0 msgr2=0x55dbf3aa5240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55dbf39a32c0 0x55dbf3aa5240 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55dbf3aab9b0 msgr2=0x55dbf3aade00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55dbf3aab9b0 0x55dbf3aade00 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2734036900 msgr2=0x7f2734038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2734036900 0x7f2734038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2844054000 tx=0x7f284404e000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.524 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 msgr2=0x55dbf3a9e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 --2- 172.21.15.169:0/44519499 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dbf39a1780 0x55dbf3a9e000 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f284000b210 tx=0x7f2840000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f284f261640 1 -- 172.21.15.169:0/44519499 reap_dead start 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 shutdown_connections 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.514+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 >> 172.21.15.169:0/44519499 conn(0x55dbf399d300 msgr2=0x55dbf3a905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.515+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 shutdown_connections 2024-04-24T01:26:06.525 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.515+0000 7f2852d28800 1 -- 172.21.15.169:0/44519499 wait complete. 2024-04-24T01:26:06.525 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-24T01:26:06.526 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-04-24T01:26:06.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-04-24T01:26:06.526 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-04-24T01:26:06.608 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.608 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.608+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.608+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.608+0000 7f2f4b30c800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563b4f8af270 0x563b4f8b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f4b30c800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b4f76ad40 con 0x563b4f8aade0 2024-04-24T01:26:06.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f4b30c800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x563b4f73d4d0 con 0x563b4f8af270 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563b4f8af270 0x563b4f8b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f48e0b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x563b4f8aade0 0x563b4f8ab200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50662/0 (socket says 172.21.15.169:50662) 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2935825841 learned_addr learned my addr 172.21.15.169:0/2935825841 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f43fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563b4f8af270 0x563b4f8b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43602/0 (socket says 172.21.15.169:43602) 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f43fff640 1 -- 172.21.15.169:0/2935825841 >> v1:172.21.15.142:6789/0 conn(0x563b4f8aade0 legacy=0x563b4f8ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.609+0000 7f2f43fff640 1 -- 172.21.15.169:0/2935825841 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f769590 con 0x563b4f8af270 2024-04-24T01:26:06.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.611+0000 7f2f43fff640 1 --2- 172.21.15.169:0/2935825841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8af270 0x563b4f8b1660 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400a470 tx=0x7f2f3401cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509de4c119b43c14 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.611+0000 7f2f437fe640 1 -- 172.21.15.169:0/2935825841 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f34057070 con 0x563b4f8af270 2024-04-24T01:26:06.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.611+0000 7f2f437fe640 1 -- 172.21.15.169:0/2935825841 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3404ac70 con 0x563b4f8af270 2024-04-24T01:26:06.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.611+0000 7f2f437fe640 1 -- 172.21.15.169:0/2935825841 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f34052440 con 0x563b4f8af270 2024-04-24T01:26:06.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2935825841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8af270 msgr2=0x563b4f8b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2935825841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8af270 0x563b4f8b1660 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400a470 tx=0x7f2f3401cce0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2935825841 shutdown_connections 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2935825841 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8af270 0x563b4f8b1660 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2935825841 >> 172.21.15.169:0/2935825841 conn(0x563b4f8a6420 msgr2=0x563b4f8a8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2935825841 shutdown_connections 2024-04-24T01:26:06.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.612+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2935825841 wait complete. 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.623+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.623+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f4b30c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f4b30c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563b4f7f73c0 con 0x563b4f8aade0 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43608/0 (socket says 172.21.15.169:43608) 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f48e0b640 1 -- 172.21.15.169:0/398682162 learned_addr learned my addr 172.21.15.169:0/398682162 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f48e0b640 1 -- 172.21.15.169:0/398682162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f99dd30 con 0x563b4f8aade0 2024-04-24T01:26:06.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.624+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/398682162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b560 tx=0x7f2f3c00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29aff1d1159d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2e36e05640 1 -- 172.21.15.169:0/398682162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c008070 con 0x563b4f8aade0 2024-04-24T01:26:06.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2e36e05640 1 -- 172.21.15.169:0/398682162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00d5c0 con 0x563b4f8aade0 2024-04-24T01:26:06.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2e36e05640 1 -- 172.21.15.169:0/398682162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c00d8e0 con 0x563b4f8aade0 2024-04-24T01:26:06.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 -- 172.21.15.169:0/398682162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 msgr2=0x563b4f81f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/398682162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b560 tx=0x7f2f3c00ba20 comp rx=0 tx=0).stop 2024-04-24T01:26:06.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 -- 172.21.15.169:0/398682162 shutdown_connections 2024-04-24T01:26:06.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/398682162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f81f0e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 -- 172.21.15.169:0/398682162 >> 172.21.15.169:0/398682162 conn(0x563b4f8a6420 msgr2=0x563b4f997a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 -- 172.21.15.169:0/398682162 shutdown_connections 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.625+0000 7f2f4b30c800 1 -- 172.21.15.169:0/398682162 wait complete. 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f4b30c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f4b30c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563b4f8b1f30 con 0x563b4f8aade0 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43622/0 (socket says 172.21.15.169:43622) 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2013889772 learned_addr learned my addr 172.21.15.169:0/2013889772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.626+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2013889772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f9a75c0 con 0x563b4f8aade0 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00ba60 tx=0x7f2f3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2e35602640 1 -- 172.21.15.169:0/2013889772 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c00fa80 con 0x563b4f8aade0 2024-04-24T01:26:06.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2e35602640 1 -- 172.21.15.169:0/2013889772 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00fc20 con 0x563b4f8aade0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2e35602640 1 -- 172.21.15.169:0/2013889772 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c019470 con 0x563b4f8aade0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b4f9a7850 con 0x563b4f8aade0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f9aa500 con 0x563b4f8aade0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.627+0000 7f2f4b30c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563b4f79d6b0 con 0x563b4f9b48c0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e35602640 1 -- 172.21.15.169:0/2013889772 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f3c017040 con 0x563b4f8aade0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f4960c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f4960c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43626/0 (socket says 172.21.15.169:43626) 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f4960c640 1 -- 172.21.15.169:0/1033559803 learned_addr learned my addr 172.21.15.169:0/1033559803 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e35602640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 0x7f2e30038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e35602640 1 -- 172.21.15.169:0/2013889772 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f3c015020 con 0x563b4f8aade0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 0x7f2e30038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f4960c640 1 -- 172.21.15.169:0/1033559803 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f9b5220 con 0x563b4f9b48c0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 0x7f2e30038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c019fd0 tx=0x7f2f3c019f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2f4960c640 1 --2- 172.21.15.169:0/1033559803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400a430 tx=0x7f2f4400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17886ad81c1bc43a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e2effd640 1 -- 172.21.15.169:0/1033559803 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f44015070 con 0x563b4f9b48c0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e2effd640 1 -- 172.21.15.169:0/1033559803 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f44001670 con 0x563b4f9b48c0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.628+0000 7f2e2effd640 1 -- 172.21.15.169:0/1033559803 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f44001990 con 0x563b4f9b48c0 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1033559803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 msgr2=0x563b4f9b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1033559803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400a430 tx=0x7f2f4400a8f0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1033559803 shutdown_connections 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1033559803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9b4ce0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1033559803 >> 172.21.15.169:0/1033559803 conn(0x563b4f8af270 msgr2=0x563b4f9b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1033559803 shutdown_connections 2024-04-24T01:26:06.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1033559803 wait complete. 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.629+0000 7f2f4b30c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563b4f9b5bb0 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4960c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4960c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43630/0 (socket says 172.21.15.169:43630) 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4960c640 1 -- 172.21.15.169:0/1378666317 learned_addr learned my addr 172.21.15.169:0/1378666317 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4960c640 1 -- 172.21.15.169:0/1378666317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f9bc360 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4960c640 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400a930 tx=0x7f2f44003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2e2d7fa640 1 -- 172.21.15.169:0/1378666317 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f44020020 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2e2d7fa640 1 -- 172.21.15.169:0/1378666317 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f440108b0 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b4f9bc5f0 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2e2d7fa640 1 -- 172.21.15.169:0/1378666317 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f44015040 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.630+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f9bf2a0 con 0x563b4f9b48c0 2024-04-24T01:26:06.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2e2d7fa640 1 -- 172.21.15.169:0/1378666317 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f44023020 con 0x563b4f9b48c0 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2e2d7fa640 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 0x7f2e20038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2e2d7fa640 1 -- 172.21.15.169:0/1378666317 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f4404c0a0 con 0x563b4f9b48c0 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2f4b30c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2f4b30c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.631+0000 7f2f43fff640 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 0x7f2e20038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f4b30c800 1 Processor -- start 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f4b30c800 1 -- start start 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f43fff640 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 0x7f2e20038e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f34054000 tx=0x7f2f3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f4b30c800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f4b30c800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563b4f9a24c0 con 0x563b4f9d6530 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f48e0b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43634/0 (socket says 172.21.15.169:43634) 2024-04-24T01:26:06.638 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2314451168 learned_addr learned my addr 172.21.15.169:0/2314451168 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2314451168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f9d6e90 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.632+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c04b690 tx=0x7f2f3c01ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2e0d7e2640 1 -- 172.21.15.169:0/2314451168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c01caf0 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2e0d7e2640 1 -- 172.21.15.169:0/2314451168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f3c01cc90 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b4f9d7900 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2e0d7e2640 1 -- 172.21.15.169:0/2314451168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2f3c04c7b0 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f9d7e00 con 0x563b4f9d6530 2024-04-24T01:26:06.639 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2e0d7e2640 1 -- 172.21.15.169:0/2314451168 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2f3c04b120 con 0x563b4f9d6530 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.633+0000 7f2e0d7e2640 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 0x7f2d84038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2e0d7e2640 1 -- 172.21.15.169:0/2314451168 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2f3c037070 con 0x563b4f9d6530 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f43fff640 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 0x7f2d84038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2d8effd640 20 reqs_thread_entry: start 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f43fff640 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 0x7f2d84038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f3401cd20 tx=0x7f2f34005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 0x563b4f9e6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563b4f9e6cd0 con 0x563b4f9e4140 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f4960c640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 0x563b4f9e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.634+0000 7f2f4960c640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 0x563b4f9e6600 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.635+0000 7f2f4960c640 1 -- 172.21.15.169:0/2013889772 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2f44010d70 con 0x563b4f9e4140 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.635+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 0x563b4f9eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.635+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:2 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563b4f9eb620 con 0x563b4f9e8b40 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.635+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 0x563b4f9eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.635+0000 7f2f48e0b640 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 0x563b4f9eaf30 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f48e0b640 1 -- 172.21.15.169:0/2013889772 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(2 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2f3c045020 con 0x563b4f9e8b40 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 msgr2=0x7f2e20038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 0x7f2e20038e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f34054000 tx=0x7f2f3404e000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 msgr2=0x563b4f9bbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400a930 tx=0x7f2f44003370 comp rx=0 tx=0).stop 2024-04-24T01:26:06.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 shutdown_connections 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e20036950 0x7f2e20038e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/1378666317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9b48c0 0x563b4f9bbe20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 >> 172.21.15.169:0/1378666317 conn(0x563b4f8af270 msgr2=0x563b4f9ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 shutdown_connections 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.636+0000 7f2f4b30c800 1 -- 172.21.15.169:0/1378666317 wait complete. 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 msgr2=0x7f2d84038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 0x7f2d84038dc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2f3401cd20 tx=0x7f2f34005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 msgr2=0x563b4f9d6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c04b690 tx=0x7f2f3c01ab20 comp rx=0 tx=0).stop 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 shutdown_connections 2024-04-24T01:26:06.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2d84036900 0x7f2d84038dc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2314451168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f9d6530 0x563b4f9d6950 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 >> 172.21.15.169:0/2314451168 conn(0x563b4f9cafe0 msgr2=0x563b4f9cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 shutdown_connections 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2314451168 wait complete. 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 msgr2=0x563b4f9eaf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 0x563b4f9eaf30 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 msgr2=0x563b4f9e6600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 0x563b4f9e6600 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 msgr2=0x7f2e30038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 0x7f2e30038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c019fd0 tx=0x7f2f3c019f40 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 msgr2=0x563b4f9a7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00ba60 tx=0x7f2f3c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 shutdown_connections 2024-04-24T01:26:06.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563b4f9e8b40 0x563b4f9eaf30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563b4f9e4140 0x563b4f9e6600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e30036900 0x7f2e30038dc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 --2- 172.21.15.169:0/2013889772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563b4f8aade0 0x563b4f9a7080 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 >> 172.21.15.169:0/2013889772 conn(0x563b4f8a6420 msgr2=0x563b4f996230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 shutdown_connections 2024-04-24T01:26:06.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.637+0000 7f2f4b30c800 1 -- 172.21.15.169:0/2013889772 wait complete. 2024-04-24T01:26:06.648 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:26:06.648 DEBUG:tasks.util.rgw: json result: {'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:26:06.648 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-04-24T01:26:06.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-04-24T01:26:06.649 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-04-24T01:26:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.729 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.729+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.729+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5185d46800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a65af5cf80 0x55a65af5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5185d46800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a65ae1bd40 con 0x55a65af5e0f0 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5185d46800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55a65adee4d0 con 0x55a65af5cf80 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183845640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a65af5cf80 0x55a65af5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183845640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55a65af5cf80 0x55a65af5d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43642/0 (socket says 172.21.15.169:43642) 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183845640 1 -- 172.21.15.169:0/1125553086 learned_addr learned my addr 172.21.15.169:0/1125553086 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183845640 1 -- 172.21.15.169:0/1125553086 >> v1:172.21.15.142:6789/0 conn(0x55a65af5e0f0 legacy=0x55a65af5e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183845640 1 -- 172.21.15.169:0/1125553086 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65ae1a590 con 0x55a65af5cf80 2024-04-24T01:26:06.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.730+0000 7f5183044640 1 -- 172.21.15.169:0/1125553086 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770804778 0 0) 0x55a65ae1bd40 con 0x55a65af5e0f0 2024-04-24T01:26:06.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.732+0000 7f5183845640 1 --2- 172.21.15.169:0/1125553086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65af5d3a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f517400a520 tx=0x7f517401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9fa72fe2b495f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.732+0000 7f5183044640 1 -- 172.21.15.169:0/1125553086 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174057070 con 0x55a65af5cf80 2024-04-24T01:26:06.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.732+0000 7f5183044640 1 -- 172.21.15.169:0/1125553086 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174052570 con 0x55a65af5cf80 2024-04-24T01:26:06.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.732+0000 7f5183044640 1 -- 172.21.15.169:0/1125553086 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517404ae60 con 0x55a65af5cf80 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 -- 172.21.15.169:0/1125553086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 msgr2=0x55a65af5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 --2- 172.21.15.169:0/1125553086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65af5d3a0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f517400a520 tx=0x7f517401d010 comp rx=0 tx=0).stop 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 -- 172.21.15.169:0/1125553086 shutdown_connections 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 --2- 172.21.15.169:0/1125553086 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65af5d3a0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 -- 172.21.15.169:0/1125553086 >> 172.21.15.169:0/1125553086 conn(0x55a65af58520 msgr2=0x55a65af5a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 -- 172.21.15.169:0/1125553086 shutdown_connections 2024-04-24T01:26:06.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.733+0000 7f5185d46800 1 -- 172.21.15.169:0/1125553086 wait complete. 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.745+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5185d46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5185d46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a65aea83b0 con 0x55a65af5cf80 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43646/0 (socket says 172.21.15.169:43646) 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5183845640 1 -- 172.21.15.169:0/1127698496 learned_addr learned my addr 172.21.15.169:0/1127698496 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5183845640 1 -- 172.21.15.169:0/1127698496 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65aed0f50 con 0x55a65af5cf80 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.746+0000 7f5183845640 1 --2- 172.21.15.169:0/1127698496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5174055040 tx=0x7f517404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaf14352df4cce server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5071e0b640 1 -- 172.21.15.169:0/1127698496 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174057040 con 0x55a65af5cf80 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5071e0b640 1 -- 172.21.15.169:0/1127698496 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174052720 con 0x55a65af5cf80 2024-04-24T01:26:06.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5071e0b640 1 -- 172.21.15.169:0/1127698496 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174052a40 con 0x55a65af5cf80 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 -- 172.21.15.169:0/1127698496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 msgr2=0x55a65aed2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 --2- 172.21.15.169:0/1127698496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5174055040 tx=0x7f517404c000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 -- 172.21.15.169:0/1127698496 shutdown_connections 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 --2- 172.21.15.169:0/1127698496 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65aed2990 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 -- 172.21.15.169:0/1127698496 >> 172.21.15.169:0/1127698496 conn(0x55a65af58520 msgr2=0x55a65b049cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 -- 172.21.15.169:0/1127698496 shutdown_connections 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.747+0000 7f5185d46800 1 -- 172.21.15.169:0/1127698496 wait complete. 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.755 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5185d46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5185d46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a65af66590 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43652/0 (socket says 172.21.15.169:43652) 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.748+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 learned_addr learned my addr 172.21.15.169:0/3550497148 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b05c990 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f5183845640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5174052540 tx=0x7f5174003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f506bfff640 1 -- 172.21.15.169:0/3550497148 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174073070 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f506bfff640 1 -- 172.21.15.169:0/3550497148 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5174052c90 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f506bfff640 1 -- 172.21.15.169:0/3550497148 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174057070 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a65b05cc20 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.749+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65b05f8d0 con 0x55a65af5cf80 2024-04-24T01:26:06.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f506bfff640 1 -- 172.21.15.169:0/3550497148 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5174076070 con 0x55a65af5cf80 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5185d46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5185d46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a65ae4e6b0 con 0x55a65b069d00 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f506bfff640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f506c036950 0x7f506c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5184046640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5184046640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43656/0 (socket says 172.21.15.169:43656) 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5184046640 1 -- 172.21.15.169:0/1908279875 learned_addr learned my addr 172.21.15.169:0/1908279875 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f506bfff640 1 -- 172.21.15.169:0/3550497148 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f517408da90 con 0x55a65af5cf80 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5183845640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f506c036950 0x7f506c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5184046640 1 -- 172.21.15.169:0/1908279875 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b06a660 con 0x55a65b069d00 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.750+0000 7f5184046640 1 --2- 172.21.15.169:0/1908279875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f517c00a430 tx=0x7f517c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6238c24fefd88679 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5183845640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f506c036950 0x7f506c038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5174055040 tx=0x7f5174066e80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5069ffb640 1 -- 172.21.15.169:0/1908279875 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517c015070 con 0x55a65b069d00 2024-04-24T01:26:06.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5069ffb640 1 -- 172.21.15.169:0/1908279875 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c001670 con 0x55a65b069d00 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5069ffb640 1 -- 172.21.15.169:0/1908279875 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517c001990 con 0x55a65b069d00 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 -- 172.21.15.169:0/1908279875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 msgr2=0x55a65b06a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 --2- 172.21.15.169:0/1908279875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f517c00a430 tx=0x7f517c00a8f0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 -- 172.21.15.169:0/1908279875 shutdown_connections 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 --2- 172.21.15.169:0/1908279875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b06a120 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 -- 172.21.15.169:0/1908279875 >> 172.21.15.169:0/1908279875 conn(0x55a65af5e0f0 msgr2=0x55a65b0667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 -- 172.21.15.169:0/1908279875 shutdown_connections 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 -- 172.21.15.169:0/1908279875 wait complete. 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.751+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5185d46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5185d46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a65b06aff0 con 0x55a65b069d00 2024-04-24T01:26:06.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5184046640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5184046640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43660/0 (socket says 172.21.15.169:43660) 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5184046640 1 -- 172.21.15.169:0/3266015037 learned_addr learned my addr 172.21.15.169:0/3266015037 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5184046640 1 -- 172.21.15.169:0/3266015037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b0716e0 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.752+0000 7f5184046640 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f517c013040 tx=0x7f517c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5063fff640 1 -- 172.21.15.169:0/3266015037 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517c020020 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5063fff640 1 -- 172.21.15.169:0/3266015037 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517c0108e0 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a65b071970 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5063fff640 1 -- 172.21.15.169:0/3266015037 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517c015040 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65b074620 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5063fff640 1 -- 172.21.15.169:0/3266015037 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f517c023020 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.753+0000 7f5063fff640 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 0x7f505c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5063fff640 1 -- 172.21.15.169:0/3266015037 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f517c04c1a0 con 0x55a65b069d00 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f517bfff640 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 0x7f505c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f517bfff640 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 0x7f505c038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f516c000f60 tx=0x7f516c001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 1 Processor -- start 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 1 -- start start 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.754+0000 7f5185d46800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55a65aed1210 con 0x55a65b08b7f0 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.755+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.755+0000 7f5183845640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43668/0 (socket says 172.21.15.169:43668) 2024-04-24T01:26:06.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.755+0000 7f5183845640 1 -- 172.21.15.169:0/127544222 learned_addr learned my addr 172.21.15.169:0/127544222 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.755+0000 7f5183845640 1 -- 172.21.15.169:0/127544222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65b08c150 con 0x55a65b08b7f0 2024-04-24T01:26:06.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f5183845640 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5174044990 tx=0x7f5174054e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f4fe3fff640 1 -- 172.21.15.169:0/127544222 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f517405c3e0 con 0x55a65b08b7f0 2024-04-24T01:26:06.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f4fe3fff640 1 -- 172.21.15.169:0/127544222 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517405d810 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a65b08cbc0 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f4fe3fff640 1 -- 172.21.15.169:0/127544222 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5174077e60 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.756+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65b08d0c0 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f4fe3fff640 1 -- 172.21.15.169:0/127544222 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5174076950 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f4fe3fff640 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 0x7f4fbc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f4fe3fff640 1 -- 172.21.15.169:0/127544222 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5174097d50 con 0x55a65b08b7f0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f517bfff640 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 0x7f4fbc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f4fe1ffb640 20 reqs_thread_entry: start 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a65b0992b0 0x55a65b09b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.757+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b09bcb0 con 0x55a65b0992b0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.758+0000 7f5184046640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a65b0992b0 0x55a65b09b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.758+0000 7f517bfff640 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 0x7f4fbc038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a65b065c20 tx=0x7f516c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.758+0000 7f5184046640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a65b0992b0 0x55a65b09b6a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.758+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.758+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b09c550 con 0x55a65b0992b0 2024-04-24T01:26:06.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.759+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.759+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a65b09de60 0x55a65b0a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.759+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a0a80 con 0x55a65b09de60 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.759+0000 7f5183845640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a65b09de60 0x55a65b0a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.760+0000 7f5183845640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a65b09de60 0x55a65b0a02f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.760+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.760+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0adbc0 con 0x55a65b0992b0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.761+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:NOTICE: set zone's realm_id= 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.761+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a65b0a4f80 0x55a65b0a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.761+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.761+0000 7f517bfff640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a65b0a4f80 0x55a65b0a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.761+0000 7f517bfff640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a65b0a4f80 0x55a65b0a7eb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.762+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(5 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c01c410 con 0x55a65b0a4f80 2024-04-24T01:26:06.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.762+0000 7f517bfff640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f516c01cb50 0x7f516c00f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.762+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.762+0000 7f5184046640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f516c01cb50 0x7f516c00f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.762+0000 7f5184046640 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f516c01cb50 0x7f516c00f8b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.763+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.764+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c01c410 con 0x55a65b0a4f80 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.765+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(17 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.766+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.767+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.768+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.768+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(25 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.769+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.770+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0a4f80 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f516c02a040 con 0x55a65b0a4f80 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f517bfff640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b09de60 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.771+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x55a65b0992b0 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(35 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a7a30 con 0x7f516c01cb50 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(36 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f517c00e070 con 0x7f516c01cb50 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0aba90 con 0x55a65b0992b0 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.772+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:38 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a65b09d170 con 0x55a65b09de60 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.773+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(38 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.773+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:39 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a72c0 con 0x55a65b09de60 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.774+0000 7f5183845640 1 -- 172.21.15.169:0/3550497148 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(39 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [create,call,writefull 0~1155] v34'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f517409c020 con 0x55a65b09de60 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.774+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a9060 con 0x55a65b0992b0 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.775+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v34'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.775+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a65b0a6580 con 0x55a65b0992b0 2024-04-24T01:26:06.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.776+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v34'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f517c00e070 con 0x55a65b0992b0 2024-04-24T01:26:06.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 msgr2=0x7f505c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 0x7f505c038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f516c000f60 tx=0x7f516c001370 comp rx=0 tx=0).stop 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 msgr2=0x55a65b0711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f517c013040 tx=0x7f517c003370 comp rx=0 tx=0).stop 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 shutdown_connections 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f505c036900 0x7f505c038dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/3266015037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b069d00 0x55a65b0711a0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 >> 172.21.15.169:0/3266015037 conn(0x55a65af5e0f0 msgr2=0x55a65b063de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 shutdown_connections 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/3266015037 wait complete. 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 msgr2=0x7f4fbc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 0x7f4fbc038e10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a65b065c20 tx=0x7f516c006000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 msgr2=0x55a65b08bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5174044990 tx=0x7f5174054e60 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 shutdown_connections 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4fbc036950 0x7f4fbc038e10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 --2- 172.21.15.169:0/127544222 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65b08b7f0 0x55a65b08bc10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 >> 172.21.15.169:0/127544222 conn(0x55a65b0802c0 msgr2=0x55a65b080ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 shutdown_connections 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.777+0000 7f5185d46800 1 -- 172.21.15.169:0/127544222 wait complete. 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a65b09de60 msgr2=0x55a65b0a02f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55a65b09de60 0x55a65b0a02f0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a65b0992b0 msgr2=0x55a65b09b6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55a65b0992b0 0x55a65b09b6a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f516c01cb50 msgr2=0x7f516c00f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f516c01cb50 0x7f516c00f8b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a65b0a4f80 msgr2=0x55a65b0a7eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55a65b0a4f80 0x55a65b0a7eb0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f506c036950 msgr2=0x7f506c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f506c036950 0x7f506c038e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5174055040 tx=0x7f5174066e80 comp rx=0 tx=0).stop 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5184046640 1 -- 172.21.15.169:0/3550497148 reap_dead start 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 msgr2=0x55a65b05c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f5174052540 tx=0x7f5174003020 comp rx=0 tx=0).stop 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 shutdown_connections 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 --2- 172.21.15.169:0/3550497148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a65af5cf80 0x55a65b05c450 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 >> 172.21.15.169:0/3550497148 conn(0x55a65af58520 msgr2=0x55a65aed1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 shutdown_connections 2024-04-24T01:26:06.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.778+0000 7f5185d46800 1 -- 172.21.15.169:0/3550497148 wait complete. 2024-04-24T01:26:06.787 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T01:26:06.787 DEBUG:tasks.util.rgw: json result: {'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T01:26:06.787 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-04-24T01:26:06.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-04-24T01:26:06.787 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-04-24T01:26:06.869 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.869 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.869+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.869+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc9c06800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c04fdff320 0x55c04fe01710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc9c06800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c04fcb9d40 con 0x55c04fdfaf80 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc9c06800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c04fc8c4d0 con 0x55c04fdff320 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc6f04640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c04fdff320 0x55c04fe01710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc7705640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c04fdfaf80 0x55c04fdfb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50684/0 (socket says 172.21.15.169:50684) 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc6f04640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c04fdff320 0x55c04fe01710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43676/0 (socket says 172.21.15.169:43676) 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc7705640 1 -- 172.21.15.169:0/785077896 learned_addr learned my addr 172.21.15.169:0/785077896 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc6f04640 1 -- 172.21.15.169:0/785077896 >> v1:172.21.15.142:6789/0 conn(0x55c04fdfaf80 legacy=0x55c04fdfb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.870+0000 7f9dc6f04640 1 -- 172.21.15.169:0/785077896 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04fcb8590 con 0x55c04fdff320 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.872+0000 7f9dc6f04640 1 --2- 172.21.15.169:0/785077896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdff320 0x55c04fe01710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00a470 tx=0x7f9dbc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151106f44d7b7770 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.872+0000 7f9dc6703640 1 -- 172.21.15.169:0/785077896 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc057070 con 0x55c04fdff320 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.872+0000 7f9dc6703640 1 -- 172.21.15.169:0/785077896 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dbc052570 con 0x55c04fdff320 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.872+0000 7f9dc6703640 1 -- 172.21.15.169:0/785077896 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dbc052870 con 0x55c04fdff320 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 -- 172.21.15.169:0/785077896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdff320 msgr2=0x55c04fe01710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/785077896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdff320 0x55c04fe01710 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc00a470 tx=0x7f9dbc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:06.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 -- 172.21.15.169:0/785077896 shutdown_connections 2024-04-24T01:26:06.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/785077896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdff320 0x55c04fe01710 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 -- 172.21.15.169:0/785077896 >> 172.21.15.169:0/785077896 conn(0x55c04fdf6520 msgr2=0x55c04fdf8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 -- 172.21.15.169:0/785077896 shutdown_connections 2024-04-24T01:26:06.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.873+0000 7f9dc9c06800 1 -- 172.21.15.169:0/785077896 wait complete. 2024-04-24T01:26:06.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.884+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.884+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc9c06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc9c06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c04fd463b0 con 0x55c04fdfaf80 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43690/0 (socket says 172.21.15.169:43690) 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc7705640 1 -- 172.21.15.169:0/2718803489 learned_addr learned my addr 172.21.15.169:0/2718803489 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.885+0000 7f9dc7705640 1 -- 172.21.15.169:0/2718803489 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04feec6b0 con 0x55c04fdfaf80 2024-04-24T01:26:06.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc7705640 1 --2- 172.21.15.169:0/2718803489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e10 tx=0x7f9db800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae34a83b4d790fd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9cb560a640 1 -- 172.21.15.169:0/2718803489 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db8012020 con 0x55c04fdfaf80 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9cb560a640 1 -- 172.21.15.169:0/2718803489 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db800e5a0 con 0x55c04fdfaf80 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9cb560a640 1 -- 172.21.15.169:0/2718803489 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db800e8e0 con 0x55c04fdfaf80 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2718803489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 msgr2=0x55c04feec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/2718803489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e10 tx=0x7f9db800b780 comp rx=0 tx=0).stop 2024-04-24T01:26:06.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2718803489 shutdown_connections 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/2718803489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04feec0e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2718803489 >> 172.21.15.169:0/2718803489 conn(0x55c04fdf6520 msgr2=0x55c04fee7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2718803489 shutdown_connections 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.886+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2718803489 wait complete. 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc9c06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc9c06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c04fe01fe0 con 0x55c04fdfaf80 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43694/0 (socket says 172.21.15.169:43694) 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.887+0000 7f9dc7705640 1 -- 172.21.15.169:0/1674210105 learned_addr learned my addr 172.21.15.169:0/1674210105 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9dc7705640 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04fef41d0 con 0x55c04fdfaf80 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9dc7705640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e10 tx=0x7f9db8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9cb3e07640 1 -- 172.21.15.169:0/1674210105 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db8012030 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9cb3e07640 1 -- 172.21.15.169:0/1674210105 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db801a7a0 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9cb3e07640 1 -- 172.21.15.169:0/1674210105 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db801aac0 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c04fef4460 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.888+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04fef7110 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc9c06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc9c06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c04fcec6b0 con 0x55c04fd70ae0 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9cb3e07640 1 -- 172.21.15.169:0/1674210105 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9db8015020 con 0x55c04fdfaf80 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7f06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7f06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43702/0 (socket says 172.21.15.169:43702) 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7f06640 1 -- 172.21.15.169:0/2790643769 learned_addr learned my addr 172.21.15.169:0/2790643769 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9cb3e07640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 0x7f9cac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9cb3e07640 1 -- 172.21.15.169:0/1674210105 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9db8020030 con 0x55c04fdfaf80 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7705640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 0x7f9cac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7f06640 1 -- 172.21.15.169:0/2790643769 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04fd6f570 con 0x55c04fd70ae0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.889+0000 7f9dc7f06640 1 --2- 172.21.15.169:0/2790643769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a430 tx=0x7f9dc000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8a6f83f51630c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc7705640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 0x7f9cac038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c010 tx=0x7f9db800ef10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9cb1e03640 1 -- 172.21.15.169:0/2790643769 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0015070 con 0x55c04fd70ae0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9cb1e03640 1 -- 172.21.15.169:0/2790643769 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc0001670 con 0x55c04fd70ae0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9cb1e03640 1 -- 172.21.15.169:0/2790643769 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0001990 con 0x55c04fd70ae0 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2790643769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 msgr2=0x55c04fd6f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/2790643769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a430 tx=0x7f9dc000a8f0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2790643769 shutdown_connections 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/2790643769 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04fd6f030 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2790643769 >> 172.21.15.169:0/2790643769 conn(0x55c04fdff320 msgr2=0x55c04fefdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2790643769 shutdown_connections 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- 172.21.15.169:0/2790643769 wait complete. 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.890+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc9c06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc9c06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c04fd6f860 con 0x55c04fd70ae0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc7f06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc7f06640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43716/0 (socket says 172.21.15.169:43716) 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc7f06640 1 -- 172.21.15.169:0/1922316412 learned_addr learned my addr 172.21.15.169:0/1922316412 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc7f06640 1 -- 172.21.15.169:0/1922316412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04ff0b180 con 0x55c04fd70ae0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc7f06640 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a930 tx=0x7f9dc0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9ca3fff640 1 -- 172.21.15.169:0/1922316412 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0020020 con 0x55c04fd70ae0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9ca3fff640 1 -- 172.21.15.169:0/1922316412 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00108b0 con 0x55c04fd70ae0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c04ff0b410 con 0x55c04fd70ae0 2024-04-24T01:26:06.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.891+0000 7f9ca3fff640 1 -- 172.21.15.169:0/1922316412 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc0015040 con 0x55c04fd70ae0 2024-04-24T01:26:06.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.892+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04ff0e0c0 con 0x55c04fd70ae0 2024-04-24T01:26:06.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.892+0000 7f9ca3fff640 1 -- 172.21.15.169:0/1922316412 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9dc0023020 con 0x55c04fd70ae0 2024-04-24T01:26:06.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.892+0000 7f9ca3fff640 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 0x7f9ca8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.892+0000 7f9ca3fff640 1 -- 172.21.15.169:0/1922316412 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9dc004c060 con 0x55c04fd70ae0 2024-04-24T01:26:06.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc6f04640 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 0x7f9ca8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc6f04640 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 0x7f9ca8038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc054000 tx=0x7f9dbc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 1 Processor -- start 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 1 -- start start 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.893+0000 7f9dc9c06800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c04feeca30 con 0x55c04ff25320 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc7705640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43732/0 (socket says 172.21.15.169:43732) 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc7705640 1 -- 172.21.15.169:0/3399991197 learned_addr learned my addr 172.21.15.169:0/3399991197 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc7705640 1 -- 172.21.15.169:0/3399991197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c04ff25c80 con 0x55c04ff25320 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc7705640 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001620 tx=0x7f9db802c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9c8cfe1640 1 -- 172.21.15.169:0/3399991197 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db8048070 con 0x55c04ff25320 2024-04-24T01:26:06.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9c8cfe1640 1 -- 172.21.15.169:0/3399991197 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9db800dd50 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c04ff266f0 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9c8cfe1640 1 -- 172.21.15.169:0/3399991197 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9db802ce40 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.894+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c04ff26bf0 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9c8cfe1640 1 -- 172.21.15.169:0/3399991197 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9db8017c50 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9c8cfe1640 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 0x7f9c00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9c8cfe1640 1 -- 172.21.15.169:0/3399991197 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f9db8034040 con 0x55c04ff25320 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9dc6f04640 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 0x7f9c00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9c867fc640 20 reqs_thread_entry: start 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 0x55c04ff35170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.895+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c04ff357f0 con 0x55c04ff32d20 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc6f04640 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 0x7f9c00038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc01ced0 tx=0x7f9dbc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc7f06640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 0x55c04ff35170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc7f06640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 0x55c04ff35170 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc7f06640 1 -- 172.21.15.169:0/1674210105 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9dc000e070 con 0x55c04ff32d20 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c04ff360d0 con 0x55c04ff32d20 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc7f06640 1 -- 172.21.15.169:0/1674210105 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9dc000e070 con 0x55c04ff32d20 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 0x55c04ff39e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.896+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c04ff3a590 con 0x55c04ff37990 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.897+0000 7f9dc7705640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 0x55c04ff39e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.897+0000 7f9dc7705640 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 0x55c04ff39e00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.897+0000 7f9dc7705640 1 -- 172.21.15.169:0/1674210105 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f9db804a030 con 0x55c04ff37990 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 msgr2=0x7f9ca8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 0x7f9ca8038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc054000 tx=0x7f9dbc04e000 comp rx=0 tx=0).stop 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 msgr2=0x55c04ff0ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000a930 tx=0x7f9dc0003370 comp rx=0 tx=0).stop 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 shutdown_connections 2024-04-24T01:26:06.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9ca8036900 0x7f9ca8038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1922316412 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fd70ae0 0x55c04ff0ac40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 >> 172.21.15.169:0/1922316412 conn(0x55c04fdff320 msgr2=0x55c04fefb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 shutdown_connections 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1922316412 wait complete. 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 msgr2=0x7f9c00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 0x7f9c00038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc01ced0 tx=0x7f9dbc005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 msgr2=0x55c04ff25740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001620 tx=0x7f9db802c980 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 shutdown_connections 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9c00036900 0x7f9c00038dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/3399991197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04ff25320 0x55c04ff25740 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 >> 172.21.15.169:0/3399991197 conn(0x55c04ff19dd0 msgr2=0x55c04ff1a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 shutdown_connections 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.898+0000 7f9dc9c06800 1 -- 172.21.15.169:0/3399991197 wait complete. 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 msgr2=0x55c04ff39e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 0x55c04ff39e00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 msgr2=0x55c04ff35170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 0x55c04ff35170 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 msgr2=0x7f9cac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 0x7f9cac038e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9db800c010 tx=0x7f9db800ef10 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 msgr2=0x55c04fef3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9db8001e10 tx=0x7f9db8000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 shutdown_connections 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c04ff37990 0x55c04ff39e00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c04ff32d20 0x55c04ff35170 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f9cac036950 0x7f9cac038e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 --2- 172.21.15.169:0/1674210105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c04fdfaf80 0x55c04fef3c90 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 >> 172.21.15.169:0/1674210105 conn(0x55c04fdf6520 msgr2=0x55c04fee6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 shutdown_connections 2024-04-24T01:26:06.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.899+0000 7f9dc9c06800 1 -- 172.21.15.169:0/1674210105 wait complete. 2024-04-24T01:26:06.910 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-04-24T01:26:06.910 DEBUG:tasks.util.rgw: json result: {'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-04-24T01:26:06.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:26:06.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-04-24T01:26:06.911 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-04-24T01:26:06.995 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:06.995 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.995+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.995+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.995+0000 7f2608c91800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55e18b70ea30 0x55e18b710e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.995+0000 7f2608c91800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e18b5ccd40 con 0x55e18b711360 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.995+0000 7f2608c91800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55e18b59f4d0 con 0x55e18b70ea30 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f2606790640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55e18b70ea30 0x55e18b710e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:06.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f25fdf8f640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55e18b711360 0x55e18b713750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50690/0 (socket says 172.21.15.169:50690) 2024-04-24T01:26:06.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f25fdf8f640 1 -- 172.21.15.169:0/4220178679 learned_addr learned my addr 172.21.15.169:0/4220178679 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:06.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f2606790640 1 -- 172.21.15.169:0/4220178679 >> v1:172.21.15.142:6789/0 conn(0x55e18b711360 legacy=0x55e18b713750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f2606790640 1 -- 172.21.15.169:0/4220178679 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b5cb590 con 0x55e18b70ea30 2024-04-24T01:26:06.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.996+0000 7f2605f8f640 1 -- 172.21.15.169:0/4220178679 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499410455 0 0) 0x55e18b5ccd40 con 0x55e18b711360 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2606790640 1 --2- 172.21.15.169:0/4220178679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b710e20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f25f800a470 tx=0x7f25f801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0e9105246e29c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2605f8f640 1 -- 172.21.15.169:0/4220178679 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8057070 con 0x55e18b70ea30 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2605f8f640 1 -- 172.21.15.169:0/4220178679 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8052570 con 0x55e18b70ea30 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2605f8f640 1 -- 172.21.15.169:0/4220178679 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8052870 con 0x55e18b70ea30 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 -- 172.21.15.169:0/4220178679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 msgr2=0x55e18b710e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 --2- 172.21.15.169:0/4220178679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b710e20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f25f800a470 tx=0x7f25f801ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 -- 172.21.15.169:0/4220178679 shutdown_connections 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 --2- 172.21.15.169:0/4220178679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b710e20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 -- 172.21.15.169:0/4220178679 >> 172.21.15.169:0/4220178679 conn(0x55e18b7083e0 msgr2=0x55e18b70a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 -- 172.21.15.169:0/4220178679 shutdown_connections 2024-04-24T01:26:06.999 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:06.998+0000 7f2608c91800 1 -- 172.21.15.169:0/4220178679 wait complete. 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.010+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.010+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.010+0000 7f2608c91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.010+0000 7f2608c91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e18b6593e0 con 0x55e18b70ea30 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43750/0 (socket says 172.21.15.169:43750) 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f2606790640 1 -- 172.21.15.169:0/3004632082 learned_addr learned my addr 172.21.15.169:0/3004632082 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f2606790640 1 -- 172.21.15.169:0/3004632082 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b7ff600 con 0x55e18b70ea30 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f2606790640 1 --2- 172.21.15.169:0/3004632082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f25f8055040 tx=0x7f25f804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f125d67e91b6858f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f24f4608640 1 -- 172.21.15.169:0/3004632082 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8057070 con 0x55e18b70ea30 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f24f4608640 1 -- 172.21.15.169:0/3004632082 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8063070 con 0x55e18b70ea30 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.011+0000 7f24f4608640 1 -- 172.21.15.169:0/3004632082 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8052720 con 0x55e18b70ea30 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- 172.21.15.169:0/3004632082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 msgr2=0x55e18b7ff030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 --2- 172.21.15.169:0/3004632082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f25f8055040 tx=0x7f25f804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- 172.21.15.169:0/3004632082 shutdown_connections 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 --2- 172.21.15.169:0/3004632082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b7ff030 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- 172.21.15.169:0/3004632082 >> 172.21.15.169:0/3004632082 conn(0x55e18b7083e0 msgr2=0x55e18b7fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- 172.21.15.169:0/3004632082 shutdown_connections 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- 172.21.15.169:0/3004632082 wait complete. 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.012+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2608c91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2608c91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e18b717180 con 0x55e18b70ea30 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43752/0 (socket says 172.21.15.169:43752) 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2606790640 1 -- 172.21.15.169:0/2331061184 learned_addr learned my addr 172.21.15.169:0/2331061184 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2606790640 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b806fa0 con 0x55e18b70ea30 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.013+0000 7f2606790640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f25f8060040 tx=0x7f25f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f24f2e05640 1 -- 172.21.15.169:0/2331061184 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8052e30 con 0x55e18b70ea30 2024-04-24T01:26:07.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f24f2e05640 1 -- 172.21.15.169:0/2331061184 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f806c070 con 0x55e18b70ea30 2024-04-24T01:26:07.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f24f2e05640 1 -- 172.21.15.169:0/2331061184 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f805e5f0 con 0x55e18b70ea30 2024-04-24T01:26:07.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e18b807230 con 0x55e18b70ea30 2024-04-24T01:26:07.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18b809ee0 con 0x55e18b70ea30 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.014+0000 7f2608c91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e18b5ff6b0 con 0x55e18b814360 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606f91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606f91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43754/0 (socket says 172.21.15.169:43754) 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606f91640 1 -- 172.21.15.169:0/1033895251 learned_addr learned my addr 172.21.15.169:0/1033895251 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f2e05640 1 -- 172.21.15.169:0/2331061184 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f25f805e790 con 0x55e18b70ea30 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606f91640 1 -- 172.21.15.169:0/1033895251 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b814cc0 con 0x55e18b814360 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f2e05640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 0x7f24ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f2e05640 1 -- 172.21.15.169:0/2331061184 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f25f808e960 con 0x55e18b70ea30 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606f91640 1 --2- 172.21.15.169:0/1033895251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f260000a430 tx=0x7f260000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce541f18b03deab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f2606790640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 0x7f24ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f0e01640 1 -- 172.21.15.169:0/1033895251 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2600015070 con 0x55e18b814360 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f0e01640 1 -- 172.21.15.169:0/1033895251 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2600001670 con 0x55e18b814360 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.015+0000 7f24f0e01640 1 -- 172.21.15.169:0/1033895251 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2600001990 con 0x55e18b814360 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- 172.21.15.169:0/1033895251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 msgr2=0x55e18b814780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2606790640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 0x7f24ec038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f25f80529c0 tx=0x7f25f807ae90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 --2- 172.21.15.169:0/1033895251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f260000a430 tx=0x7f260000a8f0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- 172.21.15.169:0/1033895251 shutdown_connections 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 --2- 172.21.15.169:0/1033895251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b814780 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- 172.21.15.169:0/1033895251 >> 172.21.15.169:0/1033895251 conn(0x55e18b711360 msgr2=0x55e18b810e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- 172.21.15.169:0/1033895251 shutdown_connections 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- 172.21.15.169:0/1033895251 wait complete. 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2608c91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e18b815650 con 0x55e18b814360 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2606f91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2606f91640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43756/0 (socket says 172.21.15.169:43756) 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.016+0000 7f2606f91640 1 -- 172.21.15.169:0/3632933589 learned_addr learned my addr 172.21.15.169:0/3632933589 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f2606f91640 1 -- 172.21.15.169:0/3632933589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b81bd40 con 0x55e18b814360 2024-04-24T01:26:07.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f2606f91640 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f260000a930 tx=0x7f2600003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f24eaffd640 1 -- 172.21.15.169:0/3632933589 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2600020020 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f24eaffd640 1 -- 172.21.15.169:0/3632933589 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26000108b0 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e18b81bfd0 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f24eaffd640 1 -- 172.21.15.169:0/3632933589 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2600015040 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.017+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18b81ec80 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f24eaffd640 1 -- 172.21.15.169:0/3632933589 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2600023020 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f24eaffd640 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 0x7f24e0038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f24eaffd640 1 -- 172.21.15.169:0/3632933589 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f260004c0a0 con 0x55e18b814360 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f2608c91800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f2608c91800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f25fdf8f640 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 0x7f24e0038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f2608c91800 1 Processor -- start 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f25fdf8f640 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 0x7f24e0038e60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.018+0000 7f2608c91800 1 -- start start 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2608c91800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2608c91800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55e18b7ff8c0 con 0x55e18b835ed0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2606790640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43760/0 (socket says 172.21.15.169:43760) 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2606790640 1 -- 172.21.15.169:0/3689043785 learned_addr learned my addr 172.21.15.169:0/3689043785 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2606790640 1 -- 172.21.15.169:0/3689043785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e18b836830 con 0x55e18b835ed0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2606790640 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25f808cd20 tx=0x7f25f8002e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f24cafe5640 1 -- 172.21.15.169:0/3689043785 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f8092070 con 0x55e18b835ed0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f24cafe5640 1 -- 172.21.15.169:0/3689043785 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8058040 con 0x55e18b835ed0 2024-04-24T01:26:07.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f24cafe5640 1 -- 172.21.15.169:0/3689043785 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25f808a040 con 0x55e18b835ed0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.019+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e18b836830 con 0x55e18b835ed0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.020+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e18b836830 con 0x55e18b835ed0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.020+0000 7f24cafe5640 1 -- 172.21.15.169:0/3689043785 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f25f807a840 con 0x55e18b835ed0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.020+0000 7f24cafe5640 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 0x7f2448038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.020+0000 7f24cafe5640 1 -- 172.21.15.169:0/3689043785 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f25f806a310 con 0x55e18b835ed0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.020+0000 7f25fdf8f640 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 0x7f2448038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f24c8fe1640 20 reqs_thread_entry: start 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 0x55e18b845a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f25fdf8f640 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 0x7f2448038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000f60 tx=0x7f25f0006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e18b846130 con 0x55e18b8435f0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2606f91640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 0x55e18b845a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2606f91640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 0x55e18b845a60 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2606f91640 1 -- 172.21.15.169:0/2331061184 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2600010d70 con 0x55e18b8435f0 2024-04-24T01:26:07.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 0x55e18b84a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.021+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:2 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e18b84a9e0 con 0x55e18b847f00 2024-04-24T01:26:07.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.022+0000 7f2606790640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 0x55e18b84a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.022+0000 7f2606790640 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 0x55e18b84a2f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.022+0000 7f2606790640 1 -- 172.21.15.169:0/2331061184 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(2 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f25f8097d60 con 0x55e18b847f00 2024-04-24T01:26:07.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.022+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e18b847560 con 0x55e18b847f00 2024-04-24T01:26:07.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2606790640 1 -- 172.21.15.169:0/2331061184 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [stat,call,call,writefull 0~993] v34'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f25f8067640 con 0x55e18b847f00 2024-04-24T01:26:07.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 msgr2=0x7f24e0038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 0x7f24e0038e60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000c00 tx=0x7f25f0001330 comp rx=0 tx=0).stop 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 msgr2=0x55e18b81b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f260000a930 tx=0x7f2600003370 comp rx=0 tx=0).stop 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 shutdown_connections 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24e00369a0 0x7f24e0038e60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 --2- 172.21.15.169:0/3632933589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b814360 0x55e18b81b800 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 >> 172.21.15.169:0/3632933589 conn(0x55e18b711360 msgr2=0x55e18b80e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.033 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 shutdown_connections 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.024+0000 7f2608c91800 1 -- 172.21.15.169:0/3632933589 wait complete. 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 msgr2=0x7f2448038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 0x7f2448038dc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f0000f60 tx=0x7f25f0006000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 msgr2=0x55e18b8362f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25f808cd20 tx=0x7f25f8002e40 comp rx=0 tx=0).stop 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 shutdown_connections 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2448036900 0x7f2448038dc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/3689043785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b835ed0 0x55e18b8362f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 >> 172.21.15.169:0/3689043785 conn(0x55e18b82a9a0 msgr2=0x55e18b82b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 shutdown_connections 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/3689043785 wait complete. 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 msgr2=0x55e18b84a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 0x55e18b84a2f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 msgr2=0x55e18b845a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 0x55e18b845a60 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 msgr2=0x7f24ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 0x7f24ec038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f25f80529c0 tx=0x7f25f807ae90 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 msgr2=0x55e18b806a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f25f8060040 tx=0x7f25f8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 shutdown_connections 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55e18b847f00 0x55e18b84a2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55e18b8435f0 0x55e18b845a60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f24ec036950 0x7f24ec038e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 --2- 172.21.15.169:0/2331061184 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e18b70ea30 0x55e18b806a60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 >> 172.21.15.169:0/2331061184 conn(0x55e18b7083e0 msgr2=0x55e18b7f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 shutdown_connections 2024-04-24T01:26:07.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.025+0000 7f2608c91800 1 -- 172.21.15.169:0/2331061184 wait complete. 2024-04-24T01:26:07.036 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-04-24T01:26:07.037 DEBUG:tasks.util.rgw: json result: {'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-04-24T01:26:07.037 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-04-24T01:26:07.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-04-24T01:26:07.037 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-04-24T01:26:07.077 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.078 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d7728800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5590a026ca60 0x5590a02fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d7728800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5590a01b7d40 con 0x5590a02fbf90 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d7728800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5590a018a4d0 con 0x5590a026ca60 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d3460640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5590a026ca60 0x5590a02fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d3460640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5590a026ca60 0x5590a02fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43776/0 (socket says 172.21.15.169:43776) 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d3460640 1 -- 172.21.15.169:0/2664125475 learned_addr learned my addr 172.21.15.169:0/2664125475 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.078+0000 7f90d2c5f640 1 --1- 172.21.15.169:0/2664125475 >> v1:172.21.15.142:6789/0 conn(0x5590a02fbf90 0x5590a02fe430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50706/0 (socket says 172.21.15.169:50706) 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.079+0000 7f90d3460640 1 -- 172.21.15.169:0/2664125475 >> v1:172.21.15.142:6789/0 conn(0x5590a02fbf90 legacy=0x5590a02fe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.079+0000 7f90d245e640 1 -- 172.21.15.169:0/2664125475 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304342874 0 0) 0x5590a01b7d40 con 0x5590a02fbf90 2024-04-24T01:26:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.079+0000 7f90d3460640 1 -- 172.21.15.169:0/2664125475 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a01b6590 con 0x5590a026ca60 2024-04-24T01:26:07.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.080+0000 7f90d3460640 1 --2- 172.21.15.169:0/2664125475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02fb9f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a520 tx=0x7f90c801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c69511cbb00496 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d245e640 1 -- 172.21.15.169:0/2664125475 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8057070 con 0x5590a026ca60 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d245e640 1 -- 172.21.15.169:0/2664125475 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8052570 con 0x5590a026ca60 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d245e640 1 -- 172.21.15.169:0/2664125475 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c804ae60 con 0x5590a026ca60 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 -- 172.21.15.169:0/2664125475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 msgr2=0x5590a02fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 --2- 172.21.15.169:0/2664125475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02fb9f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f90c800a520 tx=0x7f90c801d010 comp rx=0 tx=0).stop 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 -- 172.21.15.169:0/2664125475 shutdown_connections 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 --2- 172.21.15.169:0/2664125475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02fb9f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 -- 172.21.15.169:0/2664125475 >> 172.21.15.169:0/2664125475 conn(0x5590a02f32f0 msgr2=0x5590a02f5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 -- 172.21.15.169:0/2664125475 shutdown_connections 2024-04-24T01:26:07.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.081+0000 7f90d7728800 1 -- 172.21.15.169:0/2664125475 wait complete. 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d7728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d7728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590a02443b0 con 0x5590a026ca60 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43778/0 (socket says 172.21.15.169:43778) 2024-04-24T01:26:07.094 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.093+0000 7f90d3460640 1 -- 172.21.15.169:0/3422471313 learned_addr learned my addr 172.21.15.169:0/3422471313 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.094+0000 7f90d3460640 1 -- 172.21.15.169:0/3422471313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a03ea430 con 0x5590a026ca60 2024-04-24T01:26:07.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.094+0000 7f90d3460640 1 --2- 172.21.15.169:0/3422471313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f90c8055040 tx=0x7f90c804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a6cd85a96674bd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.094+0000 7f8fc160a640 1 -- 172.21.15.169:0/3422471313 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8062070 con 0x5590a026ca60 2024-04-24T01:26:07.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.094+0000 7f8fc160a640 1 -- 172.21.15.169:0/3422471313 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8052720 con 0x5590a026ca60 2024-04-24T01:26:07.095 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.094+0000 7f8fc160a640 1 -- 172.21.15.169:0/3422471313 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8057040 con 0x5590a026ca60 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- 172.21.15.169:0/3422471313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 msgr2=0x5590a03e9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 --2- 172.21.15.169:0/3422471313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f90c8055040 tx=0x7f90c804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- 172.21.15.169:0/3422471313 shutdown_connections 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 --2- 172.21.15.169:0/3422471313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a03e9e60 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- 172.21.15.169:0/3422471313 >> 172.21.15.169:0/3422471313 conn(0x5590a02f32f0 msgr2=0x5590a03e5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.101 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- 172.21.15.169:0/3422471313 shutdown_connections 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- 172.21.15.169:0/3422471313 wait complete. 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d7728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590a02fff00 con 0x5590a026ca60 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43794/0 (socket says 172.21.15.169:43794) 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.095+0000 7f90d3460640 1 -- 172.21.15.169:0/4023066140 learned_addr learned my addr 172.21.15.169:0/4023066140 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f90d3460640 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a02f7a10 con 0x5590a026ca60 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f90d3460640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f90c80057e0 tx=0x7f90c8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f8fbfe07640 1 -- 172.21.15.169:0/4023066140 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8057050 con 0x5590a026ca60 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f8fbfe07640 1 -- 172.21.15.169:0/4023066140 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c8067450 con 0x5590a026ca60 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f8fbfe07640 1 -- 172.21.15.169:0/4023066140 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8062040 con 0x5590a026ca60 2024-04-24T01:26:07.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a02f7ca0 con 0x5590a026ca60 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.096+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a02f8220 con 0x5590a026ca60 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d7728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d7728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590a01ea6b0 con 0x5590a04013e0 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f8fbfe07640 1 -- 172.21.15.169:0/4023066140 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f90c8067750 con 0x5590a026ca60 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d3c61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d3c61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43810/0 (socket says 172.21.15.169:43810) 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d3c61640 1 -- 172.21.15.169:0/843954042 learned_addr learned my addr 172.21.15.169:0/843954042 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f8fbfe07640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 0x7f8fb8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f8fbfe07640 1 -- 172.21.15.169:0/4023066140 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f90c808e250 con 0x5590a026ca60 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d3c61640 1 -- 172.21.15.169:0/843954042 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a0401d40 con 0x5590a04013e0 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.097+0000 7f90d3460640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 0x7f8fb8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d3c61640 1 --2- 172.21.15.169:0/843954042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00a430 tx=0x7f90cc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd169df05b5f1be1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f8fbde03640 1 -- 172.21.15.169:0/843954042 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90cc015070 con 0x5590a04013e0 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d3460640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 0x7f8fb8038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90c8052a00 tx=0x7f90c8067ca0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f8fbde03640 1 -- 172.21.15.169:0/843954042 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90cc001670 con 0x5590a04013e0 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f8fbde03640 1 -- 172.21.15.169:0/843954042 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90cc001990 con 0x5590a04013e0 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 -- 172.21.15.169:0/843954042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 msgr2=0x5590a0401800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 --2- 172.21.15.169:0/843954042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00a430 tx=0x7f90cc00a8f0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 -- 172.21.15.169:0/843954042 shutdown_connections 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 --2- 172.21.15.169:0/843954042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0401800 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 -- 172.21.15.169:0/843954042 >> 172.21.15.169:0/843954042 conn(0x5590a02fbf90 msgr2=0x5590a03fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 -- 172.21.15.169:0/843954042 shutdown_connections 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 -- 172.21.15.169:0/843954042 wait complete. 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.098+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d7728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d7728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590a04026d0 con 0x5590a04013e0 2024-04-24T01:26:07.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d3c61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d3c61640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43824/0 (socket says 172.21.15.169:43824) 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d3c61640 1 -- 172.21.15.169:0/525566765 learned_addr learned my addr 172.21.15.169:0/525566765 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d3c61640 1 -- 172.21.15.169:0/525566765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a0408da0 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d3c61640 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00a930 tx=0x7f90cc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f8faffff640 1 -- 172.21.15.169:0/525566765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90cc020020 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f8faffff640 1 -- 172.21.15.169:0/525566765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90cc0108b0 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a0409030 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.099+0000 7f8faffff640 1 -- 172.21.15.169:0/525566765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90cc015040 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.100+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a040bce0 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.100+0000 7f8faffff640 1 -- 172.21.15.169:0/525566765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f90cc023020 con 0x5590a04013e0 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.100+0000 7f90d7728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.100+0000 7f90d7728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.100+0000 7f8faffff640 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 0x7f8fb4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f8faffff640 1 -- 172.21.15.169:0/525566765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f90cc04c110 con 0x5590a04013e0 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d2c5f640 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 0x7f8fb4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d7728800 1 Processor -- start 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d7728800 1 -- start start 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d7728800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d7728800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5590a03ea6f0 con 0x5590a0422f80 2024-04-24T01:26:07.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d2c5f640 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 0x7f8fb4038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000c00 tx=0x7f90c4001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d3460640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43830/0 (socket says 172.21.15.169:43830) 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.101+0000 7f90d3460640 1 -- 172.21.15.169:0/575734634 learned_addr learned my addr 172.21.15.169:0/575734634 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f90d3460640 1 -- 172.21.15.169:0/575734634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590a0423950 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f90d3460640 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f90c808c5a0 tx=0x7f90c80667b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f8f53fff640 1 -- 172.21.15.169:0/575734634 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c8092070 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f8f53fff640 1 -- 172.21.15.169:0/575734634 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c805d960 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5590a0424310 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f8f53fff640 1 -- 172.21.15.169:0/575734634 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f90c805d440 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.102+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590a0424810 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f8f53fff640 1 -- 172.21.15.169:0/575734634 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f90c8095070 con 0x5590a0422f80 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f8f53fff640 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 0x7f8f14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f8f53fff640 1 -- 172.21.15.169:0/575734634 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f90c808c050 con 0x5590a0422f80 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f90d2c5f640 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 0x7f8f14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f8f51ffb640 20 reqs_thread_entry: start 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f90d2c5f640 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 0x7f8f14038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000f60 tx=0x7f90c4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 0x5590a0432dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a0433440 con 0x5590a0430930 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.103+0000 7f90d3c61640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 0x5590a0432dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d3c61640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 0x5590a0432dc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d3c61640 1 -- 172.21.15.169:0/4023066140 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f90cc00e070 con 0x5590a0430930 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a0433d20 con 0x5590a0430930 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d3c61640 1 -- 172.21.15.169:0/4023066140 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f90cc00e070 con 0x5590a0430930 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 0x5590a0437ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:3 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5590a0438180 con 0x5590a0435630 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.104+0000 7f90d3460640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 0x5590a0437ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.105+0000 7f90d3460640 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 0x5590a0437ac0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.105+0000 7f90d3460640 1 -- 172.21.15.169:0/4023066140 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(3 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f90c809e070 con 0x5590a0435630 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 msgr2=0x7f8fb4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 0x7f8fb4038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000c00 tx=0x7f90c4001330 comp rx=0 tx=0).stop 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 msgr2=0x5590a0408860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00a930 tx=0x7f90cc003370 comp rx=0 tx=0).stop 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 shutdown_connections 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb4036900 0x7f8fb4038dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/525566765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a04013e0 0x5590a0408860 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 >> 172.21.15.169:0/525566765 conn(0x5590a02fbf90 msgr2=0x5590a03fb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 shutdown_connections 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/525566765 wait complete. 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 msgr2=0x7f8f14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 0x7f8f14038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f90c4000f60 tx=0x7f90c4006000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 msgr2=0x5590a0423380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f90c808c5a0 tx=0x7f90c80667b0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 shutdown_connections 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8f14036900 0x7f8f14038dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/575734634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a0422f80 0x5590a0423380 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 >> 172.21.15.169:0/575734634 conn(0x5590a0417ae0 msgr2=0x5590a0418500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 shutdown_connections 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/575734634 wait complete. 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 msgr2=0x5590a0432dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 0x5590a0432dc0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 msgr2=0x5590a0437ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 0x5590a0437ac0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 msgr2=0x7f8fb8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 0x7f8fb8038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f90c8052a00 tx=0x7f90c8067ca0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 msgr2=0x5590a02f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.106+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f90c80057e0 tx=0x7f90c8002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 shutdown_connections 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5590a0435630 0x5590a0437ac0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5590a0430930 0x5590a0432dc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8fb8036900 0x7f8fb8038dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 --2- 172.21.15.169:0/4023066140 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5590a026ca60 0x5590a02f9320 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 >> 172.21.15.169:0/4023066140 conn(0x5590a02f32f0 msgr2=0x5590a03e3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 shutdown_connections 2024-04-24T01:26:07.115 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.107+0000 7f90d7728800 1 -- 172.21.15.169:0/4023066140 wait complete. 2024-04-24T01:26:07.116 INFO:teuthology.orchestra.run.smithi169.stdout:{"id":"0d63dfd5-2f76-4ac8-9c68-cc94814f72e9","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"f341815c-ea59-4c61-b01b-010b058e6023","zones":[{"id":"f341815c-ea59-4c61-b01b-010b058e6023","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-04-24T01:26:07.116 DEBUG:tasks.util.rgw: json result: {'id': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': 'f341815c-ea59-4c61-b01b-010b058e6023', 'zones': [{'id': 'f341815c-ea59-4c61-b01b-010b058e6023', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-04-24T01:26:07.119 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-04-24T01:26:07.170 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T01:26:07.170 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-04-24T01:26:07.171 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-04-24T01:26:07.223 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.223 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.224 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cfc1f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c2f9db4260 0x55c2f9dbcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cfc1f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2f9c72d40 con 0x55c2f9db2720 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cfc1f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c2f9c454d0 con 0x55c2f9db4260 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9ccf1d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c2f9db4260 0x55c2f9dbcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9ccf1d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c2f9db4260 0x55c2f9dbcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43832/0 (socket says 172.21.15.169:43832) 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9cd71e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c2f9db2720 0x55c2f9db2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50710/0 (socket says 172.21.15.169:50710) 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/401677566 learned_addr learned my addr 172.21.15.169:0/401677566 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/401677566 >> v1:172.21.15.142:6789/0 conn(0x55c2f9db2720 legacy=0x55c2f9db2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.225 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.224+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/401677566 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9c71590 con 0x55c2f9db4260 2024-04-24T01:26:07.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.226+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/401677566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db4260 0x55c2f9dbcd60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800a520 tx=0x7fe9b801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aad8b526476d08c server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.226+0000 7fe9c7fff640 1 -- 172.21.15.169:0/401677566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b8057070 con 0x55c2f9db4260 2024-04-24T01:26:07.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.226+0000 7fe9c7fff640 1 -- 172.21.15.169:0/401677566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b8052570 con 0x55c2f9db4260 2024-04-24T01:26:07.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.226+0000 7fe9c7fff640 1 -- 172.21.15.169:0/401677566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b8052870 con 0x55c2f9db4260 2024-04-24T01:26:07.227 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/401677566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db4260 msgr2=0x55c2f9dbcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/401677566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db4260 0x55c2f9dbcd60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800a520 tx=0x7fe9b801d010 comp rx=0 tx=0).stop 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/401677566 shutdown_connections 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/401677566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db4260 0x55c2f9dbcd60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/401677566 >> 172.21.15.169:0/401677566 conn(0x55c2f9dae2c0 msgr2=0x55c2f9db06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/401677566 shutdown_connections 2024-04-24T01:26:07.228 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.227+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/401677566 wait complete. 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cfc1f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cfc1f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9cff360 con 0x55c2f9db2720 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43840/0 (socket says 172.21.15.169:43840) 2024-04-24T01:26:07.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1976418120 learned_addr learned my addr 172.21.15.169:0/1976418120 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.239+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1976418120 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9ea7d10 con 0x55c2f9db2720 2024-04-24T01:26:07.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/1976418120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0001e90 tx=0x7fe9c000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578caae94a204466 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe8bb606640 1 -- 172.21.15.169:0/1976418120 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c000e5c0 con 0x55c2f9db2720 2024-04-24T01:26:07.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe8bb606640 1 -- 172.21.15.169:0/1976418120 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0006070 con 0x55c2f9db2720 2024-04-24T01:26:07.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe8bb606640 1 -- 172.21.15.169:0/1976418120 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c000e890 con 0x55c2f9db2720 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1976418120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 msgr2=0x55c2f9ea7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1976418120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0001e90 tx=0x7fe9c000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1976418120 shutdown_connections 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1976418120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9ea7740 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.240+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1976418120 >> 172.21.15.169:0/1976418120 conn(0x55c2f9dae2c0 msgr2=0x55c2f9ea3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1976418120 shutdown_connections 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1976418120 wait complete. 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9eaf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cfc1f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9dbf580 con 0x55c2f9db2720 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9eaf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.245 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9eaf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43842/0 (socket says 172.21.15.169:43842) 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3862568510 learned_addr learned my addr 172.21.15.169:0/3862568510 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.241+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9eaf7f0 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9eaf2b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c010 tx=0x7fe9c0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe8b9e03640 1 -- 172.21.15.169:0/3862568510 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c000f8d0 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe8b9e03640 1 -- 172.21.15.169:0/3862568510 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c000fa90 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2f9eafa80 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe8b9e03640 1 -- 172.21.15.169:0/3862568510 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c000fdb0 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.242+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9eb2730 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe8b9e03640 1 -- 172.21.15.169:0/3862568510 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c0017070 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe8b9e03640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8b4036900 0x7fe8b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe8b9e03640 1 -- 172.21.15.169:0/3862568510 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9c0015020 con 0x55c2f9db2720 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8b4036900 0x7fe8b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9db4260 0x55c2f9eb64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.246 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9eb6a70 con 0x55c2f9db4260 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9db4260 0x55c2f9eb64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8b4036900 0x7fe8b4038dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8054000 tx=0x7fe9b804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.243+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9db4260 0x55c2f9eb64f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/3862568510 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9db4260 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9eb3ac0 con 0x55c2f9db4260 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/3862568510 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9db4260 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9eb8e10 0x55c2f9ebb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ebb8f0 con 0x55c2f9eb8e10 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.244+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9eb8e10 0x55c2f9ebb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.247 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9eb8e10 0x55c2f9ebb200 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3862568510 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9eb8e10 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9eb7dc0 con 0x55c2f9db4260 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/3862568510 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9db4260 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c2f9ebcda0 0x55c2f9ebf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ebf950 con 0x55c2f9ebcda0 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.245+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c2f9ebcda0 0x55c2f9ebf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c2f9ebcda0 0x55c2f9ebf1f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/3862568510 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe9b805a040 con 0x55c2f9ebcda0 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9cfc1f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.246+0000 7fe9cfc1f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9ca56b0 con 0x55c2f9ecdd60 2024-04-24T01:26:07.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43852/0 (socket says 172.21.15.169:43852) 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3920869642 learned_addr learned my addr 172.21.15.169:0/3920869642 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3920869642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9ece6c0 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe9c004b540 tx=0x7fe9c0041d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe8b2ffd640 1 -- 172.21.15.169:0/3920869642 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c001a690 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe8b2ffd640 1 -- 172.21.15.169:0/3920869642 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c001a830 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2f9ecf130 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe8b2ffd640 1 -- 172.21.15.169:0/3920869642 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c0044b10 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.247+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9ecf630 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe8b2ffd640 1 -- 172.21.15.169:0/3920869642 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c0044cd0 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe8b2ffd640 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 0x7fe8a4038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe8b2ffd640 1 -- 172.21.15.169:0/3920869642 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9c002c060 con 0x55c2f9ecdd60 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 0x7fe8a4038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 0x7fe8a4038e30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55c2f9eb73c0 tx=0x7fe9b8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9cfc1f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.248+0000 7fe9cfc1f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9ea8090 con 0x55c2f9edae80 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43860/0 (socket says 172.21.15.169:43860) 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3633993899 learned_addr learned my addr 172.21.15.169:0/3633993899 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe9cd71e640 1 -- 172.21.15.169:0/3633993899 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9edb850 con 0x55c2f9edae80 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/3633993899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0046010 tx=0x7fe9c003f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc734cc619dada0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe8b0ff9640 1 -- 172.21.15.169:0/3633993899 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c003f040 con 0x55c2f9edae80 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe8b0ff9640 1 -- 172.21.15.169:0/3633993899 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c0060070 con 0x55c2f9edae80 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.249+0000 7fe8b0ff9640 1 -- 172.21.15.169:0/3633993899 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c00447b0 con 0x55c2f9edae80 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3633993899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 msgr2=0x55c2f9edb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3633993899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0046010 tx=0x7fe9c003f720 comp rx=0 tx=0).stop 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3633993899 shutdown_connections 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3633993899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9edb280 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3633993899 >> 172.21.15.169:0/3633993899 conn(0x55c2f9ed7150 msgr2=0x55c2f9ed51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3633993899 shutdown_connections 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3633993899 wait complete. 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 Processor -- start 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- start start 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cfc1f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c2f9edbf40 con 0x55c2f9edae80 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cd71e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43876/0 (socket says 172.21.15.169:43876) 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.250+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 learned_addr learned my addr 172.21.15.169:0/1378392602 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f9ee27f0 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe9c004b9d0 tx=0x7fe9c0047f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe8a2ffd640 1 -- 172.21.15.169:0/1378392602 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c003f040 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe8a2ffd640 1 -- 172.21.15.169:0/1378392602 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c006a070 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2f9ee27f0 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe8a2ffd640 1 -- 172.21.15.169:0/1378392602 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9c003f350 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.251+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f9ee27f0 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.252+0000 7fe8a2ffd640 1 -- 172.21.15.169:0/1378392602 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe9c0059030 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.252+0000 7fe8a2ffd640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe898036860 0x7fe898038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.252+0000 7fe8a2ffd640 1 -- 172.21.15.169:0/1378392602 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe9c0055670 con 0x55c2f9edae80 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.252+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe898036860 0x7fe898038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe898036860 0x7fe898038d20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8052fd0 tx=0x7fe9b804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9eed970 0x55c2f9eefe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.264 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef0580 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9eed970 0x55c2f9eefe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9eed970 0x55c2f9eefe30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 realm 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef0990 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.253+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1260 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.265 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9ef2360 0x55c2f9ef4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef4d60 con 0x55c2f9ef2360 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.254+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9ef2360 0x55c2f9ef4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cd71e640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9ef2360 0x55c2f9ef4750 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cfc1f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cfc1f800 20 searching for the correct realm 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c2f9ef6d10 0x55c2f9ef91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.266 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef98a0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.255+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c2f9ef6d10 0x55c2f9ef91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c2f9ef6d10 0x55c2f9ef91d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9ccf1d640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe9b8074040 0x7fe9b8081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef98a0 con 0x7fe9b8074040 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe9b8074040 0x7fe9b8081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.256+0000 7fe9cdf1f640 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe9b8074040 0x7fe9b8081410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x7fe9b8074040 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9ef2360 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.257+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9ef2360 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x7fe9b8074040 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x7fe9b8074040 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9ef6d10 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.258+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9ef2360 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9eed970 2024-04-24T01:26:07.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c800a4a0 con 0x55c2f9eed970 2024-04-24T01:26:07.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x7fe9b8074040 2024-04-24T01:26:07.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.259+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef1600 con 0x55c2f9ef6d10 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef2360 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.279 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.260+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9eed970 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9eed970 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.261+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef2360 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x7fe9b8074040 2024-04-24T01:26:07.280 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9eed970 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.262+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef2360 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef2360 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.263+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x7fe9b8074040 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9ef2360 2024-04-24T01:26:07.281 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x55c2f9eed970 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.264+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fe9b808e040 con 0x7fe9b8074040 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef5620 con 0x55c2f9eed970 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef5620 con 0x55c2f9eed970 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef5620 con 0x7fe9b8074040 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 zone default found 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 4 Realm: () 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 zonegroup default 2024-04-24T01:26:07.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.265+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ef5ec0 con 0x55c2f9ef2360 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efb700 con 0x55c2f9ef6d10 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efbaa0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 started sync module instance, tier type = 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:07.284 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.266+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efaba0 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.267+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.267+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94295905251264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efaba0 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.267+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efc350 con 0x55c2f9eed970 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.268+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94295905251264] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.269+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.269+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94295905254976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efaba0 con 0x55c2f9eed970 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.269+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efcdc0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.270+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94295905254976] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.271+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.271+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94295905249008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efab10 con 0x55c2f9ef6d10 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.271+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efdb80 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.273+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.273+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94295905249008] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.273+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94295905261152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efe420 con 0x7fe9b8074040 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.273+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efd1d0 con 0x55c2f9eed970 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.274+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94295905261152] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.274+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.274+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94295905263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efe9b0 con 0x55c2f9eed970 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.274+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9eff370 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.275+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94295905263232] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.275+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.275+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94295905267392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9eff760 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.275+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f00120 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.276+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94295905267392] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.276+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.276+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94295905264288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f009f0 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.276+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f012a0 con 0x55c2f9ef2360 2024-04-24T01:26:07.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.277+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94295905264288] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94295905273072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f01260 con 0x55c2f9ef2360 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=0 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=1 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=2 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=3 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=4 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=5 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=6 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94295905273072] v34'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 20 add_watcher() i=7 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.278+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f04720 con 0x55c2f9eed970 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.279+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.279+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94295905274656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f01c40 con 0x55c2f9eed970 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94295905274656] v34'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe8837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe9cfc1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe9cfc1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe9cfc1f800 5 note: GC not initialized 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe8827e4640 20 reqs_thread_entry: start 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.280+0000 7fe9cfc1f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 20 Filter name: none 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe7f3fff640 20 reqs_thread_entry: start 2024-04-24T01:26:07.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f37ad0 con 0x55c2f9ef2360 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f36270 con 0x55c2f9eed970 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.281+0000 7fe9cfc1f800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.282+0000 7fe9cfc1f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T01:26:07.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.282+0000 7fe9cfc1f800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.282+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f36c60 con 0x55c2f9ef2360 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cfc1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cfc1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cfc1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94295905494704 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f3b570 con 0x55c2f9eed970 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== watch-notify(notify (1) cookie 94295905263232 notify 146028888085 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fe9c8018a80 con 0x55c2f9eed970 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe8b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94295905263232 notifier 4829 bl.length()=649 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify cookie 94295905494704 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe8b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe8b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.283+0000 7fe8b0ff9640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe890003ea0 con 0x55c2f9eed970 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.284+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.284+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== watch-notify(notify_complete (2) cookie 94295905494704 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe9c8018d20 con 0x55c2f9eed970 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.284+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f366b0 con 0x55c2f9eed970 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v34'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9cfc1f800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9cfc1f800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9cfc1f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94295905509552 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9f366b0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== watch-notify(notify (1) cookie 94295905249008 notify 146028888088 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fe9b8088040 con 0x55c2f9ef6d10 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe8b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94295905249008 notifier 4829 bl.length()=177 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe8b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe8b0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(68 notify.2 [notify cookie 94295905509552 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe8b0ff9640 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe890003ea0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.285+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== watch-notify(notify_complete (2) cookie 94295905509552 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c2f9c71590 con 0x55c2f9ef6d10 2024-04-24T01:26:07.296 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:07.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.286+0000 7fe8837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.286+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94295905274656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ee9ed0 con 0x55c2f9eed970 2024-04-24T01:26:07.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.287+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94295905274656] v34'246 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.287+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94295905251264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9ee92a0 con 0x7fe9b8074040 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.288+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94295905251264] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.288+0000 7fe9cfc1f800 20 remove_watcher() i=0 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.288+0000 7fe9cfc1f800 2 removed watcher, disabling cache 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.288+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94295905254976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efafc0 con 0x55c2f9eed970 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.289+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94295905254976] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.289+0000 7fe9cfc1f800 20 remove_watcher() i=1 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.289+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94295905249008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efafc0 con 0x55c2f9ef6d10 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.290+0000 7fe9ccf1d640 1 -- 172.21.15.169:0/1378392602 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94295905249008] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9b807f070 con 0x55c2f9ef6d10 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.290+0000 7fe9cfc1f800 20 remove_watcher() i=2 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.290+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94295905261152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efa6f0 con 0x7fe9b8074040 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.291+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94295905261152] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x7fe9b8074040 2024-04-24T01:26:07.302 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.291+0000 7fe9cfc1f800 20 remove_watcher() i=3 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.291+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94295905263232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efafc0 con 0x55c2f9eed970 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.292+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94295905263232] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c8032040 con 0x55c2f9eed970 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.292+0000 7fe9cfc1f800 20 remove_watcher() i=4 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.292+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94295905267392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efa6f0 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.294+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94295905267392] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.294+0000 7fe9cfc1f800 20 remove_watcher() i=5 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.294+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94295905264288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efde80 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.294+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94295905264288] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.295+0000 7fe9cfc1f800 20 remove_watcher() i=6 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.295+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94295905273072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c2f9efafc0 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.295+0000 7fe9cd71e640 1 -- 172.21.15.169:0/1378392602 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94295905273072] v34'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9c002e070 con 0x55c2f9ef2360 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.295+0000 7fe9cfc1f800 20 remove_watcher() i=7 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9ef2360 msgr2=0x55c2f9ef4750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.303 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9ef2360 0x55c2f9ef4750 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9eed970 msgr2=0x55c2f9eefe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9eed970 0x55c2f9eefe30 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe9b8074040 msgr2=0x7fe9b8081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fe9b8074040 0x7fe9b8081410 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c2f9ef6d10 msgr2=0x55c2f9ef91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c2f9ef6d10 0x55c2f9ef91d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe898036860 msgr2=0x7fe898038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe898036860 0x7fe898038d20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8052fd0 tx=0x7fe9b804f000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 msgr2=0x55c2f9ee22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe9c004b9d0 tx=0x7fe9c0047f60 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/1378392602 reap_dead start 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 shutdown_connections 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/1378392602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9edae80 0x55c2f9ee22b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.304 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 >> 172.21.15.169:0/1378392602 conn(0x55c2f9ed7150 msgr2=0x55c2f9ed47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 shutdown_connections 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/1378392602 wait complete. 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 msgr2=0x7fe8a4038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 0x7fe8a4038e30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55c2f9eb73c0 tx=0x7fe9b8005ac0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 msgr2=0x55c2f9ece180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe9c004b540 tx=0x7fe9c0041d70 comp rx=0 tx=0).stop 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 shutdown_connections 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8a4036970 0x7fe8a4038e30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3920869642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9ecdd60 0x55c2f9ece180 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 >> 172.21.15.169:0/3920869642 conn(0x55c2f9ec1e00 msgr2=0x55c2f9ec2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 shutdown_connections 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.296+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3920869642 wait complete. 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9eb8e10 msgr2=0x55c2f9ebb200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c2f9eb8e10 0x55c2f9ebb200 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.305 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9db4260 msgr2=0x55c2f9eb64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c2f9db4260 0x55c2f9eb64f0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c2f9ebcda0 msgr2=0x55c2f9ebf1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c2f9ebcda0 0x55c2f9ebf1f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8b4036900 msgr2=0x7fe8b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe8b4036900 0x7fe8b4038dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8054000 tx=0x7fe9b804e000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 msgr2=0x55c2f9eaf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 --2- 172.21.15.169:0/3862568510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2f9db2720 0x55c2f9eaf2b0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c010 tx=0x7fe9c0000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cdf1f640 1 -- 172.21.15.169:0/3862568510 reap_dead start 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 shutdown_connections 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 >> 172.21.15.169:0/3862568510 conn(0x55c2f9dae2c0 msgr2=0x55c2f9ea1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 shutdown_connections 2024-04-24T01:26:07.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.297+0000 7fe9cfc1f800 1 -- 172.21.15.169:0/3862568510 wait complete. 2024-04-24T01:26:07.307 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.307 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.308 ERROR:root:0 2024-04-24T01:26:07.308 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:07.314 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000c55d45e5c7bdffc5-0066285faf-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:26:07.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-04-24T01:26:07.325 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:07.325 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-04-24T01:26:07.338 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-04-24T01:26:07.339 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-04-24T01:26:07.355 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T01:26:07.355 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-04-24T01:26:07.363 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-04-24T01:26:07.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:07.367 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:07.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-04-24T01:26:07.372 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:07.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:07.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:07.373 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-04-24T01:26:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.419 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ee03f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5591e85052a0 0x5591e850dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ee03f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591e83c3d40 con 0x5591e8503760 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ee03f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5591e83964d0 con 0x5591e85052a0 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83eb33d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5591e85052a0 0x5591e850dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ebb3e640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5591e8503760 0x5591e8503b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50724/0 (socket says 172.21.15.169:50724) 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83eb33d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5591e85052a0 0x5591e850dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43882/0 (socket says 172.21.15.169:43882) 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83ebb3e640 1 -- 172.21.15.169:0/770795040 learned_addr learned my addr 172.21.15.169:0/770795040 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:07.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83eb33d640 1 -- 172.21.15.169:0/770795040 >> v1:172.21.15.142:6789/0 conn(0x5591e8503760 legacy=0x5591e8503b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.422 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.420+0000 7f83eb33d640 1 -- 172.21.15.169:0/770795040 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e83c2590 con 0x5591e85052a0 2024-04-24T01:26:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.422+0000 7f83eb33d640 1 --2- 172.21.15.169:0/770795040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e85052a0 0x5591e850dda0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00a470 tx=0x7f83dc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83db43bbd10cd97e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.422+0000 7f83eab3c640 1 -- 172.21.15.169:0/770795040 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83dc057070 con 0x5591e85052a0 2024-04-24T01:26:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.422+0000 7f83eab3c640 1 -- 172.21.15.169:0/770795040 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc04adc0 con 0x5591e85052a0 2024-04-24T01:26:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.422+0000 7f83eab3c640 1 -- 172.21.15.169:0/770795040 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83dc052590 con 0x5591e85052a0 2024-04-24T01:26:07.423 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 -- 172.21.15.169:0/770795040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e85052a0 msgr2=0x5591e850dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 --2- 172.21.15.169:0/770795040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e85052a0 0x5591e850dda0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f83dc00a470 tx=0x7f83dc01ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 -- 172.21.15.169:0/770795040 shutdown_connections 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 --2- 172.21.15.169:0/770795040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e85052a0 0x5591e850dda0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 -- 172.21.15.169:0/770795040 >> 172.21.15.169:0/770795040 conn(0x5591e84ff3a0 msgr2=0x5591e85017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 -- 172.21.15.169:0/770795040 shutdown_connections 2024-04-24T01:26:07.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.423+0000 7f83ee03f800 1 -- 172.21.15.169:0/770795040 wait complete. 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.434+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.434+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ee03f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ee03f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591e84503b0 con 0x5591e8503760 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43890/0 (socket says 172.21.15.169:43890) 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ebb3e640 1 -- 172.21.15.169:0/550392047 learned_addr learned my addr 172.21.15.169:0/550392047 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.436 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ebb3e640 1 -- 172.21.15.169:0/550392047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e85f8bd0 con 0x5591e8503760 2024-04-24T01:26:07.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/550392047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001d50 tx=0x7f83e000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf869ddddfb5a188 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.435+0000 7f82d9e0b640 1 -- 172.21.15.169:0/550392047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0013030 con 0x5591e8503760 2024-04-24T01:26:07.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f82d9e0b640 1 -- 172.21.15.169:0/550392047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e000e470 con 0x5591e8503760 2024-04-24T01:26:07.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f82d9e0b640 1 -- 172.21.15.169:0/550392047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e000e810 con 0x5591e8503760 2024-04-24T01:26:07.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 -- 172.21.15.169:0/550392047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 msgr2=0x5591e85f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 --2- 172.21.15.169:0/550392047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f83e0001d50 tx=0x7f83e000b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 -- 172.21.15.169:0/550392047 shutdown_connections 2024-04-24T01:26:07.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 --2- 172.21.15.169:0/550392047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e85f8600 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 -- 172.21.15.169:0/550392047 >> 172.21.15.169:0/550392047 conn(0x5591e84ff3a0 msgr2=0x5591e85f3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 -- 172.21.15.169:0/550392047 shutdown_connections 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.436+0000 7f83ee03f800 1 -- 172.21.15.169:0/550392047 wait complete. 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ee03f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e8600150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ee03f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591e85105c0 con 0x5591e8503760 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e8600150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e8600150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43906/0 (socket says 172.21.15.169:43906) 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ebb3e640 1 -- 172.21.15.169:0/539906491 learned_addr learned my addr 172.21.15.169:0/539906491 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ebb3e640 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e8600690 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e8600150 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5591e85f9390 tx=0x7f83e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f82d3fff640 1 -- 172.21.15.169:0/539906491 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0027070 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.437+0000 7f82d3fff640 1 -- 172.21.15.169:0/539906491 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e0019900 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.438+0000 7f82d3fff640 1 -- 172.21.15.169:0/539906491 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0019c40 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.438+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e8600920 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.438+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e86035d0 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.438+0000 7f82d3fff640 1 -- 172.21.15.169:0/539906491 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83e002a070 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f82d3fff640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82d4036950 0x7f82d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f82d3fff640 1 -- 172.21.15.169:0/539906491 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83e001f070 con 0x5591e8503760 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83eb33d640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82d4036950 0x7f82d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e85052a0 0x5591e8607390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e86078d0 con 0x5591e85052a0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ec33f640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e85052a0 0x5591e8607390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83eb33d640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82d4036950 0x7f82d4038e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83dc054000 tx=0x7f83dc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ec33f640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e85052a0 0x5591e8607390 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ec33f640 1 -- 172.21.15.169:0/539906491 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e85052a0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.439+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8604960 con 0x5591e85052a0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.440+0000 7f83ec33f640 1 -- 172.21.15.169:0/539906491 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e85052a0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.440+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8609c20 0x5591e860c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.440+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e860c700 con 0x5591e8609c20 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.440+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8609c20 0x5591e860c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.440+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8609c20 0x5591e860c010 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83ebb3e640 1 -- 172.21.15.169:0/539906491 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f83e0029030 con 0x5591e8609c20 2024-04-24T01:26:07.446 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8608bd0 con 0x5591e85052a0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83ec33f640 1 -- 172.21.15.169:0/539906491 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e85052a0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5591e860dbb0 0x5591e8610000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8610760 con 0x5591e860dbb0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83eb33d640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5591e860dbb0 0x5591e8610000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.441+0000 7f83eb33d640 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5591e860dbb0 0x5591e8610000 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83eb33d640 1 -- 172.21.15.169:0/539906491 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f83dc05a040 con 0x5591e860dbb0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ee03f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ee03f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591e83f66b0 con 0x5591e861ebc0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.447 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43918/0 (socket says 172.21.15.169:43918) 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1188874600 learned_addr learned my addr 172.21.15.169:0/1188874600 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.442+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1188874600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e861f520 con 0x5591e861ebc0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f83e004aaf0 tx=0x7f83e004ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f82d17fa640 1 -- 172.21.15.169:0/1188874600 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e00493b0 con 0x5591e861ebc0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f82d17fa640 1 -- 172.21.15.169:0/1188874600 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e0049550 con 0x5591e861ebc0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e861ff90 con 0x5591e861ebc0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f82d17fa640 1 -- 172.21.15.169:0/1188874600 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e00448b0 con 0x5591e861ebc0 2024-04-24T01:26:07.448 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e8620490 con 0x5591e861ebc0 2024-04-24T01:26:07.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.443+0000 7f82d17fa640 1 -- 172.21.15.169:0/1188874600 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83e0016070 con 0x5591e861ebc0 2024-04-24T01:26:07.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f82d17fa640 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 0x7f82c4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f82d17fa640 1 -- 172.21.15.169:0/1188874600 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83e0014070 con 0x5591e861ebc0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 0x7f82c4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 0x7f82c4038e10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5591e86081d0 tx=0x7f83dc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83ee03f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.444+0000 7f83ee03f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591e85f8f50 con 0x5591e862bce0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43928/0 (socket says 172.21.15.169:43928) 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1393414774 learned_addr learned my addr 172.21.15.169:0/1393414774 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1393414774 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e862c6d0 con 0x5591e862bce0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/1393414774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f83e0037040 tx=0x7f83e004e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff5bcd0bca84c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f82caffd640 1 -- 172.21.15.169:0/1393414774 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e003ebc0 con 0x5591e862bce0 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f82caffd640 1 -- 172.21.15.169:0/1393414774 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e005f070 con 0x5591e862bce0 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f82caffd640 1 -- 172.21.15.169:0/1393414774 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e0044a50 con 0x5591e862bce0 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ee03f800 1 -- 172.21.15.169:0/1393414774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 msgr2=0x5591e862c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.445+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1393414774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f83e0037040 tx=0x7f83e004e220 comp rx=0 tx=0).stop 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- 172.21.15.169:0/1393414774 shutdown_connections 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1393414774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e862c100 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- 172.21.15.169:0/1393414774 >> 172.21.15.169:0/1393414774 conn(0x5591e8628040 msgr2=0x5591e86260a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- 172.21.15.169:0/1393414774 shutdown_connections 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- 172.21.15.169:0/1393414774 wait complete. 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 Processor -- start 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- start start 2024-04-24T01:26:07.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ee03f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5591e862cd80 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ebb3e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43938/0 (socket says 172.21.15.169:43938) 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 learned_addr learned my addr 172.21.15.169:0/1607131171 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.446+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591e8633630 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f83e004ab20 tx=0x7f83e004e130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f82c97fa640 1 -- 172.21.15.169:0/1607131171 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e003e520 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f82c97fa640 1 -- 172.21.15.169:0/1607131171 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e003e6c0 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5591e8633630 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f82c97fa640 1 -- 172.21.15.169:0/1607131171 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f83e004c8d0 con 0x5591e862bce0 2024-04-24T01:26:07.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.447+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591e8633630 con 0x5591e862bce0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f82c97fa640 1 -- 172.21.15.169:0/1607131171 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f83e004cb00 con 0x5591e862bce0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f82c97fa640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82b4036900 0x7f82b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f82c97fa640 1 -- 172.21.15.169:0/1607131171 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f83e0057070 con 0x5591e862bce0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82b4036900 0x7f82b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82b4036900 0x7f82b4038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5591e8610b60 tx=0x7f83dc060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e863e830 0x5591e8640cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8641440 con 0x5591e863e830 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.448+0000 7f83ec33f640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e863e830 0x5591e8640cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ec33f640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e863e830 0x5591e8640cf0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 realm 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8641850 con 0x5591e863e830 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8642120 con 0x5591e863e830 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.449+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ee03f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8643220 0x5591e8645610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8645c20 con 0x5591e8643220 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8643220 0x5591e8645610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.450+0000 7f83ebb3e640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8643220 0x5591e8645610 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ee03f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ee03f800 20 searching for the correct realm 2024-04-24T01:26:07.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5591e8647bd0 0x5591e864a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e864a760 con 0x5591e8647bd0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5591e8647bd0 0x5591e864a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5591e8647bd0 0x5591e864a090 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83eb33d640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f83dc052bb0 0x7f83dc080930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e864a760 con 0x7f83dc052bb0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.451+0000 7f83ec33f640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f83dc052bb0 0x7f83dc080930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ec33f640 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f83dc052bb0 0x7f83dc080930 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x7f83dc052bb0 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.452+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x7f83dc052bb0 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x7f83dc052bb0 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.453+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e400a4a0 con 0x5591e863e830 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.454+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x7f83dc052bb0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.455+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.456+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x7f83dc052bb0 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.457+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.458+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x7f83dc052bb0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8647bd0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x5591e863e830 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.459+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5591e86424c0 con 0x7f83dc052bb0 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e86464e0 con 0x5591e863e830 2024-04-24T01:26:07.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e86464e0 con 0x5591e863e830 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e86464e0 con 0x7f83dc052bb0 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.460+0000 7f83ee03f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 zone default found 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 4 Realm: () 2024-04-24T01:26:07.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 zonegroup default 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8646d80 con 0x5591e8643220 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e864c5c0 con 0x5591e8647bd0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e864c960 con 0x5591e8647bd0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.461+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.462+0000 7f83ee03f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.462+0000 7f83ee03f800 20 started sync module instance, tier type = 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.462+0000 7f83ee03f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.462+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864ba60 con 0x7f83dc052bb0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.463+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.463+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94085157535312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864ba60 con 0x7f83dc052bb0 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.463+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864d1f0 con 0x5591e863e830 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.464+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.464+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94085157539072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864d180 con 0x5591e863e830 2024-04-24T01:26:07.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.464+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864e190 con 0x5591e8647bd0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.465+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94085157539072] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.465+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94085157535312] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.465+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.465+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94085157533104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864d5e0 con 0x5591e8647bd0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.465+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864ea30 con 0x7f83dc052bb0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.466+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.466+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94085157545824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864f2d0 con 0x7f83dc052bb0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.467+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864fdc0 con 0x5591e863e830 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.467+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94085157533104] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.468+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.468+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94085157550224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864fd80 con 0x5591e863e830 2024-04-24T01:26:07.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.468+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8650810 con 0x5591e8643220 2024-04-24T01:26:07.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.468+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94085157545824] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.469+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94085157550224] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.469+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.469+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94085157543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8650320 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.469+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e86510b0 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.470+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94085157543008] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.470+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.470+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94085157555200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e86514d0 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.470+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651e90 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94085157558752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e86522b0 con 0x5591e8643220 2024-04-24T01:26:07.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=0 2024-04-24T01:26:07.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=1 2024-04-24T01:26:07.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=2 2024-04-24T01:26:07.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=3 2024-04-24T01:26:07.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=4 2024-04-24T01:26:07.497 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=5 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94085157555200] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.471+0000 7f83ee03f800 20 add_watcher() i=6 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94085157558752] v34'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ee03f800 20 add_watcher() i=7 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ee03f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651020 con 0x5591e863e830 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.473+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94085157559808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651020 con 0x5591e863e830 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.474+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94085157559808] v34'247 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.474+0000 7f82a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.498 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.474+0000 7f83ee03f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 5 note: GC not initialized 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f82a0fe1640 20 reqs_thread_entry: start 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 20 Filter name: none 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f821a7fc640 20 reqs_thread_entry: start 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:07.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.475+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e8688620 con 0x5591e8643220 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ee03f800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ee03f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ee03f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ee03f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.476+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e868ef40 con 0x5591e8643220 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ee03f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ee03f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ee03f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:07.500 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94085157808560 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5591e868a630 con 0x5591e863e830 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94085157550224 notify 146028888087 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f83e4018ac0 con 0x5591e863e830 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f82caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94085157550224 notifier 4836 bl.length()=636 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94085157808560 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f82caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f82caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f82caffd640 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f82b0003ea0 con 0x5591e863e830 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.477+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.478+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94085157808560 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f83e4018d60 con 0x5591e863e830 2024-04-24T01:26:07.502 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:07.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.478+0000 7f82a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.478+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94085157559808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e868dea0 con 0x5591e863e830 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.479+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94085157559808] v34'248 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.479+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94085157535312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651e00 con 0x7f83dc052bb0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.480+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94085157535312] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.480+0000 7f83ee03f800 20 remove_watcher() i=0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.480+0000 7f83ee03f800 2 removed watcher, disabling cache 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.480+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94085157539072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651e00 con 0x5591e863e830 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.481+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94085157539072] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.481+0000 7f83ee03f800 20 remove_watcher() i=1 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.481+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94085157533104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864cd00 con 0x5591e8647bd0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.482+0000 7f83eb33d640 1 -- 172.21.15.169:0/1607131171 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94085157533104] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83dc070070 con 0x5591e8647bd0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.482+0000 7f83ee03f800 20 remove_watcher() i=2 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.482+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94085157545824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8651e00 con 0x7f83dc052bb0 2024-04-24T01:26:07.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.483+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94085157545824] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x7f83dc052bb0 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.483+0000 7f83ee03f800 20 remove_watcher() i=3 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.483+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94085157550224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864e760 con 0x5591e863e830 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.484+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94085157550224] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e4032040 con 0x5591e863e830 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.484+0000 7f83ee03f800 20 remove_watcher() i=4 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.484+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94085157543008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864e760 con 0x5591e8643220 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.485+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94085157543008] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.485+0000 7f83ee03f800 20 remove_watcher() i=5 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.485+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94085157555200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e864e760 con 0x5591e8643220 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.487+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94085157555200] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.487+0000 7f83ee03f800 20 remove_watcher() i=6 2024-04-24T01:26:07.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.487+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94085157558752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5591e8650c00 con 0x5591e8643220 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ebb3e640 1 -- 172.21.15.169:0/1607131171 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94085157558752] v34'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f83e0074020 con 0x5591e8643220 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 20 remove_watcher() i=7 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8643220 msgr2=0x5591e8645610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8643220 0x5591e8645610 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e863e830 msgr2=0x5591e8640cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e863e830 0x5591e8640cf0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f83dc052bb0 msgr2=0x7f83dc080930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f83dc052bb0 0x7f83dc080930 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5591e8647bd0 msgr2=0x5591e864a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5591e8647bd0 0x5591e864a090 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82b4036900 msgr2=0x7f82b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82b4036900 0x7f82b4038dc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x5591e8610b60 tx=0x7f83dc060040 comp rx=0 tx=0).stop 2024-04-24T01:26:07.511 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 msgr2=0x5591e86330f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ec33f640 1 -- 172.21.15.169:0/1607131171 reap_dead start 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f83e004ab20 tx=0x7f83e004e130 comp rx=0 tx=0).stop 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 shutdown_connections 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1607131171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e862bce0 0x5591e86330f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 >> 172.21.15.169:0/1607131171 conn(0x5591e8628040 msgr2=0x5591e86256a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 shutdown_connections 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1607131171 wait complete. 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 msgr2=0x7f82c4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 0x7f82c4038e10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x5591e86081d0 tx=0x7f83dc005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 msgr2=0x5591e861efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f83e004aaf0 tx=0x7f83e004ace0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 shutdown_connections 2024-04-24T01:26:07.512 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82c4036950 0x7f82c4038e10 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 --2- 172.21.15.169:0/1188874600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e861ebc0 0x5591e861efe0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 >> 172.21.15.169:0/1188874600 conn(0x5591e8612c60 msgr2=0x5591e8613060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 shutdown_connections 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.488+0000 7f83ee03f800 1 -- 172.21.15.169:0/1188874600 wait complete. 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8609c20 msgr2=0x5591e860c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5591e8609c20 0x5591e860c010 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e85052a0 msgr2=0x5591e8607390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5591e85052a0 0x5591e8607390 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5591e860dbb0 msgr2=0x5591e8610000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5591e860dbb0 0x5591e8610000 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82d4036950 msgr2=0x7f82d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f82d4036950 0x7f82d4038e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83dc054000 tx=0x7f83dc04e000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 msgr2=0x5591e8600150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 --2- 172.21.15.169:0/539906491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591e8503760 0x5591e8600150 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5591e85f9390 tx=0x7f83e0000bc0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ec33f640 1 -- 172.21.15.169:0/539906491 reap_dead start 2024-04-24T01:26:07.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 shutdown_connections 2024-04-24T01:26:07.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 >> 172.21.15.169:0/539906491 conn(0x5591e84ff3a0 msgr2=0x5591e85f27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 shutdown_connections 2024-04-24T01:26:07.514 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.489+0000 7f83ee03f800 1 -- 172.21.15.169:0/539906491 wait complete. 2024-04-24T01:26:07.514 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.514 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.514 ERROR:root:0 2024-04-24T01:26:07.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T01:26:07.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-04-24T01:26:07.515 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-04-24T01:26:07.566 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.567 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3ca98800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5589725db360 0x5589725dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3ca98800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558972495d40 con 0x5589725d7850 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3ca98800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5589724684d0 con 0x5589725db360 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e39d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5589725db360 0x5589725dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e39d9d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5589725db360 0x5589725dd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43954/0 (socket says 172.21.15.169:43954) 2024-04-24T01:26:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e39d9d640 1 -- 172.21.15.169:0/815671542 learned_addr learned my addr 172.21.15.169:0/815671542 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e3a59e640 1 --1- 172.21.15.169:0/815671542 >> v1:172.21.15.142:6789/0 conn(0x5589725d7850 0x5589725d9c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50732/0 (socket says 172.21.15.169:50732) 2024-04-24T01:26:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e39d9d640 1 -- 172.21.15.169:0/815671542 >> v1:172.21.15.142:6789/0 conn(0x5589725d7850 legacy=0x5589725d9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.569 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.567+0000 7f6e39d9d640 1 -- 172.21.15.169:0/815671542 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558972494590 con 0x5589725db360 2024-04-24T01:26:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.569+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/815671542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725db360 0x5589725dd750 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a520 tx=0x7f6e3001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06d47b3eb4a9831 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.569+0000 7f6e3959c640 1 -- 172.21.15.169:0/815671542 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e30057070 con 0x5589725db360 2024-04-24T01:26:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.569+0000 7f6e3959c640 1 -- 172.21.15.169:0/815671542 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e30052570 con 0x5589725db360 2024-04-24T01:26:07.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.569+0000 7f6e3959c640 1 -- 172.21.15.169:0/815671542 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e3004ae60 con 0x5589725db360 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 -- 172.21.15.169:0/815671542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725db360 msgr2=0x5589725dd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/815671542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725db360 0x5589725dd750 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000a520 tx=0x7f6e3001d010 comp rx=0 tx=0).stop 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 -- 172.21.15.169:0/815671542 shutdown_connections 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/815671542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725db360 0x5589725dd750 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 -- 172.21.15.169:0/815671542 >> 172.21.15.169:0/815671542 conn(0x5589725d1320 msgr2=0x5589725d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 -- 172.21.15.169:0/815671542 shutdown_connections 2024-04-24T01:26:07.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.570+0000 7f6e3ca98800 1 -- 172.21.15.169:0/815671542 wait complete. 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3ca98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3ca98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x558972522360 con 0x5589725d7850 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.583 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43962/0 (socket says 172.21.15.169:43962) 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3039215549 learned_addr learned my addr 172.21.15.169:0/3039215549 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.582+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3039215549 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589726c86c0 con 0x5589725d7850 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.583+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/3039215549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001e90 tx=0x7f6e2c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5800400b91116c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.583+0000 7f6d28608640 1 -- 172.21.15.169:0/3039215549 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c00e5c0 con 0x5589725d7850 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.583+0000 7f6d28608640 1 -- 172.21.15.169:0/3039215549 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c006070 con 0x5589725d7850 2024-04-24T01:26:07.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.583+0000 7f6d28608640 1 -- 172.21.15.169:0/3039215549 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c00e890 con 0x5589725d7850 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3039215549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 msgr2=0x5589726c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3039215549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001e90 tx=0x7f6e2c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3039215549 shutdown_connections 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3039215549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726c80f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3039215549 >> 172.21.15.169:0/3039215549 conn(0x5589725d1320 msgr2=0x5589726c3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3039215549 shutdown_connections 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3039215549 wait complete. 2024-04-24T01:26:07.589 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3ca98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5589725ddf90 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43978/0 (socket says 172.21.15.169:43978) 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.584+0000 7f6e3a59e640 1 -- 172.21.15.169:0/118188761 learned_addr learned my addr 172.21.15.169:0/118188761 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6e3a59e640 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589726d01e0 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726cfca0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c010 tx=0x7f6e2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6d26e05640 1 -- 172.21.15.169:0/118188761 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c00f8d0 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6d26e05640 1 -- 172.21.15.169:0/118188761 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c00fa90 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589726d0470 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6d26e05640 1 -- 172.21.15.169:0/118188761 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c00fdb0 con 0x5589725d7850 2024-04-24T01:26:07.590 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.585+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589726d3120 con 0x5589725d7850 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6d26e05640 1 -- 172.21.15.169:0/118188761 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e2c017070 con 0x5589725d7850 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6d26e05640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d20036900 0x7f6d20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6d26e05640 1 -- 172.21.15.169:0/118188761 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6e2c015020 con 0x5589725d7850 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d20036900 0x7f6d20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5589725db360 0x5589726d6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589726d7470 con 0x5589725db360 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5589725db360 0x5589726d6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.586+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d20036900 0x7f6d20038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6e30054000 tx=0x7f6e3004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.591 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5589725db360 0x5589726d6ee0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/118188761 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e3400a4a0 con 0x5589725db360 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589726d44b0 con 0x5589725db360 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/118188761 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e3400a4a0 con 0x5589725db360 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5589726d97c0 0x5589726dbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589726dc250 con 0x5589726d97c0 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.587+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5589726d97c0 0x5589726dbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5589726d97c0 0x5589726dbbb0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3a59e640 1 -- 172.21.15.169:0/118188761 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6e2c02e070 con 0x5589726d97c0 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589726d8770 con 0x5589725db360 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/118188761 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e3400a4a0 con 0x5589725db360 2024-04-24T01:26:07.592 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5589726dd700 0x5589726dfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589726e02b0 con 0x5589726dd700 2024-04-24T01:26:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.588+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5589726dd700 0x5589726dfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5589726dd700 0x5589726dfb50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.593 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e39d9d640 1 -- 172.21.15.169:0/118188761 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6e3005a040 con 0x5589726dd700 2024-04-24T01:26:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e3ca98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.589+0000 7f6e3ca98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5589724c86b0 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43988/0 (socket says 172.21.15.169:43988) 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3a59e640 1 -- 172.21.15.169:0/58628330 learned_addr learned my addr 172.21.15.169:0/58628330 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3a59e640 1 -- 172.21.15.169:0/58628330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589725d5da0 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001300 tx=0x7f6e2c041d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6d1ffff640 1 -- 172.21.15.169:0/58628330 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c01a5b0 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6d1ffff640 1 -- 172.21.15.169:0/58628330 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c01a770 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6d1ffff640 1 -- 172.21.15.169:0/58628330 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c044b10 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589725d6030 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.590+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589725d6530 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6d1ffff640 1 -- 172.21.15.169:0/58628330 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e2c044cb0 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6d1ffff640 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 0x7f6d14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6d1ffff640 1 -- 172.21.15.169:0/58628330 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6e2c04c020 con 0x5589725d73f0 2024-04-24T01:26:07.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 0x7f6d14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.591+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3ca98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 0x7f6d14038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5589726d43d0 tx=0x7f6e30005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3ca98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5589726c8a40 con 0x5589726fda40 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:43990/0 (socket says 172.21.15.169:43990) 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3a59e640 1 -- 172.21.15.169:0/2961291554 learned_addr learned my addr 172.21.15.169:0/2961291554 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3a59e640 1 -- 172.21.15.169:0/2961291554 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589726fe3f0 con 0x5589726fda40 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/2961291554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0178a0 tx=0x7f6e2c026a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905e422cf71e87a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6d1dffb640 1 -- 172.21.15.169:0/2961291554 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c01dce0 con 0x5589726fda40 2024-04-24T01:26:07.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6d1dffb640 1 -- 172.21.15.169:0/2961291554 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c04b890 con 0x5589726fda40 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.592+0000 7f6d1dffb640 1 -- 172.21.15.169:0/2961291554 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c03f580 con 0x5589726fda40 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- 172.21.15.169:0/2961291554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 msgr2=0x5589726fde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/2961291554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c0178a0 tx=0x7f6e2c026a80 comp rx=0 tx=0).stop 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- 172.21.15.169:0/2961291554 shutdown_connections 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/2961291554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x5589726fde20 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- 172.21.15.169:0/2961291554 >> 172.21.15.169:0/2961291554 conn(0x5589726f9d10 msgr2=0x5589726f7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- 172.21.15.169:0/2961291554 shutdown_connections 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- 172.21.15.169:0/2961291554 wait complete. 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 Processor -- start 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- start start 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3ca98800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5589726feb00 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3a59e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44002/0 (socket says 172.21.15.169:44002) 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.593+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 learned_addr learned my addr 172.21.15.169:0/3139496743 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589727053c0 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c03f3c0 tx=0x7f6e2c02af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6d0bfff640 1 -- 172.21.15.169:0/3139496743 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c031690 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6d0bfff640 1 -- 172.21.15.169:0/3139496743 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c031830 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6d0bfff640 1 -- 172.21.15.169:0/3139496743 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e2c0442d0 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5589727053c0 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.594+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589727053c0 con 0x5589726fda40 2024-04-24T01:26:07.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6d0bfff640 1 -- 172.21.15.169:0/3139496743 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6e2c044470 con 0x5589726fda40 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6d0bfff640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d04036900 0x7f6d04038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6d0bfff640 1 -- 172.21.15.169:0/3139496743 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6e2c057070 con 0x5589726fda40 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d04036900 0x7f6d04038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d04036900 0x7f6d04038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e3004f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558972710540 0x558972712a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.595+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972713150 con 0x558972710540 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558972710540 0x558972712a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558972710540 0x558972712a00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 20 realm 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972713560 con 0x558972710540 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.621 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.596+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972713e30 con 0x558972710540 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558972714f30 0x558972717320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972717930 con 0x558972714f30 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.597+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558972714f30 0x558972717320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3a59e640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558972714f30 0x558972717320 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3ca98800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3ca98800 20 searching for the correct realm 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5589727198e0 0x55897271bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55897271c470 con 0x5589727198e0 2024-04-24T01:26:07.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5589727198e0 0x55897271bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.598+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5589727198e0 0x55897271bda0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e39d9d640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6e30074040 0x7f6e30081410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55897271c470 con 0x7f6e30074040 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6e30074040 0x7f6e30081410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e3ad9f640 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6e30074040 0x7f6e30081410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x7f6e30074040 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.599+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972714f30 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.600+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972714f30 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x7f6e30074040 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x7f6e30074040 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x5589727198e0 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.601+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972714f30 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x558972710540 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3400a4a0 con 0x558972710540 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x7f6e30074040 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5589727141d0 con 0x5589727198e0 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.602+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972714f30 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.603+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972710540 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972710540 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972714f30 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.627 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.604+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x7f6e30074040 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972710540 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972714f30 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.628 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.605+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972714f30 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x7f6e30074040 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x5589727198e0 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972714f30 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.606+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x558972710540 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.629 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f6e3008e040 con 0x7f6e30074040 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589727181f0 con 0x558972710540 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.630 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.607+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589727181f0 con 0x558972710540 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5589727181f0 con 0x7f6e30074040 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 zone default found 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 4 Realm: () 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:07.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 zonegroup default 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972718a90 con 0x558972714f30 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55897271e2d0 con 0x5589727198e0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.608+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55897271e670 con 0x5589727198e0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.609+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.609+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.609+0000 7f6e3ca98800 20 started sync module instance, tier type = 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.609+0000 7f6e3ca98800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.609+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271d770 con 0x7f6e30074040 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.610+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.610+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94048818944912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271d770 con 0x7f6e30074040 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.610+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271eec0 con 0x558972710540 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.611+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94048818944912] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.611+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.611+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94048818943136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271eec0 con 0x558972710540 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.611+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271f8c0 con 0x5589727198e0 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.612+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94048818943136] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.612+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.612+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94048818948624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271ee30 con 0x5589727198e0 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.612+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972720780 con 0x7f6e30074040 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.613+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94048818948624] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.613+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.613+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94048818954960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972720ba0 con 0x7f6e30074040 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.614+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972721560 con 0x558972710540 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.615+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94048818954960] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.615+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.615+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94048818958992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972720ba0 con 0x558972710540 2024-04-24T01:26:07.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.615+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972721f70 con 0x558972714f30 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.616+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94048818958992] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.616+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.616+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94048818956016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972720b10 con 0x558972714f30 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.616+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972722de0 con 0x558972714f30 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.617+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94048818956016] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.641 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.617+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.617+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94048818964784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972723200 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.617+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972723bc0 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94048818968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972723fe0 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=0 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=1 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=2 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=3 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=4 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=5 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94048818964784] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.618+0000 7f6e3ca98800 20 add_watcher() i=6 2024-04-24T01:26:07.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94048818968336] v34'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3ca98800 20 add_watcher() i=7 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3ca98800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972722d50 con 0x558972710540 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.619+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94048818969392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972722d50 con 0x558972710540 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94048818969392] v34'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6cf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.643 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 5 note: GC not initialized 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6c6b7fe640 20 reqs_thread_entry: start 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 20 Filter name: none 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6c697fa640 20 reqs_thread_entry: start 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.621+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55897275a3e0 con 0x558972714f30 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558972758b80 con 0x5589727198e0 2024-04-24T01:26:07.644 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.622+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972759610 con 0x558972714f30 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v34'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ca98800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ca98800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:26:07.645 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ca98800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94048819187712 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55897275df10 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== watch-notify(notify (1) cookie 94048818944912 notify 146028888089 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f6e34018aa0 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6d1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94048818944912 notifier 4843 bl.length()=533 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(65 notify.0 [notify cookie 94048819187712 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6d1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.623+0000 7f6d1dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.624+0000 7f6d1dffb640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6d00003ea0 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.624+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.624+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== watch-notify(notify_complete (2) cookie 94048819187712 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6e34018d40 con 0x7f6e30074040 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.624+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897275df10 con 0x5589727198e0 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v34'9 uv9 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.646 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ca98800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ca98800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ca98800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94048819187712 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55897275df10 con 0x558972710540 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94048818943136 notify 146028888088 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f6e34018d40 con 0x558972710540 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6d1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94048818943136 notifier 4843 bl.length()=176 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6d1dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(68 notify.1 [notify cookie 94048819187712 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6d1dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-04-24T01:26:07.647 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6d1dffb640 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f6d00003ea0 con 0x558972710540 2024-04-24T01:26:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.648 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.625+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94048819187712 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6e34044500 con 0x558972710540 2024-04-24T01:26:07.648 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-04-24T01:26:07.623228Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.623214Z","tags":[],"group_ids":[]} 2024-04-24T01:26:07.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.626+0000 7f6cf0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.626+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94048818969392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897270cc60 con 0x558972710540 2024-04-24T01:26:07.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.627+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94048818969392] v34'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.627+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94048818944912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972723b30 con 0x7f6e30074040 2024-04-24T01:26:07.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.628+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94048818944912] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.628+0000 7f6e3ca98800 20 remove_watcher() i=0 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.628+0000 7f6e3ca98800 2 removed watcher, disabling cache 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.628+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94048818943136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271db90 con 0x558972710540 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.629+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94048818943136] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.629+0000 7f6e3ca98800 20 remove_watcher() i=1 2024-04-24T01:26:07.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.629+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94048818948624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271db90 con 0x5589727198e0 2024-04-24T01:26:07.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.630+0000 7f6e39d9d640 1 -- 172.21.15.169:0/3139496743 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94048818948624] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e3007f070 con 0x5589727198e0 2024-04-24T01:26:07.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.630+0000 7f6e3ca98800 20 remove_watcher() i=2 2024-04-24T01:26:07.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.630+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94048818954960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271db90 con 0x7f6e30074040 2024-04-24T01:26:07.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.631+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94048818954960] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x7f6e30074040 2024-04-24T01:26:07.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.631+0000 7f6e3ca98800 20 remove_watcher() i=3 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.631+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94048818958992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5589727202d0 con 0x558972710540 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.633+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94048818958992] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e34032040 con 0x558972710540 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.633+0000 7f6e3ca98800 20 remove_watcher() i=4 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.633+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94048818956016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271db90 con 0x558972714f30 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.634+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94048818956016] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.634+0000 7f6e3ca98800 20 remove_watcher() i=5 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.634+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94048818964784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558972721290 con 0x558972714f30 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.635+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94048818964784] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.635+0000 7f6e3ca98800 20 remove_watcher() i=6 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.635+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94048818968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55897271db90 con 0x558972714f30 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.635+0000 7f6e3a59e640 1 -- 172.21.15.169:0/3139496743 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94048818968336] v34'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6e2c02e070 con 0x558972714f30 2024-04-24T01:26:07.660 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 20 remove_watcher() i=7 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558972714f30 msgr2=0x558972717320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x558972714f30 0x558972717320 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558972710540 msgr2=0x558972712a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x558972710540 0x558972712a00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6e30074040 msgr2=0x7f6e30081410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.661 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f6e30074040 0x7f6e30081410 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5589727198e0 msgr2=0x55897271bda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5589727198e0 0x55897271bda0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d04036900 msgr2=0x7f6d04038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d04036900 0x7f6d04038dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6e30000c00 tx=0x7f6e3004f000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.662 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 msgr2=0x558972704e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/3139496743 reap_dead start 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c03f3c0 tx=0x7f6e2c02af50 comp rx=0 tx=0).stop 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 shutdown_connections 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/3139496743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589726fda40 0x558972704e80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 >> 172.21.15.169:0/3139496743 conn(0x5589726f9d10 msgr2=0x5589726f7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.663 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 shutdown_connections 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/3139496743 wait complete. 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 msgr2=0x7f6d14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 0x7f6d14038dc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x5589726d43d0 tx=0x7f6e30005ac0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 msgr2=0x5589725d5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c001300 tx=0x7f6e2c041d70 comp rx=0 tx=0).stop 2024-04-24T01:26:07.664 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 shutdown_connections 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d14036900 0x7f6d14038dc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/58628330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d73f0 0x5589725d5860 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 >> 172.21.15.169:0/58628330 conn(0x5589726e2740 msgr2=0x5589726e2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 shutdown_connections 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.636+0000 7f6e3ca98800 1 -- 172.21.15.169:0/58628330 wait complete. 2024-04-24T01:26:07.665 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5589726d97c0 msgr2=0x5589726dbbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5589726d97c0 0x5589726dbbb0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5589725db360 msgr2=0x5589726d6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5589725db360 0x5589726d6ee0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5589726dd700 msgr2=0x5589726dfb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.666 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5589726dd700 0x5589726dfb50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d20036900 msgr2=0x7f6d20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6d20036900 0x7f6d20038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6e30054000 tx=0x7f6e3004e000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 msgr2=0x5589726cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 --2- 172.21.15.169:0/118188761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5589725d7850 0x5589726cfca0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c010 tx=0x7f6e2c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ad9f640 1 -- 172.21.15.169:0/118188761 reap_dead start 2024-04-24T01:26:07.667 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 shutdown_connections 2024-04-24T01:26:07.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 >> 172.21.15.169:0/118188761 conn(0x5589725d1320 msgr2=0x5589726c2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 shutdown_connections 2024-04-24T01:26:07.668 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.637+0000 7f6e3ca98800 1 -- 172.21.15.169:0/118188761 wait complete. 2024-04-24T01:26:07.668 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T01:26:07.623228Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.623214Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.669 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-04-24T01:26:07.623228Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.623214Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:07.669 ERROR:root:0 2024-04-24T01:26:07.670 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:07.675 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:07.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-04-24T01:26:07.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-04-24T01:26:07.676 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-04-24T01:26:07.718 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.719 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f6522931800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557eb21f1aa0 0x557eb21f0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f6522931800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557eb213ad40 con 0x557eb21f0590 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f6522931800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x557eb210d4d0 con 0x557eb21f1aa0 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f651e62f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557eb21f1aa0 0x557eb21f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.720 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f651e62f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x557eb21f1aa0 0x557eb21f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44012/0 (socket says 172.21.15.169:44012) 2024-04-24T01:26:07.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.719+0000 7f651e62f640 1 -- 172.21.15.169:0/3480027302 learned_addr learned my addr 172.21.15.169:0/3480027302 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.720+0000 7f651e62f640 1 -- 172.21.15.169:0/3480027302 >> v1:172.21.15.142:6789/0 conn(0x557eb21f0590 legacy=0x557eb2283e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.721 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.720+0000 7f651e62f640 1 -- 172.21.15.169:0/3480027302 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb2139590 con 0x557eb21f1aa0 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.721+0000 7f651e62f640 1 --2- 172.21.15.169:0/3480027302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f1aa0 0x557eb21f0050 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6518005fd0 tx=0x7f651801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71288158701b367 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.721+0000 7f651d62d640 1 -- 172.21.15.169:0/3480027302 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518052540 con 0x557eb21f1aa0 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f651d62d640 1 -- 172.21.15.169:0/3480027302 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651804e070 con 0x557eb21f1aa0 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f651d62d640 1 -- 172.21.15.169:0/3480027302 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518052850 con 0x557eb21f1aa0 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 -- 172.21.15.169:0/3480027302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f1aa0 msgr2=0x557eb21f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 --2- 172.21.15.169:0/3480027302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f1aa0 0x557eb21f0050 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6518005fd0 tx=0x7f651801cd80 comp rx=0 tx=0).stop 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 -- 172.21.15.169:0/3480027302 shutdown_connections 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 --2- 172.21.15.169:0/3480027302 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f1aa0 0x557eb21f0050 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 -- 172.21.15.169:0/3480027302 >> 172.21.15.169:0/3480027302 conn(0x557eb2277530 msgr2=0x557eb2279950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 -- 172.21.15.169:0/3480027302 shutdown_connections 2024-04-24T01:26:07.723 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.722+0000 7f6522931800 1 -- 172.21.15.169:0/3480027302 wait complete. 2024-04-24T01:26:07.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f6522931800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f6522931800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557eb21c73c0 con 0x557eb21f0590 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44020/0 (socket says 172.21.15.169:44020) 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.734+0000 7f651e62f640 1 -- 172.21.15.169:0/1568478305 learned_addr learned my addr 172.21.15.169:0/1568478305 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.735+0000 7f651e62f640 1 -- 172.21.15.169:0/1568478305 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb236fd80 con 0x557eb21f0590 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.735+0000 7f651e62f640 1 --2- 172.21.15.169:0/1568478305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6518000f80 tx=0x7f651804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50969c985daca6d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.735+0000 7f640c608640 1 -- 172.21.15.169:0/1568478305 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518052820 con 0x557eb21f0590 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.735+0000 7f640c608640 1 -- 172.21.15.169:0/1568478305 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518058040 con 0x557eb21f0590 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.735+0000 7f640c608640 1 -- 172.21.15.169:0/1568478305 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518052af0 con 0x557eb21f0590 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- 172.21.15.169:0/1568478305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 msgr2=0x557eb236f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 --2- 172.21.15.169:0/1568478305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f6518000f80 tx=0x7f651804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- 172.21.15.169:0/1568478305 shutdown_connections 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 --2- 172.21.15.169:0/1568478305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb236f7b0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- 172.21.15.169:0/1568478305 >> 172.21.15.169:0/1568478305 conn(0x557eb2277530 msgr2=0x557eb236b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- 172.21.15.169:0/1568478305 shutdown_connections 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- 172.21.15.169:0/1568478305 wait complete. 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb2377300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f6522931800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557eb2287810 con 0x557eb21f0590 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb2377300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb2377300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44034/0 (socket says 172.21.15.169:44034) 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.736+0000 7f651e62f640 1 -- 172.21.15.169:0/1489894206 learned_addr learned my addr 172.21.15.169:0/1489894206 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f651e62f640 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb2377840 con 0x557eb21f0590 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f651e62f640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb2377300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f651805f040 tx=0x7f6518003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f640ae05640 1 -- 172.21.15.169:0/1489894206 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518052e50 con 0x557eb21f0590 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f640ae05640 1 -- 172.21.15.169:0/1489894206 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651805d420 con 0x557eb21f0590 2024-04-24T01:26:07.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f640ae05640 1 -- 172.21.15.169:0/1489894206 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651805d740 con 0x557eb21f0590 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb2377ad0 con 0x557eb21f0590 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.737+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb237a730 con 0x557eb21f0590 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f640ae05640 1 -- 172.21.15.169:0/1489894206 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6518050070 con 0x557eb21f0590 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f640ae05640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6404036aa0 0x7f6404038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f640ae05640 1 -- 172.21.15.169:0/1489894206 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6518062070 con 0x557eb21f0590 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f651de2e640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6404036aa0 0x7f6404038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb21f1aa0 0x557eb237e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb237ea30 con 0x557eb21f1aa0 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f651ee30640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb21f1aa0 0x557eb237e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.738+0000 7f651de2e640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6404036aa0 0x7f6404038f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6508001e10 tx=0x7f6508001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f651ee30640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb21f1aa0 0x557eb237e4f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f651ee30640 1 -- 172.21.15.169:0/1489894206 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65100083e0 con 0x557eb21f1aa0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb237bac0 con 0x557eb21f1aa0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f651ee30640 1 -- 172.21.15.169:0/1489894206 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65100083e0 con 0x557eb21f1aa0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb2380d80 0x557eb2383170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb2383860 con 0x557eb2380d80 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.739+0000 7f651e62f640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb2380d80 0x557eb2383170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f651e62f640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb2380d80 0x557eb2383170 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f651e62f640 1 -- 172.21.15.169:0/1489894206 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6518077070 con 0x557eb2380d80 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb237fd30 con 0x557eb21f1aa0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f651ee30640 1 -- 172.21.15.169:0/1489894206 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f65100083e0 con 0x557eb21f1aa0 2024-04-24T01:26:07.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557eb2384cc0 0x557eb2387150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23878e0 con 0x557eb2384cc0 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.740+0000 7f651de2e640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557eb2384cc0 0x557eb2387150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f651de2e640 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557eb2384cc0 0x557eb2387150 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f651de2e640 1 -- 172.21.15.169:0/1489894206 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f65080106a0 con 0x557eb2384cc0 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f6522931800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.741+0000 7f6522931800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557eb216d6b0 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44040/0 (socket says 172.21.15.169:44040) 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f651e62f640 1 -- 172.21.15.169:0/59080024 learned_addr learned my addr 172.21.15.169:0/59080024 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f651e62f640 1 -- 172.21.15.169:0/59080024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb23966f0 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f651e62f640 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6518066900 tx=0x7f6518066f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f6403fff640 1 -- 172.21.15.169:0/59080024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518067780 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f6403fff640 1 -- 172.21.15.169:0/59080024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651805d9b0 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb2397160 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f6403fff640 1 -- 172.21.15.169:0/59080024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651805dc90 con 0x557eb2395d90 2024-04-24T01:26:07.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.742+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb2397660 con 0x557eb2395d90 2024-04-24T01:26:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f6403fff640 1 -- 172.21.15.169:0/59080024 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f651808c580 con 0x557eb2395d90 2024-04-24T01:26:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f6403fff640 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 0x7f63f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f6403fff640 1 -- 172.21.15.169:0/59080024 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6518092d40 con 0x557eb2395d90 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f651de2e640 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 0x7f63f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.743+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651de2e640 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 0x7f63f8038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x557eb2383c30 tx=0x7f6508006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f6522931800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f6522931800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557eb2370040 con 0x557eb23a2fe0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44046/0 (socket says 172.21.15.169:44046) 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651e62f640 1 -- 172.21.15.169:0/3751527467 learned_addr learned my addr 172.21.15.169:0/3751527467 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651e62f640 1 -- 172.21.15.169:0/3751527467 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb23a39d0 con 0x557eb23a2fe0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f651e62f640 1 --2- 172.21.15.169:0/3751527467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f651808e010 tx=0x7f6518079510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae5aa4c8c891f53 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f6401ffb640 1 -- 172.21.15.169:0/3751527467 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6518070cd0 con 0x557eb23a2fe0 2024-04-24T01:26:07.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f6401ffb640 1 -- 172.21.15.169:0/3751527467 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6518069070 con 0x557eb23a2fe0 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.744+0000 7f6401ffb640 1 -- 172.21.15.169:0/3751527467 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651808cb50 con 0x557eb23a2fe0 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- 172.21.15.169:0/3751527467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 msgr2=0x557eb23a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 --2- 172.21.15.169:0/3751527467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f651808e010 tx=0x7f6518079510 comp rx=0 tx=0).stop 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- 172.21.15.169:0/3751527467 shutdown_connections 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 --2- 172.21.15.169:0/3751527467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23a3400 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- 172.21.15.169:0/3751527467 >> 172.21.15.169:0/3751527467 conn(0x557eb239f260 msgr2=0x557eb239d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- 172.21.15.169:0/3751527467 shutdown_connections 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- 172.21.15.169:0/3751527467 wait complete. 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 Processor -- start 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- start start 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f6522931800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x557eb23a4040 con 0x557eb23a2fe0 2024-04-24T01:26:07.776 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f651e62f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23aa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44056/0 (socket says 172.21.15.169:44056) 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.745+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 learned_addr learned my addr 172.21.15.169:0/2441290837 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb23aa850 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f651e62f640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23aa310 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f651808ca80 tx=0x7f6518060f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f63effff640 1 -- 172.21.15.169:0/2441290837 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65180b6070 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f63effff640 1 -- 172.21.15.169:0/2441290837 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f651805fe50 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f63effff640 1 -- 172.21.15.169:0/2441290837 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f651807aa60 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557eb23aa850 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.746+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb23aa850 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f63effff640 1 -- 172.21.15.169:0/2441290837 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f65180b9070 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f63effff640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63e8036900 0x7f63e8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f63effff640 1 -- 172.21.15.169:0/2441290837 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f65180ae070 con 0x557eb23a2fe0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f651de2e640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63e8036900 0x7f63e8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.777 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb23b5900 0x557eb23b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.747+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b8510 con 0x557eb23b5900 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651de2e640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63e8036900 0x7f63e8038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x557eb237fd00 tx=0x7f6508011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651ee30640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb23b5900 0x557eb23b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651ee30640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb23b5900 0x557eb23b7dc0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65100083e0 con 0x557eb23b5900 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 realm 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b8920 con 0x557eb23b5900 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65100083e0 con 0x557eb23b5900 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.778 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f65100083e0 con 0x557eb23b5900 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.748+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b9590 con 0x557eb23b5900 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f65100083e0 con 0x557eb23b5900 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f6522931800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb23b9f50 0x557eb23bc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23bc950 con 0x557eb23b9f50 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f651e62f640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb23b9f50 0x557eb23bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.749+0000 7f651e62f640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb23b9f50 0x557eb23bc340 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.779 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f6522931800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f6522931800 20 searching for the correct realm 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557eb23be900 0x557eb23c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c1490 con 0x557eb23be900 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f651de2e640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557eb23be900 0x557eb23c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f651de2e640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557eb23be900 0x557eb23c0dc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.750+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651de2e640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65080393c0 0x7f65080397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.780 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c1490 con 0x7f65080393c0 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651ee30640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65080393c0 0x7f65080397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651ee30640 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65080393c0 0x7f65080397e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65100083e0 con 0x7f65080393c0 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.751+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65100083e0 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.781 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.752+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x7f65080393c0 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.753+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x7f65080393c0 2024-04-24T01:26:07.782 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.754+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.755+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.783 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x7f65080393c0 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.756+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.784 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.757+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x7f65080393c0 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23be900 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b9f50 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x557eb23b5900 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.758+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557eb23b91f0 con 0x7f65080393c0 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:07.785 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23bd210 con 0x557eb23b5900 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23bd210 con 0x557eb23b5900 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.786 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.759+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23bd210 con 0x7f65080393c0 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 zone default found 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 4 Realm: () 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 zonegroup default 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23bdab0 con 0x557eb23b9f50 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c32f0 con 0x557eb23be900 2024-04-24T01:26:07.787 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.760+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c3690 con 0x557eb23be900 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.761+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.761+0000 7f6522931800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.761+0000 7f6522931800 20 started sync module instance, tier type = 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.761+0000 7f6522931800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.761+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2790 con 0x7f65080393c0 2024-04-24T01:26:07.788 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.762+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.762+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94002644528000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2790 con 0x7f65080393c0 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.762+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c3f20 con 0x557eb23b5900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.763+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94002644528000] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.763+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.763+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94002644531760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2790 con 0x557eb23b5900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.763+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c4930 con 0x557eb23be900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.764+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94002644531760] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.764+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.764+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94002644525792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2700 con 0x557eb23be900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.764+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c5820 con 0x7f65080393c0 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.765+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94002644525792] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.789 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.765+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.765+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94002644538224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c5c40 con 0x7f65080393c0 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.765+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c6600 con 0x557eb23b5900 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.766+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94002644538224] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.766+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.766+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94002644539760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c6600 con 0x557eb23b5900 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.766+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c6fc0 con 0x557eb23b9f50 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.767+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94002644539760] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.768+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.768+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94002644541776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c6570 con 0x557eb23b9f50 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.768+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c7e30 con 0x557eb23b9f50 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.769+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94002644541776] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.790 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.769+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.769+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94002644546400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c8680 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.769+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c8f10 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94002644551856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c9360 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94002644546400] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=0 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=1 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=2 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=3 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=4 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=5 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.770+0000 7f6522931800 20 add_watcher() i=6 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94002644551856] v34'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f6522931800 20 add_watcher() i=7 2024-04-24T01:26:07.791 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f6522931800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c82c0 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.771+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94002644553200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c9c30 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.772+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94002644553200] v34'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.772+0000 7f63d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.772+0000 7f6522931800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.772+0000 7f6522931800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.772+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d4cc0 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.774+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'61 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.774+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d5310 con 0x557eb23b9f50 2024-04-24T01:26:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.775+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.775+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d5310 con 0x557eb23be900 2024-04-24T01:26:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.776+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.776+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d5df0 con 0x557eb23b5900 2024-04-24T01:26:07.797 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.777+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'252 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.777+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d2b60 con 0x7f65080393c0 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.778+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'86 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.778+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d2b30 con 0x557eb23be900 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.779+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'63 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.779+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d2b30 con 0x557eb23b5900 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.780+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.781+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d2960 con 0x557eb23b9f50 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.782+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'57 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.782+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d2a60 con 0x7f65080393c0 2024-04-24T01:26:07.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.783+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.783+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d6ba0 con 0x557eb23be900 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.784+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.784+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x7f65080393c0 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.785+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'87 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.785+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23b9f50 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.786+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.786+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x7f65080393c0 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.787+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.787+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23b9f50 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.788+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'70 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.799 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.788+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23b5900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.789+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'253 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.789+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23be900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.791+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'77 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.791+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x7f65080393c0 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.791+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'88 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.791+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23be900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.792+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'41 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.792+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23b5900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.793+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.800 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.793+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23b5900 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.794+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'254 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.794+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7050 con 0x557eb23be900 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.796+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'78 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.796+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d70e0 con 0x7f65080393c0 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.796+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.801 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.796+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d70e0 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.797+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.797+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d70e0 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.798+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'47 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.798+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7130 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.799+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.799+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7130 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.800+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'64 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.800+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d7130 con 0x557eb23b9f50 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.802+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.803 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.802+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d76f0 con 0x557eb23be900 2024-04-24T01:26:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.803+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.803+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d76f0 con 0x557eb23b9f50 2024-04-24T01:26:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.804+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'58 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.804 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.804+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d76f0 con 0x557eb23be900 2024-04-24T01:26:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.805+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'79 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.805 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.805+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d76f0 con 0x557eb23b9f50 2024-04-24T01:26:07.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.806+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'71 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.806 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.806+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d76f0 con 0x7f65080393c0 2024-04-24T01:26:07.807 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.807+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f634f7fe640 20 reqs_thread_entry: start 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 20 Filter name: none 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f634d7fa640 20 reqs_thread_entry: start 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.809 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb2401fc0 con 0x557eb23b9f50 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 20 rados_obj.operate() r=0 bl.length=349 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.808+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb24049e0 con 0x557eb23b9f50 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.809+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.809+0000 7f6522931800 10 removing key index: system_akey 2024-04-24T01:26:07.810 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.809+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb24029c0 con 0x557eb23be900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(96 system_akey [delete] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6522931800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94002644792608 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb2404e00 con 0x557eb23b5900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== watch-notify(notify (1) cookie 94002644531760 notify 146028888089 ret 0) ==== 203+0+0 (crc 0 0 0) 0x557eb23d6950 con 0x557eb23b5900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 94002644531760 notifier 4850 bl.length()=161 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(97 notify.1 [notify cookie 94002644792608 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6401ffb640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63e4003d60 con 0x557eb23b5900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.812 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== watch-notify(notify_complete (2) cookie 94002644792608 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557eb23d46a0 con 0x557eb23b5900 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6522931800 10 removing email index: 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6522931800 10 removing user buckets index 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.810+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb24029c0 con 0x557eb23b9f50 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.811+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(99 system_user.buckets [delete] v34'4 uv3 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.811+0000 7f6522931800 10 removing user index: system_user 2024-04-24T01:26:07.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.811+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb2406b10 con 0x557eb23b9f50 2024-04-24T01:26:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.812+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(100 system_user [call,call,delete] v34'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.812+0000 7f6522931800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-04-24T01:26:07.814 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.812+0000 7f6522931800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.812+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94002644805216 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557eb2406a80 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== watch-notify(notify (1) cookie 94002644528000 notify 146028888090 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557eb23d46a0 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f6401ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94002644528000 notifier 4850 bl.length()=160 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(101 notify.0 [notify cookie 94002644805216 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f6401ffb640 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f63e4003d60 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== watch-notify(notify_complete (2) cookie 94002644805216 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557eb23d5060 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.813+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.814+0000 7f63d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:07.815 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.814+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94002644553200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d1a50 con 0x557eb23b5900 2024-04-24T01:26:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.815+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94002644553200] v34'255 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.815+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94002644528000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23d1a50 con 0x7f65080393c0 2024-04-24T01:26:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.816+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94002644528000] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.816 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.816+0000 7f6522931800 20 remove_watcher() i=0 2024-04-24T01:26:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.816+0000 7f6522931800 2 removed watcher, disabling cache 2024-04-24T01:26:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.816+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94002644531760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2b80 con 0x557eb23b5900 2024-04-24T01:26:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.817+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94002644531760] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.817+0000 7f6522931800 20 remove_watcher() i=1 2024-04-24T01:26:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.817+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94002644525792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c2b80 con 0x557eb23be900 2024-04-24T01:26:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.818+0000 7f651de2e640 1 -- 172.21.15.169:0/2441290837 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94002644525792] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6508036040 con 0x557eb23be900 2024-04-24T01:26:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.818+0000 7f6522931800 20 remove_watcher() i=2 2024-04-24T01:26:07.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.818+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94002644538224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c22e0 con 0x7f65080393c0 2024-04-24T01:26:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.819+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94002644538224] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x7f65080393c0 2024-04-24T01:26:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.819+0000 7f6522931800 20 remove_watcher() i=3 2024-04-24T01:26:07.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.819+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94002644539760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c22e0 con 0x557eb23b5900 2024-04-24T01:26:07.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.820+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94002644539760] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6510026040 con 0x557eb23b5900 2024-04-24T01:26:07.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.820+0000 7f6522931800 20 remove_watcher() i=4 2024-04-24T01:26:07.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.820+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94002644541776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c5970 con 0x557eb23b9f50 2024-04-24T01:26:07.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.822+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94002644541776] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.822+0000 7f6522931800 20 remove_watcher() i=5 2024-04-24T01:26:07.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.822+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94002644546400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c22e0 con 0x557eb23b9f50 2024-04-24T01:26:07.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.823+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94002644546400] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.823+0000 7f6522931800 20 remove_watcher() i=6 2024-04-24T01:26:07.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.823+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94002644551856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557eb23c6150 con 0x557eb23b9f50 2024-04-24T01:26:07.827 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f651e62f640 1 -- 172.21.15.169:0/2441290837 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94002644551856] v34'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f65180b8030 con 0x557eb23b9f50 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 20 remove_watcher() i=7 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb23b9f50 msgr2=0x557eb23bc340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb23b9f50 0x557eb23bc340 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb23b5900 msgr2=0x557eb23b7dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb23b5900 0x557eb23b7dc0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.828 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65080393c0 msgr2=0x7f65080397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f65080393c0 0x7f65080397e0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557eb23be900 msgr2=0x557eb23c0dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x557eb23be900 0x557eb23c0dc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63e8036900 msgr2=0x7f63e8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63e8036900 0x7f63e8038dc0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x557eb237fd00 tx=0x7f6508011000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 msgr2=0x557eb23aa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 --2- 172.21.15.169:0/2441290837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb23a2fe0 0x557eb23aa310 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f651808ca80 tx=0x7f6518060f30 comp rx=0 tx=0).stop 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 reap_dead start 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f651ee30640 1 -- 172.21.15.169:0/2441290837 reap_dead start 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 shutdown_connections 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.824+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 >> 172.21.15.169:0/2441290837 conn(0x557eb239f260 msgr2=0x557eb239c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.829 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 shutdown_connections 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/2441290837 wait complete. 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 msgr2=0x7f63f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 0x7f63f8038e10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x557eb2383c30 tx=0x7f6508006000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 msgr2=0x557eb23961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6518066900 tx=0x7f6518066f70 comp rx=0 tx=0).stop 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 shutdown_connections 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f63f8036950 0x7f63f8038e10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/59080024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb2395d90 0x557eb23961b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 >> 172.21.15.169:0/59080024 conn(0x557eb2389e30 msgr2=0x557eb238a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 shutdown_connections 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/59080024 wait complete. 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb2380d80 msgr2=0x557eb2383170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.830 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x557eb2380d80 0x557eb2383170 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb21f1aa0 msgr2=0x557eb237e4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x557eb21f1aa0 0x557eb237e4f0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557eb2384cc0 msgr2=0x557eb2387150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x557eb2384cc0 0x557eb2387150 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6404036aa0 msgr2=0x7f6404038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6404036aa0 0x7f6404038f60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6508001e10 tx=0x7f6508001390 comp rx=0 tx=0).stop 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 msgr2=0x557eb2377300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 --2- 172.21.15.169:0/1489894206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557eb21f0590 0x557eb2377300 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f651805f040 tx=0x7f6518003330 comp rx=0 tx=0).stop 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f651ee30640 1 -- 172.21.15.169:0/1489894206 reap_dead start 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 shutdown_connections 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 >> 172.21.15.169:0/1489894206 conn(0x557eb2277530 msgr2=0x557eb23698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 shutdown_connections 2024-04-24T01:26:07.831 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.825+0000 7f6522931800 1 -- 172.21.15.169:0/1489894206 wait complete. 2024-04-24T01:26:07.834 ERROR:root:None 2024-04-24T01:26:07.834 ERROR:root:0 2024-04-24T01:26:07.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T01:26:07.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-04-24T01:26:07.835 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-04-24T01:26:07.926 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:07.926 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.926+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca7540f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556c9775c910 0x556c9775ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca7540f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556c9761ad40 con 0x556c9775f240 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca7540f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x556c975ed4d0 con 0x556c9775c910 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca70b5c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x556c9775c910 0x556c9775ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca6835b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x556c9775f240 0x556c97761630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50740/0 (socket says 172.21.15.169:50740) 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca6835b640 1 -- 172.21.15.169:0/298430096 learned_addr learned my addr 172.21.15.169:0/298430096 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca70b5c640 1 --2- 172.21.15.169:0/298430096 >> v2:172.21.15.142:3300/0 conn(0x556c9775c910 0x556c9775ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44066/0 (socket says 172.21.15.169:44066) 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca70b5c640 1 -- 172.21.15.169:0/298430096 >> v1:172.21.15.142:6789/0 conn(0x556c9775f240 legacy=0x556c97761630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.927+0000 7fca70b5c640 1 -- 172.21.15.169:0/298430096 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c97619590 con 0x556c9775c910 2024-04-24T01:26:07.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.929+0000 7fca70b5c640 1 --2- 172.21.15.169:0/298430096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9775ed00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fca6000a470 tx=0x7fca6001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a4ba9521198e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.929+0000 7fca6bfff640 1 -- 172.21.15.169:0/298430096 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60057070 con 0x556c9775c910 2024-04-24T01:26:07.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.929+0000 7fca6bfff640 1 -- 172.21.15.169:0/298430096 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60052570 con 0x556c9775c910 2024-04-24T01:26:07.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.929+0000 7fca6bfff640 1 -- 172.21.15.169:0/298430096 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60052870 con 0x556c9775c910 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 -- 172.21.15.169:0/298430096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 msgr2=0x556c9775ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 --2- 172.21.15.169:0/298430096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9775ed00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fca6000a470 tx=0x7fca6001ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 -- 172.21.15.169:0/298430096 shutdown_connections 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 --2- 172.21.15.169:0/298430096 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9775ed00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 -- 172.21.15.169:0/298430096 >> 172.21.15.169:0/298430096 conn(0x556c977562c0 msgr2=0x556c977586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 -- 172.21.15.169:0/298430096 shutdown_connections 2024-04-24T01:26:07.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.930+0000 7fca7540f800 1 -- 172.21.15.169:0/298430096 wait complete. 2024-04-24T01:26:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca7540f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca7540f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c976a7360 con 0x556c9775c910 2024-04-24T01:26:07.943 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44072/0 (socket says 172.21.15.169:44072) 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.942+0000 7fca70b5c640 1 -- 172.21.15.169:0/2807067721 learned_addr learned my addr 172.21.15.169:0/2807067721 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.943+0000 7fca70b5c640 1 -- 172.21.15.169:0/2807067721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9784d680 con 0x556c9775c910 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.943+0000 7fca70b5c640 1 --2- 172.21.15.169:0/2807067721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fca60055040 tx=0x7fca6004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3651164db1db1790 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.943+0000 7fc95ee0d640 1 -- 172.21.15.169:0/2807067721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60057070 con 0x556c9775c910 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.943+0000 7fc95ee0d640 1 -- 172.21.15.169:0/2807067721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60063070 con 0x556c9775c910 2024-04-24T01:26:07.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.943+0000 7fc95ee0d640 1 -- 172.21.15.169:0/2807067721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60052720 con 0x556c9775c910 2024-04-24T01:26:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- 172.21.15.169:0/2807067721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 msgr2=0x556c9784d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 --2- 172.21.15.169:0/2807067721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fca60055040 tx=0x7fca6004c000 comp rx=0 tx=0).stop 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- 172.21.15.169:0/2807067721 shutdown_connections 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 --2- 172.21.15.169:0/2807067721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c9784d0b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- 172.21.15.169:0/2807067721 >> 172.21.15.169:0/2807067721 conn(0x556c977562c0 msgr2=0x556c978489d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- 172.21.15.169:0/2807067721 shutdown_connections 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- 172.21.15.169:0/2807067721 wait complete. 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c97854b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca7540f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c97765060 con 0x556c9775c910 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c97854b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c97854b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44084/0 (socket says 172.21.15.169:44084) 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.944+0000 7fca70b5c640 1 -- 172.21.15.169:0/1465053672 learned_addr learned my addr 172.21.15.169:0/1465053672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fca70b5c640 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c97855070 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fca70b5c640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c97854b30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fca60055040 tx=0x7fca60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fc95d60a640 1 -- 172.21.15.169:0/1465053672 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60052d30 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fc95d60a640 1 -- 172.21.15.169:0/1465053672 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6006c070 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c97855300 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fc95d60a640 1 -- 172.21.15.169:0/1465053672 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6005e480 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.945+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c97857fb0 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fc95d60a640 1 -- 172.21.15.169:0/1465053672 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca60077060 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fc95d60a640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc958036900 0x7fc958038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fc95d60a640 1 -- 172.21.15.169:0/1465053672 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fca6008e450 con 0x556c9775c910 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca6835b640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc958036900 0x7fc958038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c9775f240 0x556c9785bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9785c300 con 0x556c9775f240 2024-04-24T01:26:07.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca7135d640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c9775f240 0x556c9785bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca6835b640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc958036900 0x7fc958038dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca580012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.946+0000 7fca7135d640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c9775f240 0x556c9785bd70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca7135d640 1 -- 172.21.15.169:0/1465053672 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c9775f240 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c97859340 con 0x556c9775f240 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca7135d640 1 -- 172.21.15.169:0/1465053672 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c9775f240 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c9785e650 0x556c97860a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978610e0 con 0x556c9785e650 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.947+0000 7fca70b5c640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c9785e650 0x556c97860a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca70b5c640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c9785e650 0x556c97860a40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca70b5c640 1 -- 172.21.15.169:0/1465053672 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca60009d30 con 0x556c9785e650 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9785d600 con 0x556c9775f240 2024-04-24T01:26:07.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca7135d640 1 -- 172.21.15.169:0/1465053672 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c9775f240 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c97862590 0x556c97864a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c97865160 con 0x556c97862590 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.948+0000 7fca6835b640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c97862590 0x556c97864a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca6835b640 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c97862590 0x556c97864a00 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca6835b640 1 -- 172.21.15.169:0/1465053672 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca58009050 con 0x556c97862590 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca7540f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.949+0000 7fca7540f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c9764d6b0 con 0x556c97873590 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44090/0 (socket says 172.21.15.169:44090) 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca70b5c640 1 -- 172.21.15.169:0/1139232983 learned_addr learned my addr 172.21.15.169:0/1139232983 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca70b5c640 1 -- 172.21.15.169:0/1139232983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c97873ef0 con 0x556c97873590 2024-04-24T01:26:07.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca70b5c640 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fca600686b0 tx=0x7fca60066380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fc9567fc640 1 -- 172.21.15.169:0/1139232983 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60089070 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fc9567fc640 1 -- 172.21.15.169:0/1139232983 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60058040 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c97874960 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fc9567fc640 1 -- 172.21.15.169:0/1139232983 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca6008b3f0 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.950+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c97874e60 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.951+0000 7fc9567fc640 1 -- 172.21.15.169:0/1139232983 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca6006e030 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.951+0000 7fc9567fc640 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.951+0000 7fc9567fc640 1 -- 172.21.15.169:0/1139232983 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fca60072070 con 0x556c97873590 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.951+0000 7fca6835b640 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca6835b640 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 0x7fc948038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca5800bf50 tx=0x7fca5800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca7540f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca7540f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c9784d940 con 0x556c9775bf00 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44092/0 (socket says 172.21.15.169:44092) 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca70b5c640 1 -- 172.21.15.169:0/1425313182 learned_addr learned my addr 172.21.15.169:0/1425313182 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca70b5c640 1 -- 172.21.15.169:0/1425313182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9775a700 con 0x556c9775bf00 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fca70b5c640 1 --2- 172.21.15.169:0/1425313182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca600082b0 tx=0x7fca6007b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a173e300f8fd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fc947fff640 1 -- 172.21.15.169:0/1425313182 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca600a0070 con 0x556c9775bf00 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fc947fff640 1 -- 172.21.15.169:0/1425313182 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60068c60 con 0x556c9775bf00 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.952+0000 7fc947fff640 1 -- 172.21.15.169:0/1425313182 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60066d50 con 0x556c9775bf00 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- 172.21.15.169:0/1425313182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 msgr2=0x556c9775c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 --2- 172.21.15.169:0/1425313182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fca600082b0 tx=0x7fca6007b170 comp rx=0 tx=0).stop 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- 172.21.15.169:0/1425313182 shutdown_connections 2024-04-24T01:26:07.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 --2- 172.21.15.169:0/1425313182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c9775c320 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- 172.21.15.169:0/1425313182 >> 172.21.15.169:0/1425313182 conn(0x556c9787c840 msgr2=0x556c9787a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- 172.21.15.169:0/1425313182 shutdown_connections 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- 172.21.15.169:0/1425313182 wait complete. 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 Processor -- start 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- start start 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.953+0000 7fca7540f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x556c9775ab10 con 0x556c9775bf00 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca70b5c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44100/0 (socket says 172.21.15.169:44100) 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 learned_addr learned my addr 172.21.15.169:0/3345532169 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c9788a060 con 0x556c9775bf00 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca70b5c640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fca6007b1b0 tx=0x7fca60066f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fc9467fc640 1 -- 172.21.15.169:0/3345532169 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60067c40 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fc9467fc640 1 -- 172.21.15.169:0/3345532169 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca600b4070 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556c9788a060 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fc9467fc640 1 -- 172.21.15.169:0/3345532169 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca60053a10 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.954+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c9788a060 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.955+0000 7fc9467fc640 1 -- 172.21.15.169:0/3345532169 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fca600a3070 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.955+0000 7fc9467fc640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc93c036900 0x7fc93c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.955+0000 7fc9467fc640 1 -- 172.21.15.169:0/3345532169 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fca600741c0 con 0x556c9775bf00 2024-04-24T01:26:07.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.955+0000 7fca6835b640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc93c036900 0x7fc93c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c978951d0 0x556c97897690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c97897de0 con 0x556c978951d0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca6835b640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc93c036900 0x7fc93c038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca58001b60 tx=0x7fca58010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7135d640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c978951d0 0x556c97897690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7135d640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c978951d0 0x556c97897690 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 20 realm 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.956+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978981f0 con 0x556c978951d0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c97898ac0 con 0x556c978951d0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c97899bc0 0x556c9789bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9789c5c0 con 0x556c97899bc0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.957+0000 7fca70b5c640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c97899bc0 0x556c9789bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca70b5c640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c97899bc0 0x556c9789bfb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca7540f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca7540f800 20 searching for the correct realm 2024-04-24T01:26:07.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c9789e500 0x556c978a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c978a1040 con 0x556c9789e500 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca6835b640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c9789e500 0x556c978a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.958+0000 7fca6835b640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c9789e500 0x556c978a09c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca6835b640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fca58038040 0x7fca5801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c978a1040 con 0x7fca58038040 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca7135d640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fca58038040 0x7fca5801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca7135d640 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fca58038040 0x7fca5801bab0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x7fca58038040 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.959+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.960+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x7fca58038040 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x7fca58038040 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.961+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c00a4a0 con 0x556c978951d0 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x7fca58038040 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.962+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.963+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.964+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x7fca58038040 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.965+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x7fca58038040 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c9789e500 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.966+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x556c978951d0 2024-04-24T01:26:07.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556c97898e60 con 0x7fca58038040 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9789ce10 con 0x556c978951d0 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.967+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9789ce10 con 0x556c978951d0 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9789ce10 con 0x7fca58038040 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 zone default found 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 4 Realm: () 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:07.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 zonegroup default 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c9789d700 con 0x556c97899bc0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.968+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2ea0 con 0x556c9789e500 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978a3240 con 0x556c9789e500 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:07.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 20 started sync module instance, tier type = 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.969+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2340 con 0x7fca58038040 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.970+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.970+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93924887242816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2340 con 0x7fca58038040 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.970+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a3c00 con 0x556c978951d0 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.971+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93924887242816] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.971+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.971+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93924887240816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a3c00 con 0x556c978951d0 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.971+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a4600 con 0x556c9789e500 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.972+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93924887240816] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.973+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.973+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93924887246672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a3b70 con 0x556c9789e500 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.973+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a54c0 con 0x7fca58038040 2024-04-24T01:26:07.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.974+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93924887246672] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.974+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.974+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93924887253008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a58e0 con 0x7fca58038040 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.974+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a62a0 con 0x556c978951d0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.975+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93924887253008] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.977+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.977+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93924887254544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a62a0 con 0x556c978951d0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.977+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a6c60 con 0x556c97899bc0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.978+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93924887254544] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.979+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.979+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93924887256560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a6210 con 0x556c97899bc0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.979+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a7ad0 con 0x556c97899bc0 2024-04-24T01:26:07.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.980+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93924887256560] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.980+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.980+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93924887261184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a8320 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.980+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a8bb0 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93924887261184] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93924887264880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a8e30 con 0x556c97899bc0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=0 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=1 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=2 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=3 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=4 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=5 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.981+0000 7fca7540f800 20 add_watcher() i=6 2024-04-24T01:26:07.995 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93924887264880] v34'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:07.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca7540f800 20 add_watcher() i=7 2024-04-24T01:26:07.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca7540f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:07.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978ac3a0 con 0x556c978951d0 2024-04-24T01:26:07.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:07.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.982+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93924887267072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a98c0 con 0x556c978951d0 2024-04-24T01:26:08.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93924887267072] v34'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:08.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fc926fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fca7540f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fca7540f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fca7540f800 5 note: GC not initialized 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.983+0000 7fc925fe3640 20 reqs_thread_entry: start 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 Filter name: none 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fc8977fe640 20 reqs_thread_entry: start 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978df740 con 0x556c9789e500 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-04-24T01:26:08.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978de390 con 0x556c9789e500 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.984+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978e2d30 con 0x556c9789e500 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v34'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca7540f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T01:26:08.002 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca7540f800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca7540f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 93924887502112 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978e2630 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== watch-notify(notify (1) cookie 93924887246672 notify 146028888089 ret 0) ==== 584+0+0 (crc 0 0 0) 0x556c978e30d0 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fc947fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 93924887246672 notifier 4857 bl.length()=542 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fc947fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fc947fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fc947fff640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc934003ea0 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(65 notify.2 [notify cookie 93924887502112 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== watch-notify(notify_complete (2) cookie 93924887502112 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556c978de130 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.986+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978e0d10 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.987+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v34'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.003 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.987+0000 7fca7540f800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.987+0000 7fca7540f800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.987+0000 7fca7540f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.987+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93924887505504 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556c978e0d10 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== watch-notify(notify (1) cookie 93924887256560 notify 146028888102 ret 0) ==== 217+0+0 (crc 0 0 0) 0x556c97873ef0 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fc9477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 93924887256560 notifier 4857 bl.length()=175 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fc9477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fc9477fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fc9477fe640 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8a4003400 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(68 notify.5 [notify cookie 93924887505504 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.988+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== watch-notify(notify_complete (2) cookie 93924887505504 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca6007f040 con 0x556c97899bc0 2024-04-24T01:26:08.004 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-04-24T01:26:07.985543Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.985529Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.989+0000 7fc926fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.010 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.989+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93924887267072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978e0430 con 0x556c978951d0 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.990+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93924887267072] v34'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.990+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93924887242816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978e2220 con 0x7fca58038040 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.991+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93924887242816] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.991+0000 7fca7540f800 20 remove_watcher() i=0 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.991+0000 7fca7540f800 2 removed watcher, disabling cache 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.991+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93924887240816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2840 con 0x556c978951d0 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.992+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93924887240816] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.992+0000 7fca7540f800 20 remove_watcher() i=1 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.992+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93924887246672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2840 con 0x556c9789e500 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.993+0000 7fca6835b640 1 -- 172.21.15.169:0/3345532169 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93924887246672] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58009050 con 0x556c9789e500 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.993+0000 7fca7540f800 20 remove_watcher() i=2 2024-04-24T01:26:08.011 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.994+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93924887253008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2840 con 0x7fca58038040 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.994+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93924887253008] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x7fca58038040 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.994+0000 7fca7540f800 20 remove_watcher() i=3 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.994+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93924887254544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a5010 con 0x556c978951d0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.995+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93924887254544] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6c032040 con 0x556c978951d0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.995+0000 7fca7540f800 20 remove_watcher() i=4 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.995+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93924887256560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a2840 con 0x556c97899bc0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.997+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93924887256560] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.997+0000 7fca7540f800 20 remove_watcher() i=5 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.997+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93924887261184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a5610 con 0x556c97899bc0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.998+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93924887261184] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.998+0000 7fca7540f800 20 remove_watcher() i=6 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.998+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93924887264880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556c978a5010 con 0x556c97899bc0 2024-04-24T01:26:08.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca70b5c640 1 -- 172.21.15.169:0/3345532169 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93924887264880] v34'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca600a2030 con 0x556c97899bc0 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 20 remove_watcher() i=7 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c97899bc0 msgr2=0x556c9789bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c97899bc0 0x556c9789bfb0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c978951d0 msgr2=0x556c97897690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c978951d0 0x556c97897690 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fca58038040 msgr2=0x7fca5801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fca58038040 0x7fca5801bab0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c9789e500 msgr2=0x556c978a09c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x556c9789e500 0x556c978a09c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc93c036900 msgr2=0x7fc93c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc93c036900 0x7fc93c038dc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca58001b60 tx=0x7fca58010000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7135d640 1 -- 172.21.15.169:0/3345532169 reap_dead start 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 msgr2=0x556c97889b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fca6007b1b0 tx=0x7fca60066f70 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 shutdown_connections 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/3345532169 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775bf00 0x556c97889b20 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 >> 172.21.15.169:0/3345532169 conn(0x556c9787c840 msgr2=0x556c97879ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 shutdown_connections 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/3345532169 wait complete. 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 msgr2=0x7fc948038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 0x7fc948038dc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fca5800bf50 tx=0x7fca5800f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 msgr2=0x556c978739b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fca600686b0 tx=0x7fca60066380 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 shutdown_connections 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc948036900 0x7fc948038dc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 --2- 172.21.15.169:0/1139232983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c97873590 0x556c978739b0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:07.999+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 >> 172.21.15.169:0/1139232983 conn(0x556c97867630 msgr2=0x556c97867a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 shutdown_connections 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1139232983 wait complete. 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c9785e650 msgr2=0x556c97860a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x556c9785e650 0x556c97860a40 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c9775f240 msgr2=0x556c9785bd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x556c9775f240 0x556c9785bd70 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c97862590 msgr2=0x556c97864a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x556c97862590 0x556c97864a00 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc958036900 msgr2=0x7fc958038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fc958036900 0x7fc958038dc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fca58000f60 tx=0x7fca580012b0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 msgr2=0x556c97854b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 --2- 172.21.15.169:0/1465053672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556c9775c910 0x556c97854b30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fca60055040 tx=0x7fca60002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7135d640 1 -- 172.21.15.169:0/1465053672 reap_dead start 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 shutdown_connections 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 >> 172.21.15.169:0/1465053672 conn(0x556c977562c0 msgr2=0x556c978471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 shutdown_connections 2024-04-24T01:26:08.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.000+0000 7fca7540f800 1 -- 172.21.15.169:0/1465053672 wait complete. 2024-04-24T01:26:08.016 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T01:26:07.985543Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.985529Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.016 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-04-24T01:26:07.985543Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.985529Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.016 ERROR:root:0 2024-04-24T01:26:08.017 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:08.021 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:08.022 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-04-24T01:26:08.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-04-24T01:26:08.022 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd1121f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563f69d9e990 0x563f69da0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.066 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd1121f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563f69c5cd40 con 0x563f69da12c0 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd1121f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x563f69c2f4d0 con 0x563f69d9e990 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.065+0000 7fbd0ed1e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x563f69d9e990 0x563f69da0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.066+0000 7fbd0651d640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x563f69da12c0 0x563f69da36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50748/0 (socket says 172.21.15.169:50748) 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.066+0000 7fbd0651d640 1 -- 172.21.15.169:0/1179015571 learned_addr learned my addr 172.21.15.169:0/1179015571 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.066+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1179015571 >> v1:172.21.15.142:6789/0 conn(0x563f69da12c0 legacy=0x563f69da36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.067 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.066+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1179015571 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69c5b590 con 0x563f69d9e990 2024-04-24T01:26:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1179015571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69da0d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000a470 tx=0x7fbd0001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47e7ae3a5755ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd0e51d640 1 -- 172.21.15.169:0/1179015571 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00057070 con 0x563f69d9e990 2024-04-24T01:26:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd0e51d640 1 -- 172.21.15.169:0/1179015571 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd00052570 con 0x563f69d9e990 2024-04-24T01:26:08.068 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd0e51d640 1 -- 172.21.15.169:0/1179015571 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00052870 con 0x563f69d9e990 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 -- 172.21.15.169:0/1179015571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 msgr2=0x563f69da0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1179015571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69da0d80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000a470 tx=0x7fbd0001ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 -- 172.21.15.169:0/1179015571 shutdown_connections 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1179015571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69da0d80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 -- 172.21.15.169:0/1179015571 >> 172.21.15.169:0/1179015571 conn(0x563f69d98300 msgr2=0x563f69d9a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 -- 172.21.15.169:0/1179015571 shutdown_connections 2024-04-24T01:26:08.069 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.068+0000 7fbd1121f800 1 -- 172.21.15.169:0/1179015571 wait complete. 2024-04-24T01:26:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd1121f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd1121f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563f69ce93c0 con 0x563f69d9e990 2024-04-24T01:26:08.081 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44124/0 (socket says 172.21.15.169:44124) 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.080+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1905259161 learned_addr learned my addr 172.21.15.169:0/1905259161 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.081+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1905259161 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69e8f680 con 0x563f69d9e990 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.081+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1905259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd00055040 tx=0x7fbd0004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35740ea6d70c6b67 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.081+0000 7fbbfce09640 1 -- 172.21.15.169:0/1905259161 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00057070 con 0x563f69d9e990 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.081+0000 7fbbfce09640 1 -- 172.21.15.169:0/1905259161 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd00063070 con 0x563f69d9e990 2024-04-24T01:26:08.082 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.081+0000 7fbbfce09640 1 -- 172.21.15.169:0/1905259161 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00052720 con 0x563f69d9e990 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- 172.21.15.169:0/1905259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 msgr2=0x563f69e8f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1905259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fbd00055040 tx=0x7fbd0004c000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- 172.21.15.169:0/1905259161 shutdown_connections 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1905259161 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e8f0b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- 172.21.15.169:0/1905259161 >> 172.21.15.169:0/1905259161 conn(0x563f69d98300 msgr2=0x563f69e8a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- 172.21.15.169:0/1905259161 shutdown_connections 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- 172.21.15.169:0/1905259161 wait complete. 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e96b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.087 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd1121f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563f69da70e0 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e96b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e96b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44134/0 (socket says 172.21.15.169:44134) 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.082+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1409587795 learned_addr learned my addr 172.21.15.169:0/1409587795 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69e970a0 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e96b60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd00055040 tx=0x7fbd00002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbbfb606640 1 -- 172.21.15.169:0/1409587795 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00052d30 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbbfb606640 1 -- 172.21.15.169:0/1409587795 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0006c070 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f69e97330 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbbfb606640 1 -- 172.21.15.169:0/1409587795 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0005e480 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.083+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f69e99fe0 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbbfb606640 1 -- 172.21.15.169:0/1409587795 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd00077060 con 0x563f69d9e990 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbbfb606640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbf4036900 0x7fbbf4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.088 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbbfb606640 1 -- 172.21.15.169:0/1409587795 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd0008e450 con 0x563f69d9e990 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbf4036900 0x7fbbf4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69da12c0 0x563f69e9dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69e9e330 con 0x563f69da12c0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69da12c0 0x563f69e9dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbf4036900 0x7fbbf4038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8000f60 tx=0x7fbcf80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.084+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69da12c0 0x563f69e9dda0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1409587795 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69da12c0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69e9b370 con 0x563f69da12c0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1409587795 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69da12c0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ea0680 0x563f69ea2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ea3160 con 0x563f69ea0680 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.085+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ea0680 0x563f69ea2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ea0680 0x563f69ea2a70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1409587795 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ea0680 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69e9f630 con 0x563f69da12c0 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1409587795 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69da12c0 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563f69ea4610 0x563f69ea6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ea71c0 con 0x563f69ea4610 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.086+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563f69ea4610 0x563f69ea6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.090 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563f69ea4610 0x563f69ea6a60 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd0651d640 1 -- 172.21.15.169:0/1409587795 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ea4610 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd1121f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.087+0000 7fbd1121f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563f69c8f6b0 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44140/0 (socket says 172.21.15.169:44140) 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/3107641259 learned_addr learned my addr 172.21.15.169:0/3107641259 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/3107641259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69eb5f80 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbd00052520 tx=0x7fbd00009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbbf8e01640 1 -- 172.21.15.169:0/3107641259 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00069250 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbbf8e01640 1 -- 172.21.15.169:0/3107641259 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd00058040 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f69eb69f0 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbbf8e01640 1 -- 172.21.15.169:0/3107641259 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0005e790 con 0x563f69eb5620 2024-04-24T01:26:08.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.088+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f69eb6ef0 con 0x563f69eb5620 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.089+0000 7fbbf8e01640 1 -- 172.21.15.169:0/3107641259 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd0006e030 con 0x563f69eb5620 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.089+0000 7fbbf8e01640 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 0x7fbbe8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.089+0000 7fbbf8e01640 1 -- 172.21.15.169:0/3107641259 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd00086070 con 0x563f69eb5620 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.089+0000 7fbd0651d640 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 0x7fbbe8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.089+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0651d640 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 0x7fbbe8038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800bf50 tx=0x7fbcf800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd1121f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd1121f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563f69e8f940 con 0x563f69ec2780 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44142/0 (socket says 172.21.15.169:44142) 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/3960962079 learned_addr learned my addr 172.21.15.169:0/3960962079 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/3960962079 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69ec3170 con 0x563f69ec2780 2024-04-24T01:26:08.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/3960962079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd0008e400 tx=0x7fbd00069660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81bf6f18775c059 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbbf27fc640 1 -- 172.21.15.169:0/3960962079 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0008ec30 con 0x563f69ec2780 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbbf27fc640 1 -- 172.21.15.169:0/3960962079 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0008b070 con 0x563f69ec2780 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.090+0000 7fbbf27fc640 1 -- 172.21.15.169:0/3960962079 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00068ae0 con 0x563f69ec2780 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- 172.21.15.169:0/3960962079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 msgr2=0x563f69ec2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3960962079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbd0008e400 tx=0x7fbd00069660 comp rx=0 tx=0).stop 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- 172.21.15.169:0/3960962079 shutdown_connections 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3960962079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec2ba0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- 172.21.15.169:0/3960962079 >> 172.21.15.169:0/3960962079 conn(0x563f69ebea50 msgr2=0x563f69ebcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- 172.21.15.169:0/3960962079 shutdown_connections 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- 172.21.15.169:0/3960962079 wait complete. 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 Processor -- start 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- start start 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.106 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd1121f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x563f69ec37d0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.091+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd0ed1e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44146/0 (socket says 172.21.15.169:44146) 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 learned_addr learned my addr 172.21.15.169:0/1370712388 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f69ec9fe0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec9aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd000529c0 tx=0x7fbd00009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbbf0ff9640 1 -- 172.21.15.169:0/1370712388 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd000531e0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbbf0ff9640 1 -- 172.21.15.169:0/1370712388 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd00053380 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbbf0ff9640 1 -- 172.21.15.169:0/1370712388 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd00056ab0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563f69ec9fe0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.092+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f69ec9fe0 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbbf0ff9640 1 -- 172.21.15.169:0/1370712388 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbd000ae020 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbbf0ff9640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbd8036950 0x7fbbd8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbbf0ff9640 1 -- 172.21.15.169:0/1370712388 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fbd000b1d30 con 0x563f69ec2780 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbd8036950 0x7fbbd8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.107 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbd8036950 0x7fbbd8038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001b60 tx=0x7fbcf8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.093+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69ed5230 0x563f69ed76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed7e40 con 0x563f69ed5230 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69ed5230 0x563f69ed76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69ed5230 0x563f69ed76f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 20 realm 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8250 con 0x563f69ed5230 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.108 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8b20 con 0x563f69ed5230 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.094+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ed9c20 0x563f69edc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69edc620 con 0x563f69ed9c20 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ed9c20 0x563f69edc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.095+0000 7fbd0ed1e640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ed9c20 0x563f69edc010 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd1121f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.109 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd1121f800 20 searching for the correct realm 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563f69ede5d0 0x563f69ee0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee1160 con 0x563f69ede5d0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563f69ede5d0 0x563f69ee0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.096+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563f69ede5d0 0x563f69ee0a90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0651d640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbcf8038040 0x7fbcf801bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee1160 con 0x7fbcf8038040 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbcf8038040 0x7fbcf801bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0f51f640 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbcf8038040 0x7fbcf801bab0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x7fbcf8038040 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.110 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.097+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.098+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x7fbcf8038040 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x7fbcf8038040 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.111 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.099+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd0800a4a0 con 0x563f69ed5230 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x7fbcf8038040 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.100+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.112 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.101+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.102+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x7fbcf8038040 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.113 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.114 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.103+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.104+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.104+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x7fbcf8038040 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.104+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.104+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ede5d0 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.104+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed9c20 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x563f69ed5230 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.123 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563f69ed8ec0 con 0x7fbcf8038040 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.105+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69edcee0 con 0x563f69ed5230 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69edcee0 con 0x563f69ed5230 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69edcee0 con 0x7fbcf8038040 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 zone default found 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 4 Realm: () 2024-04-24T01:26:08.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 zonegroup default 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69edd780 con 0x563f69ed9c20 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.106+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2fc0 con 0x563f69ede5d0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee3360 con 0x563f69ede5d0 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 20 started sync module instance, tier type = 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.107+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2460 con 0x7fbcf8038040 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.108+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.108+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94830360143952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2460 con 0x7fbcf8038040 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.108+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee3c10 con 0x563f69ed5230 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.109+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94830360143952] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.109+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.109+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94830360147712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2460 con 0x563f69ed5230 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.109+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee4690 con 0x563f69ede5d0 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.110+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.110+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94830360150432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee4f60 con 0x563f69ede5d0 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.110+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee59c0 con 0x7fbcf8038040 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.111+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94830360147712] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.111+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94830360150432] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.111+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.111+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94830360152752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee54d0 con 0x7fbcf8038040 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.111+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee62d0 con 0x563f69ed5230 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.114+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.114+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94830360157584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee6700 con 0x563f69ed5230 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.114+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee7210 con 0x563f69ed9c20 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.114+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94830360152752] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.115+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94830360157584] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.115+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.115+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94830360161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee61b0 con 0x563f69ed9c20 2024-04-24T01:26:08.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.115+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee7ab0 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.116+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94830360161472] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.116+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.116+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94830360141744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee8300 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.116+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee8cc0 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94830360141744] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94830360166448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee8cc0 con 0x563f69ed9c20 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=0 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=1 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=2 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=3 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=4 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=5 2024-04-24T01:26:08.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.117+0000 7fbd1121f800 20 add_watcher() i=6 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94830360166448] v34'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd1121f800 20 add_watcher() i=7 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd1121f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69eec0c0 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.118+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94830360168928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee9570 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.120+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94830360168928] v34'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.120+0000 7fbbc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.120+0000 7fbd1121f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.120+0000 7fbd1121f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.120+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef49d0 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.121+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'62 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.130 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.121+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef5020 con 0x563f69ed9c20 2024-04-24T01:26:08.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.122+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.131 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.122+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef5020 con 0x563f69ede5d0 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.123+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.123+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef5a40 con 0x563f69ed5230 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.124+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'259 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.124+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef28c0 con 0x7fbcf8038040 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.125+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'89 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.125+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef28c0 con 0x563f69ede5d0 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.126+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'65 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.133 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.126+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef6c20 con 0x563f69ed5230 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.127+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.127+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef6cb0 con 0x563f69ed9c20 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.128+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'59 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.128+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef6dc0 con 0x7fbcf8038040 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.129+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.129+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef6e90 con 0x563f69ede5d0 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.130+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.130+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x7fbcf8038040 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.131+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'90 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.131+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x563f69ed9c20 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.132+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.134 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.132+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x7fbcf8038040 2024-04-24T01:26:08.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.133+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.133+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x563f69ed9c20 2024-04-24T01:26:08.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.135+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'72 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.135 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.135+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x563f69ed5230 2024-04-24T01:26:08.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.136+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'260 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.136 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.136+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef78e0 con 0x563f69ede5d0 2024-04-24T01:26:08.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.137+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'80 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.137 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.137+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1800 con 0x7fbcf8038040 2024-04-24T01:26:08.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.138+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'91 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.138 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.138+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.139+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'42 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.139 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.139+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ed5230 2024-04-24T01:26:08.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.140+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.140 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.140+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ed5230 2024-04-24T01:26:08.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.141+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'261 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.141 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.141+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.142+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'81 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.143 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.143+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x7fbcf8038040 2024-04-24T01:26:08.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.143+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'46 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.144 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.143+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.144+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.145 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.145+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.145+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'48 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.145+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.146 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.146+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.147 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.146+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.147+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'66 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.148 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.147+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ed9c20 2024-04-24T01:26:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.149+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.149 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.149+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.150+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.150 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.150+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ed9c20 2024-04-24T01:26:08.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.151+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'60 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.151 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.151+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ede5d0 2024-04-24T01:26:08.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.152+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'82 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.152 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.152+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x563f69ed9c20 2024-04-24T01:26:08.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.153+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'73 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.153+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ef1dd0 con 0x7fbcf8038040 2024-04-24T01:26:08.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.154+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbb3ffff640 20 reqs_thread_entry: start 2024-04-24T01:26:08.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbd1121f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbd1121f800 20 Filter name: none 2024-04-24T01:26:08.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbb3dffb640 20 reqs_thread_entry: start 2024-04-24T01:26:08.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbd1121f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-04-24T01:26:08.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbd1121f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.155+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69f22870 con 0x563f69ede5d0 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 20 rados_obj.operate() r=0 bl.length=363 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69f25300 con 0x563f69ede5d0 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbcf8009050 con 0x563f69ede5d0 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 10 removing key index: true_admin_akey 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.156+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69f232e0 con 0x563f69ede5d0 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(96 true_admin_akey [delete] v34'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbd1121f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94830360411632 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69f25850 con 0x563f69ed9c20 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== watch-notify(notify (1) cookie 94830360161472 notify 146028888103 ret 0) ==== 207+0+0 (crc 0 0 0) 0x563f69ef6770 con 0x563f69ed9c20 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbbf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94830360161472 notifier 4864 bl.length()=165 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(97 notify.5 [notify cookie 94830360411632 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.157+0000 7fbbf27fc640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbbd4003d60 con 0x563f69ed9c20 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== watch-notify(notify_complete (2) cookie 94830360411632 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563f69eb5f80 con 0x563f69ed9c20 2024-04-24T01:26:08.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd1121f800 10 removing email index: 2024-04-24T01:26:08.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd1121f800 10 removing user buckets index 2024-04-24T01:26:08.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69f257b0 con 0x563f69ede5d0 2024-04-24T01:26:08.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.158+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(99 a_user.buckets [delete] v34'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd1121f800 10 removing user index: a_user 2024-04-24T01:26:08.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69f257b0 con 0x563f69ede5d0 2024-04-24T01:26:08.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(100 a_user [call,call,delete] v34'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd1121f800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd1121f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.159+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94830360418224 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563f69f23df0 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== watch-notify(notify (1) cookie 94830360150432 notify 146028888090 ret 0) ==== 197+0+0 (crc 0 0 0) 0x563f69ef1a30 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbbf27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94830360150432 notifier 4864 bl.length()=155 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbbf27fc640 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fbbd4003d60 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(101 notify.2 [notify cookie 94830360418224 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== watch-notify(notify_complete (2) cookie 94830360418224 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563f69ef23f0 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.160+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.161+0000 7fbbc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.161+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94830360168928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69f257b0 con 0x563f69ed5230 2024-04-24T01:26:08.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.162+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94830360168928] v34'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.162+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94830360143952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69f257b0 con 0x7fbcf8038040 2024-04-24T01:26:08.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.163+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94830360143952] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.163+0000 7fbd1121f800 20 remove_watcher() i=0 2024-04-24T01:26:08.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.163+0000 7fbd1121f800 2 removed watcher, disabling cache 2024-04-24T01:26:08.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.163+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94830360147712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ed5230 2024-04-24T01:26:08.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.164+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94830360147712] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.164+0000 7fbd1121f800 20 remove_watcher() i=1 2024-04-24T01:26:08.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.164+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94830360150432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ede5d0 2024-04-24T01:26:08.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.165+0000 7fbd0651d640 1 -- 172.21.15.169:0/1370712388 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94830360150432] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcf804e040 con 0x563f69ede5d0 2024-04-24T01:26:08.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.165+0000 7fbd1121f800 20 remove_watcher() i=2 2024-04-24T01:26:08.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.165+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94830360152752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x7fbcf8038040 2024-04-24T01:26:08.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.166+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94830360152752] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x7fbcf8038040 2024-04-24T01:26:08.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.166+0000 7fbd1121f800 20 remove_watcher() i=3 2024-04-24T01:26:08.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.166+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94830360157584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ed5230 2024-04-24T01:26:08.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.167+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94830360157584] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08032040 con 0x563f69ed5230 2024-04-24T01:26:08.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.167+0000 7fbd1121f800 20 remove_watcher() i=4 2024-04-24T01:26:08.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.167+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94830360161472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ed9c20 2024-04-24T01:26:08.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.168+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94830360161472] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.168+0000 7fbd1121f800 20 remove_watcher() i=5 2024-04-24T01:26:08.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.168+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94830360141744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ed9c20 2024-04-24T01:26:08.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.169+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94830360141744] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.169+0000 7fbd1121f800 20 remove_watcher() i=6 2024-04-24T01:26:08.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.169+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94830360166448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563f69ee2850 con 0x563f69ed9c20 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd0ed1e640 1 -- 172.21.15.169:0/1370712388 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94830360166448] v34'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd00009d30 con 0x563f69ed9c20 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 20 remove_watcher() i=7 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ed9c20 msgr2=0x563f69edc010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ed9c20 0x563f69edc010 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69ed5230 msgr2=0x563f69ed76f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69ed5230 0x563f69ed76f0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.173 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbcf8038040 msgr2=0x7fbcf801bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fbcf8038040 0x7fbcf801bab0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563f69ede5d0 msgr2=0x563f69ee0a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x563f69ede5d0 0x563f69ee0a90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbd8036950 msgr2=0x7fbbd8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbd8036950 0x7fbbd8038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8001b60 tx=0x7fbcf8010000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 msgr2=0x563f69ec9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1370712388 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69ec2780 0x563f69ec9aa0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbd000529c0 tx=0x7fbd00009c80 comp rx=0 tx=0).stop 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 reap_dead start 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1370712388 reap_dead start 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 shutdown_connections 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 >> 172.21.15.169:0/1370712388 conn(0x563f69ebea50 msgr2=0x563f69ebc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.174 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 shutdown_connections 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.170+0000 7fbd1121f800 1 -- 172.21.15.169:0/1370712388 wait complete. 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 msgr2=0x7fbbe8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 0x7fbbe8038dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800bf50 tx=0x7fbcf800f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 msgr2=0x563f69eb5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fbd00052520 tx=0x7fbd00009700 comp rx=0 tx=0).stop 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 shutdown_connections 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbe8036900 0x7fbbe8038dc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/3107641259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69eb5620 0x563f69eb5a40 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 >> 172.21.15.169:0/3107641259 conn(0x563f69ea96c0 msgr2=0x563f69ea9ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.175 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 shutdown_connections 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/3107641259 wait complete. 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ea0680 msgr2=0x563f69ea2a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x563f69ea0680 0x563f69ea2a70 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69da12c0 msgr2=0x563f69e9dda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x563f69da12c0 0x563f69e9dda0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563f69ea4610 msgr2=0x563f69ea6a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x563f69ea4610 0x563f69ea6a60 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbf4036900 msgr2=0x7fbbf4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fbbf4036900 0x7fbbf4038dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8000f60 tx=0x7fbcf80012b0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 msgr2=0x563f69e96b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 --2- 172.21.15.169:0/1409587795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f69d9e990 0x563f69e96b60 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbd00055040 tx=0x7fbd00002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd0f51f640 1 -- 172.21.15.169:0/1409587795 reap_dead start 2024-04-24T01:26:08.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 shutdown_connections 2024-04-24T01:26:08.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 >> 172.21.15.169:0/1409587795 conn(0x563f69d98300 msgr2=0x563f69e891d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 shutdown_connections 2024-04-24T01:26:08.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.171+0000 7fbd1121f800 1 -- 172.21.15.169:0/1409587795 wait complete. 2024-04-24T01:26:08.180 ERROR:root:None 2024-04-24T01:26:08.180 ERROR:root:0 2024-04-24T01:26:08.180 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T01:26:08.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-04-24T01:26:08.180 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.265+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.265+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3669519800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5645cf8ca7c0 0x5645cf8cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3669519800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5645cf78ad40 con 0x5645cf8cb120 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3669519800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5645cf75d4d0 con 0x5645cf8ca7c0 2024-04-24T01:26:08.267 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3667018640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5645cf8ca7c0 0x5645cf8cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3667018640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5645cf8ca7c0 0x5645cf8cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44148/0 (socket says 172.21.15.169:44148) 2024-04-24T01:26:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f365e817640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x5645cf8cb120 0x5645cf8cb5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50764/0 (socket says 172.21.15.169:50764) 2024-04-24T01:26:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3667018640 1 -- 172.21.15.169:0/4154340807 learned_addr learned my addr 172.21.15.169:0/4154340807 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3667018640 1 -- 172.21.15.169:0/4154340807 >> v1:172.21.15.142:6789/0 conn(0x5645cf8cb120 legacy=0x5645cf8cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.268 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.266+0000 7f3667018640 1 -- 172.21.15.169:0/4154340807 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf789590 con 0x5645cf8ca7c0 2024-04-24T01:26:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.268+0000 7f3667018640 1 --2- 172.21.15.169:0/4154340807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf8cabe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f365800a520 tx=0x7f365801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3539ca94f55f87f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.268+0000 7f3666817640 1 -- 172.21.15.169:0/4154340807 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658057070 con 0x5645cf8ca7c0 2024-04-24T01:26:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.268+0000 7f3666817640 1 -- 172.21.15.169:0/4154340807 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658052570 con 0x5645cf8ca7c0 2024-04-24T01:26:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.268+0000 7f3666817640 1 -- 172.21.15.169:0/4154340807 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658052870 con 0x5645cf8ca7c0 2024-04-24T01:26:08.269 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 -- 172.21.15.169:0/4154340807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 msgr2=0x5645cf8cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 --2- 172.21.15.169:0/4154340807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf8cabe0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f365800a520 tx=0x7f365801d010 comp rx=0 tx=0).stop 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 -- 172.21.15.169:0/4154340807 shutdown_connections 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 --2- 172.21.15.169:0/4154340807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf8cabe0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 -- 172.21.15.169:0/4154340807 >> 172.21.15.169:0/4154340807 conn(0x5645cf8c6340 msgr2=0x5645cf8c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 -- 172.21.15.169:0/4154340807 shutdown_connections 2024-04-24T01:26:08.270 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.269+0000 7f3669519800 1 -- 172.21.15.169:0/4154340807 wait complete. 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.280+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.280+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3669519800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3669519800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645cf8173b0 con 0x5645cf8ca7c0 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.282 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44150/0 (socket says 172.21.15.169:44150) 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3667018640 1 -- 172.21.15.169:0/4062017285 learned_addr learned my addr 172.21.15.169:0/4062017285 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3667018640 1 -- 172.21.15.169:0/4062017285 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf9bf9e0 con 0x5645cf8ca7c0 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f3667018640 1 --2- 172.21.15.169:0/4062017285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f365801d050 tx=0x7f365804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c658765e9da393 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.281+0000 7f355560a640 1 -- 172.21.15.169:0/4062017285 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658057040 con 0x5645cf8ca7c0 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f355560a640 1 -- 172.21.15.169:0/4062017285 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658052850 con 0x5645cf8ca7c0 2024-04-24T01:26:08.283 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f355560a640 1 -- 172.21.15.169:0/4062017285 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658052b70 con 0x5645cf8ca7c0 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 -- 172.21.15.169:0/4062017285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 msgr2=0x5645cf9bf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 --2- 172.21.15.169:0/4062017285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f365801d050 tx=0x7f365804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 -- 172.21.15.169:0/4062017285 shutdown_connections 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 --2- 172.21.15.169:0/4062017285 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9bf410 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 -- 172.21.15.169:0/4062017285 >> 172.21.15.169:0/4062017285 conn(0x5645cf8c6340 msgr2=0x5645cf9bad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 -- 172.21.15.169:0/4062017285 shutdown_connections 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 -- 172.21.15.169:0/4062017285 wait complete. 2024-04-24T01:26:08.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.282+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3669519800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3669519800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645cf8cbf80 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44152/0 (socket says 172.21.15.169:44152) 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3667018640 1 -- 172.21.15.169:0/702131048 learned_addr learned my addr 172.21.15.169:0/702131048 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3667018640 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf9c73b0 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.283+0000 7f3667018640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9c6e70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f365801cfe0 tx=0x7f3658003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3553e07640 1 -- 172.21.15.169:0/702131048 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658073070 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3553e07640 1 -- 172.21.15.169:0/702131048 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365805d650 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645cf9c7640 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3553e07640 1 -- 172.21.15.169:0/702131048 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658057070 con 0x5645cf8ca7c0 2024-04-24T01:26:08.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645cf9ca2a0 con 0x5645cf8ca7c0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3553e07640 1 -- 172.21.15.169:0/702131048 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3658076070 con 0x5645cf8ca7c0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.284+0000 7f3553e07640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f354c036900 0x7f354c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3553e07640 1 -- 172.21.15.169:0/702131048 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f365808df90 con 0x5645cf8ca7c0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f365e817640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f354c036900 0x7f354c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cf8cb120 0x5645cf9cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cf9ce540 con 0x5645cf8cb120 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3667819640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cf8cb120 0x5645cf9cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f365e817640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f354c036900 0x7f354c038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3650000f60 tx=0x7f3650001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3667819640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cf8cb120 0x5645cf9cdef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3667819640 1 -- 172.21.15.169:0/702131048 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cf8cb120 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.285+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cf9cb630 con 0x5645cf8cb120 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.286+0000 7f3667819640 1 -- 172.21.15.169:0/702131048 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cf8cb120 2024-04-24T01:26:08.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.286+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cf9d0870 0x5645cf9d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.286+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cf9d3300 con 0x5645cf9d0870 2024-04-24T01:26:08.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.286+0000 7f3667018640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cf9d0870 0x5645cf9d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.286+0000 7f3667018640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cf9d0870 0x5645cf9d2c60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f3667018640 1 -- 172.21.15.169:0/702131048 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3658075030 con 0x5645cf9d0870 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cf9cf820 con 0x5645cf8cb120 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f3667819640 1 -- 172.21.15.169:0/702131048 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cf8cb120 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5645cf9d47b0 0x5645cf9d6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cf9d7360 con 0x5645cf9d47b0 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f365e817640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5645cf9d47b0 0x5645cf9d6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.288+0000 7f365e817640 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5645cf9d47b0 0x5645cf9d6c00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f365e817640 1 -- 172.21.15.169:0/702131048 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f365000f690 con 0x5645cf9d47b0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3669519800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3669519800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645cf7bd6b0 con 0x5645cf9e57c0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44168/0 (socket says 172.21.15.169:44168) 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.289+0000 7f3667018640 1 -- 172.21.15.169:0/4180567494 learned_addr learned my addr 172.21.15.169:0/4180567494 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3667018640 1 -- 172.21.15.169:0/4180567494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf9e6120 con 0x5645cf9e57c0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3667018640 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3658000c00 tx=0x7f3658006650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3551602640 1 -- 172.21.15.169:0/4180567494 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580773b0 con 0x5645cf9e57c0 2024-04-24T01:26:08.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3551602640 1 -- 172.21.15.169:0/4180567494 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658089070 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645cf9e6b90 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3551602640 1 -- 172.21.15.169:0/4180567494 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580776c0 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.290+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645cf9e7090 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3551602640 1 -- 172.21.15.169:0/4180567494 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3658079990 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3551602640 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 0x7f3540038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3551602640 1 -- 172.21.15.169:0/4180567494 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3658091d40 con 0x5645cf9e57c0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f365e817640 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 0x7f3540038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f365e817640 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 0x7f3540038dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5645cf9cb550 tx=0x7f365000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3669519800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.291+0000 7f3669519800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645cf9bfca0 con 0x5645cf9f2930 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44172/0 (socket says 172.21.15.169:44172) 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f3667018640 1 -- 172.21.15.169:0/4284523390 learned_addr learned my addr 172.21.15.169:0/4284523390 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f3667018640 1 -- 172.21.15.169:0/4284523390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf9f3320 con 0x5645cf9f2930 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f3667018640 1 --2- 172.21.15.169:0/4284523390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3658099580 tx=0x7f365808b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47e0675c9bf5881 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f354affd640 1 -- 172.21.15.169:0/4284523390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580a9070 con 0x5645cf9f2930 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f354affd640 1 -- 172.21.15.169:0/4284523390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3658076490 con 0x5645cf9f2930 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.292+0000 7f354affd640 1 -- 172.21.15.169:0/4284523390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3658079db0 con 0x5645cf9f2930 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- 172.21.15.169:0/4284523390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 msgr2=0x5645cf9f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 --2- 172.21.15.169:0/4284523390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f3658099580 tx=0x7f365808b3d0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- 172.21.15.169:0/4284523390 shutdown_connections 2024-04-24T01:26:08.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 --2- 172.21.15.169:0/4284523390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f2d50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- 172.21.15.169:0/4284523390 >> 172.21.15.169:0/4284523390 conn(0x5645cf9eec40 msgr2=0x5645cf9ecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- 172.21.15.169:0/4284523390 shutdown_connections 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- 172.21.15.169:0/4284523390 wait complete. 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 Processor -- start 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- start start 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3669519800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5645cf9f39b0 con 0x5645cf9f2930 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3667018640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44178/0 (socket says 172.21.15.169:44178) 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 learned_addr learned my addr 172.21.15.169:0/2419384146 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.293+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645cf9fa280 con 0x5645cf9f2930 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f3667018640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f365804efd0 tx=0x7f3658006a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f35497fa640 1 -- 172.21.15.169:0/2419384146 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580b3070 con 0x5645cf9f2930 2024-04-24T01:26:08.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f35497fa640 1 -- 172.21.15.169:0/2419384146 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f365808cdb0 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f35497fa640 1 -- 172.21.15.169:0/2419384146 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36580a9040 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5645cf9fa280 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.294+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645cf9fa280 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f35497fa640 1 -- 172.21.15.169:0/2419384146 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f365808c460 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f35497fa640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3530036900 0x7f3530038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f35497fa640 1 -- 172.21.15.169:0/2419384146 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f36580b0d10 con 0x5645cf9f2930 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f365e817640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3530036900 0x7f3530038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cfa05430 0x5645cfa078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa08040 con 0x5645cfa05430 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f365e817640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3530036900 0x7f3530038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5645cf9d7760 tx=0x7f3650010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.295+0000 7f3667819640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cfa05430 0x5645cfa078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3667819640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cfa05430 0x5645cfa078f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 realm 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa08450 con 0x5645cfa05430 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa08d20 con 0x5645cfa05430 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.323 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.296+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cfa09e20 0x5645cfa0c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa0c820 con 0x5645cfa09e20 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3667018640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cfa09e20 0x5645cfa0c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3667018640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cfa09e20 0x5645cfa0c210 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 20 searching for the correct realm 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5645cfa0e7b0 0x5645cfa10c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.324 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.297+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa11340 con 0x5645cfa0e7b0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f365e817640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5645cfa0e7b0 0x5645cfa10c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f365e817640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5645cfa0e7b0 0x5645cfa10c70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f365e817640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f365000f070 0x7f365002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa11340 con 0x7f365000f070 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.298+0000 7f3667819640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f365000f070 0x7f365002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.299+0000 7f3667819640 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f365000f070 0x7f365002e910 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.299+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x7f365000f070 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.299+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.325 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.299+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.299+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.326 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.300+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x7f365000f070 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x7f365000f070 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.327 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.301+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f366000a4a0 con 0x5645cfa05430 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x7f365000f070 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.328 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.302+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.329 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.303+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x7f365000f070 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.304+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.330 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.305+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x7f365000f070 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa09e20 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.306+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x5645cfa05430 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.331 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa090c0 con 0x7f365000f070 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa0d0e0 con 0x5645cfa05430 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.332 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa0d0e0 con 0x5645cfa05430 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.307+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa0d0e0 con 0x7f365000f070 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 zone default found 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 4 Realm: () 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.333 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 zonegroup default 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa0d980 con 0x5645cfa09e20 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa131a0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.334 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa13540 con 0x5645cfa0e7b0 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.308+0000 7f3669519800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.309+0000 7f3669519800 20 started sync module instance, tier type = 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.309+0000 7f3669519800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.309+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12640 con 0x7f365000f070 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.310+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.310+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94857836178240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12640 con 0x7f365000f070 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.310+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa13f00 con 0x5645cfa05430 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.311+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94857836178240] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.311+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.311+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94857836176240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa13f00 con 0x5645cfa05430 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.311+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa148c0 con 0x5645cfa0e7b0 2024-04-24T01:26:08.335 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.312+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.312+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94857836184592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa15160 con 0x5645cfa0e7b0 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.312+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa15b90 con 0x7f365000f070 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.312+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94857836176240] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.313+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94857836184592] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.313+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.313+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94857836186800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa13a50 con 0x7f365000f070 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.313+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa16460 con 0x5645cfa05430 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.314+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94857836186800] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.314+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.314+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94857836189344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa16410 con 0x5645cfa05430 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.314+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa16e70 con 0x5645cfa09e20 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.315+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.336 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.315+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94857836194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa17710 con 0x5645cfa09e20 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.315+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94857836189344] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.315+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa17fc0 con 0x5645cfa09e20 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.316+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(56 notify.6 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.316+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94857836198672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa18440 con 0x5645cfa09e20 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.316+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa18f60 con 0x5645cfa09e20 2024-04-24T01:26:08.337 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94857836194240] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94857836198672] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94857836199728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa17260 con 0x5645cfa09e20 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=0 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=1 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=2 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=3 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=4 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=5 2024-04-24T01:26:08.342 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.317+0000 7f3669519800 20 add_watcher() i=6 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.318+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94857836199728] v34'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.318+0000 7f3669519800 20 add_watcher() i=7 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.318+0000 7f3669519800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.318+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa1bf50 con 0x5645cfa05430 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.319+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.319+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94857836202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa193d0 con 0x5645cfa05430 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94857836202544] v34'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f351dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3669519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3669519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3669519800 5 note: GC not initialized 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f351cfe1640 20 reqs_thread_entry: start 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3669519800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.343 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.320+0000 7f3669519800 20 Filter name: none 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.321+0000 7f34967fc640 20 reqs_thread_entry: start 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.321+0000 7f3669519800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.321+0000 7f3669519800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.321+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa4f1a0 con 0x5645cfa09e20 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3669519800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3669519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3669519800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3669519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.322+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa557c0 con 0x5645cfa09e20 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.344 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3669519800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3669519800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3669519800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94857836450352 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa50e70 con 0x5645cfa05430 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94857836189344 notify 146028888090 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f3660018dd0 con 0x5645cfa05430 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f354affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 94857836189344 notifier 4871 bl.length()=666 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94857836450352 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f354affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f354affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.323+0000 7f354affd640 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f352c003ea0 con 0x5645cfa05430 2024-04-24T01:26:08.345 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.324+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.346 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.324+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94857836450352 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3660044500 con 0x5645cfa05430 2024-04-24T01:26:08.346 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.352 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.324+0000 7f351dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.324+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94857836202544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa52bc0 con 0x5645cfa05430 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.325+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94857836202544] v34'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.325+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94857836178240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa18a30 con 0x7f365000f070 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.326+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94857836178240] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.326+0000 7f3669519800 20 remove_watcher() i=0 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.326+0000 7f3669519800 2 removed watcher, disabling cache 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.327+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94857836176240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12b40 con 0x5645cfa05430 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.328+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94857836176240] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.328+0000 7f3669519800 20 remove_watcher() i=1 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.328+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94857836184592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12b40 con 0x5645cfa0e7b0 2024-04-24T01:26:08.353 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.329+0000 7f365e817640 1 -- 172.21.15.169:0/2419384146 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94857836184592] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3650037040 con 0x5645cfa0e7b0 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.329+0000 7f3669519800 20 remove_watcher() i=2 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.329+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94857836186800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12370 con 0x7f365000f070 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.330+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94857836186800] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x7f365000f070 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.330+0000 7f3669519800 20 remove_watcher() i=3 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.330+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94857836189344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12370 con 0x5645cfa05430 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.331+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94857836189344] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3660032040 con 0x5645cfa05430 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.331+0000 7f3669519800 20 remove_watcher() i=4 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.331+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94857836194240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa156a0 con 0x5645cfa09e20 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.332+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94857836194240] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.332+0000 7f3669519800 20 remove_watcher() i=5 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.332+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94857836198672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12370 con 0x5645cfa09e20 2024-04-24T01:26:08.354 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.333+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94857836198672] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.333+0000 7f3669519800 20 remove_watcher() i=6 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.333+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94857836199728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5645cfa12370 con 0x5645cfa09e20 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3667018640 1 -- 172.21.15.169:0/2419384146 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94857836199728] v34'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36580ac050 con 0x5645cfa09e20 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 20 remove_watcher() i=7 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cfa09e20 msgr2=0x5645cfa0c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cfa09e20 0x5645cfa0c210 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cfa05430 msgr2=0x5645cfa078f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cfa05430 0x5645cfa078f0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f365000f070 msgr2=0x7f365002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f365000f070 0x7f365002e910 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5645cfa0e7b0 msgr2=0x5645cfa10c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.334+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5645cfa0e7b0 0x5645cfa10c70 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3530036900 msgr2=0x7f3530038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3530036900 0x7f3530038dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x5645cf9d7760 tx=0x7f3650010000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 msgr2=0x5645cf9f9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3667819640 1 -- 172.21.15.169:0/2419384146 reap_dead start 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f365804efd0 tx=0x7f3658006a40 comp rx=0 tx=0).stop 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 shutdown_connections 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/2419384146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9f2930 0x5645cf9f9d40 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 >> 172.21.15.169:0/2419384146 conn(0x5645cf9eec40 msgr2=0x5645cf9ec2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 shutdown_connections 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/2419384146 wait complete. 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 msgr2=0x7f3540038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 0x7f3540038dc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x5645cf9cb550 tx=0x7f365000f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.356 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 msgr2=0x5645cf9e5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3658000c00 tx=0x7f3658006650 comp rx=0 tx=0).stop 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 shutdown_connections 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3540036900 0x7f3540038dc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/4180567494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf9e57c0 0x5645cf9e5be0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 >> 172.21.15.169:0/4180567494 conn(0x5645cf9d9860 msgr2=0x5645cf9d9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 shutdown_connections 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/4180567494 wait complete. 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cf9d0870 msgr2=0x5645cf9d2c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5645cf9d0870 0x5645cf9d2c60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cf8cb120 msgr2=0x5645cf9cdef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.357 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5645cf8cb120 0x5645cf9cdef0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5645cf9d47b0 msgr2=0x5645cf9d6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5645cf9d47b0 0x5645cf9d6c00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f354c036900 msgr2=0x7f354c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.335+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f354c036900 0x7f354c038dc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3650000f60 tx=0x7f3650001370 comp rx=0 tx=0).stop 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 msgr2=0x5645cf9c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 --2- 172.21.15.169:0/702131048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5645cf8ca7c0 0x5645cf9c6e70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f365801cfe0 tx=0x7f3658003020 comp rx=0 tx=0).stop 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3667819640 1 -- 172.21.15.169:0/702131048 reap_dead start 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 shutdown_connections 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 >> 172.21.15.169:0/702131048 conn(0x5645cf8c6340 msgr2=0x5645cf9b9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 shutdown_connections 2024-04-24T01:26:08.358 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.336+0000 7f3669519800 1 -- 172.21.15.169:0/702131048 wait complete. 2024-04-24T01:26:08.359 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.359 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.359 ERROR:root:0 2024-04-24T01:26:08.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:08.364 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:08.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T01:26:08.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-04-24T01:26:08.364 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-04-24T01:26:08.409 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.409 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.409+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc82144800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55594469c410 0x55594469e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc82144800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555944556d40 con 0x555944699480 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc82144800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5559445294d0 con 0x55594469c410 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc77442640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55594469c410 0x55594469e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc7fc43640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x555944699480 0x5559446998a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50780/0 (socket says 172.21.15.169:50780) 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc7fc43640 1 -- 172.21.15.169:0/73684644 learned_addr learned my addr 172.21.15.169:0/73684644 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:08.411 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc77442640 1 -- 172.21.15.169:0/73684644 >> v1:172.21.15.142:6789/0 conn(0x555944699480 legacy=0x5559446998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.410+0000 7efc77442640 1 -- 172.21.15.169:0/73684644 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555944555590 con 0x55594469c410 2024-04-24T01:26:08.412 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.412+0000 7efc77442640 1 --2- 172.21.15.169:0/73684644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594469c410 0x55594469e800 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc6800a470 tx=0x7efc6801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16873d5e377f7194 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.412+0000 7efc7f442640 1 -- 172.21.15.169:0/73684644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc68057070 con 0x55594469c410 2024-04-24T01:26:08.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.412+0000 7efc7f442640 1 -- 172.21.15.169:0/73684644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68052570 con 0x55594469c410 2024-04-24T01:26:08.413 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.412+0000 7efc7f442640 1 -- 172.21.15.169:0/73684644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc68052870 con 0x55594469c410 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 -- 172.21.15.169:0/73684644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594469c410 msgr2=0x55594469e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 --2- 172.21.15.169:0/73684644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594469c410 0x55594469e800 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efc6800a470 tx=0x7efc6801ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 -- 172.21.15.169:0/73684644 shutdown_connections 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 --2- 172.21.15.169:0/73684644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55594469c410 0x55594469e800 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 -- 172.21.15.169:0/73684644 >> 172.21.15.169:0/73684644 conn(0x555944691b20 msgr2=0x555944693f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 -- 172.21.15.169:0/73684644 shutdown_connections 2024-04-24T01:26:08.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.413+0000 7efc82144800 1 -- 172.21.15.169:0/73684644 wait complete. 2024-04-24T01:26:08.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc82144800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc82144800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5559445e33b0 con 0x555944699480 2024-04-24T01:26:08.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44194/0 (socket says 172.21.15.169:44194) 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.425+0000 7efc7fc43640 1 -- 172.21.15.169:0/3466882794 learned_addr learned my addr 172.21.15.169:0/3466882794 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.426+0000 7efc7fc43640 1 -- 172.21.15.169:0/3466882794 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559446970e0 con 0x555944699480 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.426+0000 7efc7fc43640 1 --2- 172.21.15.169:0/3466882794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efc70001e10 tx=0x7efc7000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15245ff5b9dc407 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.426+0000 7efb6de0b640 1 -- 172.21.15.169:0/3466882794 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70012020 con 0x555944699480 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.426+0000 7efb6de0b640 1 -- 172.21.15.169:0/3466882794 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7000e5a0 con 0x555944699480 2024-04-24T01:26:08.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.426+0000 7efb6de0b640 1 -- 172.21.15.169:0/3466882794 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7000e8e0 con 0x555944699480 2024-04-24T01:26:08.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- 172.21.15.169:0/3466882794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 msgr2=0x555944698b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 --2- 172.21.15.169:0/3466882794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7efc70001e10 tx=0x7efc7000b780 comp rx=0 tx=0).stop 2024-04-24T01:26:08.437 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- 172.21.15.169:0/3466882794 shutdown_connections 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 --2- 172.21.15.169:0/3466882794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944698b20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- 172.21.15.169:0/3466882794 >> 172.21.15.169:0/3466882794 conn(0x555944691b20 msgr2=0x555944784a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- 172.21.15.169:0/3466882794 shutdown_connections 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- 172.21.15.169:0/3466882794 wait complete. 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944792eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc82144800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55594469f040 con 0x555944699480 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944792eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.438 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944792eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44208/0 (socket says 172.21.15.169:44208) 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.427+0000 7efc7fc43640 1 -- 172.21.15.169:0/1085602690 learned_addr learned my addr 172.21.15.169:0/1085602690 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efc7fc43640 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559447933f0 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efc7fc43640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944792eb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efc70001e10 tx=0x7efc70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efb67fff640 1 -- 172.21.15.169:0/1085602690 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70012030 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efb67fff640 1 -- 172.21.15.169:0/1085602690 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7001a7a0 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555944793680 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efb67fff640 1 -- 172.21.15.169:0/1085602690 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7001aac0 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.428+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555944796330 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efb67fff640 1 -- 172.21.15.169:0/1085602690 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc70015020 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efb67fff640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb68036900 0x7efb68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efb67fff640 1 -- 172.21.15.169:0/1085602690 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efc70020030 con 0x555944699480 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc77442640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb68036900 0x7efb68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.439 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594469c410 0x55594479a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594479a630 con 0x55594469c410 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc80444640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594469c410 0x55594479a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc77442640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb68036900 0x7efb68038dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efc68054000 tx=0x7efc6804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.429+0000 7efc80444640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594469c410 0x55594479a0f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc80444640 1 -- 172.21.15.169:0/1085602690 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800a4a0 con 0x55594469c410 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447976c0 con 0x55594469c410 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc80444640 1 -- 172.21.15.169:0/1085602690 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7800a4a0 con 0x55594469c410 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594479c9b0 0x55594479eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594479f440 con 0x55594479c9b0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.430+0000 7efc7fc43640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594479c9b0 0x55594479eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc7fc43640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594479c9b0 0x55594479eda0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc7fc43640 1 -- 172.21.15.169:0/1085602690 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc7000dcd0 con 0x55594479c9b0 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594479b960 con 0x55594469c410 2024-04-24T01:26:08.440 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc80444640 1 -- 172.21.15.169:0/1085602690 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7800a4a0 con 0x55594469c410 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5559447a08f0 0x5559447a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447a34a0 con 0x5559447a08f0 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.431+0000 7efc77442640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5559447a08f0 0x5559447a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc77442640 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5559447a08f0 0x5559447a2d40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc77442640 1 -- 172.21.15.169:0/1085602690 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc68052940 con 0x5559447a08f0 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc82144800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc82144800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5559445896b0 con 0x5559447b1830 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.441 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44210/0 (socket says 172.21.15.169:44210) 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.432+0000 7efc7fc43640 1 -- 172.21.15.169:0/2236789402 learned_addr learned my addr 172.21.15.169:0/2236789402 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efc7fc43640 1 -- 172.21.15.169:0/2236789402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559447b2190 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efc7fc43640 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efc7000dfd0 tx=0x7efc70016470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efb657fa640 1 -- 172.21.15.169:0/2236789402 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70031070 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efb657fa640 1 -- 172.21.15.169:0/2236789402 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70044bb0 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559447b2c00 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efb657fa640 1 -- 172.21.15.169:0/2236789402 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70044320 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.433+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559447b3100 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efb657fa640 1 -- 172.21.15.169:0/2236789402 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc7004cb20 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efb657fa640 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 0x7efb58038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efb657fa640 1 -- 172.21.15.169:0/2236789402 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efc70036d20 con 0x5559447b1830 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc77442640 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 0x7efb58038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.442 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc77442640 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 0x7efb58038dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5559447975e0 tx=0x7efc68005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc82144800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.434+0000 7efc82144800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x555944697460 con 0x5559447be930 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44212/0 (socket says 172.21.15.169:44212) 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efc7fc43640 1 -- 172.21.15.169:0/578607381 learned_addr learned my addr 172.21.15.169:0/578607381 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efc7fc43640 1 -- 172.21.15.169:0/578607381 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559447bf320 con 0x5559447be930 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efc7fc43640 1 --2- 172.21.15.169:0/578607381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efc7002de10 tx=0x7efc700344a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fbe591634a25af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efb5effd640 1 -- 172.21.15.169:0/578607381 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7005c070 con 0x5559447be930 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efb5effd640 1 -- 172.21.15.169:0/578607381 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70003ea0 con 0x5559447be930 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.435+0000 7efb5effd640 1 -- 172.21.15.169:0/578607381 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70053040 con 0x5559447be930 2024-04-24T01:26:08.443 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- 172.21.15.169:0/578607381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 msgr2=0x5559447bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 --2- 172.21.15.169:0/578607381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7efc7002de10 tx=0x7efc700344a0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- 172.21.15.169:0/578607381 shutdown_connections 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 --2- 172.21.15.169:0/578607381 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447bed50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- 172.21.15.169:0/578607381 >> 172.21.15.169:0/578607381 conn(0x5559447bac50 msgr2=0x5559447b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- 172.21.15.169:0/578607381 shutdown_connections 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- 172.21.15.169:0/578607381 wait complete. 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 Processor -- start 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- start start 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc82144800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5559447bfa40 con 0x5559447be930 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc7fc43640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447c5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44218/0 (socket says 172.21.15.169:44218) 2024-04-24T01:26:08.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 learned_addr learned my addr 172.21.15.169:0/2171744665 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.436+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559447c6260 con 0x5559447be930 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efc7fc43640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447c5d20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7efc7005a040 tx=0x7efc70031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efb5d7fa640 1 -- 172.21.15.169:0/2171744665 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70065020 con 0x5559447be930 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efb5d7fa640 1 -- 172.21.15.169:0/2171744665 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc700444c0 con 0x5559447be930 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efb5d7fa640 1 -- 172.21.15.169:0/2171744665 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7005c040 con 0x5559447be930 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559447c6260 con 0x5559447be930 2024-04-24T01:26:08.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.437+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559447c6260 con 0x5559447be930 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efb5d7fa640 1 -- 172.21.15.169:0/2171744665 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc70068020 con 0x5559447be930 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efb5d7fa640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb48036900 0x7efb48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efb5d7fa640 1 -- 172.21.15.169:0/2171744665 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7efc7006bd20 con 0x5559447be930 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efc77442640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb48036900 0x7efb48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5559447d1480 0x5559447d3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d4090 con 0x5559447d1480 2024-04-24T01:26:08.463 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.438+0000 7efc80444640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5559447d1480 0x5559447d3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc77442640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb48036900 0x7efb48038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efc68052fd0 tx=0x7efc6804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc80444640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5559447d1480 0x5559447d3940 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 realm 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d44a0 con 0x5559447d1480 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d4d70 con 0x5559447d1480 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.439+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc82144800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5559447d5e70 0x5559447d8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d8870 con 0x5559447d5e70 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc7fc43640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5559447d5e70 0x5559447d8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.440+0000 7efc7fc43640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5559447d5e70 0x5559447d8260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc82144800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc82144800 20 searching for the correct realm 2024-04-24T01:26:08.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5559447da820 0x5559447dcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447dd3b0 con 0x5559447da820 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc77442640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5559447da820 0x5559447dcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.441+0000 7efc77442640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5559447da820 0x5559447dcce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc77442640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7efc68076040 0x7efc68083410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447dd3b0 con 0x7efc68076040 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc80444640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7efc68076040 0x7efc68083410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc80444640 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7efc68076040 0x7efc68083410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x7efc68076040 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d5e70 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.442+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d5e70 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.443+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x7efc68076040 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x7efc68076040 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447da820 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.444+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d5e70 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447d1480 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7800a4a0 con 0x5559447d1480 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x7efc68076040 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559447d5110 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.445+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d5e70 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.468 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.446+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.447+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.447+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.447+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.447+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d5e70 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x7efc68076040 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.448+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x7efc68076040 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447da820 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.449+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x5559447d1480 2024-04-24T01:26:08.470 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7efc68090040 con 0x7efc68076040 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.471 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.450+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d9130 con 0x5559447d1480 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d9130 con 0x5559447d1480 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d9130 con 0x7efc68076040 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.472 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 zone default found 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 4 Realm: () 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 zonegroup default 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447d99d0 con 0x5559447d5e70 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.451+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447df210 con 0x5559447da820 2024-04-24T01:26:08.473 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447df5b0 con 0x5559447da820 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 20 started sync module instance, tier type = 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.452+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447de6b0 con 0x7efc68076040 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.453+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.453+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93841889553104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447de6b0 con 0x7efc68076040 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.453+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447dfe00 con 0x5559447d1480 2024-04-24T01:26:08.474 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.454+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93841889553104] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.454+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.454+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93841889551360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447dfe00 con 0x5559447d1480 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.454+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e0820 con 0x5559447da820 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.455+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93841889551360] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.456+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.456+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93841889556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447dfd70 con 0x5559447da820 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.456+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e16e0 con 0x7efc68076040 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.457+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.457+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93841889563664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e1ea0 con 0x7efc68076040 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.457+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e29c0 con 0x5559447d1480 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.457+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93841889556816] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.458+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93841889563664] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.458+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.475 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.458+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93841889567888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e2980 con 0x5559447d1480 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.458+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e3260 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.459+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93841889567888] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.459+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.459+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93841889570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e2980 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.459+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e3c20 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.460+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93841889570224] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.460+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.476 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.460+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93841889561616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4470 con 0x5559447d5e70 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.460+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4e30 con 0x5559447d5e70 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93841889561616] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93841889575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4e30 con 0x5559447d5e70 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=0 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=1 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=2 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=3 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=4 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=5 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.461+0000 7efc82144800 20 add_watcher() i=6 2024-04-24T01:26:08.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93841889575328] v34'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc82144800 20 add_watcher() i=7 2024-04-24T01:26:08.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc82144800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559447e8180 con 0x5559447d1480 2024-04-24T01:26:08.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.478 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.462+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93841889577712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e53c0 con 0x5559447d1480 2024-04-24T01:26:08.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93841889577712] v34'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efb35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 5 note: GC not initialized 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efb34fe1640 20 reqs_thread_entry: start 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 20 Filter name: none 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efaae7fc640 20 reqs_thread_entry: start 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.464+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594481b480 con 0x5559447d5e70 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc82144800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc82144800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc82144800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc82144800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.465+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x555944821dc0 con 0x5559447d5e70 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc82144800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc82144800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc82144800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93841889826864 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55594481d470 con 0x5559447d1480 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 93841889567888 notify 146028888091 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7efc78018df0 con 0x5559447d1480 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efb5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 93841889567888 notifier 4878 bl.length()=666 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efb5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efb5effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 93841889826864 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efb5effd640 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7efb44003ea0 con 0x5559447d1480 2024-04-24T01:26:08.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.467+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.468+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 93841889826864 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efc78044500 con 0x5559447d1480 2024-04-24T01:26:08.483 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.468+0000 7efb35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.468+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93841889577712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e7310 con 0x5559447d1480 2024-04-24T01:26:08.489 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.469+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93841889577712] v34'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.469+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93841889553104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4af0 con 0x7efc68076040 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.470+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93841889553104] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.470+0000 7efc82144800 20 remove_watcher() i=0 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.470+0000 7efc82144800 2 removed watcher, disabling cache 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.470+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93841889551360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4af0 con 0x5559447d1480 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.471+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93841889551360] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.471+0000 7efc82144800 20 remove_watcher() i=1 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.471+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93841889556816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e4af0 con 0x5559447da820 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.472+0000 7efc77442640 1 -- 172.21.15.169:0/2171744665 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93841889556816] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc68081070 con 0x5559447da820 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.472+0000 7efc82144800 20 remove_watcher() i=2 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.473+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93841889563664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447df950 con 0x7efc68076040 2024-04-24T01:26:08.490 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.473+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93841889563664] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x7efc68076040 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.473+0000 7efc82144800 20 remove_watcher() i=3 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.473+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93841889567888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447df950 con 0x5559447d1480 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.474+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93841889567888] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc78032040 con 0x5559447d1480 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.474+0000 7efc82144800 20 remove_watcher() i=4 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.475+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93841889570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e2490 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.476+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93841889570224] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.476+0000 7efc82144800 20 remove_watcher() i=5 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.476+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93841889561616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447df950 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.477+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93841889561616] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.477+0000 7efc82144800 20 remove_watcher() i=6 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.477+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93841889575328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559447e2490 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc7fc43640 1 -- 172.21.15.169:0/2171744665 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93841889575328] v34'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7005f040 con 0x5559447d5e70 2024-04-24T01:26:08.491 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 20 remove_watcher() i=7 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5559447d5e70 msgr2=0x5559447d8260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5559447d5e70 0x5559447d8260 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5559447d1480 msgr2=0x5559447d3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5559447d1480 0x5559447d3940 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7efc68076040 msgr2=0x7efc68083410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7efc68076040 0x7efc68083410 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5559447da820 msgr2=0x5559447dcce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5559447da820 0x5559447dcce0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb48036900 msgr2=0x7efb48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb48036900 0x7efb48038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efc68052fd0 tx=0x7efc6804f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 msgr2=0x5559447c5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2171744665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447be930 0x5559447c5d20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7efc7005a040 tx=0x7efc70031f30 comp rx=0 tx=0).stop 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc80444640 1 -- 172.21.15.169:0/2171744665 reap_dead start 2024-04-24T01:26:08.492 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 shutdown_connections 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 >> 172.21.15.169:0/2171744665 conn(0x5559447bac50 msgr2=0x5559447b82b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 shutdown_connections 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2171744665 wait complete. 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 msgr2=0x7efb58038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 0x7efb58038dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5559447975e0 tx=0x7efc68005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 msgr2=0x5559447b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7efc7000dfd0 tx=0x7efc70016470 comp rx=0 tx=0).stop 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 shutdown_connections 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb58036900 0x7efb58038dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 --2- 172.21.15.169:0/2236789402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5559447b1830 0x5559447b1c50 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 >> 172.21.15.169:0/2236789402 conn(0x5559447a58d0 msgr2=0x5559447a5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 shutdown_connections 2024-04-24T01:26:08.493 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.478+0000 7efc82144800 1 -- 172.21.15.169:0/2236789402 wait complete. 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594479c9b0 msgr2=0x55594479eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55594479c9b0 0x55594479eda0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594469c410 msgr2=0x55594479a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55594469c410 0x55594479a0f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5559447a08f0 msgr2=0x5559447a2d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5559447a08f0 0x5559447a2d40 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb68036900 msgr2=0x7efb68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7efb68036900 0x7efb68038dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efc68054000 tx=0x7efc6804e000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 msgr2=0x555944792eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 --2- 172.21.15.169:0/1085602690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555944699480 0x555944792eb0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7efc70001e10 tx=0x7efc70000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc80444640 1 -- 172.21.15.169:0/1085602690 reap_dead start 2024-04-24T01:26:08.494 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 shutdown_connections 2024-04-24T01:26:08.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 >> 172.21.15.169:0/1085602690 conn(0x555944691b20 msgr2=0x5559446979c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 shutdown_connections 2024-04-24T01:26:08.495 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.479+0000 7efc82144800 1 -- 172.21.15.169:0/1085602690 wait complete. 2024-04-24T01:26:08.495 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.495 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.495 ERROR:root:0 2024-04-24T01:26:08.495 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:08.499 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:08.500 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:08.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:08.500 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:26:08.545 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.545 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3632927800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c6354971d0 0x55c6354995c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3632927800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c635352d40 con 0x55c635492d40 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3632927800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c6353254d0 con 0x55c6354971d0 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3627fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c6354971d0 0x55c6354995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f362e5a7640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c635492d40 0x55c635493160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50790/0 (socket says 172.21.15.169:50790) 2024-04-24T01:26:08.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f362e5a7640 1 -- 172.21.15.169:0/2310135956 learned_addr learned my addr 172.21.15.169:0/2310135956 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3627fff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c6354971d0 0x55c6354995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44222/0 (socket says 172.21.15.169:44222) 2024-04-24T01:26:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.546+0000 7f3627fff640 1 -- 172.21.15.169:0/2310135956 >> v1:172.21.15.142:6789/0 conn(0x55c635492d40 legacy=0x55c635493160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.547+0000 7f362dda6640 1 -- 172.21.15.169:0/2310135956 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079366811 0 0) 0x55c635352d40 con 0x55c635492d40 2024-04-24T01:26:08.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.547+0000 7f3627fff640 1 -- 172.21.15.169:0/2310135956 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c635351590 con 0x55c6354971d0 2024-04-24T01:26:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.548+0000 7f3627fff640 1 --2- 172.21.15.169:0/2310135956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6354971d0 0x55c6354995c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f361800a470 tx=0x7f361801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b2417fe10b7affa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f362dda6640 1 -- 172.21.15.169:0/2310135956 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3618057070 con 0x55c6354971d0 2024-04-24T01:26:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f362dda6640 1 -- 172.21.15.169:0/2310135956 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3618052570 con 0x55c6354971d0 2024-04-24T01:26:08.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f362dda6640 1 -- 172.21.15.169:0/2310135956 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3618052870 con 0x55c6354971d0 2024-04-24T01:26:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 -- 172.21.15.169:0/2310135956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6354971d0 msgr2=0x55c6354995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 --2- 172.21.15.169:0/2310135956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6354971d0 0x55c6354995c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f361800a470 tx=0x7f361801ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 -- 172.21.15.169:0/2310135956 shutdown_connections 2024-04-24T01:26:08.550 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 --2- 172.21.15.169:0/2310135956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6354971d0 0x55c6354995c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 -- 172.21.15.169:0/2310135956 >> 172.21.15.169:0/2310135956 conn(0x55c63548e3a0 msgr2=0x55c6354907c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 -- 172.21.15.169:0/2310135956 shutdown_connections 2024-04-24T01:26:08.551 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.549+0000 7f3632927800 1 -- 172.21.15.169:0/2310135956 wait complete. 2024-04-24T01:26:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f3632927800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f3632927800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c6353df3b0 con 0x55c635492d40 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44228/0 (socket says 172.21.15.169:44228) 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f362e5a7640 1 -- 172.21.15.169:0/2273055280 learned_addr learned my addr 172.21.15.169:0/2273055280 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.561+0000 7f362e5a7640 1 -- 172.21.15.169:0/2273055280 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63549ad00 con 0x55c635492d40 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f362e5a7640 1 --2- 172.21.15.169:0/2273055280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f362000b240 tx=0x7f362000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70c5d43dd4fdcac server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f351c608640 1 -- 172.21.15.169:0/2273055280 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620008070 con 0x55c635492d40 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f351c608640 1 -- 172.21.15.169:0/2273055280 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362000d500 con 0x55c635492d40 2024-04-24T01:26:08.563 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f351c608640 1 -- 172.21.15.169:0/2273055280 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362000d860 con 0x55c635492d40 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f3632927800 1 -- 172.21.15.169:0/2273055280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 msgr2=0x55c63549c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.562+0000 7f3632927800 1 --2- 172.21.15.169:0/2273055280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f362000b240 tx=0x7f362000b700 comp rx=0 tx=0).stop 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- 172.21.15.169:0/2273055280 shutdown_connections 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 --2- 172.21.15.169:0/2273055280 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63549c740 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- 172.21.15.169:0/2273055280 >> 172.21.15.169:0/2273055280 conn(0x55c63548e3a0 msgr2=0x55c6355807e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- 172.21.15.169:0/2273055280 shutdown_connections 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- 172.21.15.169:0/2273055280 wait complete. 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63558ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f3632927800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c635499e90 con 0x55c635492d40 2024-04-24T01:26:08.570 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63558ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63558ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44230/0 (socket says 172.21.15.169:44230) 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f362e5a7640 1 -- 172.21.15.169:0/2029823694 learned_addr learned my addr 172.21.15.169:0/2029823694 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.563+0000 7f362e5a7640 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c63558f280 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f362e5a7640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63558ed40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3620000f60 tx=0x7f3620000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f351ae05640 1 -- 172.21.15.169:0/2029823694 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620019870 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f351ae05640 1 -- 172.21.15.169:0/2029823694 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3620019a10 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f351ae05640 1 -- 172.21.15.169:0/2029823694 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620019d10 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c63558f510 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.564+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6355921c0 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f351ae05640 1 -- 172.21.15.169:0/2029823694 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3620017040 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f351ae05640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3514036950 0x7f3514038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f351ae05640 1 -- 172.21.15.169:0/2029823694 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3620015020 con 0x55c635492d40 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f3627fff640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3514036950 0x7f3514038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.571 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6354971d0 0x55c635595f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355964c0 con 0x55c6354971d0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f362eda8640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6354971d0 0x55c635595f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f3627fff640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3514036950 0x7f3514038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3618054000 tx=0x7f361804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.565+0000 7f362eda8640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6354971d0 0x55c635595f80 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f362eda8640 1 -- 172.21.15.169:0/2029823694 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6354971d0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c635593550 con 0x55c6354971d0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f362eda8640 1 -- 172.21.15.169:0/2029823694 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6354971d0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355987b0 0x55c63559aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c63559b290 con 0x55c6355987b0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.566+0000 7f362e5a7640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355987b0 0x55c63559aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.572 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f362e5a7640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355987b0 0x55c63559aba0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f362e5a7640 1 -- 172.21.15.169:0/2029823694 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f362002d070 con 0x55c6355987b0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c635597760 con 0x55c6354971d0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f362eda8640 1 -- 172.21.15.169:0/2029823694 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6354971d0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c63559c740 0x55c63559eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c63559f2f0 con 0x55c63559c740 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.567+0000 7f3627fff640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c63559c740 0x55c63559eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3627fff640 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c63559c740 0x55c63559eb90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3627fff640 1 -- 172.21.15.169:0/2029823694 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36180528e0 con 0x55c63559c740 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3632927800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f3632927800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c6353856b0 con 0x55c6355ad6c0 2024-04-24T01:26:08.573 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44234/0 (socket says 172.21.15.169:44234) 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.568+0000 7f362e5a7640 1 -- 172.21.15.169:0/1558016629 learned_addr learned my addr 172.21.15.169:0/1558016629 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f362e5a7640 1 -- 172.21.15.169:0/1558016629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6355ae020 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f362e5a7640 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f362004b450 tx=0x7f362001aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f3513fff640 1 -- 172.21.15.169:0/1558016629 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362000f470 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f3513fff640 1 -- 172.21.15.169:0/1558016629 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362000f610 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6355aea90 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f3513fff640 1 -- 172.21.15.169:0/1558016629 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362000f8f0 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.569+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6355aef90 con 0x55c6355ad6c0 2024-04-24T01:26:08.574 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3513fff640 1 -- 172.21.15.169:0/1558016629 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f362003f200 con 0x55c6355ad6c0 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3513fff640 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 0x7f3508038d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3513fff640 1 -- 172.21.15.169:0/1558016629 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f362003b020 con 0x55c6355ad6c0 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3627fff640 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 0x7f3508038d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.602 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3627fff640 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 0x7f3508038d20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c635596d60 tx=0x7f3618005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3632927800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.570+0000 7f3632927800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c63549b080 con 0x55c6355baa70 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44248/0 (socket says 172.21.15.169:44248) 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f362e5a7640 1 -- 172.21.15.169:0/778011938 learned_addr learned my addr 172.21.15.169:0/778011938 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f362e5a7640 1 -- 172.21.15.169:0/778011938 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6355bb460 con 0x55c6355baa70 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f362e5a7640 1 --2- 172.21.15.169:0/778011938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f362000fb00 tx=0x7f362004bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102f0ac7c01dc811 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3511ffb640 1 -- 172.21.15.169:0/778011938 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620030450 con 0x55c6355baa70 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3511ffb640 1 -- 172.21.15.169:0/778011938 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362003f6d0 con 0x55c6355baa70 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3511ffb640 1 -- 172.21.15.169:0/778011938 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620044860 con 0x55c6355baa70 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3632927800 1 -- 172.21.15.169:0/778011938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 msgr2=0x55c6355bae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3632927800 1 --2- 172.21.15.169:0/778011938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f362000fb00 tx=0x7f362004bf90 comp rx=0 tx=0).stop 2024-04-24T01:26:08.603 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.571+0000 7f3632927800 1 -- 172.21.15.169:0/778011938 shutdown_connections 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 --2- 172.21.15.169:0/778011938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355bae90 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 -- 172.21.15.169:0/778011938 >> 172.21.15.169:0/778011938 conn(0x55c6355b6d40 msgr2=0x55c6355b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 -- 172.21.15.169:0/778011938 shutdown_connections 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 -- 172.21.15.169:0/778011938 wait complete. 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 Processor -- start 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 -- start start 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f3632927800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c6355bbb30 con 0x55c6355baa70 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f362e5a7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355c1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44262/0 (socket says 172.21.15.169:44262) 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 learned_addr learned my addr 172.21.15.169:0/468391307 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.572+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6355c23a0 con 0x55c6355baa70 2024-04-24T01:26:08.604 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f362e5a7640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355c1e60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f362004d190 tx=0x7f3620010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f34fffff640 1 -- 172.21.15.169:0/468391307 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f362006e070 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f34fffff640 1 -- 172.21.15.169:0/468391307 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f362004b530 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6355c23a0 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f34fffff640 1 -- 172.21.15.169:0/468391307 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3620040e20 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.573+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6355c23a0 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f34fffff640 1 -- 172.21.15.169:0/468391307 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3620071070 con 0x55c6355baa70 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f34fffff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34f8036900 0x7f34f8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.605 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f34fffff640 1 -- 172.21.15.169:0/468391307 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3620066070 con 0x55c6355baa70 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f3627fff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34f8036900 0x7f34f8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6355cd430 0x55c6355cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f3627fff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34f8036900 0x7f34f8038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3618052fd0 tx=0x7f361804f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d0040 con 0x55c6355cd430 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.574+0000 7f362eda8640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6355cd430 0x55c6355cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f362eda8640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6355cd430 0x55c6355cf8f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.606 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 realm 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d0450 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d0d20 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.575+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.607 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f3632927800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355d1e20 0x55c6355d4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d4820 con 0x55c6355d1e20 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f362e5a7640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355d1e20 0x55c6355d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.576+0000 7f362e5a7640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355d1e20 0x55c6355d4210 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3632927800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3632927800 20 searching for the correct realm 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c6355d67d0 0x55c6355d8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d9360 con 0x55c6355d67d0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3627fff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c6355d67d0 0x55c6355d8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3627fff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c6355d67d0 0x55c6355d8c90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.608 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3627fff640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3618076040 0x7f361805e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.577+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d9360 con 0x7f3618076040 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362eda8640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3618076040 0x7f361805e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362eda8640 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3618076040 0x7f361805e480 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x7f3618076040 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355d1e20 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.578+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.609 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355d1e20 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.579+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x7f3618076040 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x7f3618076040 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355d67d0 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.580+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355d1e20 2024-04-24T01:26:08.610 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355cd430 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f362800a4a0 con 0x55c6355cd430 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x7f3618076040 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d10c0 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.581+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d1e20 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.611 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.582+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355cd430 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355cd430 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d1e20 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.583+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x7f3618076040 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355cd430 2024-04-24T01:26:08.612 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.584+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x7f3618076040 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d67d0 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.585+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.613 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x55c6355cd430 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f3618090040 con 0x7f3618076040 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d50e0 con 0x55c6355cd430 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.614 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.586+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d50e0 con 0x55c6355cd430 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d50e0 con 0x7f3618076040 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 zone default found 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 4 Realm: () 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.615 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 zonegroup default 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355d59d0 con 0x55c6355d1e20 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355db1c0 con 0x55c6355d67d0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.587+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355db560 con 0x55c6355d67d0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 20 started sync module instance, tier type = 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.616 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.588+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da660 con 0x7f3618076040 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.589+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.589+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94309787216768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da660 con 0x7f3618076040 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.589+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dbf20 con 0x55c6355cd430 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.590+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94309787216768] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.590+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.590+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94309787221072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da660 con 0x55c6355cd430 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.590+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dc9c0 con 0x55c6355d67d0 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.591+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94309787221072] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.591+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.591+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94309787214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da5d0 con 0x55c6355d67d0 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.591+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dd880 con 0x7f3618076040 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.592+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94309787214256] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.617 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.592+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.593+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94309787227088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355ddca0 con 0x7f3618076040 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.593+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355de660 con 0x55c6355cd430 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.594+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94309787227088] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.594+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.594+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94309787228624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355de660 con 0x55c6355cd430 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.594+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355df020 con 0x55c6355d1e20 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.595+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.595+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94309787233136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355df870 con 0x55c6355d1e20 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.595+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e02d0 con 0x55c6355d1e20 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.595+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94309787228624] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.596+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94309787233136] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.618 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.597+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.597+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94309787230640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e06c0 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.597+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e0f10 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94309787230640] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94309787240048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e1300 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=0 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=1 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=2 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=3 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=4 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=5 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.598+0000 7f3632927800 20 add_watcher() i=6 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94309787240048] v34'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f3632927800 20 add_watcher() i=7 2024-04-24T01:26:08.619 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f3632927800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e4330 con 0x55c6355cd430 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.599+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94309787241568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e17f0 con 0x55c6355cd430 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94309787241568] v34'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f34e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f3632927800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f3632927800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f3632927800 5 note: GC not initialized 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f345f7fe640 20 reqs_thread_entry: start 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.600+0000 7f3632927800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.601+0000 7f3632927800 20 Filter name: none 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.601+0000 7f345d7fa640 20 reqs_thread_entry: start 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.601+0000 7f3632927800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.601+0000 7f3632927800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.620 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.601+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c635617670 con 0x55c6355d1e20 2024-04-24T01:26:08.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f3632927800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:26:08.622 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f3632927800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f3632927800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f3632927800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.604+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c63561e040 con 0x55c6355d1e20 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v34'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3632927800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3632927800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3632927800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94309787474800 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c63561b780 con 0x55c6355cd430 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94309787228624 notify 146028888092 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f3628018a80 con 0x55c6355cd430 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3511ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 94309787228624 notifier 4885 bl.length()=679 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3511ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3511ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94309787474800 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.623 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f3511ffb640 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f34f4003ea0 con 0x55c6355cd430 2024-04-24T01:26:08.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.606+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.607+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94309787474800 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3628018d20 con 0x55c6355cd430 2024-04-24T01:26:08.624 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.607+0000 7f34e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.607+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94309787241568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6356165b0 con 0x55c6355cd430 2024-04-24T01:26:08.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.608+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94309787241568] v34'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.608+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94309787216768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355e0c30 con 0x7f3618076040 2024-04-24T01:26:08.631 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.609+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94309787216768] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.609+0000 7f3632927800 20 remove_watcher() i=0 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.609+0000 7f3632927800 2 removed watcher, disabling cache 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.609+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94309787221072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dab60 con 0x55c6355cd430 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.611+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94309787221072] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.611+0000 7f3632927800 20 remove_watcher() i=1 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.611+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94309787214256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dbc50 con 0x55c6355d67d0 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.612+0000 7f3627fff640 1 -- 172.21.15.169:0/468391307 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94309787214256] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3618081070 con 0x55c6355d67d0 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.612+0000 7f3632927800 20 remove_watcher() i=2 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.612+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94309787227088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da1b0 con 0x7f3618076040 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.613+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94309787227088] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x7f3618076040 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.613+0000 7f3632927800 20 remove_watcher() i=3 2024-04-24T01:26:08.632 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.613+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94309787228624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da1b0 con 0x55c6355cd430 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.614+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94309787228624] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3628032040 con 0x55c6355cd430 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.614+0000 7f3632927800 20 remove_watcher() i=4 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.614+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94309787233136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355dd9d0 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.615+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94309787233136] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.615+0000 7f3632927800 20 remove_watcher() i=5 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.615+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94309787230640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355da1b0 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.616+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94309787230640] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.616+0000 7f3632927800 20 remove_watcher() i=6 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.616+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94309787240048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6355deb70 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f362e5a7640 1 -- 172.21.15.169:0/468391307 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94309787240048] v34'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3620070030 con 0x55c6355d1e20 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 20 remove_watcher() i=7 2024-04-24T01:26:08.633 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355d1e20 msgr2=0x55c6355d4210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355d1e20 0x55c6355d4210 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6355cd430 msgr2=0x55c6355cf8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6355cd430 0x55c6355cf8f0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3618076040 msgr2=0x7f361805e480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3618076040 0x7f361805e480 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c6355d67d0 msgr2=0x55c6355d8c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c6355d67d0 0x55c6355d8c90 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34f8036900 msgr2=0x7f34f8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.634 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f34f8036900 0x7f34f8038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3618052fd0 tx=0x7f361804f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 msgr2=0x55c6355c1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/468391307 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355baa70 0x55c6355c1e60 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f362004d190 tx=0x7f3620010f00 comp rx=0 tx=0).stop 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 reap_dead start 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f362eda8640 1 -- 172.21.15.169:0/468391307 reap_dead start 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 shutdown_connections 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 >> 172.21.15.169:0/468391307 conn(0x55c6355b6d40 msgr2=0x55c6355b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 shutdown_connections 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/468391307 wait complete. 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 msgr2=0x7f3508038d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 0x7f3508038d20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c635596d60 tx=0x7f3618005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 msgr2=0x55c6355adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.617+0000 7f3632927800 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f362004b450 tx=0x7f362001aaf0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.635 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 shutdown_connections 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3508036860 0x7f3508038d20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/1558016629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c6355ad6c0 0x55c6355adae0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 >> 172.21.15.169:0/1558016629 conn(0x55c6355a1760 msgr2=0x55c6355a1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 shutdown_connections 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/1558016629 wait complete. 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355987b0 msgr2=0x55c63559aba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c6355987b0 0x55c63559aba0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6354971d0 msgr2=0x55c635595f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c6354971d0 0x55c635595f80 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c63559c740 msgr2=0x55c63559eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.636 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c63559c740 0x55c63559eb90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3514036950 msgr2=0x7f3514038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3514036950 0x7f3514038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3618054000 tx=0x7f361804e000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 msgr2=0x55c63558ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 --2- 172.21.15.169:0/2029823694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c635492d40 0x55c63558ed40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3620000f60 tx=0x7f3620000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f362eda8640 1 -- 172.21.15.169:0/2029823694 reap_dead start 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 shutdown_connections 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 >> 172.21.15.169:0/2029823694 conn(0x55c63548e3a0 msgr2=0x55c63549b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 shutdown_connections 2024-04-24T01:26:08.637 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.618+0000 7f3632927800 1 -- 172.21.15.169:0/2029823694 wait complete. 2024-04-24T01:26:08.637 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.638 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.638 ERROR:root:0 2024-04-24T01:26:08.638 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:08.643 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:08.643 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T01:26:08.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-04-24T01:26:08.643 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-04-24T01:26:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.688 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.688+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.688+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3aa4b3f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac6e651300 0x55ac6e659e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3aa4b3f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac6e50fd40 con 0x55ac6e64f7c0 2024-04-24T01:26:08.689 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3aa4b3f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55ac6e4e24d0 con 0x55ac6e651300 2024-04-24T01:26:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3a9bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac6e651300 0x55ac6e659e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.690 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3a9bfff640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55ac6e651300 0x55ac6e659e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44268/0 (socket says 172.21.15.169:44268) 2024-04-24T01:26:08.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3aa089b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55ac6e64f7c0 0x55ac6e64fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50792/0 (socket says 172.21.15.169:50792) 2024-04-24T01:26:08.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3a9bfff640 1 -- 172.21.15.169:0/3402405940 learned_addr learned my addr 172.21.15.169:0/3402405940 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3a9bfff640 1 -- 172.21.15.169:0/3402405940 >> v1:172.21.15.142:6789/0 conn(0x55ac6e64f7c0 legacy=0x55ac6e64fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.691 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.689+0000 7f3a9bfff640 1 -- 172.21.15.169:0/3402405940 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e50e590 con 0x55ac6e651300 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.691+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/3402405940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e651300 0x55ac6e659e00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00a520 tx=0x7f3a8c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adadad5e13f731e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.691+0000 7f3a9b7fe640 1 -- 172.21.15.169:0/3402405940 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c057070 con 0x55ac6e651300 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.691+0000 7f3a9b7fe640 1 -- 172.21.15.169:0/3402405940 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c052440 con 0x55ac6e651300 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.691+0000 7f3a9b7fe640 1 -- 172.21.15.169:0/3402405940 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a8c04ae60 con 0x55ac6e651300 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3402405940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e651300 msgr2=0x55ac6e659e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3402405940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e651300 0x55ac6e659e00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00a520 tx=0x7f3a8c01d010 comp rx=0 tx=0).stop 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3402405940 shutdown_connections 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3402405940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e651300 0x55ac6e659e00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3402405940 >> 172.21.15.169:0/3402405940 conn(0x55ac6e64b340 msgr2=0x55ac6e64d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3402405940 shutdown_connections 2024-04-24T01:26:08.693 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.692+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3402405940 wait complete. 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.703+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa4b3f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa4b3f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac6e59c3b0 con 0x55ac6e64f7c0 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44270/0 (socket says 172.21.15.169:44270) 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa089b640 1 -- 172.21.15.169:0/1891680582 learned_addr learned my addr 172.21.15.169:0/1891680582 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa089b640 1 -- 172.21.15.169:0/1891680582 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e744b70 con 0x55ac6e64f7c0 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.704+0000 7f3aa089b640 1 --2- 172.21.15.169:0/1891680582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001e90 tx=0x7f3a9400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c17a53d186448b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f398ee05640 1 -- 172.21.15.169:0/1891680582 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9400e5c0 con 0x55ac6e64f7c0 2024-04-24T01:26:08.705 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f398ee05640 1 -- 172.21.15.169:0/1891680582 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94006070 con 0x55ac6e64f7c0 2024-04-24T01:26:08.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f398ee05640 1 -- 172.21.15.169:0/1891680582 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9400e890 con 0x55ac6e64f7c0 2024-04-24T01:26:08.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1891680582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 msgr2=0x55ac6e7445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/1891680582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001e90 tx=0x7f3a9400b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1891680582 shutdown_connections 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/1891680582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e7445a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1891680582 >> 172.21.15.169:0/1891680582 conn(0x55ac6e64b340 msgr2=0x55ac6e73fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1891680582 shutdown_connections 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.705+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1891680582 wait complete. 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa4b3f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e74c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa4b3f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac6e65c620 con 0x55ac6e64f7c0 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e74c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e74c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44278/0 (socket says 172.21.15.169:44278) 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa089b640 1 -- 172.21.15.169:0/731302855 learned_addr learned my addr 172.21.15.169:0/731302855 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa089b640 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e74c6c0 con 0x55ac6e64f7c0 2024-04-24T01:26:08.713 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.706+0000 7f3aa089b640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e74c180 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001ed0 tx=0x7f3a94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f398d602640 1 -- 172.21.15.169:0/731302855 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9401a880 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f398d602640 1 -- 172.21.15.169:0/731302855 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9401aa20 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6e74c950 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f398d602640 1 -- 172.21.15.169:0/731302855 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9401ad40 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6e74f560 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.707+0000 7f398d602640 1 -- 172.21.15.169:0/731302855 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a94017070 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f398d602640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3988036950 0x7f3988038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f398d602640 1 -- 172.21.15.169:0/731302855 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3a94015020 con 0x55ac6e64f7c0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3988036950 0x7f3988038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e651300 0x55ac6e753320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7538b0 con 0x55ac6e651300 2024-04-24T01:26:08.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa109c640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e651300 0x55ac6e753320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3988036950 0x7f3988038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c054000 tx=0x7f3a8c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa109c640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e651300 0x55ac6e753320 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa109c640 1 -- 172.21.15.169:0/731302855 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e651300 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.708+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7508f0 con 0x55ac6e651300 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa109c640 1 -- 172.21.15.169:0/731302855 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e651300 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e755c00 0x55ac6e757ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7586e0 con 0x55ac6e755c00 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa089b640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e755c00 0x55ac6e757ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa089b640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e755c00 0x55ac6e757ff0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa089b640 1 -- 172.21.15.169:0/731302855 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3a9402e070 con 0x55ac6e755c00 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.709+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e754bb0 con 0x55ac6e651300 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3aa109c640 1 -- 172.21.15.169:0/731302855 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e651300 2024-04-24T01:26:08.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac6e759b90 0x55ac6e75bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e75c740 con 0x55ac6e759b90 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac6e759b90 0x55ac6e75bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac6e759b90 0x55ac6e75bfe0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.710+0000 7f3a9bfff640 1 -- 172.21.15.169:0/731302855 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3a8c05a040 con 0x55ac6e759b90 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa4b3f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa4b3f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac6e5426b0 con 0x55ac6e76aba0 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44286/0 (socket says 172.21.15.169:44286) 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa089b640 1 -- 172.21.15.169:0/3476383785 learned_addr learned my addr 172.21.15.169:0/3476383785 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.711+0000 7f3aa089b640 1 -- 172.21.15.169:0/3476383785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e76b500 con 0x55ac6e76aba0 2024-04-24T01:26:08.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f3aa089b640 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3a9401cfd0 tx=0x7f3a9401b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f39867fc640 1 -- 172.21.15.169:0/3476383785 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a94017d60 con 0x55ac6e76aba0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f39867fc640 1 -- 172.21.15.169:0/3476383785 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94046040 con 0x55ac6e76aba0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6e76bf70 con 0x55ac6e76aba0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f39867fc640 1 -- 172.21.15.169:0/3476383785 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a9401d580 con 0x55ac6e76aba0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6e76c470 con 0x55ac6e76aba0 2024-04-24T01:26:08.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.712+0000 7f39867fc640 1 -- 172.21.15.169:0/3476383785 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a9401d720 con 0x55ac6e76aba0 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f39867fc640 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 0x7f3978038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f39867fc640 1 -- 172.21.15.169:0/3476383785 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3a9403cd50 con 0x55ac6e76aba0 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 0x7f3978038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 0x7f3978038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55ac6e7541b0 tx=0x7f3a8c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa4b3f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa4b3f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac6e744ef0 con 0x55ac6e777d10 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44294/0 (socket says 172.21.15.169:44294) 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.713+0000 7f3aa089b640 1 -- 172.21.15.169:0/1870995679 learned_addr learned my addr 172.21.15.169:0/1870995679 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa089b640 1 -- 172.21.15.169:0/1870995679 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e778700 con 0x55ac6e777d10 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa089b640 1 --2- 172.21.15.169:0/1870995679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3a94044b80 tx=0x7f3a94031c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77286b452095136a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3977fff640 1 -- 172.21.15.169:0/1870995679 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a94019d20 con 0x55ac6e777d10 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3977fff640 1 -- 172.21.15.169:0/1870995679 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a9400f5f0 con 0x55ac6e777d10 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3977fff640 1 -- 172.21.15.169:0/1870995679 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a94013130 con 0x55ac6e777d10 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1870995679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 msgr2=0x55ac6e778130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/1870995679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3a94044b80 tx=0x7f3a94031c00 comp rx=0 tx=0).stop 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1870995679 shutdown_connections 2024-04-24T01:26:08.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/1870995679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e778130 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1870995679 >> 172.21.15.169:0/1870995679 conn(0x55ac6e774020 msgr2=0x55ac6e772080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1870995679 shutdown_connections 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.714+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/1870995679 wait complete. 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa4b3f800 1 Processor -- start 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa4b3f800 1 -- start start 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa4b3f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e77f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa4b3f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55ac6e778d90 con 0x55ac6e777d10 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e77f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa089b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e77f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44308/0 (socket says 172.21.15.169:44308) 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 learned_addr learned my addr 172.21.15.169:0/644796456 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.715+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac6e77f6a0 con 0x55ac6e777d10 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f3aa089b640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e77f160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3a94031d00 tx=0x7f3a94057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f39767fc640 1 -- 172.21.15.169:0/644796456 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a94003e10 con 0x55ac6e777d10 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f39767fc640 1 -- 172.21.15.169:0/644796456 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94069030 con 0x55ac6e777d10 2024-04-24T01:26:08.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac6e77f6a0 con 0x55ac6e777d10 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f39767fc640 1 -- 172.21.15.169:0/644796456 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3a94041c60 con 0x55ac6e777d10 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac6e77f6a0 con 0x55ac6e777d10 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.716+0000 7f39767fc640 1 -- 172.21.15.169:0/644796456 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3a9405f070 con 0x55ac6e777d10 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f39767fc640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f396c036900 0x7f396c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f39767fc640 1 -- 172.21.15.169:0/644796456 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3a9405d020 con 0x55ac6e777d10 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f396c036900 0x7f396c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f396c036900 0x7f396c038dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55ac6e75cb40 tx=0x7f3a8c04f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e78a800 0x55ac6e78ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78d410 con 0x55ac6e78a800 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.717+0000 7f3aa109c640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e78a800 0x55ac6e78ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa109c640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e78a800 0x55ac6e78ccc0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.740 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 realm 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78d820 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e0f0 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.718+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.741 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e78f1f0 0x55ac6e7915e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e791bf0 con 0x55ac6e78f1f0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa089b640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e78f1f0 0x55ac6e7915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa089b640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e78f1f0 0x55ac6e7915e0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.719+0000 7f3aa4b3f800 20 searching for the correct realm 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac6e793b80 0x55ac6e796040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e796710 con 0x55ac6e793b80 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac6e793b80 0x55ac6e796040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac6e793b80 0x55ac6e796040 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.742 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3a9bfff640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3a8c085040 0x7f3a8c076430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e796710 con 0x7f3a8c085040 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.720+0000 7f3aa109c640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3a8c085040 0x7f3a8c076430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa109c640 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3a8c085040 0x7f3a8c076430 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x7f3a8c085040 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.743 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.721+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x7f3a8c085040 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x7f3a8c085040 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.722+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.744 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c00a4a0 con 0x55ac6e78a800 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x7f3a8c085040 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.723+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.724+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.745 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.725+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x7f3a8c085040 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.726+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.746 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.727+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x7f3a8c085040 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e793b80 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78f1f0 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.728+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x55ac6e78a800 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e78e490 con 0x7f3a8c085040 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.747 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7924b0 con 0x55ac6e78a800 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.748 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7924b0 con 0x55ac6e78a800 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.729+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7924b0 con 0x7f3a8c085040 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 zone default found 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 4 Realm: () 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.749 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 zonegroup default 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e792d50 con 0x55ac6e78f1f0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e798570 con 0x55ac6e793b80 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e798910 con 0x55ac6e793b80 2024-04-24T01:26:08.750 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.730+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.731+0000 7f3aa4b3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.731+0000 7f3aa4b3f800 20 started sync module instance, tier type = 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.731+0000 7f3aa4b3f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.731+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e797a10 con 0x7f3a8c085040 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.732+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.732+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199076191744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e797a10 con 0x7f3a8c085040 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.732+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7991c0 con 0x55ac6e78a800 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.733+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.733+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199076191744] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.733+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199076195504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e799180 con 0x55ac6e78a800 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.733+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e799c50 con 0x55ac6e793b80 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.734+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.734+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199076198272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79a4f0 con 0x55ac6e793b80 2024-04-24T01:26:08.751 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.734+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79afb0 con 0x7f3a8c085040 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.734+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199076195504] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.735+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199076198272] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.735+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.735+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199076200512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e797560 con 0x7f3a8c085040 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.735+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79b850 con 0x55ac6e78a800 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.736+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.736+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199076205392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79b770 con 0x55ac6e78a800 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.736+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79c750 con 0x55ac6e78f1f0 2024-04-24T01:26:08.752 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.736+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199076200512] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.737+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199076205392] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.737+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.737+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199076207680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79c260 con 0x55ac6e78f1f0 2024-04-24T01:26:08.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.738+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79cff0 con 0x55ac6e78f1f0 2024-04-24T01:26:08.756 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.738+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199076207680] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.739+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.739+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199076203136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79d840 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.739+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79e110 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199076203136] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199076215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79e920 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=1 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=2 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=3 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=4 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=5 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.740+0000 7f3aa4b3f800 20 add_watcher() i=6 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199076215776] v34'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa4b3f800 20 add_watcher() i=7 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa4b3f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79d420 con 0x55ac6e78a800 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.741+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199076217776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79d420 con 0x55ac6e78a800 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.743+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199076217776] v34'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.743+0000 7f3956fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 5 note: GC not initialized 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3955fe3640 20 reqs_thread_entry: start 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 20 Filter name: none 2024-04-24T01:26:08.758 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f38c77fe640 20 reqs_thread_entry: start 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.744+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7d4cc0 con 0x55ac6e78f1f0 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa4b3f800 20 rados_obj.operate() r=0 bl.length=503 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa4b3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa4b3f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa4b3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.745+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7db660 con 0x55ac6e78f1f0 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa4b3f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.759 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa4b3f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa4b3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94199076466896 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7d6d10 con 0x55ac6e78a800 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94199076205392 notify 146028888093 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f3a9c018a80 con 0x55ac6e78a800 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.746+0000 7f3977fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888093 cookie 94199076205392 notifier 4892 bl.length()=636 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3977fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3977fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94199076466896 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3977fff640 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f3964003ea0 con 0x55ac6e78a800 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.747+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94199076466896 notify 146028888093 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f3a9c018d20 con 0x55ac6e78a800 2024-04-24T01:26:08.761 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.748+0000 7f3956fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.748+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199076217776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7da5c0 con 0x55ac6e78a800 2024-04-24T01:26:08.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.749+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94199076217776] v34'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.749+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199076191744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e7da110 con 0x7f3a8c085040 2024-04-24T01:26:08.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.750+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94199076191744] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.750+0000 7f3aa4b3f800 20 remove_watcher() i=0 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.750+0000 7f3aa4b3f800 2 removed watcher, disabling cache 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.750+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199076195504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e797e00 con 0x55ac6e78a800 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.751+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94199076195504] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.751+0000 7f3aa4b3f800 20 remove_watcher() i=1 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.751+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199076198272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e797e00 con 0x55ac6e793b80 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.752+0000 7f3a9bfff640 1 -- 172.21.15.169:0/644796456 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94199076198272] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a8c073070 con 0x55ac6e793b80 2024-04-24T01:26:08.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.752+0000 7f3aa4b3f800 20 remove_watcher() i=2 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.752+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199076200512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e799780 con 0x7f3a8c085040 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.753+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94199076200512] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x7f3a8c085040 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.753+0000 7f3aa4b3f800 20 remove_watcher() i=3 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.753+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199076205392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79a040 con 0x55ac6e78a800 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.754+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94199076205392] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c032040 con 0x55ac6e78a800 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.754+0000 7f3aa4b3f800 20 remove_watcher() i=4 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.754+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199076207680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79a040 con 0x55ac6e78f1f0 2024-04-24T01:26:08.770 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.755+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94199076207680] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.755+0000 7f3aa4b3f800 20 remove_watcher() i=5 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.755+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199076203136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79bc40 con 0x55ac6e78f1f0 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.756+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94199076203136] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.756+0000 7f3aa4b3f800 20 remove_watcher() i=6 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.756+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199076215776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac6e79a040 con 0x55ac6e78f1f0 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa089b640 1 -- 172.21.15.169:0/644796456 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94199076215776] v34'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a94075070 con 0x55ac6e78f1f0 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 20 remove_watcher() i=7 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e78f1f0 msgr2=0x55ac6e7915e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e78f1f0 0x55ac6e7915e0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e78a800 msgr2=0x55ac6e78ccc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.771 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e78a800 0x55ac6e78ccc0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3a8c085040 msgr2=0x7f3a8c076430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f3a8c085040 0x7f3a8c076430 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac6e793b80 msgr2=0x55ac6e796040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55ac6e793b80 0x55ac6e796040 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f396c036900 msgr2=0x7f396c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f396c036900 0x7f396c038dc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x55ac6e75cb40 tx=0x7f3a8c04f000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 msgr2=0x55ac6e77f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/644796456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e777d10 0x55ac6e77f160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3a94031d00 tx=0x7f3a94057000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 reap_dead start 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa109c640 1 -- 172.21.15.169:0/644796456 reap_dead start 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 shutdown_connections 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 >> 172.21.15.169:0/644796456 conn(0x55ac6e774020 msgr2=0x55ac6e771680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 shutdown_connections 2024-04-24T01:26:08.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/644796456 wait complete. 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 msgr2=0x7f3978038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 0x7f3978038dc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55ac6e7541b0 tx=0x7f3a8c005ac0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 msgr2=0x55ac6e76afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3a9401cfd0 tx=0x7f3a9401b960 comp rx=0 tx=0).stop 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 shutdown_connections 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3978036900 0x7f3978038dc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/3476383785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e76aba0 0x55ac6e76afc0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.757+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 >> 172.21.15.169:0/3476383785 conn(0x55ac6e75ec40 msgr2=0x55ac6e75f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 shutdown_connections 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/3476383785 wait complete. 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e755c00 msgr2=0x55ac6e757ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55ac6e755c00 0x55ac6e757ff0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.773 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e651300 msgr2=0x55ac6e753320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55ac6e651300 0x55ac6e753320 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac6e759b90 msgr2=0x55ac6e75bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55ac6e759b90 0x55ac6e75bfe0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3988036950 msgr2=0x7f3988038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3988036950 0x7f3988038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c054000 tx=0x7f3a8c04e000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 msgr2=0x55ac6e74c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 --2- 172.21.15.169:0/731302855 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ac6e64f7c0 0x55ac6e74c180 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f3a94001ed0 tx=0x7f3a94000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa109c640 1 -- 172.21.15.169:0/731302855 reap_dead start 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 shutdown_connections 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 >> 172.21.15.169:0/731302855 conn(0x55ac6e64b340 msgr2=0x55ac6e73e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.774 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 shutdown_connections 2024-04-24T01:26:08.775 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.758+0000 7f3aa4b3f800 1 -- 172.21.15.169:0/731302855 wait complete. 2024-04-24T01:26:08.775 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.775 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.775 ERROR:root:0 2024-04-24T01:26:08.775 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:26:08.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:26:08.775 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-04-24T01:26:08.819 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.820 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.820+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.820+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.820+0000 7fed2c036800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b44258a2a0 0x55b442592da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.820+0000 7fed2c036800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b442448d40 con 0x55b442588760 2024-04-24T01:26:08.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.820+0000 7fed2c036800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55b44241b4d0 con 0x55b44258a2a0 2024-04-24T01:26:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.821+0000 7fed21334640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55b44258a2a0 0x55b442592da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.821+0000 7fed29b35640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55b442588760 0x55b442588b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50806/0 (socket says 172.21.15.169:50806) 2024-04-24T01:26:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.821+0000 7fed29b35640 1 -- 172.21.15.169:0/209604810 learned_addr learned my addr 172.21.15.169:0/209604810 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.821+0000 7fed21334640 1 -- 172.21.15.169:0/209604810 >> v1:172.21.15.142:6789/0 conn(0x55b442588760 legacy=0x55b442588b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.822 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.821+0000 7fed21334640 1 -- 172.21.15.169:0/209604810 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b442447590 con 0x55b44258a2a0 2024-04-24T01:26:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.823+0000 7fed21334640 1 --2- 172.21.15.169:0/209604810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b44258a2a0 0x55b442592da0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fed1400a470 tx=0x7fed1401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ce36aa7b966f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.823 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.823+0000 7fed29334640 1 -- 172.21.15.169:0/209604810 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14057070 con 0x55b44258a2a0 2024-04-24T01:26:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.823+0000 7fed29334640 1 -- 172.21.15.169:0/209604810 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1404adc0 con 0x55b44258a2a0 2024-04-24T01:26:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.823+0000 7fed29334640 1 -- 172.21.15.169:0/209604810 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed14052590 con 0x55b44258a2a0 2024-04-24T01:26:08.824 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 -- 172.21.15.169:0/209604810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b44258a2a0 msgr2=0x55b442592da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 --2- 172.21.15.169:0/209604810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b44258a2a0 0x55b442592da0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fed1400a470 tx=0x7fed1401ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 -- 172.21.15.169:0/209604810 shutdown_connections 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 --2- 172.21.15.169:0/209604810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b44258a2a0 0x55b442592da0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 -- 172.21.15.169:0/209604810 >> 172.21.15.169:0/209604810 conn(0x55b4425843a0 msgr2=0x55b4425867c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 -- 172.21.15.169:0/209604810 shutdown_connections 2024-04-24T01:26:08.825 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.824+0000 7fed2c036800 1 -- 172.21.15.169:0/209604810 wait complete. 2024-04-24T01:26:08.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.835+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.835+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed2c036800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed2c036800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b4424d53b0 con 0x55b442588760 2024-04-24T01:26:08.837 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44320/0 (socket says 172.21.15.169:44320) 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed29b35640 1 -- 172.21.15.169:0/3563961487 learned_addr learned my addr 172.21.15.169:0/3563961487 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.836+0000 7fed29b35640 1 -- 172.21.15.169:0/3563961487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44267dc30 con 0x55b442588760 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed29b35640 1 --2- 172.21.15.169:0/3563961487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001de0 tx=0x7fed1c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72712730fbc773b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fec17e07640 1 -- 172.21.15.169:0/3563961487 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c012020 con 0x55b442588760 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fec17e07640 1 -- 172.21.15.169:0/3563961487 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c00e5a0 con 0x55b442588760 2024-04-24T01:26:08.838 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fec17e07640 1 -- 172.21.15.169:0/3563961487 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c00e8c0 con 0x55b442588760 2024-04-24T01:26:08.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed2c036800 1 -- 172.21.15.169:0/3563961487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 msgr2=0x55b44267d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.844 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed2c036800 1 --2- 172.21.15.169:0/3563961487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001de0 tx=0x7fed1c00b6c0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed2c036800 1 -- 172.21.15.169:0/3563961487 shutdown_connections 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed2c036800 1 --2- 172.21.15.169:0/3563961487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b44267d660 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.837+0000 7fed2c036800 1 -- 172.21.15.169:0/3563961487 >> 172.21.15.169:0/3563961487 conn(0x55b4425843a0 msgr2=0x55b442678f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 -- 172.21.15.169:0/3563961487 shutdown_connections 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 -- 172.21.15.169:0/3563961487 wait complete. 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b442685180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed2c036800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b4425955c0 con 0x55b442588760 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b442685180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b442685180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44328/0 (socket says 172.21.15.169:44328) 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed29b35640 1 -- 172.21.15.169:0/3891062211 learned_addr learned my addr 172.21.15.169:0/3891062211 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.838+0000 7fed29b35640 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4426856c0 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fed29b35640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b442685180 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001de0 tx=0x7fed1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fec16604640 1 -- 172.21.15.169:0/3891062211 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c012030 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fec16604640 1 -- 172.21.15.169:0/3891062211 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c01a7a0 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b442685950 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fec16604640 1 -- 172.21.15.169:0/3891062211 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c01aac0 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b442688600 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.839+0000 7fec16604640 1 -- 172.21.15.169:0/3891062211 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed1c015020 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fec16604640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec10036900 0x7fec10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fec16604640 1 -- 172.21.15.169:0/3891062211 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed1c020070 con 0x55b442588760 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed21334640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec10036900 0x7fec10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b44258a2a0 0x55b44268c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.846 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b44268c900 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed2a336640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b44258a2a0 0x55b44268c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed21334640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec10036900 0x7fec10038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed14054000 tx=0x7fed1404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.840+0000 7fed2a336640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b44258a2a0 0x55b44268c3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed2a336640 1 -- 172.21.15.169:0/3891062211 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b442689990 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed2a336640 1 -- 172.21.15.169:0/3891062211 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b44268ec50 0x55b442691040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b442691730 con 0x55b44268ec50 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed29b35640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b44268ec50 0x55b442691040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.841+0000 7fed29b35640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b44268ec50 0x55b442691040 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed29b35640 1 -- 172.21.15.169:0/3891062211 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fed1c024980 con 0x55b44268ec50 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b44268dc00 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed2a336640 1 -- 172.21.15.169:0/3891062211 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b44258a2a0 2024-04-24T01:26:08.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b442692be0 0x55b442695030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b442695790 con 0x55b442692be0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed21334640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b442692be0 0x55b442695030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.842+0000 7fed21334640 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b442692be0 0x55b442695030 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed21334640 1 -- 172.21.15.169:0/3891062211 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fed1405a040 con 0x55b442692be0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed2c036800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed2c036800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b44247b6b0 con 0x55b4426a3bf0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44342/0 (socket says 172.21.15.169:44342) 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.843+0000 7fed29b35640 1 -- 172.21.15.169:0/2198994107 learned_addr learned my addr 172.21.15.169:0/2198994107 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fed29b35640 1 -- 172.21.15.169:0/2198994107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4426a4550 con 0x55b4426a3bf0 2024-04-24T01:26:08.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fed29b35640 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001250 tx=0x7fed1c044480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fec0f7fe640 1 -- 172.21.15.169:0/2198994107 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c03c070 con 0x55b4426a3bf0 2024-04-24T01:26:08.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fec0f7fe640 1 -- 172.21.15.169:0/2198994107 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c018c80 con 0x55b4426a3bf0 2024-04-24T01:26:08.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4426a4fc0 con 0x55b4426a3bf0 2024-04-24T01:26:08.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fec0f7fe640 1 -- 172.21.15.169:0/2198994107 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c016590 con 0x55b4426a3bf0 2024-04-24T01:26:08.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.844+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4426a4fc0 con 0x55b4426a3bf0 2024-04-24T01:26:08.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fec0f7fe640 1 -- 172.21.15.169:0/2198994107 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed1c03f070 con 0x55b4426a3bf0 2024-04-24T01:26:08.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fec0f7fe640 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 0x7fec04038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fec0f7fe640 1 -- 172.21.15.169:0/2198994107 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed1c039080 con 0x55b4426a3bf0 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed21334640 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 0x7fec04038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed21334640 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 0x7fec04038e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b44268d200 tx=0x7fed14005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed2c036800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed2c036800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b44267dfb0 con 0x55b4426b0b40 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44352/0 (socket says 172.21.15.169:44352) 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.845+0000 7fed29b35640 1 -- 172.21.15.169:0/3742332542 learned_addr learned my addr 172.21.15.169:0/3742332542 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed29b35640 1 -- 172.21.15.169:0/3742332542 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4426b1530 con 0x55b4426b0b40 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed29b35640 1 --2- 172.21.15.169:0/3742332542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fed1c04cc70 tx=0x7fed1c03f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659459d846dd30e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fec0d7fa640 1 -- 172.21.15.169:0/3742332542 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c037800 con 0x55b4426b0b40 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fec0d7fa640 1 -- 172.21.15.169:0/3742332542 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c03fdb0 con 0x55b4426b0b40 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fec0d7fa640 1 -- 172.21.15.169:0/3742332542 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c041490 con 0x55b4426b0b40 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 -- 172.21.15.169:0/3742332542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 msgr2=0x55b4426b0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 --2- 172.21.15.169:0/3742332542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fed1c04cc70 tx=0x7fed1c03f3e0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 -- 172.21.15.169:0/3742332542 shutdown_connections 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 --2- 172.21.15.169:0/3742332542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b0f60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 -- 172.21.15.169:0/3742332542 >> 172.21.15.169:0/3742332542 conn(0x55b4426ace60 msgr2=0x55b4426aaec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 -- 172.21.15.169:0/3742332542 shutdown_connections 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.846+0000 7fed2c036800 1 -- 172.21.15.169:0/3742332542 wait complete. 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed2c036800 1 Processor -- start 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed2c036800 1 -- start start 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed2c036800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed2c036800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55b4426b1c50 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed29b35640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44368/0 (socket says 172.21.15.169:44368) 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 learned_addr learned my addr 172.21.15.169:0/1043234441 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4426b8530 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.847+0000 7fed29b35640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fed1c04dbd0 tx=0x7fed1c041f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7febfb7fe640 1 -- 172.21.15.169:0/1043234441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c037800 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7febfb7fe640 1 -- 172.21.15.169:0/1043234441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed1c04dc50 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4426b8530 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7febfb7fe640 1 -- 172.21.15.169:0/1043234441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed1c03f820 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4426b8530 con 0x55b4426b0b40 2024-04-24T01:26:08.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.848+0000 7febfb7fe640 1 -- 172.21.15.169:0/1043234441 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fed1c03f9c0 con 0x55b4426b0b40 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7febfb7fe640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febf4036950 0x7febf4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7febfb7fe640 1 -- 172.21.15.169:0/1043234441 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fed1c063da0 con 0x55b4426b0b40 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed21334640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febf4036950 0x7febf4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed21334640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febf4036950 0x7febf4038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed14000c00 tx=0x7fed14060040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4426c3650 0x55b4426c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c6260 con 0x55b4426c3650 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.849+0000 7fed2a336640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4426c3650 0x55b4426c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2a336640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4426c3650 0x55b4426c5b10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 realm 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c6670 con 0x55b4426c3650 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c6f40 con 0x55b4426c3650 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.850+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4426c8040 0x55b4426ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426caa40 con 0x55b4426c8040 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed29b35640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4426c8040 0x55b4426ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed29b35640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4426c8040 0x55b4426ca430 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 20 searching for the correct realm 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4426cc9f0 0x55b4426ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cf580 con 0x55b4426cc9f0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.851+0000 7fed21334640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4426cc9f0 0x55b4426ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed21334640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4426cc9f0 0x55b4426ceeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed21334640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed14052b30 0x7fed14080930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cf580 con 0x7fed14052b30 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed2a336640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed14052b30 0x7fed14080930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.852+0000 7fed2a336640 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed14052b30 0x7fed14080930 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x7fed14052b30 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.853+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x7fed14052b30 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x7fed14052b30 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.854+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed2400a4a0 con 0x55b4426c3650 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x7fed14052b30 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.855+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.856+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.857+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x7fed14052b30 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.893 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.858+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x7fed14052b30 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.859+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c8040 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x55b4426c3650 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55b4426c72e0 con 0x7fed14052b30 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cb300 con 0x55b4426c3650 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.896 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.860+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cb300 con 0x55b4426c3650 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cb300 con 0x7fed14052b30 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 zone default found 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 4 Realm: () 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:08.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 zonegroup default 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426cbba0 con 0x55b4426c8040 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d13e0 con 0x55b4426cc9f0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.861+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d1780 con 0x55b4426cc9f0 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 20 started sync module instance, tier type = 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.862+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d0880 con 0x7fed14052b30 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.863+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.863+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94232696917104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d0880 con 0x7fed14052b30 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.863+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d1fd0 con 0x55b4426c3650 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.864+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94232696917104] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.864+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.864+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94232696921344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d0880 con 0x55b4426c3650 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.864+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d2a20 con 0x55b4426cc9f0 2024-04-24T01:26:08.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.865+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94232696921344] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.865+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.865+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94232696914896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d07f0 con 0x55b4426cc9f0 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.865+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d38e0 con 0x7fed14052b30 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.866+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94232696914896] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.866+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.866+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94232696927280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d3d00 con 0x7fed14052b30 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.867+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d4590 con 0x55b4426c3650 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.868+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.868+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94232696929536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d4120 con 0x55b4426c3650 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.868+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d5510 con 0x55b4426c8040 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.868+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94232696927280] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.869+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.869+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94232696929536] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.869+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94232696934400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d5900 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.869+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d49d0 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.870+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94232696934400] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.870+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.870+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94232696938000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d66e0 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.870+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d6f30 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94232696938000] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94232696941728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d62f0 con 0x55b4426c8040 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=0 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=1 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=2 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=3 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=4 2024-04-24T01:26:08.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=5 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.871+0000 7fed2c036800 20 add_watcher() i=6 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94232696941728] v34'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed2c036800 20 add_watcher() i=7 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed2c036800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b4426da710 con 0x55b4426c3650 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.872+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94232696942784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d7c30 con 0x55b4426c3650 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.873+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94232696942784] v34'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.873+0000 7febdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.873+0000 7fed2c036800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.873+0000 7fed2c036800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.873+0000 7fed2c036800 5 note: GC not initialized 2024-04-24T01:26:08.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7febda7fc640 20 reqs_thread_entry: start 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed2c036800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed2c036800 20 Filter name: none 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7feb4ffff640 20 reqs_thread_entry: start 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed2c036800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed2c036800 20 rados->read ofs=0 len=0 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b44270da50 con 0x55b4426c8040 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.874+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.875+0000 7fed2c036800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.875+0000 7fed2c036800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.875+0000 7fed2c036800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.875+0000 7fed2c036800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.875+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b442714050 con 0x55b4426c8040 2024-04-24T01:26:08.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v34'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2c036800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2c036800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2c036800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94232697191104 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b44270f720 con 0x55b4426c3650 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94232696929536 notify 146028888094 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7fed24018df0 con 0x55b4426c3650 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94232697191104 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fec0d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888094 cookie 94232696929536 notifier 4899 bl.length()=666 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fec0d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fec0d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fec0d7fa640 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7febec003ea0 con 0x55b4426c3650 2024-04-24T01:26:08.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.876+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94232697191104 notify 146028888094 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fed24044500 con 0x55b4426c3650 2024-04-24T01:26:08.905 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:08.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.877+0000 7febdb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.877+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94232696942784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b442712730 con 0x55b4426c3650 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.878+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94232696942784] v34'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.878+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94232696917104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d70c0 con 0x7fed14052b30 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.879+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94232696917104] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.879+0000 7fed2c036800 20 remove_watcher() i=0 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.879+0000 7fed2c036800 2 removed watcher, disabling cache 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.879+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94232696921344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d0c70 con 0x55b4426c3650 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.880+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94232696921344] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.880+0000 7fed2c036800 20 remove_watcher() i=1 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.880+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94232696914896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d0c70 con 0x55b4426cc9f0 2024-04-24T01:26:08.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.881+0000 7fed21334640 1 -- 172.21.15.169:0/1043234441 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94232696914896] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed14070070 con 0x55b4426cc9f0 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.882+0000 7fed2c036800 20 remove_watcher() i=2 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.882+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94232696927280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d03d0 con 0x7fed14052b30 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.882+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94232696927280] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x7fed14052b30 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.882+0000 7fed2c036800 20 remove_watcher() i=3 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.882+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94232696929536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d3430 con 0x55b4426c3650 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.884+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94232696929536] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed24032040 con 0x55b4426c3650 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.884+0000 7fed2c036800 20 remove_watcher() i=4 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.884+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94232696934400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d03d0 con 0x55b4426c8040 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.885+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94232696934400] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.885+0000 7fed2c036800 20 remove_watcher() i=5 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.885+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94232696938000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d3430 con 0x55b4426c8040 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.886+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94232696938000] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.886+0000 7fed2c036800 20 remove_watcher() i=6 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.886+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94232696941728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55b4426d5000 con 0x55b4426c8040 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed29b35640 1 -- 172.21.15.169:0/1043234441 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94232696941728] v34'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fed1c06b070 con 0x55b4426c8040 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 20 remove_watcher() i=7 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4426c8040 msgr2=0x55b4426ca430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b4426c8040 0x55b4426ca430 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4426c3650 msgr2=0x55b4426c5b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b4426c3650 0x55b4426c5b10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed14052b30 msgr2=0x7fed14080930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fed14052b30 0x7fed14080930 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4426cc9f0 msgr2=0x55b4426ceeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55b4426cc9f0 0x55b4426ceeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febf4036950 msgr2=0x7febf4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7febf4036950 0x7febf4038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fed14000c00 tx=0x7fed14060040 comp rx=0 tx=0).stop 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 msgr2=0x55b4426b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2a336640 1 -- 172.21.15.169:0/1043234441 reap_dead start 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fed1c04dbd0 tx=0x7fed1c041f30 comp rx=0 tx=0).stop 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 shutdown_connections 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/1043234441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426b0b40 0x55b4426b7ff0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 >> 172.21.15.169:0/1043234441 conn(0x55b4426ace60 msgr2=0x55b4426aa4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 shutdown_connections 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/1043234441 wait complete. 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 msgr2=0x7fec04038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.915 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 0x7fec04038e10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x55b44268d200 tx=0x7fed14005a00 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 msgr2=0x55b4426a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001250 tx=0x7fed1c044480 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 shutdown_connections 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec04036950 0x7fec04038e10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 --2- 172.21.15.169:0/2198994107 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b4426a3bf0 0x55b4426a4010 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.887+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 >> 172.21.15.169:0/2198994107 conn(0x55b442697c90 msgr2=0x55b442698090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 shutdown_connections 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/2198994107 wait complete. 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b44268ec50 msgr2=0x55b442691040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55b44268ec50 0x55b442691040 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b44258a2a0 msgr2=0x55b44268c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55b44258a2a0 0x55b44268c3c0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b442692be0 msgr2=0x55b442695030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55b442692be0 0x55b442695030 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec10036900 msgr2=0x7fec10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fec10036900 0x7fec10038dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fed14054000 tx=0x7fed1404e000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 msgr2=0x55b442685180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 --2- 172.21.15.169:0/3891062211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b442588760 0x55b442685180 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fed1c001de0 tx=0x7fed1c000ed0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2a336640 1 -- 172.21.15.169:0/3891062211 reap_dead start 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 shutdown_connections 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 >> 172.21.15.169:0/3891062211 conn(0x55b4425843a0 msgr2=0x55b442677840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 shutdown_connections 2024-04-24T01:26:08.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.888+0000 7fed2c036800 1 -- 172.21.15.169:0/3891062211 wait complete. 2024-04-24T01:26:08.917 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.917 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:08.918 ERROR:root:0 2024-04-24T01:26:08.918 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:08.922 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000f1cbafe31fe5cac5-0066285fb0-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:26:08.923 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:26:08.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-04-24T01:26:08.923 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-04-24T01:26:08.968 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:08.968 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.968+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.968+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.968+0000 7fd14a00f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5610dfcbb990 0x5610dfcbdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.968+0000 7fd14a00f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5610dfb79d40 con 0x5610dfcbe2c0 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.968+0000 7fd14a00f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x5610dfb4c4d0 con 0x5610dfcbb990 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.969+0000 7fd145747640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5610dfcbb990 0x5610dfcbdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.969+0000 7fd145747640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x5610dfcbb990 0x5610dfcbdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44380/0 (socket says 172.21.15.169:44380) 2024-04-24T01:26:08.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.969+0000 7fd145747640 1 -- 172.21.15.169:0/3621959309 learned_addr learned my addr 172.21.15.169:0/3621959309 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.969+0000 7fd145747640 1 -- 172.21.15.169:0/3621959309 >> v1:172.21.15.142:6789/0 conn(0x5610dfcbe2c0 legacy=0x5610dfcc06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.971 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.969+0000 7fd145747640 1 -- 172.21.15.169:0/3621959309 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfb78590 con 0x5610dfcbb990 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd145747640 1 --2- 172.21.15.169:0/3621959309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfcbdd80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd13800a520 tx=0x7fd13801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb3d642b0ae739 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd144f46640 1 -- 172.21.15.169:0/3621959309 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138057070 con 0x5610dfcbb990 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd144f46640 1 -- 172.21.15.169:0/3621959309 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138052570 con 0x5610dfcbb990 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd144f46640 1 -- 172.21.15.169:0/3621959309 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd13804ae60 con 0x5610dfcbb990 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 -- 172.21.15.169:0/3621959309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 msgr2=0x5610dfcbdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 --2- 172.21.15.169:0/3621959309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfcbdd80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd13800a520 tx=0x7fd13801d010 comp rx=0 tx=0).stop 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 -- 172.21.15.169:0/3621959309 shutdown_connections 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 --2- 172.21.15.169:0/3621959309 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfcbdd80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 -- 172.21.15.169:0/3621959309 >> 172.21.15.169:0/3621959309 conn(0x5610dfcb5340 msgr2=0x5610dfcb7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 -- 172.21.15.169:0/3621959309 shutdown_connections 2024-04-24T01:26:08.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.971+0000 7fd14a00f800 1 -- 172.21.15.169:0/3621959309 wait complete. 2024-04-24T01:26:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.983+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.983+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.983+0000 7fd14a00f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.983+0000 7fd14a00f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5610dfc063b0 con 0x5610dfcbb990 2024-04-24T01:26:08.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44384/0 (socket says 172.21.15.169:44384) 2024-04-24T01:26:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd145747640 1 -- 172.21.15.169:0/2406498059 learned_addr learned my addr 172.21.15.169:0/2406498059 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd145747640 1 -- 172.21.15.169:0/2406498059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfdac770 con 0x5610dfcbb990 2024-04-24T01:26:08.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd145747640 1 --2- 172.21.15.169:0/2406498059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd138055040 tx=0x7fd13804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c33fc22a127417 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd033606640 1 -- 172.21.15.169:0/2406498059 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138057040 con 0x5610dfcbb990 2024-04-24T01:26:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.984+0000 7fd033606640 1 -- 172.21.15.169:0/2406498059 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138052720 con 0x5610dfcbb990 2024-04-24T01:26:08.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd033606640 1 -- 172.21.15.169:0/2406498059 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138052a40 con 0x5610dfcbb990 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 -- 172.21.15.169:0/2406498059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 msgr2=0x5610dfdac1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2406498059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fd138055040 tx=0x7fd13804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 -- 172.21.15.169:0/2406498059 shutdown_connections 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2406498059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdac1a0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 -- 172.21.15.169:0/2406498059 >> 172.21.15.169:0/2406498059 conn(0x5610dfcb5340 msgr2=0x5610dfda7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 -- 172.21.15.169:0/2406498059 shutdown_connections 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.985+0000 7fd14a00f800 1 -- 172.21.15.169:0/2406498059 wait complete. 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd14a00f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdb39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd14a00f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5610dfcc40e0 con 0x5610dfcbb990 2024-04-24T01:26:08.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdb39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdb39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44396/0 (socket says 172.21.15.169:44396) 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.986+0000 7fd145747640 1 -- 172.21.15.169:0/1588426772 learned_addr learned my addr 172.21.15.169:0/1588426772 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd145747640 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfdb3f30 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd145747640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdb39f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd138055040 tx=0x7fd138003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd031e03640 1 -- 172.21.15.169:0/1588426772 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138073070 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd031e03640 1 -- 172.21.15.169:0/1588426772 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd13805d570 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610dfdb41c0 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.987+0000 7fd031e03640 1 -- 172.21.15.169:0/1588426772 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138057070 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610dfdb6e70 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd031e03640 1 -- 172.21.15.169:0/1588426772 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd138076070 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd031e03640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd02c036890 0x7fd02c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd031e03640 1 -- 172.21.15.169:0/1588426772 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd13805c7e0 con 0x5610dfcbb990 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd13ffff640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd02c036890 0x7fd02c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfcbe2c0 0x5610dfdbac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdbb250 con 0x5610dfcbe2c0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd145f48640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfcbe2c0 0x5610dfdbac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd13ffff640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd02c036890 0x7fd02c038d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd130001e10 tx=0x7fd130001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.988+0000 7fd145f48640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfcbe2c0 0x5610dfdbac30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd145f48640 1 -- 172.21.15.169:0/1588426772 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfcbe2c0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdbbb30 con 0x5610dfcbe2c0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd145f48640 1 -- 172.21.15.169:0/1588426772 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfcbe2c0 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdbd440 0x5610dfdbf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdc0070 con 0x5610dfdbd440 2024-04-24T01:26:08.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.989+0000 7fd145747640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdbd440 0x5610dfdbf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd145747640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdbd440 0x5610dfdbf8e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd145747640 1 -- 172.21.15.169:0/1588426772 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdbd440 2024-04-24T01:26:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdbc380 con 0x5610dfcbe2c0 2024-04-24T01:26:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd145f48640 1 -- 172.21.15.169:0/1588426772 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfcbe2c0 2024-04-24T01:26:09.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5610dfdc14d0 0x5610dfdc3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdc40d0 con 0x5610dfdc14d0 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.990+0000 7fd13ffff640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5610dfdc14d0 0x5610dfdc3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.991+0000 7fd13ffff640 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5610dfdc14d0 0x5610dfdc3940 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.991+0000 7fd13ffff640 1 -- 172.21.15.169:0/1588426772 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1300106a0 con 0x5610dfdc14d0 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.991+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.991+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.991+0000 7fd14a00f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd14a00f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5610dfbac6b0 con 0x5610dfdd2530 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44404/0 (socket says 172.21.15.169:44404) 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd145747640 1 -- 172.21.15.169:0/2757848672 learned_addr learned my addr 172.21.15.169:0/2757848672 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd145747640 1 -- 172.21.15.169:0/2757848672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfdd2e90 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd145747640 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd138052f70 tx=0x7fd138076830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd02affd640 1 -- 172.21.15.169:0/2757848672 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138093060 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd02affd640 1 -- 172.21.15.169:0/2757848672 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138066db0 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610dfdd3900 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd02affd640 1 -- 172.21.15.169:0/2757848672 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd13805cbb0 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.992+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610dfdd3e00 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.993+0000 7fd02affd640 1 -- 172.21.15.169:0/2757848672 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd1380773b0 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.993+0000 7fd02affd640 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 0x7fd01c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.993+0000 7fd02affd640 1 -- 172.21.15.169:0/2757848672 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd138082040 con 0x5610dfdd2530 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.993+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 0x7fd01c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.993+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 0x7fd01c038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5610dfdb8360 tx=0x7fd130006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd14a00f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd14a00f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5610dfdaca30 con 0x5610dfcbb090 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44410/0 (socket says 172.21.15.169:44410) 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd145747640 1 -- 172.21.15.169:0/2897563656 learned_addr learned my addr 172.21.15.169:0/2897563656 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd145747640 1 -- 172.21.15.169:0/2897563656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfcbb500 con 0x5610dfcbb090 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd145747640 1 --2- 172.21.15.169:0/2897563656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd13805cfd0 tx=0x7fd138098af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109a3b4eb8eea2df server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd028ff9640 1 -- 172.21.15.169:0/2897563656 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138098440 con 0x5610dfcbb090 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd028ff9640 1 -- 172.21.15.169:0/2897563656 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd138053e30 con 0x5610dfcbb090 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.994+0000 7fd028ff9640 1 -- 172.21.15.169:0/2897563656 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd13808a260 con 0x5610dfcbb090 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- 172.21.15.169:0/2897563656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 msgr2=0x5610dfcb9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2897563656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fd13805cfd0 tx=0x7fd138098af0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- 172.21.15.169:0/2897563656 shutdown_connections 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2897563656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfcb9780 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- 172.21.15.169:0/2897563656 >> 172.21.15.169:0/2897563656 conn(0x5610dfddb920 msgr2=0x5610dfdd9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- 172.21.15.169:0/2897563656 shutdown_connections 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- 172.21.15.169:0/2897563656 wait complete. 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 Processor -- start 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- start start 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.995+0000 7fd14a00f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x5610dfcb9cc0 con 0x5610dfcbb090 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd145747640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44418/0 (socket says 172.21.15.169:44418) 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 learned_addr learned my addr 172.21.15.169:0/2923343258 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610dfde90b0 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd145747640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd1380989c0 tx=0x7fd13805af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd01affd640 1 -- 172.21.15.169:0/2923343258 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1380513a0 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd01affd640 1 -- 172.21.15.169:0/2923343258 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1380bc070 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd01affd640 1 -- 172.21.15.169:0/2923343258 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd138098c60 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5610dfde90b0 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.996+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610dfde90b0 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.997+0000 7fd01affd640 1 -- 172.21.15.169:0/2923343258 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd13808a8f0 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.997+0000 7fd01affd640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd0100368b0 0x7fd010038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.997+0000 7fd01affd640 1 -- 172.21.15.169:0/2923343258 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd1380b2040 con 0x5610dfcbb090 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.997+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd0100368b0 0x7fd010038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd0100368b0 0x7fd010038d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5610dfdc44d0 tx=0x7fd130011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfdf4260 0x5610dfdf6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf6e70 con 0x5610dfdf4260 2024-04-24T01:26:09.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd145f48640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfdf4260 0x5610dfdf6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd145f48640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfdf4260 0x5610dfdf6720 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 20 realm 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.998+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7280 con 0x5610dfdf4260 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf76a0 con 0x5610dfdf4260 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdf8960 0x5610dfdfad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfb490 con 0x5610dfdf8960 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:08.999+0000 7fd145747640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdf8960 0x5610dfdfad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd145747640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdf8960 0x5610dfdfad50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd14a00f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd14a00f800 20 searching for the correct realm 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5610dfdfd460 0x5610dfdff920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfffa0 con 0x5610dfdfd460 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5610dfdfd460 0x5610dfdff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.000+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5610dfdfd460 0x5610dfdff920 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd13ffff640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd1300393c0 0x7fd130039810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfffa0 con 0x7fd1300393c0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd145f48640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd1300393c0 0x7fd130039810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd145f48640 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd1300393c0 0x7fd130039810 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x7fd1300393c0 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.001+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.002+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x7fd1300393c0 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x7fd1300393c0 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.003+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd14000a4a0 con 0x5610dfdf4260 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x7fd1300393c0 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.004+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.024 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.005+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.006+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x7fd1300393c0 2024-04-24T01:26:09.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.007+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x7fd1300393c0 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.008+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdfd460 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf8960 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x5610dfdf4260 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdf7f40 con 0x7fd1300393c0 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.027 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfbd50 con 0x5610dfdf4260 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.009+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfbd50 con 0x5610dfdf4260 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfbd50 con 0x7fd1300393c0 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 zone default found 2024-04-24T01:26:09.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 4 Realm: () 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 zonegroup default 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfdfc640 con 0x5610dfdf8960 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.010+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe01e00 con 0x5610dfdfd460 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe021a0 con 0x5610dfdfd460 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 20 started sync module instance, tier type = 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.011+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe012a0 con 0x7fd1300393c0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.012+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.012+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94630475470752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe012a0 con 0x7fd1300393c0 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.012+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe02b60 con 0x5610dfdf4260 2024-04-24T01:26:09.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.013+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.013+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94630475470752] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.013+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94630475474608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe02fc0 con 0x5610dfdf4260 2024-04-24T01:26:09.031 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.013+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe033e0 con 0x5610dfdfd460 2024-04-24T01:26:09.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.015+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94630475474608] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.015+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.015+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94630475475664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe00f00 con 0x5610dfdfd460 2024-04-24T01:26:09.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.015+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe04340 con 0x7fd1300393c0 2024-04-24T01:26:09.038 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.016+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.016+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94630475475664] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.016+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94630475480608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe04be0 con 0x7fd1300393c0 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.016+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe05150 con 0x5610dfdf4260 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.017+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94630475480608] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.017+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.017+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94630475478912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe04b90 con 0x5610dfdf4260 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.017+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe05b60 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.018+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94630475478912] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.018+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.018+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94630475482848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe04b00 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.018+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe068a0 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.019+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94630475482848] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.019+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.039 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.019+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94630475489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe07170 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.019+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe07b30 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94630475495520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe08230 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=0 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=1 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=2 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=3 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=4 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=5 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94630475489504] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.020+0000 7fd14a00f800 20 add_watcher() i=6 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94630475495520] v34'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd14a00f800 20 add_watcher() i=7 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd14a00f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:09.040 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe06cc0 con 0x5610dfdf4260 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.021+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94630475496640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe06cc0 con 0x5610dfdf4260 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.022+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94630475496640] v34'273 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.022+0000 7fcffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 5 note: GC not initialized 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fcffa7e4640 20 reqs_thread_entry: start 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 20 Filter name: none 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fcf6bfff640 20 reqs_thread_entry: start 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.023+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe3e640 con 0x5610dfdf8960 2024-04-24T01:26:09.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.024+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.025+0000 7fd14a00f800 20 rados_obj.operate() r=0 bl.length=490 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.025+0000 7fd14a00f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.025+0000 7fd14a00f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.025+0000 7fd14a00f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.025+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe44ec0 con 0x5610dfdf8960 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v34'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd14a00f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd14a00f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd14a00f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94630475745584 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe405b0 con 0x5610dfdf4260 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94630475478912 notify 146028888095 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7fd140018960 con 0x5610dfdf4260 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd028ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888095 cookie 94630475478912 notifier 4906 bl.length()=636 2024-04-24T01:26:09.042 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94630475745584 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd028ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd028ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd028ff9640 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fd008003ea0 con 0x5610dfdf4260 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.026+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94630475745584 notify 146028888095 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd140018c00 con 0x5610dfdf4260 2024-04-24T01:26:09.043 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.027+0000 7fcffb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.027+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94630475496640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe409c0 con 0x5610dfdf4260 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.028+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94630475496640] v34'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.028+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94630475470752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe07c80 con 0x7fd1300393c0 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.029+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94630475470752] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.029+0000 7fd14a00f800 20 remove_watcher() i=0 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.029+0000 7fd14a00f800 2 removed watcher, disabling cache 2024-04-24T01:26:09.049 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.029+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94630475474608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe017a0 con 0x5610dfdf4260 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.030+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94630475474608] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.030+0000 7fd14a00f800 20 remove_watcher() i=1 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.030+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94630475475664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe026b0 con 0x5610dfdfd460 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.031+0000 7fd13ffff640 1 -- 172.21.15.169:0/2923343258 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94630475475664] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd130036040 con 0x5610dfdfd460 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.031+0000 7fd14a00f800 20 remove_watcher() i=2 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.031+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94630475480608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe017a0 con 0x7fd1300393c0 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.032+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94630475480608] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x7fd1300393c0 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.032+0000 7fd14a00f800 20 remove_watcher() i=3 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.032+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94630475478912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe017a0 con 0x5610dfdf4260 2024-04-24T01:26:09.050 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.033+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94630475478912] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd140032040 con 0x5610dfdf4260 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.033+0000 7fd14a00f800 20 remove_watcher() i=4 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.033+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94630475482848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe017a0 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.034+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94630475482848] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.034+0000 7fd14a00f800 20 remove_watcher() i=5 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.034+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94630475489504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe017a0 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.035+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94630475489504] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.035+0000 7fd14a00f800 20 remove_watcher() i=6 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.035+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94630475495520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5610dfe060e0 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.036+0000 7fd145747640 1 -- 172.21.15.169:0/2923343258 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94630475495520] v34'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd138075030 con 0x5610dfdf8960 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.036+0000 7fd14a00f800 20 remove_watcher() i=7 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdf8960 msgr2=0x5610dfdfad50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdf8960 0x5610dfdfad50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.051 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfdf4260 msgr2=0x5610dfdf6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfdf4260 0x5610dfdf6720 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd1300393c0 msgr2=0x7fd130039810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7fd1300393c0 0x7fd130039810 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5610dfdfd460 msgr2=0x5610dfdff920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x5610dfdfd460 0x5610dfdff920 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd0100368b0 msgr2=0x7fd010038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd0100368b0 0x7fd010038d70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5610dfdc44d0 tx=0x7fd130011000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 msgr2=0x5610dfde8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd145f48640 1 -- 172.21.15.169:0/2923343258 reap_dead start 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fd1380989c0 tx=0x7fd13805af60 comp rx=0 tx=0).stop 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 shutdown_connections 2024-04-24T01:26:09.052 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2923343258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb090 0x5610dfde8b70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 >> 172.21.15.169:0/2923343258 conn(0x5610dfddb920 msgr2=0x5610dfdd8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 shutdown_connections 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2923343258 wait complete. 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 msgr2=0x7fd01c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 0x7fd01c038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x5610dfdb8360 tx=0x7fd130006000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 msgr2=0x5610dfdd2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fd138052f70 tx=0x7fd138076830 comp rx=0 tx=0).stop 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 shutdown_connections 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd01c036950 0x7fd01c038e10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 --2- 172.21.15.169:0/2757848672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfdd2530 0x5610dfdd2950 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 >> 172.21.15.169:0/2757848672 conn(0x5610dfdc65d0 msgr2=0x5610dfdc69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.053 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 shutdown_connections 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.037+0000 7fd14a00f800 1 -- 172.21.15.169:0/2757848672 wait complete. 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdbd440 msgr2=0x5610dfdbf8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x5610dfdbd440 0x5610dfdbf8e0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfcbe2c0 msgr2=0x5610dfdbac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x5610dfcbe2c0 0x5610dfdbac30 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5610dfdc14d0 msgr2=0x5610dfdc3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x5610dfdc14d0 0x5610dfdc3940 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd02c036890 msgr2=0x7fd02c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd02c036890 0x7fd02c038d50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd130001e10 tx=0x7fd130001390 comp rx=0 tx=0).stop 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 msgr2=0x5610dfdb39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 --2- 172.21.15.169:0/1588426772 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5610dfcbb990 0x5610dfdb39f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fd138055040 tx=0x7fd138003020 comp rx=0 tx=0).stop 2024-04-24T01:26:09.054 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd145f48640 1 -- 172.21.15.169:0/1588426772 reap_dead start 2024-04-24T01:26:09.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 shutdown_connections 2024-04-24T01:26:09.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 >> 172.21.15.169:0/1588426772 conn(0x5610dfcb5340 msgr2=0x5610dfda62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 shutdown_connections 2024-04-24T01:26:09.055 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.038+0000 7fd14a00f800 1 -- 172.21.15.169:0/1588426772 wait complete. 2024-04-24T01:26:09.055 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.055 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.055 ERROR:root:0 2024-04-24T01:26:09.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:09.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:09.056 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:26:09.100 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:09.100 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f2ad2f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f99093c760 0x55f99093cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f2ad2f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9907fcd40 con 0x55f99093d0c0 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f2ad2f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55f9907cf4d0 con 0x55f99093c760 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f26ac5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f99093c760 0x55f99093cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.102 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f262c4640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55f99093d0c0 0x55f99093d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50828/0 (socket says 172.21.15.169:50828) 2024-04-24T01:26:09.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f26ac5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55f99093c760 0x55f99093cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44422/0 (socket says 172.21.15.169:44422) 2024-04-24T01:26:09.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f262c4640 1 -- 172.21.15.169:0/1098345700 learned_addr learned my addr 172.21.15.169:0/1098345700 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:09.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.101+0000 7f1f26ac5640 1 -- 172.21.15.169:0/1098345700 >> v1:172.21.15.142:6789/0 conn(0x55f99093d0c0 legacy=0x55f99093d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.103 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.102+0000 7f1f26ac5640 1 -- 172.21.15.169:0/1098345700 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9907fb590 con 0x55f99093c760 2024-04-24T01:26:09.104 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.103+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/1098345700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f99093cb80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a470 tx=0x7f1f1801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11b419c8476bf2f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f25ac3640 1 -- 172.21.15.169:0/1098345700 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18057070 con 0x55f99093c760 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f25ac3640 1 -- 172.21.15.169:0/1098345700 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1804adc0 con 0x55f99093c760 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f25ac3640 1 -- 172.21.15.169:0/1098345700 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18052590 con 0x55f99093c760 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1098345700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 msgr2=0x55f99093cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1098345700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f99093cb80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800a470 tx=0x7f1f1801ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1098345700 shutdown_connections 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1098345700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f99093cb80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1098345700 >> 172.21.15.169:0/1098345700 conn(0x55f9909383a0 msgr2=0x55f99093a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1098345700 shutdown_connections 2024-04-24T01:26:09.105 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.104+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1098345700 wait complete. 2024-04-24T01:26:09.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.117 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f2ad2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f2ad2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f9908893b0 con 0x55f99093c760 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44436/0 (socket says 172.21.15.169:44436) 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.116+0000 7f1f26ac5640 1 -- 172.21.15.169:0/468947644 learned_addr learned my addr 172.21.15.169:0/468947644 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.117+0000 7f1f26ac5640 1 -- 172.21.15.169:0/468947644 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f990a31a40 con 0x55f99093c760 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.117+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/468947644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f18055040 tx=0x7f1f1804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e378962075c3328 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.117+0000 7f1e14e09640 1 -- 172.21.15.169:0/468947644 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18057040 con 0x55f99093c760 2024-04-24T01:26:09.118 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.117+0000 7f1e14e09640 1 -- 172.21.15.169:0/468947644 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18062070 con 0x55f99093c760 2024-04-24T01:26:09.119 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.117+0000 7f1e14e09640 1 -- 172.21.15.169:0/468947644 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1805d470 con 0x55f99093c760 2024-04-24T01:26:09.124 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/468947644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 msgr2=0x55f990a31470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/468947644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1f18055040 tx=0x7f1f1804c000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/468947644 shutdown_connections 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/468947644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a31470 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/468947644 >> 172.21.15.169:0/468947644 conn(0x55f9909383a0 msgr2=0x55f990a2cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/468947644 shutdown_connections 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/468947644 wait complete. 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a38f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f2ad2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f99093df20 con 0x55f99093c760 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a38f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.125 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a38f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44446/0 (socket says 172.21.15.169:44446) 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.118+0000 7f1f26ac5640 1 -- 172.21.15.169:0/795440347 learned_addr learned my addr 172.21.15.169:0/795440347 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1f26ac5640 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f990a39450 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a38f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801ce60 tx=0x7f1f18002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1e13606640 1 -- 172.21.15.169:0/795440347 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f1806b070 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1e13606640 1 -- 172.21.15.169:0/795440347 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1805d970 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f990a396e0 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1e13606640 1 -- 172.21.15.169:0/795440347 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18057070 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.119+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f990a3c390 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1e13606640 1 -- 172.21.15.169:0/795440347 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f1805dc90 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1e13606640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e0c036950 0x7f1e0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1e13606640 1 -- 172.21.15.169:0/795440347 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f1808e170 con 0x55f99093c760 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f262c4640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e0c036950 0x7f1e0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.126 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f99093d0c0 0x55f990a40150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a406e0 con 0x55f99093d0c0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f272c6640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f99093d0c0 0x55f990a40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f262c4640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e0c036950 0x7f1e0c038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c000f60 tx=0x7f1f1c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.120+0000 7f1f272c6640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f99093d0c0 0x55f990a40150 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f272c6640 1 -- 172.21.15.169:0/795440347 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f99093d0c0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a3d700 con 0x55f99093d0c0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f272c6640 1 -- 172.21.15.169:0/795440347 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f99093d0c0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a429f0 0x55f990a44de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a45480 con 0x55f990a429f0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.121+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a429f0 0x55f990a44de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a429f0 0x55f990a44de0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.127 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f26ac5640 1 -- 172.21.15.169:0/795440347 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1f1805a040 con 0x55f990a429f0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a41970 con 0x55f99093d0c0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f272c6640 1 -- 172.21.15.169:0/795440347 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f99093d0c0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f990a468e0 0x55f990a48d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a494b0 con 0x55f990a468e0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.122+0000 7f1f262c4640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f990a468e0 0x55f990a48d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f262c4640 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f990a468e0 0x55f990a48d50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f262c4640 1 -- 172.21.15.169:0/795440347 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a468e0 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.128 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f2ad2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.123+0000 7f1f2ad2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f99082f6b0 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44462/0 (socket says 172.21.15.169:44462) 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f26ac5640 1 -- 172.21.15.169:0/1940976092 learned_addr learned my addr 172.21.15.169:0/1940976092 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f26ac5640 1 -- 172.21.15.169:0/1940976092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f990a58270 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1f1808c520 tx=0x7f1f18072dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1e10e01640 1 -- 172.21.15.169:0/1940976092 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18089070 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1e10e01640 1 -- 172.21.15.169:0/1940976092 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18071e30 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f990a58ce0 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1e10e01640 1 -- 172.21.15.169:0/1940976092 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18079b90 con 0x55f990a57910 2024-04-24T01:26:09.129 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.124+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f990a58ce0 con 0x55f990a57910 2024-04-24T01:26:09.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1e10e01640 1 -- 172.21.15.169:0/1940976092 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f18070460 con 0x55f990a57910 2024-04-24T01:26:09.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1e10e01640 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 0x7f1e00038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1e10e01640 1 -- 172.21.15.169:0/1940976092 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f1808fdf0 con 0x55f990a57910 2024-04-24T01:26:09.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1f262c4640 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 0x7f1e00038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.125+0000 7f1f262c4640 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 0x7f1e00038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00bf50 tx=0x7f1f1c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f2ad2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f2ad2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f990a31d00 con 0x55f990a648a0 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44472/0 (socket says 172.21.15.169:44472) 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f26ac5640 1 -- 172.21.15.169:0/122101444 learned_addr learned my addr 172.21.15.169:0/122101444 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f26ac5640 1 -- 172.21.15.169:0/122101444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f990a65290 con 0x55f990a648a0 2024-04-24T01:26:09.154 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/122101444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1f18072940 tx=0x7f1f18097800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187417cb79bc5e0f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1e0a7fc640 1 -- 172.21.15.169:0/122101444 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f180a0070 con 0x55f990a648a0 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1e0a7fc640 1 -- 172.21.15.169:0/122101444 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f1806ec90 con 0x55f990a648a0 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.126+0000 7f1e0a7fc640 1 -- 172.21.15.169:0/122101444 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18072570 con 0x55f990a648a0 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/122101444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 msgr2=0x55f990a64cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/122101444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f1f18072940 tx=0x7f1f18097800 comp rx=0 tx=0).stop 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/122101444 shutdown_connections 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/122101444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a64cc0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/122101444 >> 172.21.15.169:0/122101444 conn(0x55f990a60c00 msgr2=0x55f990a5ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/122101444 shutdown_connections 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/122101444 wait complete. 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 Processor -- start 2024-04-24T01:26:09.155 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- start start 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f2ad2f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55f990a65940 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f26ac5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44486/0 (socket says 172.21.15.169:44486) 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.127+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 learned_addr learned my addr 172.21.15.169:0/2959330369 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f990a6c1d0 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1f18077fe0 tx=0x7f1f1809d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1e08ff9640 1 -- 172.21.15.169:0/2959330369 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18090ca0 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1e08ff9640 1 -- 172.21.15.169:0/2959330369 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f18090e40 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f990a6c1d0 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1e08ff9640 1 -- 172.21.15.169:0/2959330369 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f18070880 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.128+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f990a6c1d0 con 0x55f990a648a0 2024-04-24T01:26:09.156 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.129+0000 7f1e08ff9640 1 -- 172.21.15.169:0/2959330369 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1f180b2020 con 0x55f990a648a0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.129+0000 7f1e08ff9640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1df0036900 0x7f1df0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.129+0000 7f1e08ff9640 1 -- 172.21.15.169:0/2959330369 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1f180b5d30 con 0x55f990a648a0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.129+0000 7f1f262c4640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1df0036900 0x7f1df0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.129+0000 7f1f262c4640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1df0036900 0x7f1df0038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c001b60 tx=0x7f1f1c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f990a77410 0x55f990a798d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7a020 con 0x55f990a77410 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f272c6640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f990a77410 0x55f990a798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f272c6640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f990a77410 0x55f990a798d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 realm 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7a430 con 0x55f990a77410 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.157 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.130+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7ad00 con 0x55f990a77410 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a7be00 0x55f990a7e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7e800 con 0x55f990a7be00 2024-04-24T01:26:09.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.131+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a7be00 0x55f990a7e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f26ac5640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a7be00 0x55f990a7e1f0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f2ad2f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f2ad2f800 20 searching for the correct realm 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f990a807b0 0x55f990a82c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a83340 con 0x55f990a807b0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f262c4640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f990a807b0 0x55f990a82c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.132+0000 7f1f262c4640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f990a807b0 0x55f990a82c70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f262c4640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1f1c038040 0x7f1f1c01bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a83340 con 0x7f1f1c038040 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f272c6640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1f1c038040 0x7f1f1c01bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.159 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f272c6640 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1f1c038040 0x7f1f1c01bab0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x7f1f1c038040 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.133+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.134+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x7f1f1c038040 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x7f1f1c038040 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.135+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f2000a4a0 con 0x55f990a77410 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x7f1f1c038040 2024-04-24T01:26:09.161 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.136+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.162 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.137+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x7f1f1c038040 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.138+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.163 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.139+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x7f1f1c038040 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a807b0 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a7be00 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.140+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x55f990a77410 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7b0a0 con 0x7f1f1c038040 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.164 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7f0c0 con 0x55f990a77410 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7f0c0 con 0x55f990a77410 2024-04-24T01:26:09.165 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.141+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7f0c0 con 0x7f1f1c038040 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 zone default found 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 4 Realm: () 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 zonegroup default 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.166 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a7f960 con 0x55f990a7be00 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a851a0 con 0x55f990a807b0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a85540 con 0x55f990a807b0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 started sync module instance, tier type = 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.142+0000 7f1f2ad2f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:09.167 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.143+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a84640 con 0x7f1f1c038040 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.144+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.144+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94530362166128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a84640 con 0x7f1f1c038040 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.144+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a85f00 con 0x55f990a77410 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.145+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94530362166128] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.145+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.145+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94530362164080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a85f00 con 0x55f990a77410 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.145+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a868c0 con 0x55f990a807b0 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.146+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.146+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94530362172432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a87160 con 0x55f990a807b0 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.146+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a87c00 con 0x7f1f1c038040 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.146+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94530362164080] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.168 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.147+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94530362172432] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.147+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.147+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94530362174640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a85a50 con 0x7f1f1c038040 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.147+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a884e0 con 0x55f990a77410 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.148+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.148+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94530362179440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a888d0 con 0x55f990a77410 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.148+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a893f0 con 0x55f990a7be00 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.148+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94530362174640] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.149+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.149+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94530362183360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a897e0 con 0x55f990a7be00 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.149+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a8a1e0 con 0x55f990a7be00 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.149+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94530362179440] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.150+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94530362183360] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.150+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.150+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94530362177232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a89d70 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.150+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a8aa20 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94530362177232] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(58 notify.7 [create] v34'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94530362180496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a8a9e0 con 0x55f990a7be00 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=0 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=1 2024-04-24T01:26:09.170 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=2 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=3 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=4 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=5 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.151+0000 7f1f2ad2f800 20 add_watcher() i=6 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.152+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94530362180496] v34'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.152+0000 7f1f2ad2f800 20 add_watcher() i=7 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.152+0000 7f1f2ad2f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.152+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990a8de70 con 0x55f990a77410 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.153+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.171 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.153+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94530362189568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a8b330 con 0x55f990a77410 2024-04-24T01:26:09.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94530362189568] v34'275 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f2ad2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:09.176 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f2ad2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f2ad2f800 5 note: GC not initialized 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1d57fff640 20 reqs_thread_entry: start 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f2ad2f800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.154+0000 7f1f2ad2f800 20 Filter name: none 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1d55ffb640 20 reqs_thread_entry: start 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac10f0 con 0x55f990a7be00 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 20 rados_obj.operate() r=0 bl.length=460 2024-04-24T01:26:09.177 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.155+0000 7f1f2ad2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.156+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac76f0 con 0x55f990a7be00 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f2ad2f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f2ad2f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f2ad2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94530362437984 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac2d80 con 0x55f990a77410 2024-04-24T01:26:09.178 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94530362179440 notify 146028888096 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f1f20018aa0 con 0x55f990a77410 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1e0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888096 cookie 94530362179440 notifier 4913 bl.length()=649 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94530362437984 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1e0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1e0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1e0a7fc640 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1dec003ea0 con 0x55f990a77410 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.157+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94530362437984 notify 146028888096 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1f20018d40 con 0x55f990a77410 2024-04-24T01:26:09.179 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:09.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.158+0000 7f1ddd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.158+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94530362189568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac6a00 con 0x55f990a77410 2024-04-24T01:26:09.186 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.159+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94530362189568] v34'276 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.159+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94530362166128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac6a00 con 0x7f1f1c038040 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.160+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94530362166128] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.160+0000 7f1f2ad2f800 20 remove_watcher() i=0 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.160+0000 7f1f2ad2f800 2 removed watcher, disabling cache 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.160+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94530362164080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac6a00 con 0x55f990a77410 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.161+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94530362164080] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.161+0000 7f1f2ad2f800 20 remove_watcher() i=1 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.161+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94530362172432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990ac6a00 con 0x55f990a807b0 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.162+0000 7f1f262c4640 1 -- 172.21.15.169:0/2959330369 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94530362172432] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f1c009050 con 0x55f990a807b0 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.162+0000 7f1f2ad2f800 20 remove_watcher() i=2 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.162+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94530362174640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a86410 con 0x7f1f1c038040 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.163+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94530362174640] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x7f1f1c038040 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.163+0000 7f1f2ad2f800 20 remove_watcher() i=3 2024-04-24T01:26:09.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.163+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94530362179440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a86410 con 0x55f990a77410 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.164+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94530362179440] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f20032040 con 0x55f990a77410 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.164+0000 7f1f2ad2f800 20 remove_watcher() i=4 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.164+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94530362183360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a87f70 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.165+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94530362183360] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.165+0000 7f1f2ad2f800 20 remove_watcher() i=5 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.165+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94530362177232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a86410 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.166+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94530362177232] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.166+0000 7f1f2ad2f800 20 remove_watcher() i=6 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.166+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94530362180496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f990a87f70 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.167+0000 7f1f26ac5640 1 -- 172.21.15.169:0/2959330369 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94530362180496] v34'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1f18094020 con 0x55f990a7be00 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.167+0000 7f1f2ad2f800 20 remove_watcher() i=7 2024-04-24T01:26:09.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a7be00 msgr2=0x55f990a7e1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a7be00 0x55f990a7e1f0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f990a77410 msgr2=0x55f990a798d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f990a77410 0x55f990a798d0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1f1c038040 msgr2=0x7f1f1c01bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1f1c038040 0x7f1f1c01bab0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f990a807b0 msgr2=0x55f990a82c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55f990a807b0 0x55f990a82c70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1df0036900 msgr2=0x7f1df0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1df0036900 0x7f1df0038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c001b60 tx=0x7f1f1c010000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 msgr2=0x55f990a6bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f1f18077fe0 tx=0x7f1f1809d000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f272c6640 1 -- 172.21.15.169:0/2959330369 reap_dead start 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 shutdown_connections 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/2959330369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a648a0 0x55f990a6bc90 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 >> 172.21.15.169:0/2959330369 conn(0x55f990a60c00 msgr2=0x55f990a5e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 shutdown_connections 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/2959330369 wait complete. 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 msgr2=0x7f1e00038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 0x7f1e00038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c00bf50 tx=0x7f1f1c00f000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 msgr2=0x55f990a57d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f1f1808c520 tx=0x7f1f18072dc0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 shutdown_connections 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e00036900 0x7f1e00038dc0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/1940976092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f990a57910 0x55f990a57d30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 >> 172.21.15.169:0/1940976092 conn(0x55f990a4b9b0 msgr2=0x55f990a4bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 shutdown_connections 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/1940976092 wait complete. 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.168+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a429f0 msgr2=0x55f990a44de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55f990a429f0 0x55f990a44de0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f99093d0c0 msgr2=0x55f990a40150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55f99093d0c0 0x55f990a40150 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f990a468e0 msgr2=0x55f990a48d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55f990a468e0 0x55f990a48d50 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e0c036950 msgr2=0x7f1e0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1e0c036950 0x7f1e0c038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c000f60 tx=0x7f1f1c0012b0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 msgr2=0x55f990a38f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 --2- 172.21.15.169:0/795440347 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f99093c760 0x55f990a38f10 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801ce60 tx=0x7f1f18002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f272c6640 1 -- 172.21.15.169:0/795440347 reap_dead start 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 shutdown_connections 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 >> 172.21.15.169:0/795440347 conn(0x55f9909383a0 msgr2=0x55f990a2b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 shutdown_connections 2024-04-24T01:26:09.192 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.169+0000 7f1f2ad2f800 1 -- 172.21.15.169:0/795440347 wait complete. 2024-04-24T01:26:09.193 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.193 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.193 ERROR:root:0 2024-04-24T01:26:09.193 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:09.193 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-04-24T01:26:09.193 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-04-24T01:26:09.238 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:26:09.238 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:26:09.239 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.238+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.238+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.238+0000 7f1bbb146800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.238+0000 7f1bbb146800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c0c995ed40 con 0x55c0c9aa3200 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.238+0000 7f1bbb146800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x55c0c99314d0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb8c4c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb844b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x55c0c9aa3200 0x55c0c9aa55f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:50840/0 (socket says 172.21.15.169:50840) 2024-04-24T01:26:09.240 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb8c4c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44494/0 (socket says 172.21.15.169:44494) 2024-04-24T01:26:09.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb844b640 1 -- 172.21.15.169:0/2276635246 learned_addr learned my addr 172.21.15.169:0/2276635246 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-24T01:26:09.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2276635246 >> v1:172.21.15.142:6789/0 conn(0x55c0c9aa3200 legacy=0x55c0c9aa55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.241 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.239+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2276635246 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c995d590 con 0x55c0c9aa08d0 2024-04-24T01:26:09.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.241+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2276635246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000a470 tx=0x7f1bb001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32afe79faa6049e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.241+0000 7f1bb7c4a640 1 -- 172.21.15.169:0/2276635246 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0057070 con 0x55c0c9aa08d0 2024-04-24T01:26:09.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.241+0000 7f1bb7c4a640 1 -- 172.21.15.169:0/2276635246 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0052570 con 0x55c0c9aa08d0 2024-04-24T01:26:09.243 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.241+0000 7f1bb7c4a640 1 -- 172.21.15.169:0/2276635246 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0052870 con 0x55c0c9aa08d0 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.241+0000 7f1bbb146800 1 -- 172.21.15.169:0/2276635246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 msgr2=0x55c0c9aa2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2276635246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000a470 tx=0x7f1bb001ce90 comp rx=0 tx=0).stop 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 -- 172.21.15.169:0/2276635246 shutdown_connections 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2276635246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa2cc0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 -- 172.21.15.169:0/2276635246 >> 172.21.15.169:0/2276635246 conn(0x55c0c9a9a3a0 msgr2=0x55c0c9a9c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 -- 172.21.15.169:0/2276635246 shutdown_connections 2024-04-24T01:26:09.244 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.242+0000 7f1bbb146800 1 -- 172.21.15.169:0/2276635246 wait complete. 2024-04-24T01:26:09.259 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.253+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.253+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bbb146800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bbb146800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c0c99eb3b0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44504/0 (socket says 172.21.15.169:44504) 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2235029681 learned_addr learned my addr 172.21.15.169:0/2235029681 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2235029681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9a9e7d0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2235029681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0055040 tx=0x7f1bb004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b87d3ed96b781b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.254+0000 7f1aa6e0d640 1 -- 172.21.15.169:0/2235029681 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0057070 con 0x55c0c9aa08d0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1aa6e0d640 1 -- 172.21.15.169:0/2235029681 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0063070 con 0x55c0c9aa08d0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1aa6e0d640 1 -- 172.21.15.169:0/2235029681 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0052720 con 0x55c0c9aa08d0 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 -- 172.21.15.169:0/2235029681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 msgr2=0x55c0c9aa0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2235029681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0055040 tx=0x7f1bb004c000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 -- 172.21.15.169:0/2235029681 shutdown_connections 2024-04-24T01:26:09.260 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2235029681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9aa0210 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 -- 172.21.15.169:0/2235029681 >> 172.21.15.169:0/2235029681 conn(0x55c0c9a9a3a0 msgr2=0x55c0c9b8ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 -- 172.21.15.169:0/2235029681 shutdown_connections 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.255+0000 7f1bbb146800 1 -- 172.21.15.169:0/2235029681 wait complete. 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bbb146800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9b9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bbb146800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9aa6fb0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9b9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9b9ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44508/0 (socket says 172.21.15.169:44508) 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/3685633177 learned_addr learned my addr 172.21.15.169:0/3685633177 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9b9b3a0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9b9ae60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0060040 tx=0x7f1bb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.256+0000 7f1aa560a640 1 -- 172.21.15.169:0/3685633177 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0052e30 con 0x55c0c9aa08d0 2024-04-24T01:26:09.261 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1aa560a640 1 -- 172.21.15.169:0/3685633177 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb006c070 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c9b9b630 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1aa560a640 1 -- 172.21.15.169:0/3685633177 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb005e5f0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c9b9e2e0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1aa560a640 1 -- 172.21.15.169:0/3685633177 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bb005e790 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1aa560a640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1aa0036950 0x7f1aa0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.257+0000 7f1aa560a640 1 -- 172.21.15.169:0/3685633177 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bb008e9e0 con 0x55c0c9aa08d0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bb844b640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1aa0036950 0x7f1aa0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9aa3200 0x55c0c9ba20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9ba2620 con 0x55c0c9aa3200 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bb944d640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9aa3200 0x55c0c9ba20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.262 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bb844b640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1aa0036950 0x7f1aa0038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0000f60 tx=0x7f1ba00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bb944d640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9aa3200 0x55c0c9ba20a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bb944d640 1 -- 172.21.15.169:0/3685633177 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9aa3200 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.258+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9b9f670 con 0x55c0c9aa3200 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.259+0000 7f1bb944d640 1 -- 172.21.15.169:0/3685633177 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9aa3200 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.259+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9ba4980 0x55c0c9ba6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.259+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9ba7460 con 0x55c0c9ba4980 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.259+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9ba4980 0x55c0c9ba6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.263 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.259+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9ba4980 0x55c0c9ba6d70 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/3685633177 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bb0071990 con 0x55c0c9ba4980 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9ba3930 con 0x55c0c9aa3200 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bb944d640 1 -- 172.21.15.169:0/3685633177 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9aa3200 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c0c9ba8910 0x55c0c9baad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bab4c0 con 0x55c0c9ba8910 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bb844b640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c0c9ba8910 0x55c0c9baad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.260+0000 7f1bb844b640 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c0c9ba8910 0x55c0c9baad60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bb844b640 1 -- 172.21.15.169:0/3685633177 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9ba8910 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bbb146800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bbb146800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c0c99916b0 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44524/0 (socket says 172.21.15.169:44524) 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.261+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2003544181 learned_addr learned my addr 172.21.15.169:0/2003544181 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2003544181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9bba210 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0052520 tx=0x7f1bb0067420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1a9e7fc640 1 -- 172.21.15.169:0/2003544181 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0092070 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1a9e7fc640 1 -- 172.21.15.169:0/2003544181 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0058040 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c9bbac80 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1a9e7fc640 1 -- 172.21.15.169:0/2003544181 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb005ed90 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.262+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c9bbb180 con 0x55c0c9bb98b0 2024-04-24T01:26:09.286 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1a9e7fc640 1 -- 172.21.15.169:0/2003544181 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bb0095070 con 0x55c0c9bb98b0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1a9e7fc640 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 0x7f1a90038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1a9e7fc640 1 -- 172.21.15.169:0/2003544181 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bb0098d70 con 0x55c0c9bb98b0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 0x7f1a90038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 0x7f1a90038d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000bf50 tx=0x7f1ba000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bbb146800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.263+0000 7f1bbb146800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9a9ea90 con 0x55c0c9bc69d0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44526/0 (socket says 172.21.15.169:44526) 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/1895921050 learned_addr learned my addr 172.21.15.169:0/1895921050 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/1895921050 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9bc73c0 con 0x55c0c9bc69d0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/1895921050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0082010 tx=0x7f1bb008e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2f1bcfeadacfe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1a8ffff640 1 -- 172.21.15.169:0/1895921050 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb007a8d0 con 0x55c0c9bc69d0 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1a8ffff640 1 -- 172.21.15.169:0/1895921050 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0004600 con 0x55c0c9bc69d0 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1a8ffff640 1 -- 172.21.15.169:0/1895921050 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0002a70 con 0x55c0c9bc69d0 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bbb146800 1 -- 172.21.15.169:0/1895921050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 msgr2=0x55c0c9bc6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.264+0000 7f1bbb146800 1 --2- 172.21.15.169:0/1895921050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0082010 tx=0x7f1bb008e0f0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- 172.21.15.169:0/1895921050 shutdown_connections 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 --2- 172.21.15.169:0/1895921050 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bc6df0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- 172.21.15.169:0/1895921050 >> 172.21.15.169:0/1895921050 conn(0x55c0c9bc2d30 msgr2=0x55c0c9bc0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- 172.21.15.169:0/1895921050 shutdown_connections 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- 172.21.15.169:0/1895921050 wait complete. 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 Processor -- start 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- start start 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bbb146800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x55c0c9bc7a70 con 0x55c0c9bc69d0 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bb8c4c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:44530/0 (socket says 172.21.15.169:44530) 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 learned_addr learned my addr 172.21.15.169:0/2350516808 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.265+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0c9bce300 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1bb008ec50 tx=0x7f1bb005af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1a8e7fc640 1 -- 172.21.15.169:0/2350516808 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb00bc070 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1a8e7fc640 1 -- 172.21.15.169:0/2350516808 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb004cc10 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c0c9bce300 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1a8e7fc640 1 -- 172.21.15.169:0/2350516808 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb008b330 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.266+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0c9bce300 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1a8e7fc640 1 -- 172.21.15.169:0/2350516808 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bb00bf070 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1a8e7fc640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a84036900 0x7f1a84038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1a8e7fc640 1 -- 172.21.15.169:0/2350516808 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1bb00a8070 con 0x55c0c9bc69d0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a84036900 0x7f1a84038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a84036900 0x7f1a84038dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0001b60 tx=0x7f1ba0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.289 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9bd9560 0x55c0c9bdba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdc170 con 0x55c0c9bd9560 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.267+0000 7f1bb944d640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9bd9560 0x55c0c9bdba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bb944d640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9bd9560 0x55c0c9bdba20 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 realm 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdc580 con 0x55c0c9bd9560 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdce50 con 0x55c0c9bd9560 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.268+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bbb146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9bddf50 0x55c0c9be0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be0950 con 0x55c0c9bddf50 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9bddf50 0x55c0c9be0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bb8c4c640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9bddf50 0x55c0c9be0340 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.269+0000 7f1bbb146800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bbb146800 20 searching for the correct realm 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c0c9be2900 0x55c0c9be4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be5490 con 0x55c0c9be2900 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c0c9be2900 0x55c0c9be4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c0c9be2900 0x55c0c9be4dc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb844b640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1ba0037040 0x7f1ba0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be5490 con 0x7f1ba0037040 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.270+0000 7f1bb944d640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1ba0037040 0x7f1ba0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb944d640 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1ba0037040 0x7f1ba0036410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x7f1ba0037040 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.271+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x7f1ba0037040 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x7f1ba0037040 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.272+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba800a4a0 con 0x55c0c9bd9560 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.273+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x7f1ba0037040 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.274+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.275+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.295 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x7f1ba0037040 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.276+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.277+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.277+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.277+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.277+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x7f1ba0037040 2024-04-24T01:26:09.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9be2900 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.278+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bddf50 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x55c0c9bd9560 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bdd1f0 con 0x7f1ba0037040 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:26:09.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be1210 con 0x55c0c9bd9560 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.279+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be1210 con 0x55c0c9bd9560 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be1210 con 0x7f1ba0037040 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 zone default found 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 4 Realm: () 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 zonegroup default 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be1ab0 con 0x55c0c9bddf50 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.280+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be72f0 con 0x55c0c9be2900 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be7690 con 0x55c0c9be2900 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 20 started sync module instance, tier type = 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.281+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be6790 con 0x7f1ba0037040 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.282+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.282+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94286506781872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be6790 con 0x7f1ba0037040 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.282+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be8050 con 0x55c0c9bd9560 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.283+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94286506781872] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.283+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.283+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94286506779840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be8050 con 0x55c0c9bd9560 2024-04-24T01:26:09.300 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.283+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be8a50 con 0x55c0c9be2900 2024-04-24T01:26:09.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.284+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.284+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94286506788192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be92f0 con 0x55c0c9be2900 2024-04-24T01:26:09.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.284+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be9d70 con 0x7f1ba0037040 2024-04-24T01:26:09.301 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.285+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94286506779840] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.306 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.285+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94286506788192] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.286+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.286+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94286506790464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be7ba0 con 0x7f1ba0037040 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.286+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bea610 con 0x55c0c9bd9560 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.287+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.287+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94286506795280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bea530 con 0x55c0c9bd9560 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.287+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9beb530 con 0x55c0c9bddf50 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.287+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94286506790464] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.288+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.288+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94286506795280] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.288+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94286506799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be9860 con 0x55c0c9bddf50 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.288+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bebdc0 con 0x55c0c9bddf50 2024-04-24T01:26:09.307 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.289+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94286506799136] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.289+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.289+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94286506797568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bec690 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.289+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9becf40 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94286506805392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bed3b0 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94286506797568] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=0 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=1 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=2 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=3 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=4 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=5 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.290+0000 7f1bbb146800 20 add_watcher() i=6 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94286506805392] v34'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.308 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bbb146800 20 add_watcher() i=7 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bbb146800 2 all 8 watchers are set, enabling cache 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bed3b0 con 0x55c0c9bd9560 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.291+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94286506807040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bed390 con 0x55c0c9bd9560 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.292+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94286506807040] v34'277 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.292+0000 7f1a6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.292+0000 7f1bbb146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.292+0000 7f1bbb146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.292+0000 7f1bbb146800 5 note: GC not initialized 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1a6dfe3640 20 reqs_thread_entry: start 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1bbb146800 20 init_complete bucket index max shards: 11 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1bbb146800 20 Filter name: none 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f19df7fe640 20 reqs_thread_entry: start 2024-04-24T01:26:09.309 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1bbb146800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1bbb146800 20 rados->read ofs=0 len=0 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.293+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c23610 con 0x55c0c9bddf50 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bbb146800 20 rados_obj.operate() r=0 bl.length=473 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bbb146800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bbb146800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bbb146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.294+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c29f10 con 0x55c0c9bddf50 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v34'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bbb146800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bbb146800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bbb146800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-04-24T01:26:09.310 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94286507055488 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c25620 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== watch-notify(notify (1) cookie 94286506795280 notify 146028888097 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f1ba80189e0 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1a8ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888097 cookie 94286506795280 notifier 4920 bl.length()=649 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(64 notify.4 [notify cookie 94286507055488 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1a8ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1a8ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1a8ffff640 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1a7c003ea0 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.295+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== watch-notify(notify_complete (2) cookie 94286507055488 notify 146028888097 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1ba8018c80 con 0x55c0c9bd9560 2024-04-24T01:26:09.311 INFO:teuthology.orchestra.run.smithi169.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-04-24T01:26:07.282790Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-04-24T01:26:07.282771Z","tags":[],"group_ids":[]} 2024-04-24T01:26:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.296+0000 7f1a6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:26:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.296+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94286506807040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c29260 con 0x55c0c9bd9560 2024-04-24T01:26:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.297+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94286506807040] v34'278 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.297+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94286506781872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c29260 con 0x7f1ba0037040 2024-04-24T01:26:09.317 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.298+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94286506781872] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.298+0000 7f1bbb146800 20 remove_watcher() i=0 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.298+0000 7f1bbb146800 2 removed watcher, disabling cache 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.298+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94286506779840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c29260 con 0x55c0c9bd9560 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.299+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94286506779840] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.300+0000 7f1bbb146800 20 remove_watcher() i=1 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.300+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94286506788192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9c29260 con 0x55c0c9be2900 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.301+0000 7f1bb844b640 1 -- 172.21.15.169:0/2350516808 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94286506788192] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba0009050 con 0x55c0c9be2900 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.301+0000 7f1bbb146800 20 remove_watcher() i=2 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.301+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94286506790464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be64c0 con 0x7f1ba0037040 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.301+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94286506790464] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x7f1ba0037040 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.302+0000 7f1bbb146800 20 remove_watcher() i=3 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.302+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94286506795280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be64c0 con 0x55c0c9bd9560 2024-04-24T01:26:09.318 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.302+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94286506795280] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ba8032040 con 0x55c0c9bd9560 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.302+0000 7f1bbb146800 20 remove_watcher() i=4 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.303+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94286506799136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9bea110 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.303+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94286506799136] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.304+0000 7f1bbb146800 20 remove_watcher() i=5 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.304+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94286506797568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be64c0 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.305+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94286506797568] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.305+0000 7f1bbb146800 20 remove_watcher() i=6 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.305+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94286506805392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c0c9be64c0 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bb8c4c640 1 -- 172.21.15.169:0/2350516808 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94286506805392] v34'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb00be030 con 0x55c0c9bddf50 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 20 remove_watcher() i=7 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9bddf50 msgr2=0x55c0c9be0340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9bddf50 0x55c0c9be0340 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9bd9560 msgr2=0x55c0c9bdba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.319 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9bd9560 0x55c0c9bdba20 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1ba0037040 msgr2=0x7f1ba0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f1ba0037040 0x7f1ba0036410 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c0c9be2900 msgr2=0x55c0c9be4dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x55c0c9be2900 0x55c0c9be4dc0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a84036900 msgr2=0x7f1a84038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a84036900 0x7f1a84038dc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0001b60 tx=0x7f1ba0010000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bb944d640 1 -- 172.21.15.169:0/2350516808 reap_dead start 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 msgr2=0x55c0c9bcddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1bb008ec50 tx=0x7f1bb005af80 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 shutdown_connections 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2350516808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bc69d0 0x55c0c9bcddc0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 >> 172.21.15.169:0/2350516808 conn(0x55c0c9bc2d30 msgr2=0x55c0c9bc0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 shutdown_connections 2024-04-24T01:26:09.320 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2350516808 wait complete. 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 msgr2=0x7f1a90038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 0x7f1a90038d70 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000bf50 tx=0x7f1ba000f000 comp rx=0 tx=0).stop 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 msgr2=0x55c0c9bb9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0052520 tx=0x7f1bb0067420 comp rx=0 tx=0).stop 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 shutdown_connections 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1a900368b0 0x7f1a90038d70 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 --2- 172.21.15.169:0/2003544181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9bb98b0 0x55c0c9bb9cd0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 >> 172.21.15.169:0/2003544181 conn(0x55c0c9bad950 msgr2=0x55c0c9badd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 shutdown_connections 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.306+0000 7f1bbb146800 1 -- 172.21.15.169:0/2003544181 wait complete. 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9ba4980 msgr2=0x55c0c9ba6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x55c0c9ba4980 0x55c0c9ba6d70 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9aa3200 msgr2=0x55c0c9ba20a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.321 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x55c0c9aa3200 0x55c0c9ba20a0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c0c9ba8910 msgr2=0x55c0c9baad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x55c0c9ba8910 0x55c0c9baad60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1aa0036950 msgr2=0x7f1aa0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1aa0036950 0x7f1aa0038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0000f60 tx=0x7f1ba00012b0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 msgr2=0x55c0c9b9ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 --2- 172.21.15.169:0/3685633177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0c9aa08d0 0x55c0c9b9ae60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0060040 tx=0x7f1bb0002fb0 comp rx=0 tx=0).stop 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bb944d640 1 -- 172.21.15.169:0/3685633177 reap_dead start 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 shutdown_connections 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 >> 172.21.15.169:0/3685633177 conn(0x55c0c9a9a3a0 msgr2=0x55c0c9b8c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 shutdown_connections 2024-04-24T01:26:09.322 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:26:09.307+0000 7f1bbb146800 1 -- 172.21.15.169:0/3685633177 wait complete. 2024-04-24T01:26:09.322 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.323 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-04-24T01:26:07.282790Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-04-24T01:26:07.282771Z', 'tags': [], 'group_ids': []} 2024-04-24T01:26:09.323 ERROR:root:0 2024-04-24T01:26:09.323 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T01:26:09.330 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.330 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.333 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.334 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T01:26:09.339 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.340 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.344 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.344 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-04-24T01:26:09.352 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-04-24T01:26:09.352 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.356 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.356 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-04-24T01:26:09.364 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.368 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.368 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-04-24T01:26:09.375 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-04-24T01:26:09.376 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.380 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.380 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-04-24T01:26:09.387 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-04-24T01:26:09.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.391 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.392 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-04-24T01:26:09.399 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.403 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.403 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-04-24T01:26:09.410 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.414 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-04-24T01:26:09.421 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.425 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.425 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.430 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:26:09.431 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T01:26:09.435 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:26:09.446 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-04-24T01:26:09.450 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-04-24T01:26:09.451 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:26:09.456 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:26:09.442899Z', 'creation_time': '2024-04-24T01:26:09.439943Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:26:09.456 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-04-24T01:26:09.460 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:26:09.442899Z', 'creation_time': '2024-04-24T01:26:09.439943Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-04-24T01:26:09.465 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:26:09.470 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:26:09.442899Z', 'creation_time': '2024-04-24T01:26:09.439943Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:26:09.470 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-04-24T01:26:09.474 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000c94637cc9cdd258e-0066285fb1-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:26:09.479 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-04-24T01:26:09.486 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.486 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-04-24T01:26:09.495 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:26:09.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11'} 2024-04-24T01:26:09.553 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.558 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11'} 2024-04-24T01:26:09.569 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-04-24T01:26:09.578 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.587 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-04-24T01:26:09.595 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:26:09.595 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-04-24T01:26:09.600 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '0d63dfd5-2f76-4ac8-9c68-cc94814f72e9', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'marker': 'f341815c-ea59-4c61-b01b-010b058e6023.4227.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-04-24T01:26:09.564770Z', 'creation_time': '2024-04-24T01:26:09.439943Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-04-24T01:27:09.646 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-04-24T01:27:09.665 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-04-24T01:27:09.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-04-24T01:27:09.680 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-04-24T01:27:09.681 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T01:27:09.686 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-04-24T01:27:09.686 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-04-24T01:27:09.691 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-04-24T01:27:09.691 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-04-24T01:27:09.695 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-04-24T01:27:09.695 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-04-24T01:27:09.701 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-04-24T01:27:09.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-04-24T01:27:09.708 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-04-24T01:00:00.000000Z', 'epoch': 1713920400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-04-24T01:27:09.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-04-24T01:27:09.715 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:09.715 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-04-24T01:27:09.719 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-04-24T01:27:09.719 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-04-24T01:27:09.729 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:27:09.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-04-24T01:27:09.742 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:27:10.007 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T01:27:10.011 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000001baf11cc96b76a4e-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.107 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T01:27:10.111 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T01:27:10.115 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-04-24T01:27:10.120 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-04-24T01:27:10.234 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-04-24T01:27:10.275 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:10.275 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T01:27:10.281 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-04-24T01:27:10.282 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-04-24T01:27:10.287 INFO:tasks.radosgw_admin_rest: json result: [] 2024-04-24T01:27:10.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-04-24T01:27:10.306 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000000c0873becdac3e8e-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.330 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-04-24T01:27:10.358 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:10.359 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-04-24T01:27:10.363 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000a8305bfedd108cc5-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-04-24T01:27:10.367 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'aa5c51fd-2ac5-45d6-b08d-87c82c45b459'}]}} 2024-04-24T01:27:10.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-04-24T01:27:10.377 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-04-24T01:27:10.377 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T01:27:10.381 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:27:10.381 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-04-24T01:27:10.385 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000041ada02e55292142-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.386 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-04-24T01:27:10.389 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000001a560d8625cc190b-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.399 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T01:27:10.402 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:27:10.403 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-04-24T01:27:10.406 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000e9a5081afcddea99-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.407 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-04-24T01:27:10.410 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000fc98e1b7bfb63c6c-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.410 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-04-24T01:27:10.414 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-04-24T01:27:10.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-04-24T01:27:10.418 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000692a084e6868464e-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.418 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-04-24T01:27:10.422 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000080958a0cb0e09c8c-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.422 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-04-24T01:27:10.425 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b2de48dd738d2d30-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.426 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-04-24T01:27:10.429 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000057ff3a7d0ab63ffd-0066285fee-4227-default', 'HostId': '4227-default-default'} 2024-04-24T01:27:10.429 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-04-24T01:27:10.438 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:10.439 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-04-24T01:27:10.442 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-04-24T01:27:10.443 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-04-24T01:27:10.448 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:10.448 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-04-24T01:27:10.451 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-04-24T01:27:10.452 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-04-24T01:27:10.457 INFO:tasks.radosgw_admin_rest: empty result 2024-04-24T01:27:10.461 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-24T01:27:10.473 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-24T01:27:10.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:27:10.474 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-24T01:27:10.473+0000 7f9cd7954640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 34504) UID: 0 2024-04-24T01:27:10.474 INFO:tasks.rgw.client.0.smithi169.stdout:2024-04-24T01:27:10.473+0000 7f9cdd611880 -1 shutting down 2024-04-24T01:27:10.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-24T01:27:16.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2024-04-24T01:27:16.576 INFO:tasks.rgw.client.0:Stopped 2024-04-24T01:27:16.576 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-24T01:27:16.595 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /etc/ceph/vault-root-token 2024-04-24T01:27:16.664 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-24T01:27:16.731 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-24T01:27:16.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-24T01:27:16.731 DEBUG:teuthology.orchestra.run.smithi169:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-24T01:27:16.816 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setuser ceph since I am not root 2024-04-24T01:27:16.816 INFO:teuthology.orchestra.run.smithi169.stderr:ignoring --setgroup ceph since I am not root 2024-04-24T01:27:16.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.816+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.816+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.816+0000 7f39da71f800 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560e8fcce990 0x560e8fcd0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.816+0000 7f39da71f800 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560e8fb8cd40 con 0x560e8fcd12c0 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.816+0000 7f39da71f800 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x560e8fb5f4d0 con 0x560e8fcce990 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d63e7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560e8fcce990 0x560e8fcd0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d63e7640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x560e8fcce990 0x560e8fcd0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57568/0 (socket says 172.21.15.169:57568) 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d63e7640 1 -- 172.21.15.169:0/1700852800 learned_addr learned my addr 172.21.15.169:0/1700852800 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d5be6640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x560e8fcd12c0 0x560e8fcd36b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.169:41226/0 (socket says 172.21.15.169:41226) 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d63e7640 1 -- 172.21.15.169:0/1700852800 >> v1:172.21.15.142:6789/0 conn(0x560e8fcd12c0 legacy=0x560e8fcd36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:16.818 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.817+0000 7f39d63e7640 1 -- 172.21.15.169:0/1700852800 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fb8b590 con 0x560e8fcce990 2024-04-24T01:27:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.819+0000 7f39d63e7640 1 --2- 172.21.15.169:0/1700852800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fcd0d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f39c8005fd0 tx=0x7f39c801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595fe12c65f23ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.819+0000 7f39d53e5640 1 -- 172.21.15.169:0/1700852800 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8052540 con 0x560e8fcce990 2024-04-24T01:27:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.819+0000 7f39d53e5640 1 -- 172.21.15.169:0/1700852800 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c804e070 con 0x560e8fcce990 2024-04-24T01:27:16.820 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.819+0000 7f39d53e5640 1 -- 172.21.15.169:0/1700852800 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8052890 con 0x560e8fcce990 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 -- 172.21.15.169:0/1700852800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 msgr2=0x560e8fcd0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 --2- 172.21.15.169:0/1700852800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fcd0d80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f39c8005fd0 tx=0x7f39c801cd80 comp rx=0 tx=0).stop 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 -- 172.21.15.169:0/1700852800 shutdown_connections 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 --2- 172.21.15.169:0/1700852800 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fcd0d80 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 -- 172.21.15.169:0/1700852800 >> 172.21.15.169:0/1700852800 conn(0x560e8fcc8320 msgr2=0x560e8fcca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 -- 172.21.15.169:0/1700852800 shutdown_connections 2024-04-24T01:27:16.821 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.820+0000 7f39da71f800 1 -- 172.21.15.169:0/1700852800 wait complete. 2024-04-24T01:27:16.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39da71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.834 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39da71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560e8fc193c0 con 0x560e8fcce990 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57584/0 (socket says 172.21.15.169:57584) 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.833+0000 7f39d63e7640 1 -- 172.21.15.169:0/90218902 learned_addr learned my addr 172.21.15.169:0/90218902 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.834+0000 7f39d63e7640 1 -- 172.21.15.169:0/90218902 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fdbf680 con 0x560e8fcce990 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.834+0000 7f39d63e7640 1 --2- 172.21.15.169:0/90218902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f39c8007000 tx=0x7f39c804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695247d48c8c3534 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.834+0000 7f38c4608640 1 -- 172.21.15.169:0/90218902 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8052410 con 0x560e8fcce990 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.834+0000 7f38c4608640 1 -- 172.21.15.169:0/90218902 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8062070 con 0x560e8fcce990 2024-04-24T01:27:16.835 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.834+0000 7f38c4608640 1 -- 172.21.15.169:0/90218902 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8052720 con 0x560e8fcce990 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- 172.21.15.169:0/90218902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 msgr2=0x560e8fdbf0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 --2- 172.21.15.169:0/90218902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f39c8007000 tx=0x7f39c804c000 comp rx=0 tx=0).stop 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- 172.21.15.169:0/90218902 shutdown_connections 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 --2- 172.21.15.169:0/90218902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdbf0b0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- 172.21.15.169:0/90218902 >> 172.21.15.169:0/90218902 conn(0x560e8fcc8320 msgr2=0x560e8fdba9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- 172.21.15.169:0/90218902 shutdown_connections 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- 172.21.15.169:0/90218902 wait complete. 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.839 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdc6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39da71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560e8fcd70e0 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdc6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.835+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdc6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57586/0 (socket says 172.21.15.169:57586) 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f39d63e7640 1 -- 172.21.15.169:0/247743927 learned_addr learned my addr 172.21.15.169:0/247743927 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f39d63e7640 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fdc70a0 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f39d63e7640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdc6b60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f39c805f040 tx=0x7f39c8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f38c2e05640 1 -- 172.21.15.169:0/247743927 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8071570 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f38c2e05640 1 -- 172.21.15.169:0/247743927 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8058040 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e8fdc7330 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f38c2e05640 1 -- 172.21.15.169:0/247743927 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8071860 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.836+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8fdc9fe0 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f38c2e05640 1 -- 172.21.15.169:0/247743927 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39c8050070 con 0x560e8fcce990 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f38c2e05640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38bc036950 0x7f38bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.840 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f38c2e05640 1 -- 172.21.15.169:0/247743927 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39c808e5a0 con 0x560e8fcce990 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f39d5be6640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38bc036950 0x7f38bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fcd12c0 0x560e8fdcdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.837+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fdce320 con 0x560e8fcd12c0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39d6be8640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fcd12c0 0x560e8fdcdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39d5be6640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38bc036950 0x7f38bc038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f60 tx=0x7f39c0001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39d6be8640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fcd12c0 0x560e8fdcdda0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39d6be8640 1 -- 172.21.15.169:0/247743927 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fcd12c0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fdcb350 con 0x560e8fcd12c0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39d6be8640 1 -- 172.21.15.169:0/247743927 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fcd12c0 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fdd0660 0x560e8fdd2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.838+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:3 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fdd3140 con 0x560e8fdd0660 2024-04-24T01:27:16.841 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.839+0000 7f39d63e7640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fdd0660 0x560e8fdd2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.839+0000 7f39d63e7640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fdd0660 0x560e8fdd2a50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39d63e7640 1 -- 172.21.15.169:0/247743927 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(3 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fdd0660 2024-04-24T01:27:16.848 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fdcf610 con 0x560e8fcd12c0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39d6be8640 1 -- 172.21.15.169:0/247743927 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fcd12c0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560e8fdd45a0 0x560e8fdd6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:5 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fdd7170 con 0x560e8fdd45a0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39d5be6640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560e8fdd45a0 0x560e8fdd6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.840+0000 7f39d5be6640 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560e8fdd45a0 0x560e8fdd6a10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39d5be6640 1 -- 172.21.15.169:0/247743927 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(5 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39c000f690 con 0x560e8fdd45a0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39da71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39da71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560e8fbbf6b0 con 0x560e8fde55d0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57598/0 (socket says 172.21.15.169:57598) 2024-04-24T01:27:16.849 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.841+0000 7f39d63e7640 1 -- 172.21.15.169:0/4100826046 learned_addr learned my addr 172.21.15.169:0/4100826046 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f39d63e7640 1 -- 172.21.15.169:0/4100826046 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fde5f30 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f39d63e7640 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f39c808c960 tx=0x7f39c80706d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f38bbfff640 1 -- 172.21.15.169:0/4100826046 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8051da0 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f38bbfff640 1 -- 172.21.15.169:0/4100826046 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8066ae0 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e8fde69a0 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f38bbfff640 1 -- 172.21.15.169:0/4100826046 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8066de0 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.842+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8fde69a0 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.843+0000 7f38bbfff640 1 -- 172.21.15.169:0/4100826046 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39c808b200 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.843+0000 7f38bbfff640 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 0x7f38b0038e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.843+0000 7f38bbfff640 1 -- 172.21.15.169:0/4100826046 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39c8098d10 con 0x560e8fde55d0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.843+0000 7f39d5be6640 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 0x7f38b0038e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.843+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.850 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d5be6640 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 0x7f38b0038e30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x560e8fdcec10 tx=0x7f39c000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39da71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39da71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560e8fdbf940 con 0x560e8fdf2630 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57606/0 (socket says 172.21.15.169:57606) 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d63e7640 1 -- 172.21.15.169:0/997241797 learned_addr learned my addr 172.21.15.169:0/997241797 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d63e7640 1 -- 172.21.15.169:0/997241797 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fdf3000 con 0x560e8fdf2630 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f39d63e7640 1 --2- 172.21.15.169:0/997241797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f39c8090040 tx=0x7f39c8072030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b200e4c2e954ad25 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.844+0000 7f38b9ffb640 1 -- 172.21.15.169:0/997241797 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c80ab070 con 0x560e8fdf2630 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f38b9ffb640 1 -- 172.21.15.169:0/997241797 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c808cba0 con 0x560e8fdf2630 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f38b9ffb640 1 -- 172.21.15.169:0/997241797 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c804c250 con 0x560e8fdf2630 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- 172.21.15.169:0/997241797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 msgr2=0x560e8fdf2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 --2- 172.21.15.169:0/997241797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f39c8090040 tx=0x7f39c8072030 comp rx=0 tx=0).stop 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- 172.21.15.169:0/997241797 shutdown_connections 2024-04-24T01:27:16.851 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 --2- 172.21.15.169:0/997241797 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fdf2a30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- 172.21.15.169:0/997241797 >> 172.21.15.169:0/997241797 conn(0x560e8fdee900 msgr2=0x560e8fdec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- 172.21.15.169:0/997241797 shutdown_connections 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- 172.21.15.169:0/997241797 wait complete. 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 Processor -- start 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.845+0000 7f39da71f800 1 -- start start 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39da71f800 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fcce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39da71f800 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x560e8fdf36f0 con 0x560e8fdf2630 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fcce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39d63e7640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fcce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.169:57610/0 (socket says 172.21.15.169:57610) 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 learned_addr learned my addr 172.21.15.169:0/1658900406 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8fcce770 con 0x560e8fdf2630 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39d63e7640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fcce230 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f39c808cb70 tx=0x7f39c8093ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f38a7fff640 1 -- 172.21.15.169:0/1658900406 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c80ab070 con 0x560e8fdf2630 2024-04-24T01:27:16.852 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f38a7fff640 1 -- 172.21.15.169:0/1658900406 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c80b8070 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e8fcce770 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f38a7fff640 1 -- 172.21.15.169:0/1658900406 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39c8065800 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.846+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e8fcce770 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.847+0000 7f38a7fff640 1 -- 172.21.15.169:0/1658900406 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39c80659c0 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.847+0000 7f38a7fff640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38a0036900 0x7f38a0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.847+0000 7f38a7fff640 1 -- 172.21.15.169:0/1658900406 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f39c80a2070 con 0x560e8fdf2630 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.847+0000 7f39d5be6640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38a0036900 0x7f38a0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39d5be6640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38a0036900 0x7f38a0038dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x560e8fdcf5e0 tx=0x7f39c0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fe071c0 0x560e8fe09680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe09dd0 con 0x560e8fe071c0 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39d6be8640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fe071c0 0x560e8fe09680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.853 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.848+0000 7f39d6be8640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fe071c0 0x560e8fe09680 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fe071c0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 realm 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0a1e0 con 0x560e8fe071c0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fe071c0 2024-04-24T01:27:16.866 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fe071c0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0ae50 con 0x560e8fe071c0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fe071c0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fe0b810 0x560e8fe0dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.849+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:5 5.8 5:15764eac:::zone_info.f341815c-ea59-4c61-b01b-010b058e6023:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0e210 con 0x560e8fe0b810 2024-04-24T01:27:16.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39d63e7640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fe0b810 0x560e8fe0dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39d63e7640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fe0b810 0x560e8fe0dc00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== osd_op_reply(5 zone_info.f341815c-ea59-4c61-b01b-010b058e6023 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39da71f800 20 rados_obj.operate() r=0 bl.length=993 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39da71f800 20 searching for the correct realm 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560e8fe101c0 0x560e8fe12680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe12d50 con 0x560e8fe101c0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.850+0000 7f39d5be6640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560e8fe101c0 0x560e8fe12680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.851+0000 7f39d5be6640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560e8fe101c0 0x560e8fe12680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.851+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.851+0000 7f39d5be6640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39c000f070 0x7f39c002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.851+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe12d50 con 0x7f39c000f070 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.851+0000 7f39d6be8640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39c000f070 0x7f39c002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d6be8640 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39c000f070 0x7f39c002e910 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:16.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== osd_op_reply(7 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d00083e0 con 0x7f39c000f070 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== osd_op_reply(8 [pgnls start_epoch 34 out=107b] v34'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 5 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d00083e0 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.852+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 6 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 7 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 3 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x7f39c000f070 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.853+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 8 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 4 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 9 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.854+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x7f39c000f070 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 3 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 4 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.855+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 5 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 5 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 6 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.856+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v34'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 6 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 7 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x7f39c000f070 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.857+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 12 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 7 ==== osd_op_reply(30 [pgnls start_epoch 34 out=82b] v34'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 8 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.858+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 8 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x7f39c000f070 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 5 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe101c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.872 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe0b810 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 9 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.859+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x560e8fe071c0 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 13 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v34'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0aab0 con 0x7f39c000f070 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 6 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got zone_info.f341815c-ea59-4c61-b01b-010b058e6023 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got default.zone. 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got period_config.default 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-04-24T01:27:16.873 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0ead0 con 0x560e8fe071c0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0ead0 con 0x560e8fe071c0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 15 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.860+0000 7f39da71f800 20 rados_obj.operate() r=0 bl.length=46 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:40 5.6 5:6294b4bb:::zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0ead0 con 0x7f39c000f070 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 7 ==== osd_op_reply(40 zonegroup_info.0d63dfd5-2f76-4ac8-9c68-cc94814f72e9 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 20 rados_obj.operate() r=0 bl.length=436 2024-04-24T01:27:16.874 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 20 zone default found 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 4 Realm: () 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 4 ZoneGroup: default (0d63dfd5-2f76-4ac8-9c68-cc94814f72e9) 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 4 Zone: default (f341815c-ea59-4c61-b01b-010b058e6023) 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 20 zonegroup default 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.861+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe0f3c0 con 0x560e8fe0b810 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 rados_obj.operate() r=0 bl.length=187 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe14bb0 con 0x560e8fe101c0 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.875 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 rados->read ofs=0 len=0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe14f50 con 0x560e8fe101c0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 started sync module instance, tier type = 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 20 started zone id=f341815c-ea59-4c61-b01b-010b058e6023 (name=default) with tier type = 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.862+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe14050 con 0x7f39c000f070 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.863+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 8 ==== osd_op_reply(44 notify.0 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.863+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94620543436112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe14050 con 0x7f39c000f070 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.864+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe15950 con 0x560e8fe071c0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.865+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94620543436112] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.865+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 16 ==== osd_op_reply(46 notify.1 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.865+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94620543439968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe14050 con 0x560e8fe071c0 2024-04-24T01:27:16.876 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.865+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe16360 con 0x560e8fe101c0 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.866+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94620543439968] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.867+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 12 ==== osd_op_reply(48 notify.2 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.867+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94620543433632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe13fc0 con 0x560e8fe101c0 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.867+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe170a0 con 0x7f39c000f070 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.868+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 10 ==== osd_op_reply(50 notify.3 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.881 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.868+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94620543445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe17940 con 0x7f39c000f070 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.868+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe18400 con 0x560e8fe071c0 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.868+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94620543433632] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.869+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94620543445936] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.869+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 18 ==== osd_op_reply(52 notify.4 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.869+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94620543450832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe173a0 con 0x560e8fe071c0 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.869+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe18ca0 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.870+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94620543450832] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.870+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 11 ==== osd_op_reply(54 notify.5 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.870+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94620543453168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe173a0 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.870+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe196a0 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.871+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94620543453168] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.872+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 13 ==== osd_op_reply(56 notify.6 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.882 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.872+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94620543444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe19ef0 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.872+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe1a8b0 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 14 ==== osd_op_reply(58 notify.7 [create] v34'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94620543444736] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94620543460832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe1aff0 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=0 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=1 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=2 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=3 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=4 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=5 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.873+0000 7f39da71f800 20 add_watcher() i=6 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94620543460832] v34'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.883 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39da71f800 20 add_watcher() i=7 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39da71f800 2 all 8 watchers are set, enabling cache 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe19b00 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.874+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94620543462016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe19b00 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.875+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94620543462016] v34'280 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.875+0000 7f388cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.875+0000 7f39da71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.875+0000 7f39da71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.875+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe26860 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.877+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.877+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe26eb0 con 0x560e8fe0b810 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.878+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.878+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe26eb0 con 0x560e8fe101c0 2024-04-24T01:27:16.884 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.879+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.879+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe27990 con 0x560e8fe071c0 2024-04-24T01:27:16.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.880+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'281 uv170 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.880+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe24740 con 0x7f39c000f070 2024-04-24T01:27:16.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.881+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'92 uv59 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.885 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.881+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe24710 con 0x560e8fe101c0 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.882+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'67 uv48 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.882+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe284f0 con 0x560e8fe071c0 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.883+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'40 uv29 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.883+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe0b810 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.884+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'61 uv42 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.884+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x7f39c000f070 2024-04-24T01:27:16.886 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.886+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.886+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe101c0 2024-04-24T01:27:16.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.887+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.887 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.887+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x7f39c000f070 2024-04-24T01:27:16.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.887+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'93 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.888 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.888+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe0b810 2024-04-24T01:27:16.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.889+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'44 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.889 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.889+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x7f39c000f070 2024-04-24T01:27:16.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.890+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.890 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.890+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe0b810 2024-04-24T01:27:16.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.891+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'75 uv54 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.891 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.891+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe071c0 2024-04-24T01:27:16.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.892+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'282 uv172 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.892 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.892+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28ac0 con 0x560e8fe101c0 2024-04-24T01:27:16.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.893+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'83 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.893+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe29000 con 0x7f39c000f070 2024-04-24T01:27:16.894 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.894+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'94 uv64 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.894+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.895+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'43 uv33 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.895 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.895+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe071c0 2024-04-24T01:27:16.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.896+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'41 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.897 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.897+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe071c0 2024-04-24T01:27:16.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.897+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'283 uv168 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.898 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.898+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.899+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'84 uv51 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.899 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.899+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x7f39c000f070 2024-04-24T01:27:16.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.900+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.900 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.900+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.901+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'40 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.901 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.901+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.901+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'49 uv39 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.902 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.902+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.902+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.903 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.902+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.903+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'68 uv46 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.904 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.903+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe0b810 2024-04-24T01:27:16.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.905+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.905 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.905+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.906+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.906 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.906+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe0b810 2024-04-24T01:27:16.907 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.907+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.908 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.907+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe101c0 2024-04-24T01:27:16.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.908+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'85 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.909 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.908+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x560e8fe0b810 2024-04-24T01:27:16.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.909+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'76 uv52 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.909+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe28f80 con 0x7f39c000f070 2024-04-24T01:27:16.910 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.910+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f38077fe640 20 reqs_thread_entry: start 2024-04-24T01:27:16.911 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f39da71f800 20 init_complete bucket index max shards: 11 2024-04-24T01:27:16.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f39da71f800 20 Filter name: none 2024-04-24T01:27:16.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-04-24T01:27:16.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f38057fa640 20 reqs_thread_entry: start 2024-04-24T01:27:16.912 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.911+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:94 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.912+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 26 ==== osd_op_reply(94 gc.23 [call] v34'50 uv50 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.912+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:95 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.913 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.912+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 27 ==== osd_op_reply(95 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.912+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.912+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:96 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 28 ==== osd_op_reply(96 gc.23 [call out=24b] v0'0 uv50 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:97 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 29 ==== osd_op_reply(97 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:98 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 30 ==== osd_op_reply(98 gc.23 [call out=15b] v0'0 uv50 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.913+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:99 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.914+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 31 ==== osd_op_reply(99 gc.23 [call] v34'51 uv51 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.914+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-04-24T01:27:16.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.914+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:100 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 32 ==== osd_op_reply(100 gc.24 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.916 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:101 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 33 ==== osd_op_reply(101 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:102 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 34 ==== osd_op_reply(102 gc.24 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.915+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:103 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 35 ==== osd_op_reply(103 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:104 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 36 ==== osd_op_reply(104 gc.24 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.917 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.916+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:105 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.917+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 37 ==== osd_op_reply(105 gc.24 [call] v34'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.917+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.917+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:106 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 38 ==== osd_op_reply(106 gc.25 [call] v34'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:107 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.919 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 39 ==== osd_op_reply(107 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:108 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 40 ==== osd_op_reply(108 gc.25 [call out=24b] v0'0 uv69 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:109 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 41 ==== osd_op_reply(109 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.918+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:110 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.919+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 42 ==== osd_op_reply(110 gc.25 [call out=15b] v0'0 uv69 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.919+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.920 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.919+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:111 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.920+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 43 ==== osd_op_reply(111 gc.25 [call] v34'70 uv70 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.920+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-04-24T01:27:16.921 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.920+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:112 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.921+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 24 ==== osd_op_reply(112 gc.26 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.921+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:113 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.922+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 25 ==== osd_op_reply(113 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.922+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.922+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:114 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.922 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.922+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 26 ==== osd_op_reply(114 gc.26 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.922+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:115 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 27 ==== osd_op_reply(115 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.923 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:116 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 28 ==== osd_op_reply(116 gc.26 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.924 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.923+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:117 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.925+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 29 ==== osd_op_reply(117 gc.26 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.925+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-04-24T01:27:16.925 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.925+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:118 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 44 ==== osd_op_reply(118 gc.27 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:119 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 45 ==== osd_op_reply(119 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:120 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 46 ==== osd_op_reply(120 gc.27 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:121 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 47 ==== osd_op_reply(121 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.927 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:122 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 48 ==== osd_op_reply(122 gc.27 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.926+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:123 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.927+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 49 ==== osd_op_reply(123 gc.27 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.928 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.927+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-04-24T01:27:16.929 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.927+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:124 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 30 ==== osd_op_reply(124 gc.28 [call] v34'63 uv63 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:125 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.930 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 31 ==== osd_op_reply(125 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:126 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 32 ==== osd_op_reply(126 gc.28 [call out=24b] v0'0 uv63 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.929+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:127 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 33 ==== osd_op_reply(127 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:128 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 34 ==== osd_op_reply(128 gc.28 [call out=15b] v0'0 uv63 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.931 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.930+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:129 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.931+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 35 ==== osd_op_reply(129 gc.28 [call] v34'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.931+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-04-24T01:27:16.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.931+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:130 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.932+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 50 ==== osd_op_reply(130 gc.29 [call] v34'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.932 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.932+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:131 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.932+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 51 ==== osd_op_reply(131 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.932+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.932+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:132 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 52 ==== osd_op_reply(132 gc.29 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:133 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 53 ==== osd_op_reply(133 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0037040 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:134 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.934 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 54 ==== osd_op_reply(134 gc.29 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.933+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:135 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.934+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 55 ==== osd_op_reply(135 gc.29 [call] v34'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.934+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-04-24T01:27:16.935 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.934+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:136 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 36 ==== osd_op_reply(136 gc.30 [call] v34'77 uv77 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:137 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 37 ==== osd_op_reply(137 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:138 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 38 ==== osd_op_reply(138 gc.30 [call out=24b] v0'0 uv77 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.937 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.936+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:139 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 39 ==== osd_op_reply(139 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:140 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 40 ==== osd_op_reply(140 gc.30 [call out=15b] v0'0 uv77 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.937+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:141 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.938+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 41 ==== osd_op_reply(141 gc.30 [call] v34'78 uv78 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.938+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-04-24T01:27:16.939 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.938+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:142 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 19 ==== osd_op_reply(142 gc.31 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:143 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 20 ==== osd_op_reply(143 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:144 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 21 ==== osd_op_reply(144 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.939+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:145 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 22 ==== osd_op_reply(145 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:146 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 23 ==== osd_op_reply(146 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.941 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.940+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:147 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.941+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 24 ==== osd_op_reply(147 gc.31 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.941+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-04-24T01:27:16.942 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.941+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:148 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.942+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 28 ==== osd_op_reply(148 gc.0 [call] v34'64 uv64 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.942+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:149 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 29 ==== osd_op_reply(149 gc.0 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:150 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 30 ==== osd_op_reply(150 gc.0 [call out=24b] v0'0 uv64 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:151 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 31 ==== osd_op_reply(151 gc.0 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:152 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 32 ==== osd_op_reply(152 gc.0 [call out=15b] v0'0 uv64 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.944 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.943+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:153 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.945+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 33 ==== osd_op_reply(153 gc.0 [call] v34'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.945+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-04-24T01:27:16.945 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.945+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:154 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 42 ==== osd_op_reply(154 gc.1 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:155 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 43 ==== osd_op_reply(155 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:156 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 44 ==== osd_op_reply(156 gc.1 [call out=24b] v0'0 uv39 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.947 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:157 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 45 ==== osd_op_reply(157 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.946+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:158 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.947+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 46 ==== osd_op_reply(158 gc.1 [call out=15b] v0'0 uv39 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.947+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.948 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.947+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:159 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.948+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 47 ==== osd_op_reply(159 gc.1 [call] v34'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.948+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.948+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:160 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 56 ==== osd_op_reply(160 gc.2 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:161 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 57 ==== osd_op_reply(161 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:162 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.950 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 58 ==== osd_op_reply(162 gc.2 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:163 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 59 ==== osd_op_reply(163 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.949+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:164 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 60 ==== osd_op_reply(164 gc.2 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.951 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:165 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 61 ==== osd_op_reply(165 gc.2 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.950+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:166 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.951+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 34 ==== osd_op_reply(166 gc.3 [call] v34'284 uv284 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.951+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:167 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 35 ==== osd_op_reply(167 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:168 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 36 ==== osd_op_reply(168 gc.3 [call out=24b] v0'0 uv284 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:169 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 37 ==== osd_op_reply(169 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:170 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 38 ==== osd_op_reply(170 gc.3 [call out=15b] v0'0 uv284 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.952+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:171 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.953+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 39 ==== osd_op_reply(171 gc.3 [call] v34'285 uv285 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.953+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.953+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:172 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.954+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 25 ==== osd_op_reply(172 gc.4 [call] v34'95 uv95 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.954+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:173 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.954+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 26 ==== osd_op_reply(173 gc.4 [call out=15b] v0'0 uv95 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.954+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.954+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:174 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 27 ==== osd_op_reply(174 gc.4 [call out=24b] v0'0 uv95 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:175 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 28 ==== osd_op_reply(175 gc.4 [call out=15b] v0'0 uv95 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:176 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 29 ==== osd_op_reply(176 gc.4 [call out=15b] v0'0 uv95 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.955+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:177 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.956+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 30 ==== osd_op_reply(177 gc.4 [call] v34'96 uv96 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.956+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.956+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:178 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 62 ==== osd_op_reply(178 gc.5 [call] v34'71 uv71 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:179 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 63 ==== osd_op_reply(179 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:180 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 64 ==== osd_op_reply(180 gc.5 [call out=24b] v0'0 uv71 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.957+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:181 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 65 ==== osd_op_reply(181 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:182 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 66 ==== osd_op_reply(182 gc.5 [call out=15b] v0'0 uv71 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.960 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.958+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:183 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.959+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 67 ==== osd_op_reply(183 gc.5 [call] v34'72 uv72 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.959+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.959+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:184 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.960+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 40 ==== osd_op_reply(184 gc.6 [call] v34'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.960+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:185 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.960+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 41 ==== osd_op_reply(185 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.960+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.960+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:186 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 42 ==== osd_op_reply(186 gc.6 [call out=24b] v0'0 uv41 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:187 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 43 ==== osd_op_reply(187 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:188 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 44 ==== osd_op_reply(188 gc.6 [call out=15b] v0'0 uv41 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.961+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:189 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.962+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 45 ==== osd_op_reply(189 gc.6 [call] v34'42 uv42 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.962+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-04-24T01:27:16.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.962+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:190 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 48 ==== osd_op_reply(190 gc.7 [call] v34'65 uv65 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:191 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 49 ==== osd_op_reply(191 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:192 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 50 ==== osd_op_reply(192 gc.7 [call out=24b] v0'0 uv65 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.964+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:193 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 51 ==== osd_op_reply(193 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:194 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 52 ==== osd_op_reply(194 gc.7 [call out=15b] v0'0 uv65 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.965+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:195 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.966+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 53 ==== osd_op_reply(195 gc.7 [call] v34'66 uv66 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.966+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-04-24T01:27:16.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.966+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:196 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.967+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 31 ==== osd_op_reply(196 gc.8 [call] v34'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.967+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:197 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.967+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 32 ==== osd_op_reply(197 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.967+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.967+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:198 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 33 ==== osd_op_reply(198 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:199 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 34 ==== osd_op_reply(199 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:200 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 35 ==== osd_op_reply(200 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.969 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.968+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:201 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.969+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 36 ==== osd_op_reply(201 gc.8 [call] v34'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.970+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-04-24T01:27:16.970 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.970+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:202 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.970+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 68 ==== osd_op_reply(202 gc.9 [call] v34'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.970+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:203 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 69 ==== osd_op_reply(203 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:204 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 70 ==== osd_op_reply(204 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:205 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 71 ==== osd_op_reply(205 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:206 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.972 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 72 ==== osd_op_reply(206 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.973 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.971+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:207 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.972+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 73 ==== osd_op_reply(207 gc.9 [call] v34'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.972+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-04-24T01:27:16.974 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.972+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:208 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.973+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 37 ==== osd_op_reply(208 gc.10 [call] v34'97 uv97 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.973+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:209 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 38 ==== osd_op_reply(209 gc.10 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:210 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 39 ==== osd_op_reply(210 gc.10 [call out=24b] v0'0 uv97 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:211 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 40 ==== osd_op_reply(211 gc.10 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:212 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 41 ==== osd_op_reply(212 gc.10 [call out=15b] v0'0 uv97 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.975 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.974+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:213 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.975+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 42 ==== osd_op_reply(213 gc.10 [call] v34'98 uv98 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.975+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-04-24T01:27:16.976 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.975+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:214 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.976+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 54 ==== osd_op_reply(214 gc.11 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.976+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:215 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 55 ==== osd_op_reply(215 gc.11 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:216 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 56 ==== osd_op_reply(216 gc.11 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:217 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 57 ==== osd_op_reply(217 gc.11 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.978 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.977+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:218 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.978+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 58 ==== osd_op_reply(218 gc.11 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.978+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.978+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:219 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.979+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 59 ==== osd_op_reply(219 gc.11 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.979+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-04-24T01:27:16.979 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.979+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:220 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 43 ==== osd_op_reply(220 gc.12 [call] v34'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:221 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 44 ==== osd_op_reply(221 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:222 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 45 ==== osd_op_reply(222 gc.12 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:223 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 46 ==== osd_op_reply(223 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.981 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.980+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:224 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.981+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 47 ==== osd_op_reply(224 gc.12 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.981+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.981+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:225 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.982+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 48 ==== osd_op_reply(225 gc.12 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.982 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.982+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-04-24T01:27:16.983 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.982+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:226 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 60 ==== osd_op_reply(226 gc.13 [call] v34'79 uv79 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:227 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 61 ==== osd_op_reply(227 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:228 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 62 ==== osd_op_reply(228 gc.13 [call out=24b] v0'0 uv79 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:229 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.984 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 63 ==== osd_op_reply(229 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.983+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.984+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:230 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.984+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 64 ==== osd_op_reply(230 gc.13 [call out=15b] v0'0 uv79 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.984+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.985 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.984+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:231 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe0b810 2024-04-24T01:27:16.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.985+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 65 ==== osd_op_reply(231 gc.13 [call] v34'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:16.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.985+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-04-24T01:27:16.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.985+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:232 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 46 ==== osd_op_reply(232 gc.14 [call] v34'286 uv286 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.986 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:233 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 47 ==== osd_op_reply(233 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:234 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:16.987 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 48 ==== osd_op_reply(234 gc.14 [call out=24b] v0'0 uv286 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.986+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:235 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 49 ==== osd_op_reply(235 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:236 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 50 ==== osd_op_reply(236 gc.14 [call out=15b] v0'0 uv286 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.988 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.987+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:237 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.988+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 51 ==== osd_op_reply(237 gc.14 [call] v34'287 uv287 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.988+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-04-24T01:27:16.989 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.988+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:238 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.989+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 74 ==== osd_op_reply(238 gc.15 [call] v34'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.989+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:239 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.989+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 75 ==== osd_op_reply(239 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.989+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.990 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.989+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:240 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 76 ==== osd_op_reply(240 gc.15 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:241 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 77 ==== osd_op_reply(241 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:242 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 78 ==== osd_op_reply(242 gc.15 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.991 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.990+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:243 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.991+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 79 ==== osd_op_reply(243 gc.15 [call] v34'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.991+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-04-24T01:27:16.992 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.991+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:244 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.992+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 49 ==== osd_op_reply(244 gc.16 [call] v34'99 uv99 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.993 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.992+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:245 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 50 ==== osd_op_reply(245 gc.16 [call out=15b] v0'0 uv99 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:246 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 51 ==== osd_op_reply(246 gc.16 [call out=24b] v0'0 uv99 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:247 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 52 ==== osd_op_reply(247 gc.16 [call out=15b] v0'0 uv99 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:248 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 53 ==== osd_op_reply(248 gc.16 [call out=15b] v0'0 uv99 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.994 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.993+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:249 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.994+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 54 ==== osd_op_reply(249 gc.16 [call] v34'100 uv100 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.994+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-04-24T01:27:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.994+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:250 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.995+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 80 ==== osd_op_reply(250 gc.17 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.996 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.995+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:251 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.995+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 81 ==== osd_op_reply(251 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.995+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.995+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:252 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 82 ==== osd_op_reply(252 gc.17 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:253 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 83 ==== osd_op_reply(253 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:254 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 84 ==== osd_op_reply(254 gc.17 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:16.997 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.996+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:255 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.997+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 85 ==== osd_op_reply(255 gc.17 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.997+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-04-24T01:27:16.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.997+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:256 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.998+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 52 ==== osd_op_reply(256 gc.18 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.998+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:257 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 53 ==== osd_op_reply(257 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:258 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 54 ==== osd_op_reply(258 gc.18 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:259 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 55 ==== osd_op_reply(259 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:260 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.000 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 56 ==== osd_op_reply(260 gc.18 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.001 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:16.999+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:261 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.000+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 57 ==== osd_op_reply(261 gc.18 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.000+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.000+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:262 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.001+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 58 ==== osd_op_reply(262 gc.19 [call] v34'288 uv288 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.001+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:263 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 59 ==== osd_op_reply(263 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:264 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 60 ==== osd_op_reply(264 gc.19 [call out=24b] v0'0 uv288 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:265 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 61 ==== osd_op_reply(265 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.006 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:17.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:266 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 62 ==== osd_op_reply(266 gc.19 [call out=15b] v0'0 uv288 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.007 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.002+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:267 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe071c0 2024-04-24T01:27:17.012 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.003+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 63 ==== osd_op_reply(267 gc.19 [call] v34'289 uv289 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.003+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.003+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:268 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.004+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 86 ==== osd_op_reply(268 gc.20 [call] v34'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.004+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:269 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 87 ==== osd_op_reply(269 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:270 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 88 ==== osd_op_reply(270 gc.20 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:271 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 89 ==== osd_op_reply(271 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:272 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 90 ==== osd_op_reply(272 gc.20 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.013 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.005+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:273 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.006+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 91 ==== osd_op_reply(273 gc.20 [call] v34'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.006+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.006+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:274 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.007+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 55 ==== osd_op_reply(274 gc.21 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.007+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:275 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 56 ==== osd_op_reply(275 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:276 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 57 ==== osd_op_reply(276 gc.21 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:277 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 58 ==== osd_op_reply(277 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:17.014 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:278 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 59 ==== osd_op_reply(278 gc.21 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.008+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:279 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x7f39c000f070 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.009+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 60 ==== osd_op_reply(279 gc.21 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.009+0000 7f39da71f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.009+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:280 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.010+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 92 ==== osd_op_reply(280 gc.22 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.010+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:281 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.010+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 93 ==== osd_op_reply(281 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.010+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.010+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:282 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53e60 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 94 ==== osd_op_reply(282 gc.22 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:283 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.015 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 95 ==== osd_op_reply(283 gc.22 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:284 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe54e70 con 0x560e8fe101c0 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 96 ==== osd_op_reply(284 gc.22 [call out=1716b] v0'0 uv41 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 20 garbage collection: RGWGC::process iterating over entry tag='f341815c-ea59-4c61-b01b-010b058e6023.4227.11878499364362833220', time=2024-04-24T01:27:25.004706+0000, chain.objs.size()=7 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_1 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:285 3.34s0 3:2fe904c6:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe53150 con 0x560e8fe071c0 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_2 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:286 3.1s0 3:83d19f35:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe58070 con 0x560e8fe0b810 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_3 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:287 3.ds0 3:b031a7cb:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe5aa80 con 0x560e8fe101c0 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_4 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:288 3.15s0 3:a8875634:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe5d350 con 0x7f39c000f070 2024-04-24T01:27:17.016 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_5 2024-04-24T01:27:17.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:289 3.20s0 3:068ff81f:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe5aa80 con 0x7f39c000f070 2024-04-24T01:27:17.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_6 2024-04-24T01:27:17.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:290 3.19s0 3:981d1ab0:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe620f0 con 0x560e8fe071c0 2024-04-24T01:27:17.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_7 2024-04-24T01:27:17.017 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.011+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:291 3.36s0 3:6d0e5eac:::f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x7f39c000f070 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.014+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 66 ==== osd_op_reply(286 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_2 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.014+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 97 ==== osd_op_reply(287 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_3 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 64 ==== osd_op_reply(285 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_1 [call] v34'8 uv8 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 61 ==== osd_op_reply(291 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_7 [call] v34'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 62 ==== osd_op_reply(288 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_4 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.018 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 63 ==== osd_op_reply(289 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_5 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 65 ==== osd_op_reply(290 f341815c-ea59-4c61-b01b-010b058e6023.4227.11__shadow_.qa4gF74U9Hg-jzEnzHZ3uuIaSSXAHQa_6 [call] v34'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39da71f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-04-24T01:27:17.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.016+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:292 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe101c0 2024-04-24T01:27:17.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.019+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 98 ==== osd_op_reply(292 gc.22 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.019 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.019+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:293 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe101c0 2024-04-24T01:27:17.020 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.020+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 99 ==== osd_op_reply(293 gc.22 [call] v34'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.021+0000 7f388cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-04-24T01:27:17.021 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.021+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94620543462016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe071c0 2024-04-24T01:27:17.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.022+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94620543462016] v34'290 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.022 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.022+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94620543436112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x7f39c000f070 2024-04-24T01:27:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.023+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94620543436112] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.023+0000 7f39da71f800 20 remove_watcher() i=0 2024-04-24T01:27:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.023+0000 7f39da71f800 2 removed watcher, disabling cache 2024-04-24T01:27:17.023 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.023+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94620543439968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe071c0 2024-04-24T01:27:17.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.024+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94620543439968] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.024+0000 7f39da71f800 20 remove_watcher() i=1 2024-04-24T01:27:17.025 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.024+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94620543433632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe101c0 2024-04-24T01:27:17.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.026+0000 7f39d5be6640 1 -- 172.21.15.169:0/1658900406 <== osd.3 v2:172.21.15.169:6816/1313458488 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94620543433632] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c0054040 con 0x560e8fe101c0 2024-04-24T01:27:17.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.026+0000 7f39da71f800 20 remove_watcher() i=2 2024-04-24T01:27:17.026 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.026+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94620543445936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x7f39c000f070 2024-04-24T01:27:17.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.027+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.2 v2:172.21.15.169:6808/1447817104 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94620543445936] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x7f39c000f070 2024-04-24T01:27:17.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.027+0000 7f39da71f800 20 remove_watcher() i=3 2024-04-24T01:27:17.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.027+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94620543450832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe071c0 2024-04-24T01:27:17.028 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.028+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 <== osd.1 v2:172.21.15.169:6800/461208471 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94620543450832] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d0026040 con 0x560e8fe071c0 2024-04-24T01:27:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.028+0000 7f39da71f800 20 remove_watcher() i=4 2024-04-24T01:27:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.028+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94620543453168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe0b810 2024-04-24T01:27:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.029+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94620543453168] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.029+0000 7f39da71f800 20 remove_watcher() i=5 2024-04-24T01:27:17.029 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.029+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94620543444736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe0b810 2024-04-24T01:27:17.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.030+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94620543444736] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:17.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.030+0000 7f39da71f800 20 remove_watcher() i=6 2024-04-24T01:27:17.030 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.030+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94620543460832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560e8fe64ac0 con 0x560e8fe0b810 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39d63e7640 1 -- 172.21.15.169:0/1658900406 <== osd.0 v2:172.21.15.142:6800/3255114084 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94620543460832] v34'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39c8077020 con 0x560e8fe0b810 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 20 remove_watcher() i=7 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fe0b810 msgr2=0x560e8fe0dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fe0b810 0x560e8fe0dc00 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fe071c0 msgr2=0x560e8fe09680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fe071c0 0x560e8fe09680 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39c000f070 msgr2=0x7f39c002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7f39c000f070 0x7f39c002e910 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.034 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560e8fe101c0 msgr2=0x560e8fe12680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x560e8fe101c0 0x560e8fe12680 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38a0036900 msgr2=0x7f38a0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38a0036900 0x7f38a0038dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x560e8fdcf5e0 tx=0x7f39c0010000 comp rx=0 tx=0).stop 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 msgr2=0x560e8fcce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 --2- 172.21.15.169:0/1658900406 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fdf2630 0x560e8fcce230 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f39c808cb70 tx=0x7f39c8093ee0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 reap_dead start 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39d6be8640 1 -- 172.21.15.169:0/1658900406 reap_dead start 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 shutdown_connections 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 >> 172.21.15.169:0/1658900406 conn(0x560e8fdee900 msgr2=0x560e8fdebf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.031+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 shutdown_connections 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/1658900406 wait complete. 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 msgr2=0x7f38b0038e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 0x7f38b0038e30 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x560e8fdcec10 tx=0x7f39c000f000 comp rx=0 tx=0).stop 2024-04-24T01:27:17.035 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 msgr2=0x560e8fde59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f39c808c960 tx=0x7f39c80706d0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 shutdown_connections 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38b0036970 0x7f38b0038e30 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/4100826046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fde55d0 0x560e8fde59f0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 >> 172.21.15.169:0/4100826046 conn(0x560e8fdd9670 msgr2=0x560e8fdd9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 shutdown_connections 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/4100826046 wait complete. 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fdd0660 msgr2=0x560e8fdd2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x560e8fdd0660 0x560e8fdd2a50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fcd12c0 msgr2=0x560e8fdcdda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x560e8fcd12c0 0x560e8fdcdda0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560e8fdd45a0 msgr2=0x560e8fdd6a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.036 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x560e8fdd45a0 0x560e8fdd6a10 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38bc036950 msgr2=0x7f38bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f38bc036950 0x7f38bc038e10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f39c0000f60 tx=0x7f39c0001370 comp rx=0 tx=0).stop 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 msgr2=0x560e8fdc6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 --2- 172.21.15.169:0/247743927 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560e8fcce990 0x560e8fdc6b60 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f39c805f040 tx=0x7f39c8003330 comp rx=0 tx=0).stop 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39d6be8640 1 -- 172.21.15.169:0/247743927 reap_dead start 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 shutdown_connections 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 >> 172.21.15.169:0/247743927 conn(0x560e8fcc8320 msgr2=0x560e8fdb91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 shutdown_connections 2024-04-24T01:27:17.037 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-24T01:27:17.032+0000 7f39da71f800 1 -- 172.21.15.169:0/247743927 wait complete. 2024-04-24T01:27:17.041 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T01:27:17.050 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T01:27:17.051 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.148+0000 7faf572a5640 1 Processor -- start 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf572a5640 1 -- start start 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf572a5640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf501287d0 0x7faf50130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf572a5640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf50127b00 con 0x7faf50127ce0 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf572a5640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf500708e0 con 0x7faf501287d0 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf54840640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf501287d0 0x7faf50130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf54840640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf501287d0 0x7faf50130360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33476/0 (socket says 172.21.15.142:33476) 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf54840640 1 -- 172.21.15.142:0/771315766 learned_addr learned my addr 172.21.15.142:0/771315766 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf55041640 1 --1- 172.21.15.142:0/771315766 >> v1:172.21.15.142:6789/0 conn(0x7faf50127ce0 0x7faf501280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49160/0 (socket says 172.21.15.142:49160) 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.149+0000 7faf54840640 1 -- 172.21.15.142:0/771315766 >> v1:172.21.15.142:6789/0 conn(0x7faf50127ce0 legacy=0x7faf501280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf47fff640 1 -- 172.21.15.142:0/771315766 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134885134 0 0) 0x7faf48001490 con 0x7faf50127ce0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf54840640 1 -- 172.21.15.142:0/771315766 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf50098800 con 0x7faf501287d0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf54840640 1 --2- 172.21.15.142:0/771315766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf501287d0 0x7faf50130360 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7faf40009820 tx=0x7faf4002db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09d972591e89348 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf47fff640 1 -- 172.21.15.142:0/771315766 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4002f810 con 0x7faf501287d0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf47fff640 1 -- 172.21.15.142:0/771315766 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4002f9b0 con 0x7faf501287d0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.150+0000 7faf47fff640 1 -- 172.21.15.142:0/771315766 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4002fcb0 con 0x7faf501287d0 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 -- 172.21.15.142:0/771315766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf501287d0 msgr2=0x7faf50130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 --2- 172.21.15.142:0/771315766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf501287d0 0x7faf50130360 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7faf40009820 tx=0x7faf4002db20 comp rx=0 tx=0).stop 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 -- 172.21.15.142:0/771315766 shutdown_connections 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 --2- 172.21.15.142:0/771315766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf501287d0 0x7faf50130360 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 -- 172.21.15.142:0/771315766 >> 172.21.15.142:0/771315766 conn(0x7faf50099680 msgr2=0x7faf50099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 -- 172.21.15.142:0/771315766 shutdown_connections 2024-04-24T01:27:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.151+0000 7faf572a5640 1 -- 172.21.15.142:0/771315766 wait complete. 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf572a5640 1 Processor -- start 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf572a5640 1 -- start start 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf572a5640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf572a5640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf5006faa0 con 0x7faf50127ce0 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf55041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf55041640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33486/0 (socket says 172.21.15.142:33486) 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.152+0000 7faf55041640 1 -- 172.21.15.142:0/1245695947 learned_addr learned my addr 172.21.15.142:0/1245695947 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf55041640 1 -- 172.21.15.142:0/1245695947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5008a640 con 0x7faf50127ce0 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf55041640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c790 tx=0x7faf4800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf48018070 con 0x7faf50127ce0 2024-04-24T01:27:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf48004d70 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5008a1a0 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4800a7f0 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.153+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf501249e0 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.154+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf4801b070 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.154+0000 7faf45ffb640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 0x7faf3403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.154+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf4804b160 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.154+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf50062da0 con 0x7faf50127ce0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.154+0000 7faf54840640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 0x7faf3403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.155+0000 7faf54840640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 0x7faf3403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf40038000 tx=0x7faf40008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.159+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7faf50127b00 con 0x7faf50127ce0 2024-04-24T01:27:17.326 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.326+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf50126d30 con 0x7faf34038060 2024-04-24T01:27:17.342 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.341+0000 7faf45ffb640 1 -- 172.21.15.142:0/1245695947 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665959 (secure 0 0 0) 0x7faf50126d30 con 0x7faf34038060 2024-04-24T01:27:17.351 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:17.358 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:27:17.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 msgr2=0x7faf3403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 0x7faf3403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7faf40038000 tx=0x7faf40008030 comp rx=0 tx=0).stop 2024-04-24T01:27:17.360 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 msgr2=0x7faf501244a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c790 tx=0x7faf4800cc50 comp rx=0 tx=0).stop 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 shutdown_connections 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf34038060 0x7faf3403a520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 --2- 172.21.15.142:0/1245695947 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf50127ce0 0x7faf501244a0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 >> 172.21.15.142:0/1245695947 conn(0x7faf50099680 msgr2=0x7faf50096720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 shutdown_connections 2024-04-24T01:27:17.361 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.346+0000 7faf572a5640 1 -- 172.21.15.142:0/1245695947 wait complete. 2024-04-24T01:27:17.362 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-24T01:27:15.962298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":259,"num_object_clones":0,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5161,"num_read_kb":4706,"num_write":2300,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4675,"ondisk_log_size":4675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182032,"kb_used_data":36528,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305328,"statfs":{"total":386547056640,"available":386360655872,"internally_reserved":0,"allocated":37404672,"data_stored":36204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":511,"num_read_kb":466,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004265"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793282+0000","last_change":"2024-04-24T01:23:58.745975+0000","last_active":"2024-04-24T01:24:39.793282+0000","last_peered":"2024-04-24T01:24:39.793282+0000","last_clean":"2024-04-24T01:24:39.793282+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:24:39.793282+0000","last_undegraded":"2024-04-24T01:24:39.793282+0000","last_fullsized":"2024-04-24T01:24:39.793282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261969+0000","last_change":"2024-04-24T01:24:00.745235+0000","last_active":"2024-04-24T01:27:10.261969+0000","last_peered":"2024-04-24T01:27:10.261969+0000","last_clean":"2024-04-24T01:27:10.261969+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:10.261969+0000","last_undegraded":"2024-04-24T01:27:10.261969+0000","last_fullsized":"2024-04-24T01:27:10.261969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:45.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843868+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:24:39.843868+0000","last_peered":"2024-04-24T01:24:39.843868+0000","last_clean":"2024-04-24T01:24:39.843868+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:24:39.843868+0000","last_undegraded":"2024-04-24T01:24:39.843868+0000","last_fullsized":"2024-04-24T01:24:39.843868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:01.751302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.370886+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:24:42.370886+0000","last_peered":"2024-04-24T01:24:42.370886+0000","last_clean":"2024-04-24T01:24:42.370886+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:24:42.370886+0000","last_undegraded":"2024-04-24T01:24:42.370886+0000","last_fullsized":"2024-04-24T01:24:42.370886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:01.873024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794269+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:24:39.794269+0000","last_peered":"2024-04-24T01:24:39.794269+0000","last_clean":"2024-04-24T01:24:39.794269+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:24:39.794269+0000","last_undegraded":"2024-04-24T01:24:39.794269+0000","last_fullsized":"2024-04-24T01:24:39.794269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.373104+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:06.373104+0000","last_peered":"2024-04-24T01:26:06.373104+0000","last_clean":"2024-04-24T01:26:06.373104+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:06.373104+0000","last_undegraded":"2024-04-24T01:26:06.373104+0000","last_fullsized":"2024-04-24T01:26:06.373104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:58.173467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894191+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:24:41.894191+0000","last_peered":"2024-04-24T01:24:41.894191+0000","last_clean":"2024-04-24T01:24:41.894191+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:24:41.894191+0000","last_undegraded":"2024-04-24T01:24:41.894191+0000","last_fullsized":"2024-04-24T01:24:41.894191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370793+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:06.370793+0000","last_peered":"2024-04-24T01:26:06.370793+0000","last_clean":"2024-04-24T01:26:06.370793+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:06.370793+0000","last_undegraded":"2024-04-24T01:26:06.370793+0000","last_fullsized":"2024-04-24T01:26:06.370793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:36.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.966530+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:24:42.966530+0000","last_peered":"2024-04-24T01:24:42.966530+0000","last_clean":"2024-04-24T01:24:42.966530+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:24:42.966530+0000","last_undegraded":"2024-04-24T01:24:42.966530+0000","last_fullsized":"2024-04-24T01:24:42.966530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:46.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262034+0000","last_change":"2024-04-24T01:24:00.739114+0000","last_active":"2024-04-24T01:27:10.262034+0000","last_peered":"2024-04-24T01:27:10.262034+0000","last_clean":"2024-04-24T01:27:10.262034+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:10.262034+0000","last_undegraded":"2024-04-24T01:27:10.262034+0000","last_fullsized":"2024-04-24T01:27:10.262034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:15.071031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789367+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:24:39.789367+0000","last_peered":"2024-04-24T01:24:39.789367+0000","last_clean":"2024-04-24T01:24:39.789367+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:24:39.789367+0000","last_undegraded":"2024-04-24T01:24:39.789367+0000","last_fullsized":"2024-04-24T01:24:39.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:43.987882+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:26:43.987882+0000","last_peered":"2024-04-24T01:26:43.987882+0000","last_clean":"2024-04-24T01:26:43.987882+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:26:43.987882+0000","last_undegraded":"2024-04-24T01:26:43.987882+0000","last_fullsized":"2024-04-24T01:26:43.987882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:44.665563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.249789+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.249789+0000","last_peered":"2024-04-24T01:27:10.249789+0000","last_clean":"2024-04-24T01:27:10.249789+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.249789+0000","last_undegraded":"2024-04-24T01:27:10.249789+0000","last_fullsized":"2024-04-24T01:27:10.249789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:50.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642467+0000","last_change":"2024-04-24T01:24:00.745053+0000","last_active":"2024-04-24T01:26:09.642467+0000","last_peered":"2024-04-24T01:26:09.642467+0000","last_clean":"2024-04-24T01:26:09.642467+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:26:09.642467+0000","last_undegraded":"2024-04-24T01:26:09.642467+0000","last_fullsized":"2024-04-24T01:26:09.642467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841355+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:24:39.841355+0000","last_peered":"2024-04-24T01:24:39.841355+0000","last_clean":"2024-04-24T01:24:39.841355+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:24:39.841355+0000","last_undegraded":"2024-04-24T01:24:39.841355+0000","last_fullsized":"2024-04-24T01:24:39.841355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:59.075615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349980+0000","last_change":"2024-04-24T01:24:00.740054+0000","last_active":"2024-04-24T01:27:10.349980+0000","last_peered":"2024-04-24T01:27:10.349980+0000","last_clean":"2024-04-24T01:27:10.349980+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:10.349980+0000","last_undegraded":"2024-04-24T01:27:10.349980+0000","last_fullsized":"2024-04-24T01:27:10.349980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313995+0000","last_change":"2024-04-24T01:24:00.738224+0000","last_active":"2024-04-24T01:27:10.313995+0000","last_peered":"2024-04-24T01:27:10.313995+0000","last_clean":"2024-04-24T01:27:10.313995+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:10.313995+0000","last_undegraded":"2024-04-24T01:27:10.313995+0000","last_fullsized":"2024-04-24T01:27:10.313995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:35.336241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797425+0000","last_change":"2024-04-24T01:23:58.755611+0000","last_active":"2024-04-24T01:24:39.797425+0000","last_peered":"2024-04-24T01:24:39.797425+0000","last_clean":"2024-04-24T01:24:39.797425+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:24:39.797425+0000","last_undegraded":"2024-04-24T01:24:39.797425+0000","last_fullsized":"2024-04-24T01:24:39.797425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314134+0000","last_change":"2024-04-24T01:24:00.744762+0000","last_active":"2024-04-24T01:27:10.314134+0000","last_peered":"2024-04-24T01:27:10.314134+0000","last_clean":"2024-04-24T01:27:10.314134+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:10.314134+0000","last_undegraded":"2024-04-24T01:27:10.314134+0000","last_fullsized":"2024-04-24T01:27:10.314134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984616+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:26:23.984616+0000","last_peered":"2024-04-24T01:26:23.984616+0000","last_clean":"2024-04-24T01:26:23.984616+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:26:23.984616+0000","last_undegraded":"2024-04-24T01:26:23.984616+0000","last_fullsized":"2024-04-24T01:26:23.984616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984442+0000","last_change":"2024-04-24T01:24:00.745273+0000","last_active":"2024-04-24T01:24:42.984442+0000","last_peered":"2024-04-24T01:24:42.984442+0000","last_clean":"2024-04-24T01:24:42.984442+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:24:42.984442+0000","last_undegraded":"2024-04-24T01:24:42.984442+0000","last_fullsized":"2024-04-24T01:24:42.984442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:11.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.021107+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.021107+0000","last_peered":"2024-04-24T01:27:10.021107+0000","last_clean":"2024-04-24T01:27:10.021107+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.021107+0000","last_undegraded":"2024-04-24T01:27:10.021107+0000","last_fullsized":"2024-04-24T01:27:10.021107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320595+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.320595+0000","last_peered":"2024-04-24T01:27:10.320595+0000","last_clean":"2024-04-24T01:27:10.320595+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.320595+0000","last_undegraded":"2024-04-24T01:27:10.320595+0000","last_fullsized":"2024-04-24T01:27:10.320595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:40:35.960909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.255757+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:10.255757+0000","last_peered":"2024-04-24T01:27:10.255757+0000","last_clean":"2024-04-24T01:27:10.255757+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:10.255757+0000","last_undegraded":"2024-04-24T01:27:10.255757+0000","last_fullsized":"2024-04-24T01:27:10.255757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":39,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.037285+0000","last_change":"2024-04-24T01:24:00.740372+0000","last_active":"2024-04-24T01:27:10.037285+0000","last_peered":"2024-04-24T01:27:10.037285+0000","last_clean":"2024-04-24T01:27:10.037285+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:10.037285+0000","last_undegraded":"2024-04-24T01:27:10.037285+0000","last_fullsized":"2024-04-24T01:27:10.037285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:00.415935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844104+0000","last_change":"2024-04-24T01:23:58.747782+0000","last_active":"2024-04-24T01:24:39.844104+0000","last_peered":"2024-04-24T01:24:39.844104+0000","last_clean":"2024-04-24T01:24:39.844104+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:24:39.844104+0000","last_undegraded":"2024-04-24T01:24:39.844104+0000","last_fullsized":"2024-04-24T01:24:39.844104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:33.918132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349714+0000","last_change":"2024-04-24T01:24:00.744154+0000","last_active":"2024-04-24T01:27:10.349714+0000","last_peered":"2024-04-24T01:27:10.349714+0000","last_clean":"2024-04-24T01:27:10.349714+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:10.349714+0000","last_undegraded":"2024-04-24T01:27:10.349714+0000","last_fullsized":"2024-04-24T01:27:10.349714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:46.325470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.595508+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:09.595508+0000","last_peered":"2024-04-24T01:26:09.595508+0000","last_clean":"2024-04-24T01:26:09.595508+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:09.595508+0000","last_undegraded":"2024-04-24T01:26:09.595508+0000","last_fullsized":"2024-04-24T01:26:09.595508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:14.628366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.287302+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.287302+0000","last_peered":"2024-04-24T01:27:10.287302+0000","last_clean":"2024-04-24T01:27:10.287302+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.287302+0000","last_undegraded":"2024-04-24T01:27:10.287302+0000","last_fullsized":"2024-04-24T01:27:10.287302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:03.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039068+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.039068+0000","last_peered":"2024-04-24T01:27:10.039068+0000","last_clean":"2024-04-24T01:27:10.039068+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.039068+0000","last_undegraded":"2024-04-24T01:27:10.039068+0000","last_fullsized":"2024-04-24T01:27:10.039068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:59.847574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791248+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:24:39.791248+0000","last_peered":"2024-04-24T01:24:39.791248+0000","last_clean":"2024-04-24T01:24:39.791248+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:24:39.791248+0000","last_undegraded":"2024-04-24T01:24:39.791248+0000","last_fullsized":"2024-04-24T01:24:39.791248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:11.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793258+0000","last_change":"2024-04-24T01:24:02.754649+0000","last_active":"2024-04-24T01:24:39.793258+0000","last_peered":"2024-04-24T01:24:39.793258+0000","last_clean":"2024-04-24T01:24:39.793258+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:24:39.793258+0000","last_undegraded":"2024-04-24T01:24:39.793258+0000","last_fullsized":"2024-04-24T01:24:39.793258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:36.231675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.139951+0000","last_change":"2024-04-24T01:24:04.759269+0000","last_active":"2024-04-24T01:26:08.139951+0000","last_peered":"2024-04-24T01:26:08.139951+0000","last_clean":"2024-04-24T01:26:08.139951+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:26:08.139951+0000","last_undegraded":"2024-04-24T01:26:08.139951+0000","last_fullsized":"2024-04-24T01:26:08.139951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:48.568742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797301+0000","last_change":"2024-04-24T01:24:06.771210+0000","last_active":"2024-04-24T01:24:39.797301+0000","last_peered":"2024-04-24T01:24:39.797301+0000","last_clean":"2024-04-24T01:24:39.797301+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:24:39.797301+0000","last_undegraded":"2024-04-24T01:24:39.797301+0000","last_fullsized":"2024-04-24T01:24:39.797301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:42.412982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.649922+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:25:25.649922+0000","last_peered":"2024-04-24T01:25:25.649922+0000","last_clean":"2024-04-24T01:25:25.649922+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:25:25.649922+0000","last_undegraded":"2024-04-24T01:25:25.649922+0000","last_fullsized":"2024-04-24T01:25:25.649922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:32.845545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343531+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.343531+0000","last_peered":"2024-04-24T01:27:10.343531+0000","last_clean":"2024-04-24T01:27:10.343531+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.343531+0000","last_undegraded":"2024-04-24T01:27:10.343531+0000","last_fullsized":"2024-04-24T01:27:10.343531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:11.415544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789109+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:24:39.789109+0000","last_peered":"2024-04-24T01:24:39.789109+0000","last_clean":"2024-04-24T01:24:39.789109+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:24:39.789109+0000","last_undegraded":"2024-04-24T01:24:39.789109+0000","last_fullsized":"2024-04-24T01:24:39.789109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.800415+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:24:39.800415+0000","last_peered":"2024-04-24T01:24:39.800415+0000","last_clean":"2024-04-24T01:24:39.800415+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:24:39.800415+0000","last_undegraded":"2024-04-24T01:24:39.800415+0000","last_fullsized":"2024-04-24T01:24:39.800415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:27.933493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.644975+0000","last_change":"2024-04-24T01:24:04.754457+0000","last_active":"2024-04-24T01:26:09.644975+0000","last_peered":"2024-04-24T01:26:09.644975+0000","last_clean":"2024-04-24T01:26:09.644975+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:26:09.644975+0000","last_undegraded":"2024-04-24T01:26:09.644975+0000","last_fullsized":"2024-04-24T01:26:09.644975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:44.985335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796898+0000","last_change":"2024-04-24T01:24:06.767131+0000","last_active":"2024-04-24T01:24:39.796898+0000","last_peered":"2024-04-24T01:24:39.796898+0000","last_clean":"2024-04-24T01:24:39.796898+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:24:39.796898+0000","last_undegraded":"2024-04-24T01:24:39.796898+0000","last_fullsized":"2024-04-24T01:24:39.796898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:37.537173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841120+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:24:39.841120+0000","last_peered":"2024-04-24T01:24:39.841120+0000","last_clean":"2024-04-24T01:24:39.841120+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:24:39.841120+0000","last_undegraded":"2024-04-24T01:24:39.841120+0000","last_fullsized":"2024-04-24T01:24:39.841120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:30.549905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261903+0000","last_change":"2024-04-24T01:24:00.735337+0000","last_active":"2024-04-24T01:27:10.261903+0000","last_peered":"2024-04-24T01:27:10.261903+0000","last_clean":"2024-04-24T01:27:10.261903+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:10.261903+0000","last_undegraded":"2024-04-24T01:27:10.261903+0000","last_fullsized":"2024-04-24T01:27:10.261903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:23.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.969496+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:24:42.969496+0000","last_peered":"2024-04-24T01:24:42.969496+0000","last_clean":"2024-04-24T01:24:42.969496+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:24:42.969496+0000","last_undegraded":"2024-04-24T01:24:42.969496+0000","last_fullsized":"2024-04-24T01:24:42.969496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:01.497950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844317+0000","last_change":"2024-04-24T01:24:02.754545+0000","last_active":"2024-04-24T01:24:39.844317+0000","last_peered":"2024-04-24T01:24:39.844317+0000","last_clean":"2024-04-24T01:24:39.844317+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:24:39.844317+0000","last_undegraded":"2024-04-24T01:24:39.844317+0000","last_fullsized":"2024-04-24T01:24:39.844317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:28.692526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791153+0000","last_change":"2024-04-24T01:24:04.756975+0000","last_active":"2024-04-24T01:24:39.791153+0000","last_peered":"2024-04-24T01:24:39.791153+0000","last_clean":"2024-04-24T01:24:39.791153+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:24:39.791153+0000","last_undegraded":"2024-04-24T01:24:39.791153+0000","last_fullsized":"2024-04-24T01:24:39.791153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:05.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":421,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831485+0000","last_change":"2024-04-24T01:24:06.766289+0000","last_active":"2024-04-24T01:27:07.831485+0000","last_peered":"2024-04-24T01:27:07.831485+0000","last_clean":"2024-04-24T01:27:07.831485+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:07.831485+0000","last_undegraded":"2024-04-24T01:27:07.831485+0000","last_fullsized":"2024-04-24T01:27:07.831485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:56.567330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.056866+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.056866+0000","last_peered":"2024-04-24T01:27:10.056866+0000","last_clean":"2024-04-24T01:27:10.056866+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.056866+0000","last_undegraded":"2024-04-24T01:27:10.056866+0000","last_fullsized":"2024-04-24T01:27:10.056866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:09:23.826046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984471+0000","last_change":"2024-04-24T01:24:00.746538+0000","last_active":"2024-04-24T01:24:42.984471+0000","last_peered":"2024-04-24T01:24:42.984471+0000","last_clean":"2024-04-24T01:24:42.984471+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:24:42.984471+0000","last_undegraded":"2024-04-24T01:24:42.984471+0000","last_fullsized":"2024-04-24T01:24:42.984471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:42.978833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790051+0000","last_change":"2024-04-24T01:23:58.755957+0000","last_active":"2024-04-24T01:24:39.790051+0000","last_peered":"2024-04-24T01:24:39.790051+0000","last_clean":"2024-04-24T01:24:39.790051+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:24:39.790051+0000","last_undegraded":"2024-04-24T01:24:39.790051+0000","last_fullsized":"2024-04-24T01:24:39.790051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790172+0000","last_change":"2024-04-24T01:24:02.753656+0000","last_active":"2024-04-24T01:24:39.790172+0000","last_peered":"2024-04-24T01:24:39.790172+0000","last_clean":"2024-04-24T01:24:39.790172+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:24:39.790172+0000","last_undegraded":"2024-04-24T01:24:39.790172+0000","last_fullsized":"2024-04-24T01:24:39.790172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:33.516719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.134546+0000","last_change":"2024-04-24T01:24:04.759628+0000","last_active":"2024-04-24T01:26:08.134546+0000","last_peered":"2024-04-24T01:26:08.134546+0000","last_clean":"2024-04-24T01:26:08.134546+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:26:08.134546+0000","last_undegraded":"2024-04-24T01:26:08.134546+0000","last_fullsized":"2024-04-24T01:26:08.134546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:38.198064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.346463+0000","last_change":"2024-04-24T01:24:06.765145+0000","last_active":"2024-04-24T01:27:10.346463+0000","last_peered":"2024-04-24T01:27:10.346463+0000","last_clean":"2024-04-24T01:27:10.346463+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:10.346463+0000","last_undegraded":"2024-04-24T01:27:10.346463+0000","last_fullsized":"2024-04-24T01:27:10.346463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:35.968565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:43.536575+0000","last_change":"2024-04-24T01:24:00.737956+0000","last_active":"2024-04-24T01:24:43.536575+0000","last_peered":"2024-04-24T01:24:43.536575+0000","last_clean":"2024-04-24T01:24:43.536575+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:24:43.536575+0000","last_undegraded":"2024-04-24T01:24:43.536575+0000","last_fullsized":"2024-04-24T01:24:43.536575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:01.856776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793056+0000","last_change":"2024-04-24T01:23:58.744402+0000","last_active":"2024-04-24T01:24:39.793056+0000","last_peered":"2024-04-24T01:24:39.793056+0000","last_clean":"2024-04-24T01:24:39.793056+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:24:39.793056+0000","last_undegraded":"2024-04-24T01:24:39.793056+0000","last_fullsized":"2024-04-24T01:24:39.793056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794002+0000","last_change":"2024-04-24T01:24:02.760212+0000","last_active":"2024-04-24T01:24:39.794002+0000","last_peered":"2024-04-24T01:24:39.794002+0000","last_clean":"2024-04-24T01:24:39.794002+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:24:39.794002+0000","last_undegraded":"2024-04-24T01:24:39.794002+0000","last_fullsized":"2024-04-24T01:24:39.794002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:38.380237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.144588+0000","last_change":"2024-04-24T01:24:04.753455+0000","last_active":"2024-04-24T01:26:08.144588+0000","last_peered":"2024-04-24T01:26:08.144588+0000","last_clean":"2024-04-24T01:26:08.144588+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:26:08.144588+0000","last_undegraded":"2024-04-24T01:26:08.144588+0000","last_fullsized":"2024-04-24T01:26:08.144588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:43.056736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843661+0000","last_change":"2024-04-24T01:24:06.765236+0000","last_active":"2024-04-24T01:24:39.843661+0000","last_peered":"2024-04-24T01:24:39.843661+0000","last_clean":"2024-04-24T01:24:39.843661+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:24:39.843661+0000","last_undegraded":"2024-04-24T01:24:39.843661+0000","last_fullsized":"2024-04-24T01:24:39.843661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:24.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.652091+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:25:25.652091+0000","last_peered":"2024-04-24T01:25:25.652091+0000","last_clean":"2024-04-24T01:25:25.652091+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:25:25.652091+0000","last_undegraded":"2024-04-24T01:25:25.652091+0000","last_fullsized":"2024-04-24T01:25:25.652091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:02.933343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.371033+0000","last_change":"2024-04-24T01:24:00.739375+0000","last_active":"2024-04-24T01:24:42.371033+0000","last_peered":"2024-04-24T01:24:42.371033+0000","last_clean":"2024-04-24T01:24:42.371033+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:24:42.371033+0000","last_undegraded":"2024-04-24T01:24:42.371033+0000","last_fullsized":"2024-04-24T01:24:42.371033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.996880+0000","last_change":"2024-04-24T01:23:58.747337+0000","last_active":"2024-04-24T01:27:09.996880+0000","last_peered":"2024-04-24T01:27:09.996880+0000","last_clean":"2024-04-24T01:27:09.996880+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:09.996880+0000","last_undegraded":"2024-04-24T01:27:09.996880+0000","last_fullsized":"2024-04-24T01:27:09.996880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:52.523923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.270639+0000","last_change":"2024-04-24T01:24:02.754621+0000","last_active":"2024-04-24T01:26:09.270639+0000","last_peered":"2024-04-24T01:26:09.270639+0000","last_clean":"2024-04-24T01:26:09.270639+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:26:09.270639+0000","last_undegraded":"2024-04-24T01:26:09.270639+0000","last_fullsized":"2024-04-24T01:26:09.270639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:50.938939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.124152+0000","last_change":"2024-04-24T01:24:04.757399+0000","last_active":"2024-04-24T01:26:08.124152+0000","last_peered":"2024-04-24T01:26:08.124152+0000","last_clean":"2024-04-24T01:26:08.124152+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:26:08.124152+0000","last_undegraded":"2024-04-24T01:26:08.124152+0000","last_fullsized":"2024-04-24T01:26:08.124152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:32.641634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842244+0000","last_change":"2024-04-24T01:24:06.770235+0000","last_active":"2024-04-24T01:24:39.842244+0000","last_peered":"2024-04-24T01:24:39.842244+0000","last_clean":"2024-04-24T01:24:39.842244+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:24:39.842244+0000","last_undegraded":"2024-04-24T01:24:39.842244+0000","last_fullsized":"2024-04-24T01:24:39.842244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:57.117920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:19.779279+0000","last_change":"2024-04-24T01:24:08.772727+0000","last_active":"2024-04-24T01:25:19.779279+0000","last_peered":"2024-04-24T01:25:19.779279+0000","last_clean":"2024-04-24T01:25:19.779279+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:25:19.779279+0000","last_undegraded":"2024-04-24T01:25:19.779279+0000","last_fullsized":"2024-04-24T01:25:19.779279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:52.582338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642683+0000","last_change":"2024-04-24T01:24:00.740217+0000","last_active":"2024-04-24T01:26:09.642683+0000","last_peered":"2024-04-24T01:26:09.642683+0000","last_clean":"2024-04-24T01:26:09.642683+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:26:09.642683+0000","last_undegraded":"2024-04-24T01:26:09.642683+0000","last_fullsized":"2024-04-24T01:26:09.642683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:44.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983645+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:26:13.983645+0000","last_peered":"2024-04-24T01:26:13.983645+0000","last_clean":"2024-04-24T01:26:13.983645+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:26:13.983645+0000","last_undegraded":"2024-04-24T01:26:13.983645+0000","last_fullsized":"2024-04-24T01:26:13.983645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:57.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842662+0000","last_change":"2024-04-24T01:24:02.755085+0000","last_active":"2024-04-24T01:24:39.842662+0000","last_peered":"2024-04-24T01:24:39.842662+0000","last_clean":"2024-04-24T01:24:39.842662+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:24:39.842662+0000","last_undegraded":"2024-04-24T01:24:39.842662+0000","last_fullsized":"2024-04-24T01:24:39.842662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:00.515637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.146601+0000","last_change":"2024-04-24T01:24:04.760716+0000","last_active":"2024-04-24T01:26:08.146601+0000","last_peered":"2024-04-24T01:26:08.146601+0000","last_clean":"2024-04-24T01:26:08.146601+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:26:08.146601+0000","last_undegraded":"2024-04-24T01:26:08.146601+0000","last_fullsized":"2024-04-24T01:26:08.146601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:02.956787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":376,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.457969+0000","last_change":"2024-04-24T01:24:06.770574+0000","last_active":"2024-04-24T01:27:10.457969+0000","last_peered":"2024-04-24T01:27:10.457969+0000","last_clean":"2024-04-24T01:27:10.457969+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:10.457969+0000","last_undegraded":"2024-04-24T01:27:10.457969+0000","last_fullsized":"2024-04-24T01:27:10.457969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:45:08.995703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842818+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:24:39.842818+0000","last_peered":"2024-04-24T01:24:39.842818+0000","last_clean":"2024-04-24T01:24:39.842818+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:24:39.842818+0000","last_undegraded":"2024-04-24T01:24:39.842818+0000","last_fullsized":"2024-04-24T01:24:39.842818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:07.197054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370607+0000","last_change":"2024-04-24T01:24:00.731534+0000","last_active":"2024-04-24T01:26:06.370607+0000","last_peered":"2024-04-24T01:26:06.370607+0000","last_clean":"2024-04-24T01:26:06.370607+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:26:06.370607+0000","last_undegraded":"2024-04-24T01:26:06.370607+0000","last_fullsized":"2024-04-24T01:26:06.370607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:02.215844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791221+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:24:39.791221+0000","last_peered":"2024-04-24T01:24:39.791221+0000","last_clean":"2024-04-24T01:24:39.791221+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:24:39.791221+0000","last_undegraded":"2024-04-24T01:24:39.791221+0000","last_fullsized":"2024-04-24T01:24:39.791221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:00.208350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841637+0000","last_change":"2024-04-24T01:24:02.754790+0000","last_active":"2024-04-24T01:24:39.841637+0000","last_peered":"2024-04-24T01:24:39.841637+0000","last_clean":"2024-04-24T01:24:39.841637+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:24:39.841637+0000","last_undegraded":"2024-04-24T01:24:39.841637+0000","last_fullsized":"2024-04-24T01:24:39.841637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:34.987188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.148643+0000","last_change":"2024-04-24T01:24:04.761320+0000","last_active":"2024-04-24T01:26:08.148643+0000","last_peered":"2024-04-24T01:26:08.148643+0000","last_clean":"2024-04-24T01:26:08.148643+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:26:08.148643+0000","last_undegraded":"2024-04-24T01:26:08.148643+0000","last_fullsized":"2024-04-24T01:26:08.148643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:36:40.993593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841213+0000","last_change":"2024-04-24T01:24:06.769787+0000","last_active":"2024-04-24T01:24:39.841213+0000","last_peered":"2024-04-24T01:24:39.841213+0000","last_clean":"2024-04-24T01:24:39.841213+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:24:39.841213+0000","last_undegraded":"2024-04-24T01:24:39.841213+0000","last_fullsized":"2024-04-24T01:24:39.841213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:14.938788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.435601+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.435601+0000","last_peered":"2024-04-24T01:27:10.435601+0000","last_clean":"2024-04-24T01:27:10.435601+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.435601+0000","last_undegraded":"2024-04-24T01:27:10.435601+0000","last_fullsized":"2024-04-24T01:27:10.435601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:26.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039360+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.039360+0000","last_peered":"2024-04-24T01:27:10.039360+0000","last_clean":"2024-04-24T01:27:10.039360+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.039360+0000","last_undegraded":"2024-04-24T01:27:10.039360+0000","last_fullsized":"2024-04-24T01:27:10.039360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:50.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894208+0000","last_change":"2024-04-24T01:23:58.747661+0000","last_active":"2024-04-24T01:24:41.894208+0000","last_peered":"2024-04-24T01:24:41.894208+0000","last_clean":"2024-04-24T01:24:41.894208+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:24:41.894208+0000","last_undegraded":"2024-04-24T01:24:41.894208+0000","last_fullsized":"2024-04-24T01:24:41.894208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:15.213886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792715+0000","last_change":"2024-04-24T01:24:02.751285+0000","last_active":"2024-04-24T01:24:39.792715+0000","last_peered":"2024-04-24T01:24:39.792715+0000","last_clean":"2024-04-24T01:24:39.792715+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:24:39.792715+0000","last_undegraded":"2024-04-24T01:24:39.792715+0000","last_fullsized":"2024-04-24T01:24:39.792715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:30.582902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.128326+0000","last_change":"2024-04-24T01:24:04.757977+0000","last_active":"2024-04-24T01:26:08.128326+0000","last_peered":"2024-04-24T01:26:08.128326+0000","last_clean":"2024-04-24T01:26:08.128326+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:26:08.128326+0000","last_undegraded":"2024-04-24T01:26:08.128326+0000","last_fullsized":"2024-04-24T01:26:08.128326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:41.769486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790314+0000","last_change":"2024-04-24T01:24:06.762347+0000","last_active":"2024-04-24T01:24:39.790314+0000","last_peered":"2024-04-24T01:24:39.790314+0000","last_clean":"2024-04-24T01:24:39.790314+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:24:39.790314+0000","last_undegraded":"2024-04-24T01:24:39.790314+0000","last_fullsized":"2024-04-24T01:24:39.790314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:11.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982729+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:26:08.982729+0000","last_peered":"2024-04-24T01:26:08.982729+0000","last_clean":"2024-04-24T01:26:08.982729+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:26:08.982729+0000","last_undegraded":"2024-04-24T01:26:08.982729+0000","last_fullsized":"2024-04-24T01:26:08.982729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:24.366261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642598+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:09.642598+0000","last_peered":"2024-04-24T01:26:09.642598+0000","last_clean":"2024-04-24T01:26:09.642598+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:09.642598+0000","last_undegraded":"2024-04-24T01:26:09.642598+0000","last_fullsized":"2024-04-24T01:26:09.642598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:49.386770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794593+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:24:39.794593+0000","last_peered":"2024-04-24T01:24:39.794593+0000","last_clean":"2024-04-24T01:24:39.794593+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:24:39.794593+0000","last_undegraded":"2024-04-24T01:24:39.794593+0000","last_fullsized":"2024-04-24T01:24:39.794593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:58.408440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842272+0000","last_change":"2024-04-24T01:24:02.754670+0000","last_active":"2024-04-24T01:24:39.842272+0000","last_peered":"2024-04-24T01:24:39.842272+0000","last_clean":"2024-04-24T01:24:39.842272+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:24:39.842272+0000","last_undegraded":"2024-04-24T01:24:39.842272+0000","last_fullsized":"2024-04-24T01:24:39.842272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:43.302766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.155674+0000","last_change":"2024-04-24T01:24:04.752408+0000","last_active":"2024-04-24T01:26:08.155674+0000","last_peered":"2024-04-24T01:26:08.155674+0000","last_clean":"2024-04-24T01:26:08.155674+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:26:08.155674+0000","last_undegraded":"2024-04-24T01:26:08.155674+0000","last_fullsized":"2024-04-24T01:26:08.155674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:05.893512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.439306+0000","last_change":"2024-04-24T01:24:06.768791+0000","last_active":"2024-04-24T01:27:10.439306+0000","last_peered":"2024-04-24T01:27:10.439306+0000","last_clean":"2024-04-24T01:27:10.439306+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:10.439306+0000","last_undegraded":"2024-04-24T01:27:10.439306+0000","last_fullsized":"2024-04-24T01:27:10.439306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:38.429385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974110+0000","last_change":"2024-04-24T01:24:08.768551+0000","last_active":"2024-04-24T01:26:16.974110+0000","last_peered":"2024-04-24T01:26:16.974110+0000","last_clean":"2024-04-24T01:26:16.974110+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:26:16.974110+0000","last_undegraded":"2024-04-24T01:26:16.974110+0000","last_fullsized":"2024-04-24T01:26:16.974110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.067146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343453+0000","last_change":"2024-04-24T01:24:00.740730+0000","last_active":"2024-04-24T01:27:10.343453+0000","last_peered":"2024-04-24T01:27:10.343453+0000","last_clean":"2024-04-24T01:27:10.343453+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:10.343453+0000","last_undegraded":"2024-04-24T01:27:10.343453+0000","last_fullsized":"2024-04-24T01:27:10.343453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.960520+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:24:42.960520+0000","last_peered":"2024-04-24T01:24:42.960520+0000","last_clean":"2024-04-24T01:24:42.960520+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:24:42.960520+0000","last_undegraded":"2024-04-24T01:24:42.960520+0000","last_fullsized":"2024-04-24T01:24:42.960520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:05:27.917471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.280792+0000","last_change":"2024-04-24T01:24:02.755990+0000","last_active":"2024-04-24T01:26:09.280792+0000","last_peered":"2024-04-24T01:26:09.280792+0000","last_clean":"2024-04-24T01:26:09.280792+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:26:09.280792+0000","last_undegraded":"2024-04-24T01:26:09.280792+0000","last_fullsized":"2024-04-24T01:26:09.280792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:13.423016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794664+0000","last_change":"2024-04-24T01:24:04.759964+0000","last_active":"2024-04-24T01:24:39.794664+0000","last_peered":"2024-04-24T01:24:39.794664+0000","last_clean":"2024-04-24T01:24:39.794664+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:24:39.794664+0000","last_undegraded":"2024-04-24T01:24:39.794664+0000","last_fullsized":"2024-04-24T01:24:39.794664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:57.073362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":459,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.398554+0000","last_change":"2024-04-24T01:24:06.769489+0000","last_active":"2024-04-24T01:27:10.398554+0000","last_peered":"2024-04-24T01:27:10.398554+0000","last_clean":"2024-04-24T01:27:10.398554+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:10.398554+0000","last_undegraded":"2024-04-24T01:27:10.398554+0000","last_fullsized":"2024-04-24T01:27:10.398554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:40.252129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.421794+0000","last_change":"2024-04-24T01:24:08.769465+0000","last_active":"2024-04-24T01:26:09.421794+0000","last_peered":"2024-04-24T01:26:09.421794+0000","last_clean":"2024-04-24T01:26:09.421794+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:26:09.421794+0000","last_undegraded":"2024-04-24T01:26:09.421794+0000","last_fullsized":"2024-04-24T01:26:09.421794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:49.696659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124448+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.124448+0000","last_peered":"2024-04-24T01:27:10.124448+0000","last_clean":"2024-04-24T01:27:10.124448+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.124448+0000","last_undegraded":"2024-04-24T01:27:10.124448+0000","last_fullsized":"2024-04-24T01:27:10.124448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:54:42.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790064+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:24:39.790064+0000","last_peered":"2024-04-24T01:24:39.790064+0000","last_clean":"2024-04-24T01:24:39.790064+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:24:39.790064+0000","last_undegraded":"2024-04-24T01:24:39.790064+0000","last_fullsized":"2024-04-24T01:24:39.790064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:51.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790262+0000","last_change":"2024-04-24T01:24:02.753182+0000","last_active":"2024-04-24T01:24:39.790262+0000","last_peered":"2024-04-24T01:24:39.790262+0000","last_clean":"2024-04-24T01:24:39.790262+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:24:39.790262+0000","last_undegraded":"2024-04-24T01:24:39.790262+0000","last_fullsized":"2024-04-24T01:24:39.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:38.392527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'40","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983864+0000","last_change":"2024-04-24T01:24:04.754866+0000","last_active":"2024-04-24T01:26:18.983864+0000","last_peered":"2024-04-24T01:26:18.983864+0000","last_clean":"2024-04-24T01:26:18.983864+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:26:18.983864+0000","last_undegraded":"2024-04-24T01:26:18.983864+0000","last_fullsized":"2024-04-24T01:26:18.983864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:19.241933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790987+0000","last_change":"2024-04-24T01:24:06.767120+0000","last_active":"2024-04-24T01:24:39.790987+0000","last_peered":"2024-04-24T01:24:39.790987+0000","last_clean":"2024-04-24T01:24:39.790987+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:24:39.790987+0000","last_undegraded":"2024-04-24T01:24:39.790987+0000","last_fullsized":"2024-04-24T01:24:39.790987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:09.566148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.375629+0000","last_change":"2024-04-24T01:24:08.772039+0000","last_active":"2024-04-24T01:27:10.375629+0000","last_peered":"2024-04-24T01:27:10.375629+0000","last_clean":"2024-04-24T01:27:10.375629+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:10.375629+0000","last_undegraded":"2024-04-24T01:27:10.375629+0000","last_fullsized":"2024-04-24T01:27:10.375629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:37.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046285+0000","last_change":"2024-04-24T01:24:00.747539+0000","last_active":"2024-04-24T01:27:10.046285+0000","last_peered":"2024-04-24T01:27:10.046285+0000","last_clean":"2024-04-24T01:27:10.046285+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:10.046285+0000","last_undegraded":"2024-04-24T01:27:10.046285+0000","last_fullsized":"2024-04-24T01:27:10.046285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:03.538221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789580+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:24:39.789580+0000","last_peered":"2024-04-24T01:24:39.789580+0000","last_clean":"2024-04-24T01:24:39.789580+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:24:39.789580+0000","last_undegraded":"2024-04-24T01:24:39.789580+0000","last_fullsized":"2024-04-24T01:24:39.789580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792236+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:24:39.792236+0000","last_peered":"2024-04-24T01:24:39.792236+0000","last_clean":"2024-04-24T01:24:39.792236+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:24:39.792236+0000","last_undegraded":"2024-04-24T01:24:39.792236+0000","last_fullsized":"2024-04-24T01:24:39.792236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:15.195026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793836+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:24:39.793836+0000","last_peered":"2024-04-24T01:24:39.793836+0000","last_clean":"2024-04-24T01:24:39.793836+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:24:39.793836+0000","last_undegraded":"2024-04-24T01:24:39.793836+0000","last_fullsized":"2024-04-24T01:24:39.793836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:25.383897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.801934+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:24:39.801934+0000","last_peered":"2024-04-24T01:24:39.801934+0000","last_clean":"2024-04-24T01:24:39.801934+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:24:39.801934+0000","last_undegraded":"2024-04-24T01:24:39.801934+0000","last_fullsized":"2024-04-24T01:24:39.801934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:39.300121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.153261+0000","last_change":"2024-04-24T01:24:04.758941+0000","last_active":"2024-04-24T01:26:08.153261+0000","last_peered":"2024-04-24T01:26:08.153261+0000","last_clean":"2024-04-24T01:26:08.153261+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:26:08.153261+0000","last_undegraded":"2024-04-24T01:26:08.153261+0000","last_fullsized":"2024-04-24T01:26:08.153261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:28.497024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770234+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:03.262620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.353300+0000","last_change":"2024-04-24T01:24:08.768417+0000","last_active":"2024-04-24T01:27:10.353300+0000","last_peered":"2024-04-24T01:27:10.353300+0000","last_clean":"2024-04-24T01:27:10.353300+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:10.353300+0000","last_undegraded":"2024-04-24T01:27:10.353300+0000","last_fullsized":"2024-04-24T01:27:10.353300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:30.971611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'3","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983682+0000","last_change":"2024-04-24T01:24:00.735658+0000","last_active":"2024-04-24T01:26:13.983682+0000","last_peered":"2024-04-24T01:26:13.983682+0000","last_clean":"2024-04-24T01:26:13.983682+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:26:13.983682+0000","last_undegraded":"2024-04-24T01:26:13.983682+0000","last_fullsized":"2024-04-24T01:26:13.983682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:42.397476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789517+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:24:39.789517+0000","last_peered":"2024-04-24T01:24:39.789517+0000","last_clean":"2024-04-24T01:24:39.789517+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:24:39.789517+0000","last_undegraded":"2024-04-24T01:24:39.789517+0000","last_fullsized":"2024-04-24T01:24:39.789517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:48.109200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972617+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:26:06.972617+0000","last_peered":"2024-04-24T01:26:06.972617+0000","last_clean":"2024-04-24T01:26:06.972617+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:26:06.972617+0000","last_undegraded":"2024-04-24T01:26:06.972617+0000","last_fullsized":"2024-04-24T01:26:06.972617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:15.111274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790478+0000","last_change":"2024-04-24T01:24:02.754010+0000","last_active":"2024-04-24T01:24:39.790478+0000","last_peered":"2024-04-24T01:24:39.790478+0000","last_clean":"2024-04-24T01:24:39.790478+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:24:39.790478+0000","last_undegraded":"2024-04-24T01:24:39.790478+0000","last_fullsized":"2024-04-24T01:24:39.790478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:31.372135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831459+0000","last_change":"2024-04-24T01:24:04.762704+0000","last_active":"2024-04-24T01:27:07.831459+0000","last_peered":"2024-04-24T01:27:07.831459+0000","last_clean":"2024-04-24T01:27:07.831459+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:07.831459+0000","last_undegraded":"2024-04-24T01:27:07.831459+0000","last_fullsized":"2024-04-24T01:27:07.831459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:37.274008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792861+0000","last_change":"2024-04-24T01:24:06.760509+0000","last_active":"2024-04-24T01:24:39.792861+0000","last_peered":"2024-04-24T01:24:39.792861+0000","last_clean":"2024-04-24T01:24:39.792861+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:24:39.792861+0000","last_undegraded":"2024-04-24T01:24:39.792861+0000","last_fullsized":"2024-04-24T01:24:39.792861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:08.522687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.647797+0000","last_change":"2024-04-24T01:24:08.773331+0000","last_active":"2024-04-24T01:25:25.647797+0000","last_peered":"2024-04-24T01:25:25.647797+0000","last_clean":"2024-04-24T01:25:25.647797+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:25:25.647797+0000","last_undegraded":"2024-04-24T01:25:25.647797+0000","last_fullsized":"2024-04-24T01:25:25.647797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.429035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261927+0000","last_change":"2024-04-24T01:24:00.746776+0000","last_active":"2024-04-24T01:27:10.261927+0000","last_peered":"2024-04-24T01:27:10.261927+0000","last_clean":"2024-04-24T01:27:10.261927+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:10.261927+0000","last_undegraded":"2024-04-24T01:27:10.261927+0000","last_fullsized":"2024-04-24T01:27:10.261927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:10.175248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789461+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:24:39.789461+0000","last_peered":"2024-04-24T01:24:39.789461+0000","last_clean":"2024-04-24T01:24:39.789461+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:24:39.789461+0000","last_undegraded":"2024-04-24T01:24:39.789461+0000","last_fullsized":"2024-04-24T01:24:39.789461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:09.383332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.840955+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:24:39.840955+0000","last_peered":"2024-04-24T01:24:39.840955+0000","last_clean":"2024-04-24T01:24:39.840955+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:24:39.840955+0000","last_undegraded":"2024-04-24T01:24:39.840955+0000","last_fullsized":"2024-04-24T01:24:39.840955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:24.635245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.281055+0000","last_change":"2024-04-24T01:24:02.752449+0000","last_active":"2024-04-24T01:26:09.281055+0000","last_peered":"2024-04-24T01:26:09.281055+0000","last_clean":"2024-04-24T01:26:09.281055+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:26:09.281055+0000","last_undegraded":"2024-04-24T01:26:09.281055+0000","last_fullsized":"2024-04-24T01:26:09.281055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:25.280491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831477+0000","last_change":"2024-04-24T01:24:04.757333+0000","last_active":"2024-04-24T01:27:07.831477+0000","last_peered":"2024-04-24T01:27:07.831477+0000","last_clean":"2024-04-24T01:27:07.831477+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:07.831477+0000","last_undegraded":"2024-04-24T01:27:07.831477+0000","last_fullsized":"2024-04-24T01:27:07.831477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:05.189769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770584+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:27.982282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790216+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:24:39.790216+0000","last_peered":"2024-04-24T01:24:39.790216+0000","last_clean":"2024-04-24T01:24:39.790216+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:24:39.790216+0000","last_undegraded":"2024-04-24T01:24:39.790216+0000","last_fullsized":"2024-04-24T01:24:39.790216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:30.742533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349653+0000","last_change":"2024-04-24T01:24:00.731982+0000","last_active":"2024-04-24T01:27:10.349653+0000","last_peered":"2024-04-24T01:27:10.349653+0000","last_clean":"2024-04-24T01:27:10.349653+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:10.349653+0000","last_undegraded":"2024-04-24T01:27:10.349653+0000","last_fullsized":"2024-04-24T01:27:10.349653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:01.094309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793490+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:24:39.793490+0000","last_peered":"2024-04-24T01:24:39.793490+0000","last_clean":"2024-04-24T01:24:39.793490+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:24:39.793490+0000","last_undegraded":"2024-04-24T01:24:39.793490+0000","last_fullsized":"2024-04-24T01:24:39.793490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:52.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.618279+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.618279+0000","last_peered":"2024-04-24T01:26:09.618279+0000","last_clean":"2024-04-24T01:26:09.618279+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.618279+0000","last_undegraded":"2024-04-24T01:26:09.618279+0000","last_fullsized":"2024-04-24T01:26:09.618279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842816+0000","last_change":"2024-04-24T01:24:02.751517+0000","last_active":"2024-04-24T01:24:39.842816+0000","last_peered":"2024-04-24T01:24:39.842816+0000","last_clean":"2024-04-24T01:24:39.842816+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:24:39.842816+0000","last_undegraded":"2024-04-24T01:24:39.842816+0000","last_fullsized":"2024-04-24T01:24:39.842816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:05.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.655738+0000","last_change":"2024-04-24T01:24:04.760913+0000","last_active":"2024-04-24T01:27:09.655738+0000","last_peered":"2024-04-24T01:27:09.655738+0000","last_clean":"2024-04-24T01:27:09.655738+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:09.655738+0000","last_undegraded":"2024-04-24T01:27:09.655738+0000","last_fullsized":"2024-04-24T01:27:09.655738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:30.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790734+0000","last_change":"2024-04-24T01:24:06.760113+0000","last_active":"2024-04-24T01:24:39.790734+0000","last_peered":"2024-04-24T01:24:39.790734+0000","last_clean":"2024-04-24T01:24:39.790734+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:24:39.790734+0000","last_undegraded":"2024-04-24T01:24:39.790734+0000","last_fullsized":"2024-04-24T01:24:39.790734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:00.960850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.398901+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:09.398901+0000","last_peered":"2024-04-24T01:26:09.398901+0000","last_clean":"2024-04-24T01:26:09.398901+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:09.398901+0000","last_undegraded":"2024-04-24T01:26:09.398901+0000","last_fullsized":"2024-04-24T01:26:09.398901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:04.383799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040345+0000","last_change":"2024-04-24T01:24:00.742538+0000","last_active":"2024-04-24T01:27:10.040345+0000","last_peered":"2024-04-24T01:27:10.040345+0000","last_clean":"2024-04-24T01:27:10.040345+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:10.040345+0000","last_undegraded":"2024-04-24T01:27:10.040345+0000","last_fullsized":"2024-04-24T01:27:10.040345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:22.605289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.243741+0000","last_change":"2024-04-24T01:23:58.743583+0000","last_active":"2024-04-24T01:27:10.243741+0000","last_peered":"2024-04-24T01:27:10.243741+0000","last_clean":"2024-04-24T01:27:10.243741+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:10.243741+0000","last_undegraded":"2024-04-24T01:27:10.243741+0000","last_fullsized":"2024-04-24T01:27:10.243741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842590+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:24:39.842590+0000","last_peered":"2024-04-24T01:24:39.842590+0000","last_clean":"2024-04-24T01:24:39.842590+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:24:39.842590+0000","last_undegraded":"2024-04-24T01:24:39.842590+0000","last_fullsized":"2024-04-24T01:24:39.842590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:24.173468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972667+0000","last_change":"2024-04-24T01:24:02.750475+0000","last_active":"2024-04-24T01:26:06.972667+0000","last_peered":"2024-04-24T01:26:06.972667+0000","last_clean":"2024-04-24T01:26:06.972667+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:26:06.972667+0000","last_undegraded":"2024-04-24T01:26:06.972667+0000","last_fullsized":"2024-04-24T01:26:06.972667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:41.546855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.154417+0000","last_change":"2024-04-24T01:24:04.759676+0000","last_active":"2024-04-24T01:26:08.154417+0000","last_peered":"2024-04-24T01:26:08.154417+0000","last_clean":"2024-04-24T01:26:08.154417+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:26:08.154417+0000","last_undegraded":"2024-04-24T01:26:08.154417+0000","last_fullsized":"2024-04-24T01:26:08.154417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:49.476095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788138+0000","last_change":"2024-04-24T01:24:06.768799+0000","last_active":"2024-04-24T01:24:39.788138+0000","last_peered":"2024-04-24T01:24:39.788138+0000","last_clean":"2024-04-24T01:24:39.788138+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:24:39.788138+0000","last_undegraded":"2024-04-24T01:24:39.788138+0000","last_fullsized":"2024-04-24T01:24:39.788138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:29.140123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.578357+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:09.578357+0000","last_peered":"2024-04-24T01:26:09.578357+0000","last_clean":"2024-04-24T01:26:09.578357+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:09.578357+0000","last_undegraded":"2024-04-24T01:26:09.578357+0000","last_fullsized":"2024-04-24T01:26:09.578357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:58.022650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269116+0000","last_change":"2024-04-24T01:24:00.740995+0000","last_active":"2024-04-24T01:27:10.269116+0000","last_peered":"2024-04-24T01:27:10.269116+0000","last_clean":"2024-04-24T01:27:10.269116+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:10.269116+0000","last_undegraded":"2024-04-24T01:27:10.269116+0000","last_fullsized":"2024-04-24T01:27:10.269116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:25.504403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843750+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:24:39.843750+0000","last_peered":"2024-04-24T01:24:39.843750+0000","last_clean":"2024-04-24T01:24:39.843750+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:24:39.843750+0000","last_undegraded":"2024-04-24T01:24:39.843750+0000","last_fullsized":"2024-04-24T01:24:39.843750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:33.415474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793649+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:24:39.793649+0000","last_peered":"2024-04-24T01:24:39.793649+0000","last_clean":"2024-04-24T01:24:39.793649+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:24:39.793649+0000","last_undegraded":"2024-04-24T01:24:39.793649+0000","last_fullsized":"2024-04-24T01:24:39.793649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:49:44.621596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793155+0000","last_change":"2024-04-24T01:24:02.753858+0000","last_active":"2024-04-24T01:24:39.793155+0000","last_peered":"2024-04-24T01:24:39.793155+0000","last_clean":"2024-04-24T01:24:39.793155+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:24:39.793155+0000","last_undegraded":"2024-04-24T01:24:39.793155+0000","last_fullsized":"2024-04-24T01:24:39.793155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:56.906730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794508+0000","last_change":"2024-04-24T01:24:04.761717+0000","last_active":"2024-04-24T01:24:39.794508+0000","last_peered":"2024-04-24T01:24:39.794508+0000","last_clean":"2024-04-24T01:24:39.794508+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:24:39.794508+0000","last_undegraded":"2024-04-24T01:24:39.794508+0000","last_fullsized":"2024-04-24T01:24:39.794508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.225449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":356,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448921+0000","last_change":"2024-04-24T01:24:06.769511+0000","last_active":"2024-04-24T01:27:10.448921+0000","last_peered":"2024-04-24T01:27:10.448921+0000","last_clean":"2024-04-24T01:27:10.448921+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:10.448921+0000","last_undegraded":"2024-04-24T01:27:10.448921+0000","last_fullsized":"2024-04-24T01:27:10.448921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:27.014536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.876452+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:25:25.876452+0000","last_peered":"2024-04-24T01:25:25.876452+0000","last_clean":"2024-04-24T01:25:25.876452+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:25:25.876452+0000","last_undegraded":"2024-04-24T01:25:25.876452+0000","last_fullsized":"2024-04-24T01:25:25.876452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.793963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791495+0000","last_change":"2024-04-24T01:24:00.748141+0000","last_active":"2024-04-24T01:24:39.791495+0000","last_peered":"2024-04-24T01:24:39.791495+0000","last_clean":"2024-04-24T01:24:39.791495+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:24:39.791495+0000","last_undegraded":"2024-04-24T01:24:39.791495+0000","last_fullsized":"2024-04-24T01:24:39.791495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:01.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791804+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:24:39.791804+0000","last_peered":"2024-04-24T01:24:39.791804+0000","last_clean":"2024-04-24T01:24:39.791804+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:24:39.791804+0000","last_undegraded":"2024-04-24T01:24:39.791804+0000","last_fullsized":"2024-04-24T01:24:39.791804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:42.186635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843585+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:24:39.843585+0000","last_peered":"2024-04-24T01:24:39.843585+0000","last_clean":"2024-04-24T01:24:39.843585+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:24:39.843585+0000","last_undegraded":"2024-04-24T01:24:39.843585+0000","last_fullsized":"2024-04-24T01:24:39.843585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.744197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.799913+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:24:39.799913+0000","last_peered":"2024-04-24T01:24:39.799913+0000","last_clean":"2024-04-24T01:24:39.799913+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:24:39.799913+0000","last_undegraded":"2024-04-24T01:24:39.799913+0000","last_fullsized":"2024-04-24T01:24:39.799913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.029820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794303+0000","last_change":"2024-04-24T01:24:04.761597+0000","last_active":"2024-04-24T01:24:39.794303+0000","last_peered":"2024-04-24T01:24:39.794303+0000","last_clean":"2024-04-24T01:24:39.794303+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:24:39.794303+0000","last_undegraded":"2024-04-24T01:24:39.794303+0000","last_fullsized":"2024-04-24T01:24:39.794303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:04.640275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.436168+0000","last_change":"2024-04-24T01:24:06.765101+0000","last_active":"2024-04-24T01:27:10.436168+0000","last_peered":"2024-04-24T01:27:10.436168+0000","last_clean":"2024-04-24T01:27:10.436168+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:10.436168+0000","last_undegraded":"2024-04-24T01:27:10.436168+0000","last_fullsized":"2024-04-24T01:27:10.436168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:06.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797965+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:24:39.797965+0000","last_peered":"2024-04-24T01:24:39.797965+0000","last_clean":"2024-04-24T01:24:39.797965+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:24:39.797965+0000","last_undegraded":"2024-04-24T01:24:39.797965+0000","last_fullsized":"2024-04-24T01:24:39.797965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:06.970384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.038450+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.038450+0000","last_peered":"2024-04-24T01:27:10.038450+0000","last_clean":"2024-04-24T01:27:10.038450+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.038450+0000","last_undegraded":"2024-04-24T01:27:10.038450+0000","last_fullsized":"2024-04-24T01:27:10.038450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.048730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797039+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:24:39.797039+0000","last_peered":"2024-04-24T01:24:39.797039+0000","last_clean":"2024-04-24T01:24:39.797039+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:24:39.797039+0000","last_undegraded":"2024-04-24T01:24:39.797039+0000","last_fullsized":"2024-04-24T01:24:39.797039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794665+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:24:39.794665+0000","last_peered":"2024-04-24T01:24:39.794665+0000","last_clean":"2024-04-24T01:24:39.794665+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:24:39.794665+0000","last_undegraded":"2024-04-24T01:24:39.794665+0000","last_fullsized":"2024-04-24T01:24:39.794665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.535319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789366+0000","last_change":"2024-04-24T01:24:02.755458+0000","last_active":"2024-04-24T01:24:39.789366+0000","last_peered":"2024-04-24T01:24:39.789366+0000","last_clean":"2024-04-24T01:24:39.789366+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:24:39.789366+0000","last_undegraded":"2024-04-24T01:24:39.789366+0000","last_fullsized":"2024-04-24T01:24:39.789366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:22.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.138976+0000","last_change":"2024-04-24T01:24:04.761852+0000","last_active":"2024-04-24T01:26:08.138976+0000","last_peered":"2024-04-24T01:26:08.138976+0000","last_clean":"2024-04-24T01:26:08.138976+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:26:08.138976+0000","last_undegraded":"2024-04-24T01:26:08.138976+0000","last_fullsized":"2024-04-24T01:26:08.138976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:40.393254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841291+0000","last_change":"2024-04-24T01:24:06.769694+0000","last_active":"2024-04-24T01:24:39.841291+0000","last_peered":"2024-04-24T01:24:39.841291+0000","last_clean":"2024-04-24T01:24:39.841291+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:24:39.841291+0000","last_undegraded":"2024-04-24T01:24:39.841291+0000","last_fullsized":"2024-04-24T01:24:39.841291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:24.633566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.127833+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.127833+0000","last_peered":"2024-04-24T01:27:10.127833+0000","last_clean":"2024-04-24T01:27:10.127833+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.127833+0000","last_undegraded":"2024-04-24T01:27:10.127833+0000","last_fullsized":"2024-04-24T01:27:10.127833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:29.020694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792868+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:24:39.792868+0000","last_peered":"2024-04-24T01:24:39.792868+0000","last_clean":"2024-04-24T01:24:39.792868+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:24:39.792868+0000","last_undegraded":"2024-04-24T01:24:39.792868+0000","last_fullsized":"2024-04-24T01:24:39.792868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:40.801219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984452+0000","last_change":"2024-04-24T01:24:00.738356+0000","last_active":"2024-04-24T01:26:23.984452+0000","last_peered":"2024-04-24T01:26:23.984452+0000","last_clean":"2024-04-24T01:26:23.984452+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:26:23.984452+0000","last_undegraded":"2024-04-24T01:26:23.984452+0000","last_fullsized":"2024-04-24T01:26:23.984452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:27.391392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791345+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:24:39.791345+0000","last_peered":"2024-04-24T01:24:39.791345+0000","last_clean":"2024-04-24T01:24:39.791345+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:24:39.791345+0000","last_undegraded":"2024-04-24T01:24:39.791345+0000","last_fullsized":"2024-04-24T01:24:39.791345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:47.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795254+0000","last_change":"2024-04-24T01:24:02.754871+0000","last_active":"2024-04-24T01:24:39.795254+0000","last_peered":"2024-04-24T01:24:39.795254+0000","last_clean":"2024-04-24T01:24:39.795254+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:24:39.795254+0000","last_undegraded":"2024-04-24T01:24:39.795254+0000","last_fullsized":"2024-04-24T01:24:39.795254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:06.026635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985063+0000","last_change":"2024-04-24T01:24:04.759052+0000","last_active":"2024-04-24T01:26:23.985063+0000","last_peered":"2024-04-24T01:26:23.985063+0000","last_clean":"2024-04-24T01:26:23.985063+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:26:23.985063+0000","last_undegraded":"2024-04-24T01:26:23.985063+0000","last_fullsized":"2024-04-24T01:26:23.985063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:10.084623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792919+0000","last_change":"2024-04-24T01:24:06.767554+0000","last_active":"2024-04-24T01:24:39.792919+0000","last_peered":"2024-04-24T01:24:39.792919+0000","last_clean":"2024-04-24T01:24:39.792919+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:24:39.792919+0000","last_undegraded":"2024-04-24T01:24:39.792919+0000","last_fullsized":"2024-04-24T01:24:39.792919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.395728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.739765+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:09.739765+0000","last_peered":"2024-04-24T01:27:09.739765+0000","last_clean":"2024-04-24T01:27:09.739765+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:09.739765+0000","last_undegraded":"2024-04-24T01:27:09.739765+0000","last_fullsized":"2024-04-24T01:27:09.739765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:31.337496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314081+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.314081+0000","last_peered":"2024-04-24T01:27:10.314081+0000","last_clean":"2024-04-24T01:27:10.314081+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.314081+0000","last_undegraded":"2024-04-24T01:27:10.314081+0000","last_fullsized":"2024-04-24T01:27:10.314081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984537+0000","last_change":"2024-04-24T01:23:58.742514+0000","last_active":"2024-04-24T01:26:23.984537+0000","last_peered":"2024-04-24T01:26:23.984537+0000","last_clean":"2024-04-24T01:26:23.984537+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:26:23.984537+0000","last_undegraded":"2024-04-24T01:26:23.984537+0000","last_fullsized":"2024-04-24T01:26:23.984537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792781+0000","last_change":"2024-04-24T01:24:02.753260+0000","last_active":"2024-04-24T01:24:39.792781+0000","last_peered":"2024-04-24T01:24:39.792781+0000","last_clean":"2024-04-24T01:24:39.792781+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:24:39.792781+0000","last_undegraded":"2024-04-24T01:24:39.792781+0000","last_fullsized":"2024-04-24T01:24:39.792781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:34.774605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.660299+0000","last_change":"2024-04-24T01:24:04.746990+0000","last_active":"2024-04-24T01:27:09.660299+0000","last_peered":"2024-04-24T01:27:09.660299+0000","last_clean":"2024-04-24T01:27:09.660299+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:09.660299+0000","last_undegraded":"2024-04-24T01:27:09.660299+0000","last_fullsized":"2024-04-24T01:27:09.660299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:37.157422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789266+0000","last_change":"2024-04-24T01:24:06.763815+0000","last_active":"2024-04-24T01:24:39.789266+0000","last_peered":"2024-04-24T01:24:39.789266+0000","last_clean":"2024-04-24T01:24:39.789266+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:24:39.789266+0000","last_undegraded":"2024-04-24T01:24:39.789266+0000","last_fullsized":"2024-04-24T01:24:39.789266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:48.425403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.639815+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:09.639815+0000","last_peered":"2024-04-24T01:26:09.639815+0000","last_clean":"2024-04-24T01:26:09.639815+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:09.639815+0000","last_undegraded":"2024-04-24T01:26:09.639815+0000","last_fullsized":"2024-04-24T01:26:09.639815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:43.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974876+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:26:21.974876+0000","last_peered":"2024-04-24T01:26:21.974876+0000","last_clean":"2024-04-24T01:26:21.974876+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:26:21.974876+0000","last_undegraded":"2024-04-24T01:26:21.974876+0000","last_fullsized":"2024-04-24T01:26:21.974876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:50.598466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793735+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:24:39.793735+0000","last_peered":"2024-04-24T01:24:39.793735+0000","last_clean":"2024-04-24T01:24:39.793735+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:24:39.793735+0000","last_undegraded":"2024-04-24T01:24:39.793735+0000","last_fullsized":"2024-04-24T01:24:39.793735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:26.434050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788571+0000","last_change":"2024-04-24T01:24:02.751458+0000","last_active":"2024-04-24T01:24:39.788571+0000","last_peered":"2024-04-24T01:24:39.788571+0000","last_clean":"2024-04-24T01:24:39.788571+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:24:39.788571+0000","last_undegraded":"2024-04-24T01:24:39.788571+0000","last_fullsized":"2024-04-24T01:24:39.788571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:42.145688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.352141+0000","last_change":"2024-04-24T01:24:04.755755+0000","last_active":"2024-04-24T01:27:10.352141+0000","last_peered":"2024-04-24T01:27:10.352141+0000","last_clean":"2024-04-24T01:27:10.352141+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:10.352141+0000","last_undegraded":"2024-04-24T01:27:10.352141+0000","last_fullsized":"2024-04-24T01:27:10.352141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:33.640976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795040+0000","last_change":"2024-04-24T01:24:06.769210+0000","last_active":"2024-04-24T01:24:39.795040+0000","last_peered":"2024-04-24T01:24:39.795040+0000","last_clean":"2024-04-24T01:24:39.795040+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:24:39.795040+0000","last_undegraded":"2024-04-24T01:24:39.795040+0000","last_fullsized":"2024-04-24T01:24:39.795040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:03.675110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790701+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:24:39.790701+0000","last_peered":"2024-04-24T01:24:39.790701+0000","last_clean":"2024-04-24T01:24:39.790701+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:24:39.790701+0000","last_undegraded":"2024-04-24T01:24:39.790701+0000","last_fullsized":"2024-04-24T01:24:39.790701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:18.860876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313998+0000","last_change":"2024-04-24T01:24:00.748273+0000","last_active":"2024-04-24T01:27:10.313998+0000","last_peered":"2024-04-24T01:27:10.313998+0000","last_clean":"2024-04-24T01:27:10.313998+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:10.313998+0000","last_undegraded":"2024-04-24T01:27:10.313998+0000","last_fullsized":"2024-04-24T01:27:10.313998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:39.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.349714+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:24:42.349714+0000","last_peered":"2024-04-24T01:24:42.349714+0000","last_clean":"2024-04-24T01:24:42.349714+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:24:42.349714+0000","last_undegraded":"2024-04-24T01:24:42.349714+0000","last_fullsized":"2024-04-24T01:24:42.349714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:55.545071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794708+0000","last_change":"2024-04-24T01:24:02.753232+0000","last_active":"2024-04-24T01:24:39.794708+0000","last_peered":"2024-04-24T01:24:39.794708+0000","last_clean":"2024-04-24T01:24:39.794708+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:24:39.794708+0000","last_undegraded":"2024-04-24T01:24:39.794708+0000","last_fullsized":"2024-04-24T01:24:39.794708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:59.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.130351+0000","last_change":"2024-04-24T01:24:04.749427+0000","last_active":"2024-04-24T01:26:08.130351+0000","last_peered":"2024-04-24T01:26:08.130351+0000","last_clean":"2024-04-24T01:26:08.130351+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:26:08.130351+0000","last_undegraded":"2024-04-24T01:26:08.130351+0000","last_fullsized":"2024-04-24T01:26:08.130351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:20.707833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790257+0000","last_change":"2024-04-24T01:24:06.765858+0000","last_active":"2024-04-24T01:24:39.790257+0000","last_peered":"2024-04-24T01:24:39.790257+0000","last_clean":"2024-04-24T01:24:39.790257+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:24:39.790257+0000","last_undegraded":"2024-04-24T01:24:39.790257+0000","last_fullsized":"2024-04-24T01:24:39.790257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:41.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.712721+0000","last_change":"2024-04-24T01:24:00.736176+0000","last_active":"2024-04-24T01:24:42.712721+0000","last_peered":"2024-04-24T01:24:42.712721+0000","last_clean":"2024-04-24T01:24:42.712721+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:24:42.712721+0000","last_undegraded":"2024-04-24T01:24:42.712721+0000","last_fullsized":"2024-04-24T01:24:42.712721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:43.962305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789625+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:24:39.789625+0000","last_peered":"2024-04-24T01:24:39.789625+0000","last_clean":"2024-04-24T01:24:39.789625+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:24:39.789625+0000","last_undegraded":"2024-04-24T01:24:39.789625+0000","last_fullsized":"2024-04-24T01:24:39.789625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843577+0000","last_change":"2024-04-24T01:24:02.752935+0000","last_active":"2024-04-24T01:24:39.843577+0000","last_peered":"2024-04-24T01:24:39.843577+0000","last_clean":"2024-04-24T01:24:39.843577+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:24:39.843577+0000","last_undegraded":"2024-04-24T01:24:39.843577+0000","last_fullsized":"2024-04-24T01:24:39.843577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:47:05.280503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.152050+0000","last_change":"2024-04-24T01:24:04.754439+0000","last_active":"2024-04-24T01:26:08.152050+0000","last_peered":"2024-04-24T01:26:08.152050+0000","last_clean":"2024-04-24T01:26:08.152050+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:26:08.152050+0000","last_undegraded":"2024-04-24T01:26:08.152050+0000","last_fullsized":"2024-04-24T01:26:08.152050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:32.262142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790895+0000","last_change":"2024-04-24T01:24:06.765083+0000","last_active":"2024-04-24T01:24:39.790895+0000","last_peered":"2024-04-24T01:24:39.790895+0000","last_clean":"2024-04-24T01:24:39.790895+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:24:39.790895+0000","last_undegraded":"2024-04-24T01:24:39.790895+0000","last_fullsized":"2024-04-24T01:24:39.790895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:11.672040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.396373+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.396373+0000","last_peered":"2024-04-24T01:27:10.396373+0000","last_clean":"2024-04-24T01:27:10.396373+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.396373+0000","last_undegraded":"2024-04-24T01:27:10.396373+0000","last_fullsized":"2024-04-24T01:27:10.396373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:59.796477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314066+0000","last_change":"2024-04-24T01:24:00.746542+0000","last_active":"2024-04-24T01:27:10.314066+0000","last_peered":"2024-04-24T01:27:10.314066+0000","last_clean":"2024-04-24T01:27:10.314066+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:10.314066+0000","last_undegraded":"2024-04-24T01:27:10.314066+0000","last_fullsized":"2024-04-24T01:27:10.314066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:34:54.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984466+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:26:23.984466+0000","last_peered":"2024-04-24T01:26:23.984466+0000","last_clean":"2024-04-24T01:26:23.984466+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:26:23.984466+0000","last_undegraded":"2024-04-24T01:26:23.984466+0000","last_fullsized":"2024-04-24T01:26:23.984466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793348+0000","last_change":"2024-04-24T01:24:02.750800+0000","last_active":"2024-04-24T01:24:39.793348+0000","last_peered":"2024-04-24T01:24:39.793348+0000","last_clean":"2024-04-24T01:24:39.793348+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:24:39.793348+0000","last_undegraded":"2024-04-24T01:24:39.793348+0000","last_fullsized":"2024-04-24T01:24:39.793348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:37.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.131427+0000","last_change":"2024-04-24T01:24:04.758945+0000","last_active":"2024-04-24T01:26:08.131427+0000","last_peered":"2024-04-24T01:26:08.131427+0000","last_clean":"2024-04-24T01:26:08.131427+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:26:08.131427+0000","last_undegraded":"2024-04-24T01:26:08.131427+0000","last_fullsized":"2024-04-24T01:26:08.131427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:50.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796689+0000","last_change":"2024-04-24T01:24:06.771761+0000","last_active":"2024-04-24T01:24:39.796689+0000","last_peered":"2024-04-24T01:24:39.796689+0000","last_clean":"2024-04-24T01:24:39.796689+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:24:39.796689+0000","last_undegraded":"2024-04-24T01:24:39.796689+0000","last_fullsized":"2024-04-24T01:24:39.796689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:35.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792017+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:24:39.792017+0000","last_peered":"2024-04-24T01:24:39.792017+0000","last_clean":"2024-04-24T01:24:39.792017+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:24:39.792017+0000","last_undegraded":"2024-04-24T01:24:39.792017+0000","last_fullsized":"2024-04-24T01:24:39.792017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:33.305911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794785+0000","last_change":"2024-04-24T01:24:00.748328+0000","last_active":"2024-04-24T01:24:39.794785+0000","last_peered":"2024-04-24T01:24:39.794785+0000","last_clean":"2024-04-24T01:24:39.794785+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:24:39.794785+0000","last_undegraded":"2024-04-24T01:24:39.794785+0000","last_fullsized":"2024-04-24T01:24:39.794785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:32.401459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795365+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:24:39.795365+0000","last_peered":"2024-04-24T01:24:39.795365+0000","last_clean":"2024-04-24T01:24:39.795365+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:24:39.795365+0000","last_undegraded":"2024-04-24T01:24:39.795365+0000","last_fullsized":"2024-04-24T01:24:39.795365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791825+0000","last_change":"2024-04-24T01:24:02.751213+0000","last_active":"2024-04-24T01:24:39.791825+0000","last_peered":"2024-04-24T01:24:39.791825+0000","last_clean":"2024-04-24T01:24:39.791825+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:24:39.791825+0000","last_undegraded":"2024-04-24T01:24:39.791825+0000","last_fullsized":"2024-04-24T01:24:39.791825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:17.078503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.150009+0000","last_change":"2024-04-24T01:24:04.759228+0000","last_active":"2024-04-24T01:26:08.150009+0000","last_peered":"2024-04-24T01:26:08.150009+0000","last_clean":"2024-04-24T01:26:08.150009+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:26:08.150009+0000","last_undegraded":"2024-04-24T01:26:08.150009+0000","last_fullsized":"2024-04-24T01:26:08.150009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:35.649948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842771+0000","last_change":"2024-04-24T01:24:06.767031+0000","last_active":"2024-04-24T01:24:39.842771+0000","last_peered":"2024-04-24T01:24:39.842771+0000","last_clean":"2024-04-24T01:24:39.842771+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:24:39.842771+0000","last_undegraded":"2024-04-24T01:24:39.842771+0000","last_fullsized":"2024-04-24T01:24:39.842771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:10.767999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.638179+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:09.638179+0000","last_peered":"2024-04-24T01:26:09.638179+0000","last_clean":"2024-04-24T01:26:09.638179+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:09.638179+0000","last_undegraded":"2024-04-24T01:26:09.638179+0000","last_fullsized":"2024-04-24T01:26:09.638179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:34.213505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370705+0000","last_change":"2024-04-24T01:24:00.732301+0000","last_active":"2024-04-24T01:26:06.370705+0000","last_peered":"2024-04-24T01:26:06.370705+0000","last_clean":"2024-04-24T01:26:06.370705+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:26:06.370705+0000","last_undegraded":"2024-04-24T01:26:06.370705+0000","last_fullsized":"2024-04-24T01:26:06.370705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:24.753026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791433+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:24:39.791433+0000","last_peered":"2024-04-24T01:24:39.791433+0000","last_clean":"2024-04-24T01:24:39.791433+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:24:39.791433+0000","last_undegraded":"2024-04-24T01:24:39.791433+0000","last_fullsized":"2024-04-24T01:24:39.791433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:26.702951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797556+0000","last_change":"2024-04-24T01:24:02.753145+0000","last_active":"2024-04-24T01:24:39.797556+0000","last_peered":"2024-04-24T01:24:39.797556+0000","last_clean":"2024-04-24T01:24:39.797556+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:24:39.797556+0000","last_undegraded":"2024-04-24T01:24:39.797556+0000","last_fullsized":"2024-04-24T01:24:39.797556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:47.630785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790507+0000","last_change":"2024-04-24T01:24:04.759523+0000","last_active":"2024-04-24T01:24:39.790507+0000","last_peered":"2024-04-24T01:24:39.790507+0000","last_clean":"2024-04-24T01:24:39.790507+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:24:39.790507+0000","last_undegraded":"2024-04-24T01:24:39.790507+0000","last_fullsized":"2024-04-24T01:24:39.790507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:22:53.916052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":375,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831397+0000","last_change":"2024-04-24T01:24:06.769994+0000","last_active":"2024-04-24T01:27:07.831397+0000","last_peered":"2024-04-24T01:27:07.831397+0000","last_clean":"2024-04-24T01:27:07.831397+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:07.831397+0000","last_undegraded":"2024-04-24T01:27:07.831397+0000","last_fullsized":"2024-04-24T01:27:07.831397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:03.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792482+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:24:39.792482+0000","last_peered":"2024-04-24T01:24:39.792482+0000","last_clean":"2024-04-24T01:24:39.792482+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:24:39.792482+0000","last_undegraded":"2024-04-24T01:24:39.792482+0000","last_fullsized":"2024-04-24T01:24:39.792482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:40.559182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343653+0000","last_change":"2024-04-24T01:24:00.732138+0000","last_active":"2024-04-24T01:27:10.343653+0000","last_peered":"2024-04-24T01:27:10.343653+0000","last_clean":"2024-04-24T01:27:10.343653+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:10.343653+0000","last_undegraded":"2024-04-24T01:27:10.343653+0000","last_fullsized":"2024-04-24T01:27:10.343653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:59.208377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894122+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:24:41.894122+0000","last_peered":"2024-04-24T01:24:41.894122+0000","last_clean":"2024-04-24T01:24:41.894122+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:24:41.894122+0000","last_undegraded":"2024-04-24T01:24:41.894122+0000","last_fullsized":"2024-04-24T01:24:41.894122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795147+0000","last_change":"2024-04-24T01:24:02.755459+0000","last_active":"2024-04-24T01:24:39.795147+0000","last_peered":"2024-04-24T01:24:39.795147+0000","last_clean":"2024-04-24T01:24:39.795147+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:24:39.795147+0000","last_undegraded":"2024-04-24T01:24:39.795147+0000","last_fullsized":"2024-04-24T01:24:39.795147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:03.880496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'62","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.122189+0000","last_change":"2024-04-24T01:24:04.753792+0000","last_active":"2024-04-24T01:26:08.122189+0000","last_peered":"2024-04-24T01:26:08.122189+0000","last_clean":"2024-04-24T01:26:08.122189+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:26:08.122189+0000","last_undegraded":"2024-04-24T01:26:08.122189+0000","last_fullsized":"2024-04-24T01:26:08.122189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:36.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841092+0000","last_change":"2024-04-24T01:24:06.770663+0000","last_active":"2024-04-24T01:24:39.841092+0000","last_peered":"2024-04-24T01:24:39.841092+0000","last_clean":"2024-04-24T01:24:39.841092+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:24:39.841092+0000","last_undegraded":"2024-04-24T01:24:39.841092+0000","last_fullsized":"2024-04-24T01:24:39.841092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:13:20.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797448+0000","last_change":"2024-04-24T01:24:08.769131+0000","last_active":"2024-04-24T01:24:39.797448+0000","last_peered":"2024-04-24T01:24:39.797448+0000","last_clean":"2024-04-24T01:24:39.797448+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:24:39.797448+0000","last_undegraded":"2024-04-24T01:24:39.797448+0000","last_fullsized":"2024-04-24T01:24:39.797448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:14.098220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311172+0000","last_change":"2024-04-24T01:24:00.729678+0000","last_active":"2024-04-24T01:27:10.311172+0000","last_peered":"2024-04-24T01:27:10.311172+0000","last_clean":"2024-04-24T01:27:10.311172+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:10.311172+0000","last_undegraded":"2024-04-24T01:27:10.311172+0000","last_fullsized":"2024-04-24T01:27:10.311172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.631103+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:25:25.631103+0000","last_peered":"2024-04-24T01:25:25.631103+0000","last_clean":"2024-04-24T01:25:25.631103+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:25:25.631103+0000","last_undegraded":"2024-04-24T01:25:25.631103+0000","last_fullsized":"2024-04-24T01:25:25.631103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:50.919310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791338+0000","last_change":"2024-04-24T01:24:02.753343+0000","last_active":"2024-04-24T01:24:39.791338+0000","last_peered":"2024-04-24T01:24:39.791338+0000","last_clean":"2024-04-24T01:24:39.791338+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:24:39.791338+0000","last_undegraded":"2024-04-24T01:24:39.791338+0000","last_fullsized":"2024-04-24T01:24:39.791338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.027557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976311+0000","last_change":"2024-04-24T01:24:04.759090+0000","last_active":"2024-04-24T01:26:31.976311+0000","last_peered":"2024-04-24T01:26:31.976311+0000","last_clean":"2024-04-24T01:26:31.976311+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:26:31.976311+0000","last_undegraded":"2024-04-24T01:26:31.976311+0000","last_fullsized":"2024-04-24T01:26:31.976311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:43.590882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792417+0000","last_change":"2024-04-24T01:24:06.765993+0000","last_active":"2024-04-24T01:24:39.792417+0000","last_peered":"2024-04-24T01:24:39.792417+0000","last_clean":"2024-04-24T01:24:39.792417+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:24:39.792417+0000","last_undegraded":"2024-04-24T01:24:39.792417+0000","last_fullsized":"2024-04-24T01:24:39.792417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:41.757073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792239+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:24:39.792239+0000","last_peered":"2024-04-24T01:24:39.792239+0000","last_clean":"2024-04-24T01:24:39.792239+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:24:39.792239+0000","last_undegraded":"2024-04-24T01:24:39.792239+0000","last_fullsized":"2024-04-24T01:24:39.792239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:09.221221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985926+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:26:28.985926+0000","last_peered":"2024-04-24T01:26:28.985926+0000","last_clean":"2024-04-24T01:26:28.985926+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:26:28.985926+0000","last_undegraded":"2024-04-24T01:26:28.985926+0000","last_fullsized":"2024-04-24T01:26:28.985926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:34.177576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843706+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:24:39.843706+0000","last_peered":"2024-04-24T01:24:39.843706+0000","last_clean":"2024-04-24T01:24:39.843706+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:24:39.843706+0000","last_undegraded":"2024-04-24T01:24:39.843706+0000","last_fullsized":"2024-04-24T01:24:39.843706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:10.215840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789419+0000","last_change":"2024-04-24T01:24:02.756957+0000","last_active":"2024-04-24T01:24:39.789419+0000","last_peered":"2024-04-24T01:24:39.789419+0000","last_clean":"2024-04-24T01:24:39.789419+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:24:39.789419+0000","last_undegraded":"2024-04-24T01:24:39.789419+0000","last_fullsized":"2024-04-24T01:24:39.789419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:38.961968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.147521+0000","last_change":"2024-04-24T01:24:04.761512+0000","last_active":"2024-04-24T01:26:08.147521+0000","last_peered":"2024-04-24T01:26:08.147521+0000","last_clean":"2024-04-24T01:26:08.147521+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:26:08.147521+0000","last_undegraded":"2024-04-24T01:26:08.147521+0000","last_fullsized":"2024-04-24T01:26:08.147521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:33.309938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793397+0000","last_change":"2024-04-24T01:24:06.770228+0000","last_active":"2024-04-24T01:24:39.793397+0000","last_peered":"2024-04-24T01:24:39.793397+0000","last_clean":"2024-04-24T01:24:39.793397+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:24:39.793397+0000","last_undegraded":"2024-04-24T01:24:39.793397+0000","last_fullsized":"2024-04-24T01:24:39.793397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:18:11.286272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.158027+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:08.158027+0000","last_peered":"2024-04-24T01:26:08.158027+0000","last_clean":"2024-04-24T01:26:08.158027+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:08.158027+0000","last_undegraded":"2024-04-24T01:26:08.158027+0000","last_fullsized":"2024-04-24T01:26:08.158027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:44.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.881602+0000","last_change":"2024-04-24T01:24:00.730610+0000","last_active":"2024-04-24T01:25:25.881602+0000","last_peered":"2024-04-24T01:25:25.881602+0000","last_clean":"2024-04-24T01:25:25.881602+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:25:25.881602+0000","last_undegraded":"2024-04-24T01:25:25.881602+0000","last_fullsized":"2024-04-24T01:25:25.881602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:38.644402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797330+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:24:39.797330+0000","last_peered":"2024-04-24T01:24:39.797330+0000","last_clean":"2024-04-24T01:24:39.797330+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:24:39.797330+0000","last_undegraded":"2024-04-24T01:24:39.797330+0000","last_fullsized":"2024-04-24T01:24:39.797330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.777248+0000","last_change":"2024-04-24T01:24:02.758075+0000","last_active":"2024-04-24T01:26:06.777248+0000","last_peered":"2024-04-24T01:26:06.777248+0000","last_clean":"2024-04-24T01:26:06.777248+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:26:06.777248+0000","last_undegraded":"2024-04-24T01:26:06.777248+0000","last_fullsized":"2024-04-24T01:26:06.777248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:03.864248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'45","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.661103+0000","last_change":"2024-04-24T01:24:04.761785+0000","last_active":"2024-04-24T01:27:09.661103+0000","last_peered":"2024-04-24T01:27:09.661103+0000","last_clean":"2024-04-24T01:27:09.661103+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:09.661103+0000","last_undegraded":"2024-04-24T01:27:09.661103+0000","last_fullsized":"2024-04-24T01:27:09.661103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:58.149475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842218+0000","last_change":"2024-04-24T01:24:06.770604+0000","last_active":"2024-04-24T01:24:39.842218+0000","last_peered":"2024-04-24T01:24:39.842218+0000","last_clean":"2024-04-24T01:24:39.842218+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:24:39.842218+0000","last_undegraded":"2024-04-24T01:24:39.842218+0000","last_fullsized":"2024-04-24T01:24:39.842218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:16.930856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.160611+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:08.160611+0000","last_peered":"2024-04-24T01:26:08.160611+0000","last_clean":"2024-04-24T01:26:08.160611+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:08.160611+0000","last_undegraded":"2024-04-24T01:26:08.160611+0000","last_fullsized":"2024-04-24T01:26:08.160611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:18.783056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642790+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:09.642790+0000","last_peered":"2024-04-24T01:26:09.642790+0000","last_clean":"2024-04-24T01:26:09.642790+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:09.642790+0000","last_undegraded":"2024-04-24T01:26:09.642790+0000","last_fullsized":"2024-04-24T01:26:09.642790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:11.472098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981484+0000","last_change":"2024-04-24T01:23:58.747335+0000","last_active":"2024-04-24T01:26:03.981484+0000","last_peered":"2024-04-24T01:26:03.981484+0000","last_clean":"2024-04-24T01:26:03.981484+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:26:03.981484+0000","last_undegraded":"2024-04-24T01:26:03.981484+0000","last_fullsized":"2024-04-24T01:26:03.981484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.641524+0000","last_change":"2024-04-24T01:24:00.732134+0000","last_active":"2024-04-24T01:25:25.641524+0000","last_peered":"2024-04-24T01:25:25.641524+0000","last_clean":"2024-04-24T01:25:25.641524+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:25:25.641524+0000","last_undegraded":"2024-04-24T01:25:25.641524+0000","last_fullsized":"2024-04-24T01:25:25.641524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:12.420444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894175+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:24:41.894175+0000","last_peered":"2024-04-24T01:24:41.894175+0000","last_clean":"2024-04-24T01:24:41.894175+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:24:41.894175+0000","last_undegraded":"2024-04-24T01:24:41.894175+0000","last_fullsized":"2024-04-24T01:24:41.894175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:34.164253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124466+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.124466+0000","last_peered":"2024-04-24T01:27:10.124466+0000","last_clean":"2024-04-24T01:27:10.124466+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.124466+0000","last_undegraded":"2024-04-24T01:27:10.124466+0000","last_fullsized":"2024-04-24T01:27:10.124466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:45.623313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793654+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:24:39.793654+0000","last_peered":"2024-04-24T01:24:39.793654+0000","last_clean":"2024-04-24T01:24:39.793654+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:24:39.793654+0000","last_undegraded":"2024-04-24T01:24:39.793654+0000","last_fullsized":"2024-04-24T01:24:39.793654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:36.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124201+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.124201+0000","last_peered":"2024-04-24T01:27:10.124201+0000","last_clean":"2024-04-24T01:27:10.124201+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.124201+0000","last_undegraded":"2024-04-24T01:27:10.124201+0000","last_fullsized":"2024-04-24T01:27:10.124201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:23.382109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843929+0000","last_change":"2024-04-24T01:23:58.747256+0000","last_active":"2024-04-24T01:24:39.843929+0000","last_peered":"2024-04-24T01:24:39.843929+0000","last_clean":"2024-04-24T01:24:39.843929+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:24:39.843929+0000","last_undegraded":"2024-04-24T01:24:39.843929+0000","last_fullsized":"2024-04-24T01:24:39.843929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:24.901113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311360+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.311360+0000","last_peered":"2024-04-24T01:27:10.311360+0000","last_clean":"2024-04-24T01:27:10.311360+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.311360+0000","last_undegraded":"2024-04-24T01:27:10.311360+0000","last_fullsized":"2024-04-24T01:27:10.311360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:23.445860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843749+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:24:39.843749+0000","last_peered":"2024-04-24T01:24:39.843749+0000","last_clean":"2024-04-24T01:24:39.843749+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:24:39.843749+0000","last_undegraded":"2024-04-24T01:24:39.843749+0000","last_fullsized":"2024-04-24T01:24:39.843749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:35.046540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262087+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.262087+0000","last_peered":"2024-04-24T01:27:10.262087+0000","last_clean":"2024-04-24T01:27:10.262087+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.262087+0000","last_undegraded":"2024-04-24T01:27:10.262087+0000","last_fullsized":"2024-04-24T01:27:10.262087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:40.138216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.541257+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.541257+0000","last_peered":"2024-04-24T01:26:09.541257+0000","last_clean":"2024-04-24T01:26:09.541257+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.541257+0000","last_undegraded":"2024-04-24T01:26:09.541257+0000","last_fullsized":"2024-04-24T01:26:09.541257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.879998+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:25:25.879998+0000","last_peered":"2024-04-24T01:25:25.879998+0000","last_clean":"2024-04-24T01:25:25.879998+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:25:25.879998+0000","last_undegraded":"2024-04-24T01:25:25.879998+0000","last_fullsized":"2024-04-24T01:25:25.879998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:09.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.338702+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.338702+0000","last_peered":"2024-04-24T01:27:10.338702+0000","last_clean":"2024-04-24T01:27:10.338702+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.338702+0000","last_undegraded":"2024-04-24T01:27:10.338702+0000","last_fullsized":"2024-04-24T01:27:10.338702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.125794+0000","last_change":"2024-04-24T01:24:00.744090+0000","last_active":"2024-04-24T01:27:10.125794+0000","last_peered":"2024-04-24T01:27:10.125794+0000","last_clean":"2024-04-24T01:27:10.125794+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:10.125794+0000","last_undegraded":"2024-04-24T01:27:10.125794+0000","last_fullsized":"2024-04-24T01:27:10.125794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:35.200859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.480239+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:09.480239+0000","last_peered":"2024-04-24T01:26:09.480239+0000","last_clean":"2024-04-24T01:26:09.480239+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:09.480239+0000","last_undegraded":"2024-04-24T01:26:09.480239+0000","last_fullsized":"2024-04-24T01:26:09.480239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:44.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314098+0000","last_change":"2024-04-24T01:24:00.745364+0000","last_active":"2024-04-24T01:27:10.314098+0000","last_peered":"2024-04-24T01:27:10.314098+0000","last_clean":"2024-04-24T01:27:10.314098+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:10.314098+0000","last_undegraded":"2024-04-24T01:27:10.314098+0000","last_fullsized":"2024-04-24T01:27:10.314098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:04.207670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789907+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:24:39.789907+0000","last_peered":"2024-04-24T01:24:39.789907+0000","last_clean":"2024-04-24T01:24:39.789907+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:24:39.789907+0000","last_undegraded":"2024-04-24T01:24:39.789907+0000","last_fullsized":"2024-04-24T01:24:39.789907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.471255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040648+0000","last_change":"2024-04-24T01:24:00.738594+0000","last_active":"2024-04-24T01:27:10.040648+0000","last_peered":"2024-04-24T01:27:10.040648+0000","last_clean":"2024-04-24T01:27:10.040648+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:10.040648+0000","last_undegraded":"2024-04-24T01:27:10.040648+0000","last_fullsized":"2024-04-24T01:27:10.040648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:05.644113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.972565+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:24:42.972565+0000","last_peered":"2024-04-24T01:24:42.972565+0000","last_clean":"2024-04-24T01:24:42.972565+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:24:42.972565+0000","last_undegraded":"2024-04-24T01:24:42.972565+0000","last_fullsized":"2024-04-24T01:24:42.972565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:08.200562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124410+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.124410+0000","last_peered":"2024-04-24T01:27:10.124410+0000","last_clean":"2024-04-24T01:27:10.124410+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.124410+0000","last_undegraded":"2024-04-24T01:27:10.124410+0000","last_fullsized":"2024-04-24T01:27:10.124410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:37.307723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252871+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.252871+0000","last_peered":"2024-04-24T01:27:10.252871+0000","last_clean":"2024-04-24T01:27:10.252871+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.252871+0000","last_undegraded":"2024-04-24T01:27:10.252871+0000","last_fullsized":"2024-04-24T01:27:10.252871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311477+0000","last_change":"2024-04-24T01:24:00.739108+0000","last_active":"2024-04-24T01:27:10.311477+0000","last_peered":"2024-04-24T01:27:10.311477+0000","last_clean":"2024-04-24T01:27:10.311477+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:10.311477+0000","last_undegraded":"2024-04-24T01:27:10.311477+0000","last_fullsized":"2024-04-24T01:27:10.311477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:35.209417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796505+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:24:39.796505+0000","last_peered":"2024-04-24T01:24:39.796505+0000","last_clean":"2024-04-24T01:24:39.796505+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:24:39.796505+0000","last_undegraded":"2024-04-24T01:24:39.796505+0000","last_fullsized":"2024-04-24T01:24:39.796505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984070+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:24:42.984070+0000","last_peered":"2024-04-24T01:24:42.984070+0000","last_clean":"2024-04-24T01:24:42.984070+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:24:42.984070+0000","last_undegraded":"2024-04-24T01:24:42.984070+0000","last_fullsized":"2024-04-24T01:24:42.984070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791579+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:24:39.791579+0000","last_peered":"2024-04-24T01:24:39.791579+0000","last_clean":"2024-04-24T01:24:39.791579+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:24:39.791579+0000","last_undegraded":"2024-04-24T01:24:39.791579+0000","last_fullsized":"2024-04-24T01:24:39.791579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:00:17.843103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983736+0000","last_change":"2024-04-24T01:24:00.745475+0000","last_active":"2024-04-24T01:26:18.983736+0000","last_peered":"2024-04-24T01:26:18.983736+0000","last_clean":"2024-04-24T01:26:18.983736+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:26:18.983736+0000","last_undegraded":"2024-04-24T01:26:18.983736+0000","last_fullsized":"2024-04-24T01:26:18.983736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:30.020085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793966+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:24:39.793966+0000","last_peered":"2024-04-24T01:24:39.793966+0000","last_clean":"2024-04-24T01:24:39.793966+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:24:39.793966+0000","last_undegraded":"2024-04-24T01:24:39.793966+0000","last_fullsized":"2024-04-24T01:24:39.793966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:31.252182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350752+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350752+0000","last_peered":"2024-04-24T01:27:10.350752+0000","last_clean":"2024-04-24T01:27:10.350752+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350752+0000","last_undegraded":"2024-04-24T01:27:10.350752+0000","last_fullsized":"2024-04-24T01:27:10.350752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:52.523705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793919+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:24:39.793919+0000","last_peered":"2024-04-24T01:24:39.793919+0000","last_clean":"2024-04-24T01:24:39.793919+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:24:39.793919+0000","last_undegraded":"2024-04-24T01:24:39.793919+0000","last_fullsized":"2024-04-24T01:24:39.793919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'11","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349775+0000","last_change":"2024-04-24T01:24:00.739611+0000","last_active":"2024-04-24T01:27:10.349775+0000","last_peered":"2024-04-24T01:27:10.349775+0000","last_clean":"2024-04-24T01:27:10.349775+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:10.349775+0000","last_undegraded":"2024-04-24T01:27:10.349775+0000","last_fullsized":"2024-04-24T01:27:10.349775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:19:58.147363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790857+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:24:39.790857+0000","last_peered":"2024-04-24T01:24:39.790857+0000","last_clean":"2024-04-24T01:24:39.790857+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:24:39.790857+0000","last_undegraded":"2024-04-24T01:24:39.790857+0000","last_fullsized":"2024-04-24T01:24:39.790857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:55.041236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791604+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:24:39.791604+0000","last_peered":"2024-04-24T01:24:39.791604+0000","last_clean":"2024-04-24T01:24:39.791604+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:24:39.791604+0000","last_undegraded":"2024-04-24T01:24:39.791604+0000","last_fullsized":"2024-04-24T01:24:39.791604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:25.351096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261937+0000","last_change":"2024-04-24T01:24:00.746896+0000","last_active":"2024-04-24T01:27:10.261937+0000","last_peered":"2024-04-24T01:27:10.261937+0000","last_clean":"2024-04-24T01:27:10.261937+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:10.261937+0000","last_undegraded":"2024-04-24T01:27:10.261937+0000","last_fullsized":"2024-04-24T01:27:10.261937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:49.762286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841409+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:24:39.841409+0000","last_peered":"2024-04-24T01:24:39.841409+0000","last_clean":"2024-04-24T01:24:39.841409+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:24:39.841409+0000","last_undegraded":"2024-04-24T01:24:39.841409+0000","last_fullsized":"2024-04-24T01:24:39.841409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:15.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.375679+0000","last_change":"2024-04-24T01:24:00.743656+0000","last_active":"2024-04-24T01:26:06.375679+0000","last_peered":"2024-04-24T01:26:06.375679+0000","last_clean":"2024-04-24T01:26:06.375679+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:26:06.375679+0000","last_undegraded":"2024-04-24T01:26:06.375679+0000","last_fullsized":"2024-04-24T01:26:06.375679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1691,"num_read_kb":1445,"num_write":725,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1473,"ondisk_log_size":1473,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44208,"kb_used_data":8872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327632,"statfs":{"total":96636764160,"available":96591495168,"internally_reserved":0,"allocated":9084928,"data_stored":8757155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44728,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327112,"statfs":{"total":96636764160,"available":96590962688,"internally_reserved":0,"allocated":9617408,"data_stored":9344390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44752,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327088,"statfs":{"total":96636764160,"available":96590938112,"internally_reserved":0,"allocated":9641984,"data_stored":9346589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9060352,"data_stored":8756282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:27:17.374 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb33e6d2640 1 Processor -- start 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb33e6d2640 1 -- start start 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb33e6d2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb338071090 0x7fb338131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb33e6d2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb338098800 con 0x7fb338096430 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb33e6d2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fb338071930 con 0x7fb338071090 2024-04-24T01:27:17.496 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb3377fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fb338071090 0x7fb338131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb337fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fb338096430 0x7fb338096810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49172/0 (socket says 172.21.15.142:49172) 2024-04-24T01:27:17.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.495+0000 7fb337fff640 1 -- 172.21.15.142:0/426138783 learned_addr learned my addr 172.21.15.142:0/426138783 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:17.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb3377fe640 1 -- 172.21.15.142:0/426138783 >> v1:172.21.15.142:6789/0 conn(0x7fb338096430 legacy=0x7fb338096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.497 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb3377fe640 1 -- 172.21.15.142:0/426138783 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338071f50 con 0x7fb338071090 2024-04-24T01:27:17.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb3377fe640 1 --2- 172.21.15.142:0/426138783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb338131430 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009720 tx=0x7fb32c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90081b11c834687d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb336ffd640 1 -- 172.21.15.142:0/426138783 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c0316d0 con 0x7fb338071090 2024-04-24T01:27:17.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb336ffd640 1 -- 172.21.15.142:0/426138783 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb32c037070 con 0x7fb338071090 2024-04-24T01:27:17.498 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.496+0000 7fb336ffd640 1 -- 172.21.15.142:0/426138783 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb32c0319c0 con 0x7fb338071090 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 -- 172.21.15.142:0/426138783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 msgr2=0x7fb338131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/426138783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb338131430 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009720 tx=0x7fb32c02b840 comp rx=0 tx=0).stop 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 -- 172.21.15.142:0/426138783 shutdown_connections 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/426138783 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb338131430 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 -- 172.21.15.142:0/426138783 >> 172.21.15.142:0/426138783 conn(0x7fb338099680 msgr2=0x7fb338099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 -- 172.21.15.142:0/426138783 shutdown_connections 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.497+0000 7fb33e6d2640 1 -- 172.21.15.142:0/426138783 wait complete. 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb33e6d2640 1 Processor -- start 2024-04-24T01:27:17.499 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb33e6d2640 1 -- start start 2024-04-24T01:27:17.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb33e6d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb33e6d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fb338131af0 con 0x7fb338071090 2024-04-24T01:27:17.501 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb337fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb337fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33504/0 (socket says 172.21.15.142:33504) 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.498+0000 7fb337fff640 1 -- 172.21.15.142:0/1969894706 learned_addr learned my addr 172.21.15.142:0/1969894706 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb337fff640 1 -- 172.21.15.142:0/1969894706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb338124580 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb337fff640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb32800c4a0 tx=0x7fb32800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328017070 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3381311c0 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb338125630 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb328005c10 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.499+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328021060 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.500+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb32801a070 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.500+0000 7fb334ff9640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 0x7fb32403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.500+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb318005080 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.500+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fb32804ad20 con 0x7fb338071090 2024-04-24T01:27:17.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.500+0000 7fb3377fe640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 0x7fb32403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.501+0000 7fb3377fe640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 0x7fb32403a4d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb32c036000 tx=0x7fb32c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.505 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.505+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fb328007250 con 0x7fb338071090 2024-04-24T01:27:17.674 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.673+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb318000bc0 con 0x7fb324038010 2024-04-24T01:27:17.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.687+0000 7fb334ff9640 1 -- 172.21.15.142:0/1969894706 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665959 (secure 0 0 0) 0x7fb318000bc0 con 0x7fb324038010 2024-04-24T01:27:17.696 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:27:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 msgr2=0x7fb32403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 0x7fb32403a4d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb32c036000 tx=0x7fb32c008030 comp rx=0 tx=0).stop 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 msgr2=0x7fb3381250f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fb32800c4a0 tx=0x7fb32800c960 comp rx=0 tx=0).stop 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 shutdown_connections 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fb324038010 0x7fb32403a4d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.692+0000 7fb33e6d2640 1 --2- 172.21.15.142:0/1969894706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb338071090 0x7fb3381250f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.693+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 >> 172.21.15.142:0/1969894706 conn(0x7fb338099680 msgr2=0x7fb338129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.693+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 shutdown_connections 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.693+0000 7fb33e6d2640 1 -- 172.21.15.142:0/1969894706 wait complete. 2024-04-24T01:27:17.704 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-24T01:27:15.962298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":259,"num_object_clones":0,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5161,"num_read_kb":4706,"num_write":2300,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4675,"ondisk_log_size":4675,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182032,"kb_used_data":36528,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305328,"statfs":{"total":386547056640,"available":386360655872,"internally_reserved":0,"allocated":37404672,"data_stored":36204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":511,"num_read_kb":466,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004265"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793282+0000","last_change":"2024-04-24T01:23:58.745975+0000","last_active":"2024-04-24T01:24:39.793282+0000","last_peered":"2024-04-24T01:24:39.793282+0000","last_clean":"2024-04-24T01:24:39.793282+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:24:39.793282+0000","last_undegraded":"2024-04-24T01:24:39.793282+0000","last_fullsized":"2024-04-24T01:24:39.793282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261969+0000","last_change":"2024-04-24T01:24:00.745235+0000","last_active":"2024-04-24T01:27:10.261969+0000","last_peered":"2024-04-24T01:27:10.261969+0000","last_clean":"2024-04-24T01:27:10.261969+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:10.261969+0000","last_undegraded":"2024-04-24T01:27:10.261969+0000","last_fullsized":"2024-04-24T01:27:10.261969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:45.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843868+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:24:39.843868+0000","last_peered":"2024-04-24T01:24:39.843868+0000","last_clean":"2024-04-24T01:24:39.843868+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:24:39.843868+0000","last_undegraded":"2024-04-24T01:24:39.843868+0000","last_fullsized":"2024-04-24T01:24:39.843868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:01.751302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.370886+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:24:42.370886+0000","last_peered":"2024-04-24T01:24:42.370886+0000","last_clean":"2024-04-24T01:24:42.370886+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:24:42.370886+0000","last_undegraded":"2024-04-24T01:24:42.370886+0000","last_fullsized":"2024-04-24T01:24:42.370886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:01.873024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794269+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:24:39.794269+0000","last_peered":"2024-04-24T01:24:39.794269+0000","last_clean":"2024-04-24T01:24:39.794269+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:24:39.794269+0000","last_undegraded":"2024-04-24T01:24:39.794269+0000","last_fullsized":"2024-04-24T01:24:39.794269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.373104+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:06.373104+0000","last_peered":"2024-04-24T01:26:06.373104+0000","last_clean":"2024-04-24T01:26:06.373104+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:06.373104+0000","last_undegraded":"2024-04-24T01:26:06.373104+0000","last_fullsized":"2024-04-24T01:26:06.373104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:58.173467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894191+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:24:41.894191+0000","last_peered":"2024-04-24T01:24:41.894191+0000","last_clean":"2024-04-24T01:24:41.894191+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:24:41.894191+0000","last_undegraded":"2024-04-24T01:24:41.894191+0000","last_fullsized":"2024-04-24T01:24:41.894191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370793+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:06.370793+0000","last_peered":"2024-04-24T01:26:06.370793+0000","last_clean":"2024-04-24T01:26:06.370793+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:06.370793+0000","last_undegraded":"2024-04-24T01:26:06.370793+0000","last_fullsized":"2024-04-24T01:26:06.370793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:36.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.966530+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:24:42.966530+0000","last_peered":"2024-04-24T01:24:42.966530+0000","last_clean":"2024-04-24T01:24:42.966530+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:24:42.966530+0000","last_undegraded":"2024-04-24T01:24:42.966530+0000","last_fullsized":"2024-04-24T01:24:42.966530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:46.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262034+0000","last_change":"2024-04-24T01:24:00.739114+0000","last_active":"2024-04-24T01:27:10.262034+0000","last_peered":"2024-04-24T01:27:10.262034+0000","last_clean":"2024-04-24T01:27:10.262034+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:10.262034+0000","last_undegraded":"2024-04-24T01:27:10.262034+0000","last_fullsized":"2024-04-24T01:27:10.262034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:15.071031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789367+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:24:39.789367+0000","last_peered":"2024-04-24T01:24:39.789367+0000","last_clean":"2024-04-24T01:24:39.789367+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:24:39.789367+0000","last_undegraded":"2024-04-24T01:24:39.789367+0000","last_fullsized":"2024-04-24T01:24:39.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:43.987882+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:26:43.987882+0000","last_peered":"2024-04-24T01:26:43.987882+0000","last_clean":"2024-04-24T01:26:43.987882+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:26:43.987882+0000","last_undegraded":"2024-04-24T01:26:43.987882+0000","last_fullsized":"2024-04-24T01:26:43.987882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:44.665563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.249789+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.249789+0000","last_peered":"2024-04-24T01:27:10.249789+0000","last_clean":"2024-04-24T01:27:10.249789+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.249789+0000","last_undegraded":"2024-04-24T01:27:10.249789+0000","last_fullsized":"2024-04-24T01:27:10.249789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:50.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642467+0000","last_change":"2024-04-24T01:24:00.745053+0000","last_active":"2024-04-24T01:26:09.642467+0000","last_peered":"2024-04-24T01:26:09.642467+0000","last_clean":"2024-04-24T01:26:09.642467+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:26:09.642467+0000","last_undegraded":"2024-04-24T01:26:09.642467+0000","last_fullsized":"2024-04-24T01:26:09.642467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841355+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:24:39.841355+0000","last_peered":"2024-04-24T01:24:39.841355+0000","last_clean":"2024-04-24T01:24:39.841355+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:24:39.841355+0000","last_undegraded":"2024-04-24T01:24:39.841355+0000","last_fullsized":"2024-04-24T01:24:39.841355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:59.075615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349980+0000","last_change":"2024-04-24T01:24:00.740054+0000","last_active":"2024-04-24T01:27:10.349980+0000","last_peered":"2024-04-24T01:27:10.349980+0000","last_clean":"2024-04-24T01:27:10.349980+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:10.349980+0000","last_undegraded":"2024-04-24T01:27:10.349980+0000","last_fullsized":"2024-04-24T01:27:10.349980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313995+0000","last_change":"2024-04-24T01:24:00.738224+0000","last_active":"2024-04-24T01:27:10.313995+0000","last_peered":"2024-04-24T01:27:10.313995+0000","last_clean":"2024-04-24T01:27:10.313995+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:10.313995+0000","last_undegraded":"2024-04-24T01:27:10.313995+0000","last_fullsized":"2024-04-24T01:27:10.313995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:35.336241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797425+0000","last_change":"2024-04-24T01:23:58.755611+0000","last_active":"2024-04-24T01:24:39.797425+0000","last_peered":"2024-04-24T01:24:39.797425+0000","last_clean":"2024-04-24T01:24:39.797425+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:24:39.797425+0000","last_undegraded":"2024-04-24T01:24:39.797425+0000","last_fullsized":"2024-04-24T01:24:39.797425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314134+0000","last_change":"2024-04-24T01:24:00.744762+0000","last_active":"2024-04-24T01:27:10.314134+0000","last_peered":"2024-04-24T01:27:10.314134+0000","last_clean":"2024-04-24T01:27:10.314134+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:10.314134+0000","last_undegraded":"2024-04-24T01:27:10.314134+0000","last_fullsized":"2024-04-24T01:27:10.314134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984616+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:26:23.984616+0000","last_peered":"2024-04-24T01:26:23.984616+0000","last_clean":"2024-04-24T01:26:23.984616+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:26:23.984616+0000","last_undegraded":"2024-04-24T01:26:23.984616+0000","last_fullsized":"2024-04-24T01:26:23.984616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984442+0000","last_change":"2024-04-24T01:24:00.745273+0000","last_active":"2024-04-24T01:24:42.984442+0000","last_peered":"2024-04-24T01:24:42.984442+0000","last_clean":"2024-04-24T01:24:42.984442+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:24:42.984442+0000","last_undegraded":"2024-04-24T01:24:42.984442+0000","last_fullsized":"2024-04-24T01:24:42.984442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:11.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.021107+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.021107+0000","last_peered":"2024-04-24T01:27:10.021107+0000","last_clean":"2024-04-24T01:27:10.021107+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.021107+0000","last_undegraded":"2024-04-24T01:27:10.021107+0000","last_fullsized":"2024-04-24T01:27:10.021107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320595+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.320595+0000","last_peered":"2024-04-24T01:27:10.320595+0000","last_clean":"2024-04-24T01:27:10.320595+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.320595+0000","last_undegraded":"2024-04-24T01:27:10.320595+0000","last_fullsized":"2024-04-24T01:27:10.320595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:40:35.960909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.255757+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:10.255757+0000","last_peered":"2024-04-24T01:27:10.255757+0000","last_clean":"2024-04-24T01:27:10.255757+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:10.255757+0000","last_undegraded":"2024-04-24T01:27:10.255757+0000","last_fullsized":"2024-04-24T01:27:10.255757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":39,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.037285+0000","last_change":"2024-04-24T01:24:00.740372+0000","last_active":"2024-04-24T01:27:10.037285+0000","last_peered":"2024-04-24T01:27:10.037285+0000","last_clean":"2024-04-24T01:27:10.037285+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:10.037285+0000","last_undegraded":"2024-04-24T01:27:10.037285+0000","last_fullsized":"2024-04-24T01:27:10.037285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:00.415935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844104+0000","last_change":"2024-04-24T01:23:58.747782+0000","last_active":"2024-04-24T01:24:39.844104+0000","last_peered":"2024-04-24T01:24:39.844104+0000","last_clean":"2024-04-24T01:24:39.844104+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:24:39.844104+0000","last_undegraded":"2024-04-24T01:24:39.844104+0000","last_fullsized":"2024-04-24T01:24:39.844104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:33.918132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349714+0000","last_change":"2024-04-24T01:24:00.744154+0000","last_active":"2024-04-24T01:27:10.349714+0000","last_peered":"2024-04-24T01:27:10.349714+0000","last_clean":"2024-04-24T01:27:10.349714+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:10.349714+0000","last_undegraded":"2024-04-24T01:27:10.349714+0000","last_fullsized":"2024-04-24T01:27:10.349714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:46.325470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.595508+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:09.595508+0000","last_peered":"2024-04-24T01:26:09.595508+0000","last_clean":"2024-04-24T01:26:09.595508+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:09.595508+0000","last_undegraded":"2024-04-24T01:26:09.595508+0000","last_fullsized":"2024-04-24T01:26:09.595508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:14.628366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.287302+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.287302+0000","last_peered":"2024-04-24T01:27:10.287302+0000","last_clean":"2024-04-24T01:27:10.287302+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.287302+0000","last_undegraded":"2024-04-24T01:27:10.287302+0000","last_fullsized":"2024-04-24T01:27:10.287302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:03.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039068+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.039068+0000","last_peered":"2024-04-24T01:27:10.039068+0000","last_clean":"2024-04-24T01:27:10.039068+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.039068+0000","last_undegraded":"2024-04-24T01:27:10.039068+0000","last_fullsized":"2024-04-24T01:27:10.039068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:59.847574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791248+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:24:39.791248+0000","last_peered":"2024-04-24T01:24:39.791248+0000","last_clean":"2024-04-24T01:24:39.791248+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:24:39.791248+0000","last_undegraded":"2024-04-24T01:24:39.791248+0000","last_fullsized":"2024-04-24T01:24:39.791248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:11.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793258+0000","last_change":"2024-04-24T01:24:02.754649+0000","last_active":"2024-04-24T01:24:39.793258+0000","last_peered":"2024-04-24T01:24:39.793258+0000","last_clean":"2024-04-24T01:24:39.793258+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:24:39.793258+0000","last_undegraded":"2024-04-24T01:24:39.793258+0000","last_fullsized":"2024-04-24T01:24:39.793258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:36.231675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.139951+0000","last_change":"2024-04-24T01:24:04.759269+0000","last_active":"2024-04-24T01:26:08.139951+0000","last_peered":"2024-04-24T01:26:08.139951+0000","last_clean":"2024-04-24T01:26:08.139951+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:26:08.139951+0000","last_undegraded":"2024-04-24T01:26:08.139951+0000","last_fullsized":"2024-04-24T01:26:08.139951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:48.568742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797301+0000","last_change":"2024-04-24T01:24:06.771210+0000","last_active":"2024-04-24T01:24:39.797301+0000","last_peered":"2024-04-24T01:24:39.797301+0000","last_clean":"2024-04-24T01:24:39.797301+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:24:39.797301+0000","last_undegraded":"2024-04-24T01:24:39.797301+0000","last_fullsized":"2024-04-24T01:24:39.797301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:42.412982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.649922+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:25:25.649922+0000","last_peered":"2024-04-24T01:25:25.649922+0000","last_clean":"2024-04-24T01:25:25.649922+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:25:25.649922+0000","last_undegraded":"2024-04-24T01:25:25.649922+0000","last_fullsized":"2024-04-24T01:25:25.649922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:32.845545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343531+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.343531+0000","last_peered":"2024-04-24T01:27:10.343531+0000","last_clean":"2024-04-24T01:27:10.343531+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.343531+0000","last_undegraded":"2024-04-24T01:27:10.343531+0000","last_fullsized":"2024-04-24T01:27:10.343531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:11.415544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789109+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:24:39.789109+0000","last_peered":"2024-04-24T01:24:39.789109+0000","last_clean":"2024-04-24T01:24:39.789109+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:24:39.789109+0000","last_undegraded":"2024-04-24T01:24:39.789109+0000","last_fullsized":"2024-04-24T01:24:39.789109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.800415+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:24:39.800415+0000","last_peered":"2024-04-24T01:24:39.800415+0000","last_clean":"2024-04-24T01:24:39.800415+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:24:39.800415+0000","last_undegraded":"2024-04-24T01:24:39.800415+0000","last_fullsized":"2024-04-24T01:24:39.800415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:27.933493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.644975+0000","last_change":"2024-04-24T01:24:04.754457+0000","last_active":"2024-04-24T01:26:09.644975+0000","last_peered":"2024-04-24T01:26:09.644975+0000","last_clean":"2024-04-24T01:26:09.644975+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:26:09.644975+0000","last_undegraded":"2024-04-24T01:26:09.644975+0000","last_fullsized":"2024-04-24T01:26:09.644975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:44.985335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796898+0000","last_change":"2024-04-24T01:24:06.767131+0000","last_active":"2024-04-24T01:24:39.796898+0000","last_peered":"2024-04-24T01:24:39.796898+0000","last_clean":"2024-04-24T01:24:39.796898+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:24:39.796898+0000","last_undegraded":"2024-04-24T01:24:39.796898+0000","last_fullsized":"2024-04-24T01:24:39.796898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:37.537173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841120+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:24:39.841120+0000","last_peered":"2024-04-24T01:24:39.841120+0000","last_clean":"2024-04-24T01:24:39.841120+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:24:39.841120+0000","last_undegraded":"2024-04-24T01:24:39.841120+0000","last_fullsized":"2024-04-24T01:24:39.841120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:30.549905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261903+0000","last_change":"2024-04-24T01:24:00.735337+0000","last_active":"2024-04-24T01:27:10.261903+0000","last_peered":"2024-04-24T01:27:10.261903+0000","last_clean":"2024-04-24T01:27:10.261903+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:10.261903+0000","last_undegraded":"2024-04-24T01:27:10.261903+0000","last_fullsized":"2024-04-24T01:27:10.261903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:23.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.969496+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:24:42.969496+0000","last_peered":"2024-04-24T01:24:42.969496+0000","last_clean":"2024-04-24T01:24:42.969496+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:24:42.969496+0000","last_undegraded":"2024-04-24T01:24:42.969496+0000","last_fullsized":"2024-04-24T01:24:42.969496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:01.497950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844317+0000","last_change":"2024-04-24T01:24:02.754545+0000","last_active":"2024-04-24T01:24:39.844317+0000","last_peered":"2024-04-24T01:24:39.844317+0000","last_clean":"2024-04-24T01:24:39.844317+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:24:39.844317+0000","last_undegraded":"2024-04-24T01:24:39.844317+0000","last_fullsized":"2024-04-24T01:24:39.844317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:28.692526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791153+0000","last_change":"2024-04-24T01:24:04.756975+0000","last_active":"2024-04-24T01:24:39.791153+0000","last_peered":"2024-04-24T01:24:39.791153+0000","last_clean":"2024-04-24T01:24:39.791153+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:24:39.791153+0000","last_undegraded":"2024-04-24T01:24:39.791153+0000","last_fullsized":"2024-04-24T01:24:39.791153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:05.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":421,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831485+0000","last_change":"2024-04-24T01:24:06.766289+0000","last_active":"2024-04-24T01:27:07.831485+0000","last_peered":"2024-04-24T01:27:07.831485+0000","last_clean":"2024-04-24T01:27:07.831485+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:07.831485+0000","last_undegraded":"2024-04-24T01:27:07.831485+0000","last_fullsized":"2024-04-24T01:27:07.831485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:56.567330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.056866+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.056866+0000","last_peered":"2024-04-24T01:27:10.056866+0000","last_clean":"2024-04-24T01:27:10.056866+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.056866+0000","last_undegraded":"2024-04-24T01:27:10.056866+0000","last_fullsized":"2024-04-24T01:27:10.056866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:09:23.826046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984471+0000","last_change":"2024-04-24T01:24:00.746538+0000","last_active":"2024-04-24T01:24:42.984471+0000","last_peered":"2024-04-24T01:24:42.984471+0000","last_clean":"2024-04-24T01:24:42.984471+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:24:42.984471+0000","last_undegraded":"2024-04-24T01:24:42.984471+0000","last_fullsized":"2024-04-24T01:24:42.984471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:42.978833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790051+0000","last_change":"2024-04-24T01:23:58.755957+0000","last_active":"2024-04-24T01:24:39.790051+0000","last_peered":"2024-04-24T01:24:39.790051+0000","last_clean":"2024-04-24T01:24:39.790051+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:24:39.790051+0000","last_undegraded":"2024-04-24T01:24:39.790051+0000","last_fullsized":"2024-04-24T01:24:39.790051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790172+0000","last_change":"2024-04-24T01:24:02.753656+0000","last_active":"2024-04-24T01:24:39.790172+0000","last_peered":"2024-04-24T01:24:39.790172+0000","last_clean":"2024-04-24T01:24:39.790172+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:24:39.790172+0000","last_undegraded":"2024-04-24T01:24:39.790172+0000","last_fullsized":"2024-04-24T01:24:39.790172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:33.516719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.134546+0000","last_change":"2024-04-24T01:24:04.759628+0000","last_active":"2024-04-24T01:26:08.134546+0000","last_peered":"2024-04-24T01:26:08.134546+0000","last_clean":"2024-04-24T01:26:08.134546+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:26:08.134546+0000","last_undegraded":"2024-04-24T01:26:08.134546+0000","last_fullsized":"2024-04-24T01:26:08.134546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:38.198064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'282","reported_seq":401,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.346463+0000","last_change":"2024-04-24T01:24:06.765145+0000","last_active":"2024-04-24T01:27:10.346463+0000","last_peered":"2024-04-24T01:27:10.346463+0000","last_clean":"2024-04-24T01:27:10.346463+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:10.346463+0000","last_undegraded":"2024-04-24T01:27:10.346463+0000","last_fullsized":"2024-04-24T01:27:10.346463+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:35.968565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:43.536575+0000","last_change":"2024-04-24T01:24:00.737956+0000","last_active":"2024-04-24T01:24:43.536575+0000","last_peered":"2024-04-24T01:24:43.536575+0000","last_clean":"2024-04-24T01:24:43.536575+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:24:43.536575+0000","last_undegraded":"2024-04-24T01:24:43.536575+0000","last_fullsized":"2024-04-24T01:24:43.536575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:01.856776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793056+0000","last_change":"2024-04-24T01:23:58.744402+0000","last_active":"2024-04-24T01:24:39.793056+0000","last_peered":"2024-04-24T01:24:39.793056+0000","last_clean":"2024-04-24T01:24:39.793056+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:24:39.793056+0000","last_undegraded":"2024-04-24T01:24:39.793056+0000","last_fullsized":"2024-04-24T01:24:39.793056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794002+0000","last_change":"2024-04-24T01:24:02.760212+0000","last_active":"2024-04-24T01:24:39.794002+0000","last_peered":"2024-04-24T01:24:39.794002+0000","last_clean":"2024-04-24T01:24:39.794002+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:24:39.794002+0000","last_undegraded":"2024-04-24T01:24:39.794002+0000","last_fullsized":"2024-04-24T01:24:39.794002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:38.380237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.144588+0000","last_change":"2024-04-24T01:24:04.753455+0000","last_active":"2024-04-24T01:26:08.144588+0000","last_peered":"2024-04-24T01:26:08.144588+0000","last_clean":"2024-04-24T01:26:08.144588+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:26:08.144588+0000","last_undegraded":"2024-04-24T01:26:08.144588+0000","last_fullsized":"2024-04-24T01:26:08.144588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:43.056736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843661+0000","last_change":"2024-04-24T01:24:06.765236+0000","last_active":"2024-04-24T01:24:39.843661+0000","last_peered":"2024-04-24T01:24:39.843661+0000","last_clean":"2024-04-24T01:24:39.843661+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:24:39.843661+0000","last_undegraded":"2024-04-24T01:24:39.843661+0000","last_fullsized":"2024-04-24T01:24:39.843661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:24.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.652091+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:25:25.652091+0000","last_peered":"2024-04-24T01:25:25.652091+0000","last_clean":"2024-04-24T01:25:25.652091+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:25:25.652091+0000","last_undegraded":"2024-04-24T01:25:25.652091+0000","last_fullsized":"2024-04-24T01:25:25.652091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:02.933343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.371033+0000","last_change":"2024-04-24T01:24:00.739375+0000","last_active":"2024-04-24T01:24:42.371033+0000","last_peered":"2024-04-24T01:24:42.371033+0000","last_clean":"2024-04-24T01:24:42.371033+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:24:42.371033+0000","last_undegraded":"2024-04-24T01:24:42.371033+0000","last_fullsized":"2024-04-24T01:24:42.371033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.996880+0000","last_change":"2024-04-24T01:23:58.747337+0000","last_active":"2024-04-24T01:27:09.996880+0000","last_peered":"2024-04-24T01:27:09.996880+0000","last_clean":"2024-04-24T01:27:09.996880+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:09.996880+0000","last_undegraded":"2024-04-24T01:27:09.996880+0000","last_fullsized":"2024-04-24T01:27:09.996880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:52.523923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'4","reported_seq":226,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.270639+0000","last_change":"2024-04-24T01:24:02.754621+0000","last_active":"2024-04-24T01:26:09.270639+0000","last_peered":"2024-04-24T01:26:09.270639+0000","last_clean":"2024-04-24T01:26:09.270639+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:26:09.270639+0000","last_undegraded":"2024-04-24T01:26:09.270639+0000","last_fullsized":"2024-04-24T01:26:09.270639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:50.938939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.124152+0000","last_change":"2024-04-24T01:24:04.757399+0000","last_active":"2024-04-24T01:26:08.124152+0000","last_peered":"2024-04-24T01:26:08.124152+0000","last_clean":"2024-04-24T01:26:08.124152+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:26:08.124152+0000","last_undegraded":"2024-04-24T01:26:08.124152+0000","last_fullsized":"2024-04-24T01:26:08.124152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:32.641634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842244+0000","last_change":"2024-04-24T01:24:06.770235+0000","last_active":"2024-04-24T01:24:39.842244+0000","last_peered":"2024-04-24T01:24:39.842244+0000","last_clean":"2024-04-24T01:24:39.842244+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:24:39.842244+0000","last_undegraded":"2024-04-24T01:24:39.842244+0000","last_fullsized":"2024-04-24T01:24:39.842244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:57.117920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:19.779279+0000","last_change":"2024-04-24T01:24:08.772727+0000","last_active":"2024-04-24T01:25:19.779279+0000","last_peered":"2024-04-24T01:25:19.779279+0000","last_clean":"2024-04-24T01:25:19.779279+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:25:19.779279+0000","last_undegraded":"2024-04-24T01:25:19.779279+0000","last_fullsized":"2024-04-24T01:25:19.779279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:52.582338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642683+0000","last_change":"2024-04-24T01:24:00.740217+0000","last_active":"2024-04-24T01:26:09.642683+0000","last_peered":"2024-04-24T01:26:09.642683+0000","last_clean":"2024-04-24T01:26:09.642683+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:26:09.642683+0000","last_undegraded":"2024-04-24T01:26:09.642683+0000","last_fullsized":"2024-04-24T01:26:09.642683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:44.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983645+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:26:13.983645+0000","last_peered":"2024-04-24T01:26:13.983645+0000","last_clean":"2024-04-24T01:26:13.983645+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:26:13.983645+0000","last_undegraded":"2024-04-24T01:26:13.983645+0000","last_fullsized":"2024-04-24T01:26:13.983645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:57.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842662+0000","last_change":"2024-04-24T01:24:02.755085+0000","last_active":"2024-04-24T01:24:39.842662+0000","last_peered":"2024-04-24T01:24:39.842662+0000","last_clean":"2024-04-24T01:24:39.842662+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:24:39.842662+0000","last_undegraded":"2024-04-24T01:24:39.842662+0000","last_fullsized":"2024-04-24T01:24:39.842662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:00.515637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.146601+0000","last_change":"2024-04-24T01:24:04.760716+0000","last_active":"2024-04-24T01:26:08.146601+0000","last_peered":"2024-04-24T01:26:08.146601+0000","last_clean":"2024-04-24T01:26:08.146601+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:26:08.146601+0000","last_undegraded":"2024-04-24T01:26:08.146601+0000","last_fullsized":"2024-04-24T01:26:08.146601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:02.956787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'282","reported_seq":376,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.457969+0000","last_change":"2024-04-24T01:24:06.770574+0000","last_active":"2024-04-24T01:27:10.457969+0000","last_peered":"2024-04-24T01:27:10.457969+0000","last_clean":"2024-04-24T01:27:10.457969+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:10.457969+0000","last_undegraded":"2024-04-24T01:27:10.457969+0000","last_fullsized":"2024-04-24T01:27:10.457969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:45:08.995703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842818+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:24:39.842818+0000","last_peered":"2024-04-24T01:24:39.842818+0000","last_clean":"2024-04-24T01:24:39.842818+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:24:39.842818+0000","last_undegraded":"2024-04-24T01:24:39.842818+0000","last_fullsized":"2024-04-24T01:24:39.842818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:07.197054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370607+0000","last_change":"2024-04-24T01:24:00.731534+0000","last_active":"2024-04-24T01:26:06.370607+0000","last_peered":"2024-04-24T01:26:06.370607+0000","last_clean":"2024-04-24T01:26:06.370607+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:26:06.370607+0000","last_undegraded":"2024-04-24T01:26:06.370607+0000","last_fullsized":"2024-04-24T01:26:06.370607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:02.215844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791221+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:24:39.791221+0000","last_peered":"2024-04-24T01:24:39.791221+0000","last_clean":"2024-04-24T01:24:39.791221+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:24:39.791221+0000","last_undegraded":"2024-04-24T01:24:39.791221+0000","last_fullsized":"2024-04-24T01:24:39.791221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:00.208350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841637+0000","last_change":"2024-04-24T01:24:02.754790+0000","last_active":"2024-04-24T01:24:39.841637+0000","last_peered":"2024-04-24T01:24:39.841637+0000","last_clean":"2024-04-24T01:24:39.841637+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:24:39.841637+0000","last_undegraded":"2024-04-24T01:24:39.841637+0000","last_fullsized":"2024-04-24T01:24:39.841637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:34.987188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.148643+0000","last_change":"2024-04-24T01:24:04.761320+0000","last_active":"2024-04-24T01:26:08.148643+0000","last_peered":"2024-04-24T01:26:08.148643+0000","last_clean":"2024-04-24T01:26:08.148643+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:26:08.148643+0000","last_undegraded":"2024-04-24T01:26:08.148643+0000","last_fullsized":"2024-04-24T01:26:08.148643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:36:40.993593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841213+0000","last_change":"2024-04-24T01:24:06.769787+0000","last_active":"2024-04-24T01:24:39.841213+0000","last_peered":"2024-04-24T01:24:39.841213+0000","last_clean":"2024-04-24T01:24:39.841213+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:24:39.841213+0000","last_undegraded":"2024-04-24T01:24:39.841213+0000","last_fullsized":"2024-04-24T01:24:39.841213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:14.938788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.435601+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.435601+0000","last_peered":"2024-04-24T01:27:10.435601+0000","last_clean":"2024-04-24T01:27:10.435601+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.435601+0000","last_undegraded":"2024-04-24T01:27:10.435601+0000","last_fullsized":"2024-04-24T01:27:10.435601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:26.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039360+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.039360+0000","last_peered":"2024-04-24T01:27:10.039360+0000","last_clean":"2024-04-24T01:27:10.039360+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.039360+0000","last_undegraded":"2024-04-24T01:27:10.039360+0000","last_fullsized":"2024-04-24T01:27:10.039360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:50.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894208+0000","last_change":"2024-04-24T01:23:58.747661+0000","last_active":"2024-04-24T01:24:41.894208+0000","last_peered":"2024-04-24T01:24:41.894208+0000","last_clean":"2024-04-24T01:24:41.894208+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:24:41.894208+0000","last_undegraded":"2024-04-24T01:24:41.894208+0000","last_fullsized":"2024-04-24T01:24:41.894208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:15.213886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792715+0000","last_change":"2024-04-24T01:24:02.751285+0000","last_active":"2024-04-24T01:24:39.792715+0000","last_peered":"2024-04-24T01:24:39.792715+0000","last_clean":"2024-04-24T01:24:39.792715+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:24:39.792715+0000","last_undegraded":"2024-04-24T01:24:39.792715+0000","last_fullsized":"2024-04-24T01:24:39.792715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:30.582902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.128326+0000","last_change":"2024-04-24T01:24:04.757977+0000","last_active":"2024-04-24T01:26:08.128326+0000","last_peered":"2024-04-24T01:26:08.128326+0000","last_clean":"2024-04-24T01:26:08.128326+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:26:08.128326+0000","last_undegraded":"2024-04-24T01:26:08.128326+0000","last_fullsized":"2024-04-24T01:26:08.128326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:41.769486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790314+0000","last_change":"2024-04-24T01:24:06.762347+0000","last_active":"2024-04-24T01:24:39.790314+0000","last_peered":"2024-04-24T01:24:39.790314+0000","last_clean":"2024-04-24T01:24:39.790314+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:24:39.790314+0000","last_undegraded":"2024-04-24T01:24:39.790314+0000","last_fullsized":"2024-04-24T01:24:39.790314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:11.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982729+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:26:08.982729+0000","last_peered":"2024-04-24T01:26:08.982729+0000","last_clean":"2024-04-24T01:26:08.982729+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:26:08.982729+0000","last_undegraded":"2024-04-24T01:26:08.982729+0000","last_fullsized":"2024-04-24T01:26:08.982729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:24.366261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642598+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:09.642598+0000","last_peered":"2024-04-24T01:26:09.642598+0000","last_clean":"2024-04-24T01:26:09.642598+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:09.642598+0000","last_undegraded":"2024-04-24T01:26:09.642598+0000","last_fullsized":"2024-04-24T01:26:09.642598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:49.386770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794593+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:24:39.794593+0000","last_peered":"2024-04-24T01:24:39.794593+0000","last_clean":"2024-04-24T01:24:39.794593+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:24:39.794593+0000","last_undegraded":"2024-04-24T01:24:39.794593+0000","last_fullsized":"2024-04-24T01:24:39.794593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:58.408440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842272+0000","last_change":"2024-04-24T01:24:02.754670+0000","last_active":"2024-04-24T01:24:39.842272+0000","last_peered":"2024-04-24T01:24:39.842272+0000","last_clean":"2024-04-24T01:24:39.842272+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:24:39.842272+0000","last_undegraded":"2024-04-24T01:24:39.842272+0000","last_fullsized":"2024-04-24T01:24:39.842272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:43.302766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.155674+0000","last_change":"2024-04-24T01:24:04.752408+0000","last_active":"2024-04-24T01:26:08.155674+0000","last_peered":"2024-04-24T01:26:08.155674+0000","last_clean":"2024-04-24T01:26:08.155674+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:26:08.155674+0000","last_undegraded":"2024-04-24T01:26:08.155674+0000","last_fullsized":"2024-04-24T01:26:08.155674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:05.893512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.439306+0000","last_change":"2024-04-24T01:24:06.768791+0000","last_active":"2024-04-24T01:27:10.439306+0000","last_peered":"2024-04-24T01:27:10.439306+0000","last_clean":"2024-04-24T01:27:10.439306+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:10.439306+0000","last_undegraded":"2024-04-24T01:27:10.439306+0000","last_fullsized":"2024-04-24T01:27:10.439306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:38.429385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974110+0000","last_change":"2024-04-24T01:24:08.768551+0000","last_active":"2024-04-24T01:26:16.974110+0000","last_peered":"2024-04-24T01:26:16.974110+0000","last_clean":"2024-04-24T01:26:16.974110+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:26:16.974110+0000","last_undegraded":"2024-04-24T01:26:16.974110+0000","last_fullsized":"2024-04-24T01:26:16.974110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.067146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343453+0000","last_change":"2024-04-24T01:24:00.740730+0000","last_active":"2024-04-24T01:27:10.343453+0000","last_peered":"2024-04-24T01:27:10.343453+0000","last_clean":"2024-04-24T01:27:10.343453+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:10.343453+0000","last_undegraded":"2024-04-24T01:27:10.343453+0000","last_fullsized":"2024-04-24T01:27:10.343453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.960520+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:24:42.960520+0000","last_peered":"2024-04-24T01:24:42.960520+0000","last_clean":"2024-04-24T01:24:42.960520+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:24:42.960520+0000","last_undegraded":"2024-04-24T01:24:42.960520+0000","last_fullsized":"2024-04-24T01:24:42.960520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:05:27.917471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.280792+0000","last_change":"2024-04-24T01:24:02.755990+0000","last_active":"2024-04-24T01:26:09.280792+0000","last_peered":"2024-04-24T01:26:09.280792+0000","last_clean":"2024-04-24T01:26:09.280792+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:26:09.280792+0000","last_undegraded":"2024-04-24T01:26:09.280792+0000","last_fullsized":"2024-04-24T01:26:09.280792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:13.423016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794664+0000","last_change":"2024-04-24T01:24:04.759964+0000","last_active":"2024-04-24T01:24:39.794664+0000","last_peered":"2024-04-24T01:24:39.794664+0000","last_clean":"2024-04-24T01:24:39.794664+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:24:39.794664+0000","last_undegraded":"2024-04-24T01:24:39.794664+0000","last_fullsized":"2024-04-24T01:24:39.794664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:57.073362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":459,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.398554+0000","last_change":"2024-04-24T01:24:06.769489+0000","last_active":"2024-04-24T01:27:10.398554+0000","last_peered":"2024-04-24T01:27:10.398554+0000","last_clean":"2024-04-24T01:27:10.398554+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:10.398554+0000","last_undegraded":"2024-04-24T01:27:10.398554+0000","last_fullsized":"2024-04-24T01:27:10.398554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:40.252129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.421794+0000","last_change":"2024-04-24T01:24:08.769465+0000","last_active":"2024-04-24T01:26:09.421794+0000","last_peered":"2024-04-24T01:26:09.421794+0000","last_clean":"2024-04-24T01:26:09.421794+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:26:09.421794+0000","last_undegraded":"2024-04-24T01:26:09.421794+0000","last_fullsized":"2024-04-24T01:26:09.421794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:49.696659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124448+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.124448+0000","last_peered":"2024-04-24T01:27:10.124448+0000","last_clean":"2024-04-24T01:27:10.124448+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.124448+0000","last_undegraded":"2024-04-24T01:27:10.124448+0000","last_fullsized":"2024-04-24T01:27:10.124448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:54:42.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790064+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:24:39.790064+0000","last_peered":"2024-04-24T01:24:39.790064+0000","last_clean":"2024-04-24T01:24:39.790064+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:24:39.790064+0000","last_undegraded":"2024-04-24T01:24:39.790064+0000","last_fullsized":"2024-04-24T01:24:39.790064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:51.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790262+0000","last_change":"2024-04-24T01:24:02.753182+0000","last_active":"2024-04-24T01:24:39.790262+0000","last_peered":"2024-04-24T01:24:39.790262+0000","last_clean":"2024-04-24T01:24:39.790262+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:24:39.790262+0000","last_undegraded":"2024-04-24T01:24:39.790262+0000","last_fullsized":"2024-04-24T01:24:39.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:38.392527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'40","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983864+0000","last_change":"2024-04-24T01:24:04.754866+0000","last_active":"2024-04-24T01:26:18.983864+0000","last_peered":"2024-04-24T01:26:18.983864+0000","last_clean":"2024-04-24T01:26:18.983864+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:26:18.983864+0000","last_undegraded":"2024-04-24T01:26:18.983864+0000","last_fullsized":"2024-04-24T01:26:18.983864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:19.241933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790987+0000","last_change":"2024-04-24T01:24:06.767120+0000","last_active":"2024-04-24T01:24:39.790987+0000","last_peered":"2024-04-24T01:24:39.790987+0000","last_clean":"2024-04-24T01:24:39.790987+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:24:39.790987+0000","last_undegraded":"2024-04-24T01:24:39.790987+0000","last_fullsized":"2024-04-24T01:24:39.790987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:09.566148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.375629+0000","last_change":"2024-04-24T01:24:08.772039+0000","last_active":"2024-04-24T01:27:10.375629+0000","last_peered":"2024-04-24T01:27:10.375629+0000","last_clean":"2024-04-24T01:27:10.375629+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:10.375629+0000","last_undegraded":"2024-04-24T01:27:10.375629+0000","last_fullsized":"2024-04-24T01:27:10.375629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:37.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046285+0000","last_change":"2024-04-24T01:24:00.747539+0000","last_active":"2024-04-24T01:27:10.046285+0000","last_peered":"2024-04-24T01:27:10.046285+0000","last_clean":"2024-04-24T01:27:10.046285+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:10.046285+0000","last_undegraded":"2024-04-24T01:27:10.046285+0000","last_fullsized":"2024-04-24T01:27:10.046285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:03.538221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789580+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:24:39.789580+0000","last_peered":"2024-04-24T01:24:39.789580+0000","last_clean":"2024-04-24T01:24:39.789580+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:24:39.789580+0000","last_undegraded":"2024-04-24T01:24:39.789580+0000","last_fullsized":"2024-04-24T01:24:39.789580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792236+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:24:39.792236+0000","last_peered":"2024-04-24T01:24:39.792236+0000","last_clean":"2024-04-24T01:24:39.792236+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:24:39.792236+0000","last_undegraded":"2024-04-24T01:24:39.792236+0000","last_fullsized":"2024-04-24T01:24:39.792236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:15.195026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793836+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:24:39.793836+0000","last_peered":"2024-04-24T01:24:39.793836+0000","last_clean":"2024-04-24T01:24:39.793836+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:24:39.793836+0000","last_undegraded":"2024-04-24T01:24:39.793836+0000","last_fullsized":"2024-04-24T01:24:39.793836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:25.383897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.801934+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:24:39.801934+0000","last_peered":"2024-04-24T01:24:39.801934+0000","last_clean":"2024-04-24T01:24:39.801934+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:24:39.801934+0000","last_undegraded":"2024-04-24T01:24:39.801934+0000","last_fullsized":"2024-04-24T01:24:39.801934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:39.300121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.153261+0000","last_change":"2024-04-24T01:24:04.758941+0000","last_active":"2024-04-24T01:26:08.153261+0000","last_peered":"2024-04-24T01:26:08.153261+0000","last_clean":"2024-04-24T01:26:08.153261+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:26:08.153261+0000","last_undegraded":"2024-04-24T01:26:08.153261+0000","last_fullsized":"2024-04-24T01:26:08.153261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:28.497024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770234+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:03.262620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.353300+0000","last_change":"2024-04-24T01:24:08.768417+0000","last_active":"2024-04-24T01:27:10.353300+0000","last_peered":"2024-04-24T01:27:10.353300+0000","last_clean":"2024-04-24T01:27:10.353300+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:10.353300+0000","last_undegraded":"2024-04-24T01:27:10.353300+0000","last_fullsized":"2024-04-24T01:27:10.353300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:30.971611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'3","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983682+0000","last_change":"2024-04-24T01:24:00.735658+0000","last_active":"2024-04-24T01:26:13.983682+0000","last_peered":"2024-04-24T01:26:13.983682+0000","last_clean":"2024-04-24T01:26:13.983682+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:26:13.983682+0000","last_undegraded":"2024-04-24T01:26:13.983682+0000","last_fullsized":"2024-04-24T01:26:13.983682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:42.397476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789517+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:24:39.789517+0000","last_peered":"2024-04-24T01:24:39.789517+0000","last_clean":"2024-04-24T01:24:39.789517+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:24:39.789517+0000","last_undegraded":"2024-04-24T01:24:39.789517+0000","last_fullsized":"2024-04-24T01:24:39.789517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:48.109200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972617+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:26:06.972617+0000","last_peered":"2024-04-24T01:26:06.972617+0000","last_clean":"2024-04-24T01:26:06.972617+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:26:06.972617+0000","last_undegraded":"2024-04-24T01:26:06.972617+0000","last_fullsized":"2024-04-24T01:26:06.972617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:15.111274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790478+0000","last_change":"2024-04-24T01:24:02.754010+0000","last_active":"2024-04-24T01:24:39.790478+0000","last_peered":"2024-04-24T01:24:39.790478+0000","last_clean":"2024-04-24T01:24:39.790478+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:24:39.790478+0000","last_undegraded":"2024-04-24T01:24:39.790478+0000","last_fullsized":"2024-04-24T01:24:39.790478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:31.372135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831459+0000","last_change":"2024-04-24T01:24:04.762704+0000","last_active":"2024-04-24T01:27:07.831459+0000","last_peered":"2024-04-24T01:27:07.831459+0000","last_clean":"2024-04-24T01:27:07.831459+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:07.831459+0000","last_undegraded":"2024-04-24T01:27:07.831459+0000","last_fullsized":"2024-04-24T01:27:07.831459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:37.274008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792861+0000","last_change":"2024-04-24T01:24:06.760509+0000","last_active":"2024-04-24T01:24:39.792861+0000","last_peered":"2024-04-24T01:24:39.792861+0000","last_clean":"2024-04-24T01:24:39.792861+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:24:39.792861+0000","last_undegraded":"2024-04-24T01:24:39.792861+0000","last_fullsized":"2024-04-24T01:24:39.792861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:08.522687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.647797+0000","last_change":"2024-04-24T01:24:08.773331+0000","last_active":"2024-04-24T01:25:25.647797+0000","last_peered":"2024-04-24T01:25:25.647797+0000","last_clean":"2024-04-24T01:25:25.647797+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:25:25.647797+0000","last_undegraded":"2024-04-24T01:25:25.647797+0000","last_fullsized":"2024-04-24T01:25:25.647797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.429035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261927+0000","last_change":"2024-04-24T01:24:00.746776+0000","last_active":"2024-04-24T01:27:10.261927+0000","last_peered":"2024-04-24T01:27:10.261927+0000","last_clean":"2024-04-24T01:27:10.261927+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:10.261927+0000","last_undegraded":"2024-04-24T01:27:10.261927+0000","last_fullsized":"2024-04-24T01:27:10.261927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:10.175248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789461+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:24:39.789461+0000","last_peered":"2024-04-24T01:24:39.789461+0000","last_clean":"2024-04-24T01:24:39.789461+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:24:39.789461+0000","last_undegraded":"2024-04-24T01:24:39.789461+0000","last_fullsized":"2024-04-24T01:24:39.789461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:09.383332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.840955+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:24:39.840955+0000","last_peered":"2024-04-24T01:24:39.840955+0000","last_clean":"2024-04-24T01:24:39.840955+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:24:39.840955+0000","last_undegraded":"2024-04-24T01:24:39.840955+0000","last_fullsized":"2024-04-24T01:24:39.840955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:24.635245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.281055+0000","last_change":"2024-04-24T01:24:02.752449+0000","last_active":"2024-04-24T01:26:09.281055+0000","last_peered":"2024-04-24T01:26:09.281055+0000","last_clean":"2024-04-24T01:26:09.281055+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:26:09.281055+0000","last_undegraded":"2024-04-24T01:26:09.281055+0000","last_fullsized":"2024-04-24T01:26:09.281055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:25.280491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831477+0000","last_change":"2024-04-24T01:24:04.757333+0000","last_active":"2024-04-24T01:27:07.831477+0000","last_peered":"2024-04-24T01:27:07.831477+0000","last_clean":"2024-04-24T01:27:07.831477+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:07.831477+0000","last_undegraded":"2024-04-24T01:27:07.831477+0000","last_fullsized":"2024-04-24T01:27:07.831477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:05.189769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770584+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:27.982282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790216+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:24:39.790216+0000","last_peered":"2024-04-24T01:24:39.790216+0000","last_clean":"2024-04-24T01:24:39.790216+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:24:39.790216+0000","last_undegraded":"2024-04-24T01:24:39.790216+0000","last_fullsized":"2024-04-24T01:24:39.790216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:30.742533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349653+0000","last_change":"2024-04-24T01:24:00.731982+0000","last_active":"2024-04-24T01:27:10.349653+0000","last_peered":"2024-04-24T01:27:10.349653+0000","last_clean":"2024-04-24T01:27:10.349653+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:10.349653+0000","last_undegraded":"2024-04-24T01:27:10.349653+0000","last_fullsized":"2024-04-24T01:27:10.349653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:01.094309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793490+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:24:39.793490+0000","last_peered":"2024-04-24T01:24:39.793490+0000","last_clean":"2024-04-24T01:24:39.793490+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:24:39.793490+0000","last_undegraded":"2024-04-24T01:24:39.793490+0000","last_fullsized":"2024-04-24T01:24:39.793490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:52.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.618279+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.618279+0000","last_peered":"2024-04-24T01:26:09.618279+0000","last_clean":"2024-04-24T01:26:09.618279+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.618279+0000","last_undegraded":"2024-04-24T01:26:09.618279+0000","last_fullsized":"2024-04-24T01:26:09.618279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842816+0000","last_change":"2024-04-24T01:24:02.751517+0000","last_active":"2024-04-24T01:24:39.842816+0000","last_peered":"2024-04-24T01:24:39.842816+0000","last_clean":"2024-04-24T01:24:39.842816+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:24:39.842816+0000","last_undegraded":"2024-04-24T01:24:39.842816+0000","last_fullsized":"2024-04-24T01:24:39.842816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:05.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.655738+0000","last_change":"2024-04-24T01:24:04.760913+0000","last_active":"2024-04-24T01:27:09.655738+0000","last_peered":"2024-04-24T01:27:09.655738+0000","last_clean":"2024-04-24T01:27:09.655738+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:09.655738+0000","last_undegraded":"2024-04-24T01:27:09.655738+0000","last_fullsized":"2024-04-24T01:27:09.655738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:30.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790734+0000","last_change":"2024-04-24T01:24:06.760113+0000","last_active":"2024-04-24T01:24:39.790734+0000","last_peered":"2024-04-24T01:24:39.790734+0000","last_clean":"2024-04-24T01:24:39.790734+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:24:39.790734+0000","last_undegraded":"2024-04-24T01:24:39.790734+0000","last_fullsized":"2024-04-24T01:24:39.790734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:00.960850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.398901+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:09.398901+0000","last_peered":"2024-04-24T01:26:09.398901+0000","last_clean":"2024-04-24T01:26:09.398901+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:09.398901+0000","last_undegraded":"2024-04-24T01:26:09.398901+0000","last_fullsized":"2024-04-24T01:26:09.398901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:04.383799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040345+0000","last_change":"2024-04-24T01:24:00.742538+0000","last_active":"2024-04-24T01:27:10.040345+0000","last_peered":"2024-04-24T01:27:10.040345+0000","last_clean":"2024-04-24T01:27:10.040345+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:10.040345+0000","last_undegraded":"2024-04-24T01:27:10.040345+0000","last_fullsized":"2024-04-24T01:27:10.040345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:22.605289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.243741+0000","last_change":"2024-04-24T01:23:58.743583+0000","last_active":"2024-04-24T01:27:10.243741+0000","last_peered":"2024-04-24T01:27:10.243741+0000","last_clean":"2024-04-24T01:27:10.243741+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:10.243741+0000","last_undegraded":"2024-04-24T01:27:10.243741+0000","last_fullsized":"2024-04-24T01:27:10.243741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842590+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:24:39.842590+0000","last_peered":"2024-04-24T01:24:39.842590+0000","last_clean":"2024-04-24T01:24:39.842590+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:24:39.842590+0000","last_undegraded":"2024-04-24T01:24:39.842590+0000","last_fullsized":"2024-04-24T01:24:39.842590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:24.173468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972667+0000","last_change":"2024-04-24T01:24:02.750475+0000","last_active":"2024-04-24T01:26:06.972667+0000","last_peered":"2024-04-24T01:26:06.972667+0000","last_clean":"2024-04-24T01:26:06.972667+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:26:06.972667+0000","last_undegraded":"2024-04-24T01:26:06.972667+0000","last_fullsized":"2024-04-24T01:26:06.972667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:41.546855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'74","reported_seq":145,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.154417+0000","last_change":"2024-04-24T01:24:04.759676+0000","last_active":"2024-04-24T01:26:08.154417+0000","last_peered":"2024-04-24T01:26:08.154417+0000","last_clean":"2024-04-24T01:26:08.154417+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:26:08.154417+0000","last_undegraded":"2024-04-24T01:26:08.154417+0000","last_fullsized":"2024-04-24T01:26:08.154417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:49.476095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":63,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788138+0000","last_change":"2024-04-24T01:24:06.768799+0000","last_active":"2024-04-24T01:24:39.788138+0000","last_peered":"2024-04-24T01:24:39.788138+0000","last_clean":"2024-04-24T01:24:39.788138+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:24:39.788138+0000","last_undegraded":"2024-04-24T01:24:39.788138+0000","last_fullsized":"2024-04-24T01:24:39.788138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:29.140123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.578357+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:09.578357+0000","last_peered":"2024-04-24T01:26:09.578357+0000","last_clean":"2024-04-24T01:26:09.578357+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:09.578357+0000","last_undegraded":"2024-04-24T01:26:09.578357+0000","last_fullsized":"2024-04-24T01:26:09.578357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:58.022650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269116+0000","last_change":"2024-04-24T01:24:00.740995+0000","last_active":"2024-04-24T01:27:10.269116+0000","last_peered":"2024-04-24T01:27:10.269116+0000","last_clean":"2024-04-24T01:27:10.269116+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:10.269116+0000","last_undegraded":"2024-04-24T01:27:10.269116+0000","last_fullsized":"2024-04-24T01:27:10.269116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:25.504403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843750+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:24:39.843750+0000","last_peered":"2024-04-24T01:24:39.843750+0000","last_clean":"2024-04-24T01:24:39.843750+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:24:39.843750+0000","last_undegraded":"2024-04-24T01:24:39.843750+0000","last_fullsized":"2024-04-24T01:24:39.843750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:33.415474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793649+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:24:39.793649+0000","last_peered":"2024-04-24T01:24:39.793649+0000","last_clean":"2024-04-24T01:24:39.793649+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:24:39.793649+0000","last_undegraded":"2024-04-24T01:24:39.793649+0000","last_fullsized":"2024-04-24T01:24:39.793649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:49:44.621596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793155+0000","last_change":"2024-04-24T01:24:02.753858+0000","last_active":"2024-04-24T01:24:39.793155+0000","last_peered":"2024-04-24T01:24:39.793155+0000","last_clean":"2024-04-24T01:24:39.793155+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:24:39.793155+0000","last_undegraded":"2024-04-24T01:24:39.793155+0000","last_fullsized":"2024-04-24T01:24:39.793155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:56.906730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794508+0000","last_change":"2024-04-24T01:24:04.761717+0000","last_active":"2024-04-24T01:24:39.794508+0000","last_peered":"2024-04-24T01:24:39.794508+0000","last_clean":"2024-04-24T01:24:39.794508+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:24:39.794508+0000","last_undegraded":"2024-04-24T01:24:39.794508+0000","last_fullsized":"2024-04-24T01:24:39.794508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.225449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":356,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448921+0000","last_change":"2024-04-24T01:24:06.769511+0000","last_active":"2024-04-24T01:27:10.448921+0000","last_peered":"2024-04-24T01:27:10.448921+0000","last_clean":"2024-04-24T01:27:10.448921+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:10.448921+0000","last_undegraded":"2024-04-24T01:27:10.448921+0000","last_fullsized":"2024-04-24T01:27:10.448921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:27.014536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.876452+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:25:25.876452+0000","last_peered":"2024-04-24T01:25:25.876452+0000","last_clean":"2024-04-24T01:25:25.876452+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:25:25.876452+0000","last_undegraded":"2024-04-24T01:25:25.876452+0000","last_fullsized":"2024-04-24T01:25:25.876452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.793963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791495+0000","last_change":"2024-04-24T01:24:00.748141+0000","last_active":"2024-04-24T01:24:39.791495+0000","last_peered":"2024-04-24T01:24:39.791495+0000","last_clean":"2024-04-24T01:24:39.791495+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:24:39.791495+0000","last_undegraded":"2024-04-24T01:24:39.791495+0000","last_fullsized":"2024-04-24T01:24:39.791495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:01.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791804+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:24:39.791804+0000","last_peered":"2024-04-24T01:24:39.791804+0000","last_clean":"2024-04-24T01:24:39.791804+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:24:39.791804+0000","last_undegraded":"2024-04-24T01:24:39.791804+0000","last_fullsized":"2024-04-24T01:24:39.791804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:42.186635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843585+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:24:39.843585+0000","last_peered":"2024-04-24T01:24:39.843585+0000","last_clean":"2024-04-24T01:24:39.843585+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:24:39.843585+0000","last_undegraded":"2024-04-24T01:24:39.843585+0000","last_fullsized":"2024-04-24T01:24:39.843585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.744197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.799913+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:24:39.799913+0000","last_peered":"2024-04-24T01:24:39.799913+0000","last_clean":"2024-04-24T01:24:39.799913+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:24:39.799913+0000","last_undegraded":"2024-04-24T01:24:39.799913+0000","last_fullsized":"2024-04-24T01:24:39.799913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.029820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794303+0000","last_change":"2024-04-24T01:24:04.761597+0000","last_active":"2024-04-24T01:24:39.794303+0000","last_peered":"2024-04-24T01:24:39.794303+0000","last_clean":"2024-04-24T01:24:39.794303+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:24:39.794303+0000","last_undegraded":"2024-04-24T01:24:39.794303+0000","last_fullsized":"2024-04-24T01:24:39.794303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:04.640275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'282","reported_seq":412,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.436168+0000","last_change":"2024-04-24T01:24:06.765101+0000","last_active":"2024-04-24T01:27:10.436168+0000","last_peered":"2024-04-24T01:27:10.436168+0000","last_clean":"2024-04-24T01:27:10.436168+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:10.436168+0000","last_undegraded":"2024-04-24T01:27:10.436168+0000","last_fullsized":"2024-04-24T01:27:10.436168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:06.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797965+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:24:39.797965+0000","last_peered":"2024-04-24T01:24:39.797965+0000","last_clean":"2024-04-24T01:24:39.797965+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:24:39.797965+0000","last_undegraded":"2024-04-24T01:24:39.797965+0000","last_fullsized":"2024-04-24T01:24:39.797965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:06.970384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.038450+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.038450+0000","last_peered":"2024-04-24T01:27:10.038450+0000","last_clean":"2024-04-24T01:27:10.038450+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.038450+0000","last_undegraded":"2024-04-24T01:27:10.038450+0000","last_fullsized":"2024-04-24T01:27:10.038450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.048730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797039+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:24:39.797039+0000","last_peered":"2024-04-24T01:24:39.797039+0000","last_clean":"2024-04-24T01:24:39.797039+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:24:39.797039+0000","last_undegraded":"2024-04-24T01:24:39.797039+0000","last_fullsized":"2024-04-24T01:24:39.797039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794665+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:24:39.794665+0000","last_peered":"2024-04-24T01:24:39.794665+0000","last_clean":"2024-04-24T01:24:39.794665+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:24:39.794665+0000","last_undegraded":"2024-04-24T01:24:39.794665+0000","last_fullsized":"2024-04-24T01:24:39.794665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.535319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789366+0000","last_change":"2024-04-24T01:24:02.755458+0000","last_active":"2024-04-24T01:24:39.789366+0000","last_peered":"2024-04-24T01:24:39.789366+0000","last_clean":"2024-04-24T01:24:39.789366+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:24:39.789366+0000","last_undegraded":"2024-04-24T01:24:39.789366+0000","last_fullsized":"2024-04-24T01:24:39.789366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:22.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.138976+0000","last_change":"2024-04-24T01:24:04.761852+0000","last_active":"2024-04-24T01:26:08.138976+0000","last_peered":"2024-04-24T01:26:08.138976+0000","last_clean":"2024-04-24T01:26:08.138976+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:26:08.138976+0000","last_undegraded":"2024-04-24T01:26:08.138976+0000","last_fullsized":"2024-04-24T01:26:08.138976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:40.393254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841291+0000","last_change":"2024-04-24T01:24:06.769694+0000","last_active":"2024-04-24T01:24:39.841291+0000","last_peered":"2024-04-24T01:24:39.841291+0000","last_clean":"2024-04-24T01:24:39.841291+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:24:39.841291+0000","last_undegraded":"2024-04-24T01:24:39.841291+0000","last_fullsized":"2024-04-24T01:24:39.841291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:24.633566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.127833+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.127833+0000","last_peered":"2024-04-24T01:27:10.127833+0000","last_clean":"2024-04-24T01:27:10.127833+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.127833+0000","last_undegraded":"2024-04-24T01:27:10.127833+0000","last_fullsized":"2024-04-24T01:27:10.127833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:29.020694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792868+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:24:39.792868+0000","last_peered":"2024-04-24T01:24:39.792868+0000","last_clean":"2024-04-24T01:24:39.792868+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:24:39.792868+0000","last_undegraded":"2024-04-24T01:24:39.792868+0000","last_fullsized":"2024-04-24T01:24:39.792868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:40.801219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984452+0000","last_change":"2024-04-24T01:24:00.738356+0000","last_active":"2024-04-24T01:26:23.984452+0000","last_peered":"2024-04-24T01:26:23.984452+0000","last_clean":"2024-04-24T01:26:23.984452+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:26:23.984452+0000","last_undegraded":"2024-04-24T01:26:23.984452+0000","last_fullsized":"2024-04-24T01:26:23.984452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:27.391392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791345+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:24:39.791345+0000","last_peered":"2024-04-24T01:24:39.791345+0000","last_clean":"2024-04-24T01:24:39.791345+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:24:39.791345+0000","last_undegraded":"2024-04-24T01:24:39.791345+0000","last_fullsized":"2024-04-24T01:24:39.791345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:47.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795254+0000","last_change":"2024-04-24T01:24:02.754871+0000","last_active":"2024-04-24T01:24:39.795254+0000","last_peered":"2024-04-24T01:24:39.795254+0000","last_clean":"2024-04-24T01:24:39.795254+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:24:39.795254+0000","last_undegraded":"2024-04-24T01:24:39.795254+0000","last_fullsized":"2024-04-24T01:24:39.795254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:06.026635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985063+0000","last_change":"2024-04-24T01:24:04.759052+0000","last_active":"2024-04-24T01:26:23.985063+0000","last_peered":"2024-04-24T01:26:23.985063+0000","last_clean":"2024-04-24T01:26:23.985063+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:26:23.985063+0000","last_undegraded":"2024-04-24T01:26:23.985063+0000","last_fullsized":"2024-04-24T01:26:23.985063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:10.084623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792919+0000","last_change":"2024-04-24T01:24:06.767554+0000","last_active":"2024-04-24T01:24:39.792919+0000","last_peered":"2024-04-24T01:24:39.792919+0000","last_clean":"2024-04-24T01:24:39.792919+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:24:39.792919+0000","last_undegraded":"2024-04-24T01:24:39.792919+0000","last_fullsized":"2024-04-24T01:24:39.792919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.395728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.739765+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:09.739765+0000","last_peered":"2024-04-24T01:27:09.739765+0000","last_clean":"2024-04-24T01:27:09.739765+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:09.739765+0000","last_undegraded":"2024-04-24T01:27:09.739765+0000","last_fullsized":"2024-04-24T01:27:09.739765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:31.337496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314081+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.314081+0000","last_peered":"2024-04-24T01:27:10.314081+0000","last_clean":"2024-04-24T01:27:10.314081+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.314081+0000","last_undegraded":"2024-04-24T01:27:10.314081+0000","last_fullsized":"2024-04-24T01:27:10.314081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984537+0000","last_change":"2024-04-24T01:23:58.742514+0000","last_active":"2024-04-24T01:26:23.984537+0000","last_peered":"2024-04-24T01:26:23.984537+0000","last_clean":"2024-04-24T01:26:23.984537+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:26:23.984537+0000","last_undegraded":"2024-04-24T01:26:23.984537+0000","last_fullsized":"2024-04-24T01:26:23.984537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792781+0000","last_change":"2024-04-24T01:24:02.753260+0000","last_active":"2024-04-24T01:24:39.792781+0000","last_peered":"2024-04-24T01:24:39.792781+0000","last_clean":"2024-04-24T01:24:39.792781+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:24:39.792781+0000","last_undegraded":"2024-04-24T01:24:39.792781+0000","last_fullsized":"2024-04-24T01:24:39.792781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:34.774605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.660299+0000","last_change":"2024-04-24T01:24:04.746990+0000","last_active":"2024-04-24T01:27:09.660299+0000","last_peered":"2024-04-24T01:27:09.660299+0000","last_clean":"2024-04-24T01:27:09.660299+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:09.660299+0000","last_undegraded":"2024-04-24T01:27:09.660299+0000","last_fullsized":"2024-04-24T01:27:09.660299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:37.157422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789266+0000","last_change":"2024-04-24T01:24:06.763815+0000","last_active":"2024-04-24T01:24:39.789266+0000","last_peered":"2024-04-24T01:24:39.789266+0000","last_clean":"2024-04-24T01:24:39.789266+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:24:39.789266+0000","last_undegraded":"2024-04-24T01:24:39.789266+0000","last_fullsized":"2024-04-24T01:24:39.789266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:48.425403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.639815+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:09.639815+0000","last_peered":"2024-04-24T01:26:09.639815+0000","last_clean":"2024-04-24T01:26:09.639815+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:09.639815+0000","last_undegraded":"2024-04-24T01:26:09.639815+0000","last_fullsized":"2024-04-24T01:26:09.639815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:43.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974876+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:26:21.974876+0000","last_peered":"2024-04-24T01:26:21.974876+0000","last_clean":"2024-04-24T01:26:21.974876+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:26:21.974876+0000","last_undegraded":"2024-04-24T01:26:21.974876+0000","last_fullsized":"2024-04-24T01:26:21.974876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:50.598466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793735+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:24:39.793735+0000","last_peered":"2024-04-24T01:24:39.793735+0000","last_clean":"2024-04-24T01:24:39.793735+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:24:39.793735+0000","last_undegraded":"2024-04-24T01:24:39.793735+0000","last_fullsized":"2024-04-24T01:24:39.793735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:26.434050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788571+0000","last_change":"2024-04-24T01:24:02.751458+0000","last_active":"2024-04-24T01:24:39.788571+0000","last_peered":"2024-04-24T01:24:39.788571+0000","last_clean":"2024-04-24T01:24:39.788571+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:24:39.788571+0000","last_undegraded":"2024-04-24T01:24:39.788571+0000","last_fullsized":"2024-04-24T01:24:39.788571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:42.145688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'43","reported_seq":102,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.352141+0000","last_change":"2024-04-24T01:24:04.755755+0000","last_active":"2024-04-24T01:27:10.352141+0000","last_peered":"2024-04-24T01:27:10.352141+0000","last_clean":"2024-04-24T01:27:10.352141+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:10.352141+0000","last_undegraded":"2024-04-24T01:27:10.352141+0000","last_fullsized":"2024-04-24T01:27:10.352141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:33.640976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795040+0000","last_change":"2024-04-24T01:24:06.769210+0000","last_active":"2024-04-24T01:24:39.795040+0000","last_peered":"2024-04-24T01:24:39.795040+0000","last_clean":"2024-04-24T01:24:39.795040+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:24:39.795040+0000","last_undegraded":"2024-04-24T01:24:39.795040+0000","last_fullsized":"2024-04-24T01:24:39.795040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:03.675110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790701+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:24:39.790701+0000","last_peered":"2024-04-24T01:24:39.790701+0000","last_clean":"2024-04-24T01:24:39.790701+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:24:39.790701+0000","last_undegraded":"2024-04-24T01:24:39.790701+0000","last_fullsized":"2024-04-24T01:24:39.790701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:18.860876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313998+0000","last_change":"2024-04-24T01:24:00.748273+0000","last_active":"2024-04-24T01:27:10.313998+0000","last_peered":"2024-04-24T01:27:10.313998+0000","last_clean":"2024-04-24T01:27:10.313998+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:10.313998+0000","last_undegraded":"2024-04-24T01:27:10.313998+0000","last_fullsized":"2024-04-24T01:27:10.313998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:39.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.349714+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:24:42.349714+0000","last_peered":"2024-04-24T01:24:42.349714+0000","last_clean":"2024-04-24T01:24:42.349714+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:24:42.349714+0000","last_undegraded":"2024-04-24T01:24:42.349714+0000","last_fullsized":"2024-04-24T01:24:42.349714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:55.545071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794708+0000","last_change":"2024-04-24T01:24:02.753232+0000","last_active":"2024-04-24T01:24:39.794708+0000","last_peered":"2024-04-24T01:24:39.794708+0000","last_clean":"2024-04-24T01:24:39.794708+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:24:39.794708+0000","last_undegraded":"2024-04-24T01:24:39.794708+0000","last_fullsized":"2024-04-24T01:24:39.794708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:59.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.130351+0000","last_change":"2024-04-24T01:24:04.749427+0000","last_active":"2024-04-24T01:26:08.130351+0000","last_peered":"2024-04-24T01:26:08.130351+0000","last_clean":"2024-04-24T01:26:08.130351+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:26:08.130351+0000","last_undegraded":"2024-04-24T01:26:08.130351+0000","last_fullsized":"2024-04-24T01:26:08.130351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:20.707833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790257+0000","last_change":"2024-04-24T01:24:06.765858+0000","last_active":"2024-04-24T01:24:39.790257+0000","last_peered":"2024-04-24T01:24:39.790257+0000","last_clean":"2024-04-24T01:24:39.790257+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:24:39.790257+0000","last_undegraded":"2024-04-24T01:24:39.790257+0000","last_fullsized":"2024-04-24T01:24:39.790257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:41.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.712721+0000","last_change":"2024-04-24T01:24:00.736176+0000","last_active":"2024-04-24T01:24:42.712721+0000","last_peered":"2024-04-24T01:24:42.712721+0000","last_clean":"2024-04-24T01:24:42.712721+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:24:42.712721+0000","last_undegraded":"2024-04-24T01:24:42.712721+0000","last_fullsized":"2024-04-24T01:24:42.712721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:43.962305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789625+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:24:39.789625+0000","last_peered":"2024-04-24T01:24:39.789625+0000","last_clean":"2024-04-24T01:24:39.789625+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:24:39.789625+0000","last_undegraded":"2024-04-24T01:24:39.789625+0000","last_fullsized":"2024-04-24T01:24:39.789625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843577+0000","last_change":"2024-04-24T01:24:02.752935+0000","last_active":"2024-04-24T01:24:39.843577+0000","last_peered":"2024-04-24T01:24:39.843577+0000","last_clean":"2024-04-24T01:24:39.843577+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:24:39.843577+0000","last_undegraded":"2024-04-24T01:24:39.843577+0000","last_fullsized":"2024-04-24T01:24:39.843577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:47:05.280503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'60","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.152050+0000","last_change":"2024-04-24T01:24:04.754439+0000","last_active":"2024-04-24T01:26:08.152050+0000","last_peered":"2024-04-24T01:26:08.152050+0000","last_clean":"2024-04-24T01:26:08.152050+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:26:08.152050+0000","last_undegraded":"2024-04-24T01:26:08.152050+0000","last_fullsized":"2024-04-24T01:26:08.152050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:32.262142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":58,"num_read_kb":48,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790895+0000","last_change":"2024-04-24T01:24:06.765083+0000","last_active":"2024-04-24T01:24:39.790895+0000","last_peered":"2024-04-24T01:24:39.790895+0000","last_clean":"2024-04-24T01:24:39.790895+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:24:39.790895+0000","last_undegraded":"2024-04-24T01:24:39.790895+0000","last_fullsized":"2024-04-24T01:24:39.790895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:11.672040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.396373+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.396373+0000","last_peered":"2024-04-24T01:27:10.396373+0000","last_clean":"2024-04-24T01:27:10.396373+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.396373+0000","last_undegraded":"2024-04-24T01:27:10.396373+0000","last_fullsized":"2024-04-24T01:27:10.396373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:59.796477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314066+0000","last_change":"2024-04-24T01:24:00.746542+0000","last_active":"2024-04-24T01:27:10.314066+0000","last_peered":"2024-04-24T01:27:10.314066+0000","last_clean":"2024-04-24T01:27:10.314066+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:10.314066+0000","last_undegraded":"2024-04-24T01:27:10.314066+0000","last_fullsized":"2024-04-24T01:27:10.314066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:34:54.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984466+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:26:23.984466+0000","last_peered":"2024-04-24T01:26:23.984466+0000","last_clean":"2024-04-24T01:26:23.984466+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:26:23.984466+0000","last_undegraded":"2024-04-24T01:26:23.984466+0000","last_fullsized":"2024-04-24T01:26:23.984466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793348+0000","last_change":"2024-04-24T01:24:02.750800+0000","last_active":"2024-04-24T01:24:39.793348+0000","last_peered":"2024-04-24T01:24:39.793348+0000","last_clean":"2024-04-24T01:24:39.793348+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:24:39.793348+0000","last_undegraded":"2024-04-24T01:24:39.793348+0000","last_fullsized":"2024-04-24T01:24:39.793348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:37.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.131427+0000","last_change":"2024-04-24T01:24:04.758945+0000","last_active":"2024-04-24T01:26:08.131427+0000","last_peered":"2024-04-24T01:26:08.131427+0000","last_clean":"2024-04-24T01:26:08.131427+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:26:08.131427+0000","last_undegraded":"2024-04-24T01:26:08.131427+0000","last_fullsized":"2024-04-24T01:26:08.131427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:50.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796689+0000","last_change":"2024-04-24T01:24:06.771761+0000","last_active":"2024-04-24T01:24:39.796689+0000","last_peered":"2024-04-24T01:24:39.796689+0000","last_clean":"2024-04-24T01:24:39.796689+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:24:39.796689+0000","last_undegraded":"2024-04-24T01:24:39.796689+0000","last_fullsized":"2024-04-24T01:24:39.796689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:35.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792017+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:24:39.792017+0000","last_peered":"2024-04-24T01:24:39.792017+0000","last_clean":"2024-04-24T01:24:39.792017+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:24:39.792017+0000","last_undegraded":"2024-04-24T01:24:39.792017+0000","last_fullsized":"2024-04-24T01:24:39.792017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:33.305911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794785+0000","last_change":"2024-04-24T01:24:00.748328+0000","last_active":"2024-04-24T01:24:39.794785+0000","last_peered":"2024-04-24T01:24:39.794785+0000","last_clean":"2024-04-24T01:24:39.794785+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:24:39.794785+0000","last_undegraded":"2024-04-24T01:24:39.794785+0000","last_fullsized":"2024-04-24T01:24:39.794785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:32.401459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795365+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:24:39.795365+0000","last_peered":"2024-04-24T01:24:39.795365+0000","last_clean":"2024-04-24T01:24:39.795365+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:24:39.795365+0000","last_undegraded":"2024-04-24T01:24:39.795365+0000","last_fullsized":"2024-04-24T01:24:39.795365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791825+0000","last_change":"2024-04-24T01:24:02.751213+0000","last_active":"2024-04-24T01:24:39.791825+0000","last_peered":"2024-04-24T01:24:39.791825+0000","last_clean":"2024-04-24T01:24:39.791825+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:24:39.791825+0000","last_undegraded":"2024-04-24T01:24:39.791825+0000","last_fullsized":"2024-04-24T01:24:39.791825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:17.078503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'38","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.150009+0000","last_change":"2024-04-24T01:24:04.759228+0000","last_active":"2024-04-24T01:26:08.150009+0000","last_peered":"2024-04-24T01:26:08.150009+0000","last_clean":"2024-04-24T01:26:08.150009+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:26:08.150009+0000","last_undegraded":"2024-04-24T01:26:08.150009+0000","last_fullsized":"2024-04-24T01:26:08.150009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:35.649948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842771+0000","last_change":"2024-04-24T01:24:06.767031+0000","last_active":"2024-04-24T01:24:39.842771+0000","last_peered":"2024-04-24T01:24:39.842771+0000","last_clean":"2024-04-24T01:24:39.842771+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:24:39.842771+0000","last_undegraded":"2024-04-24T01:24:39.842771+0000","last_fullsized":"2024-04-24T01:24:39.842771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:10.767999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.638179+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:09.638179+0000","last_peered":"2024-04-24T01:26:09.638179+0000","last_clean":"2024-04-24T01:26:09.638179+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:09.638179+0000","last_undegraded":"2024-04-24T01:26:09.638179+0000","last_fullsized":"2024-04-24T01:26:09.638179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:34.213505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370705+0000","last_change":"2024-04-24T01:24:00.732301+0000","last_active":"2024-04-24T01:26:06.370705+0000","last_peered":"2024-04-24T01:26:06.370705+0000","last_clean":"2024-04-24T01:26:06.370705+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:26:06.370705+0000","last_undegraded":"2024-04-24T01:26:06.370705+0000","last_fullsized":"2024-04-24T01:26:06.370705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:24.753026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791433+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:24:39.791433+0000","last_peered":"2024-04-24T01:24:39.791433+0000","last_clean":"2024-04-24T01:24:39.791433+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:24:39.791433+0000","last_undegraded":"2024-04-24T01:24:39.791433+0000","last_fullsized":"2024-04-24T01:24:39.791433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:26.702951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797556+0000","last_change":"2024-04-24T01:24:02.753145+0000","last_active":"2024-04-24T01:24:39.797556+0000","last_peered":"2024-04-24T01:24:39.797556+0000","last_clean":"2024-04-24T01:24:39.797556+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:24:39.797556+0000","last_undegraded":"2024-04-24T01:24:39.797556+0000","last_fullsized":"2024-04-24T01:24:39.797556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:47.630785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790507+0000","last_change":"2024-04-24T01:24:04.759523+0000","last_active":"2024-04-24T01:24:39.790507+0000","last_peered":"2024-04-24T01:24:39.790507+0000","last_clean":"2024-04-24T01:24:39.790507+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:24:39.790507+0000","last_undegraded":"2024-04-24T01:24:39.790507+0000","last_fullsized":"2024-04-24T01:24:39.790507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:22:53.916052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":375,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831397+0000","last_change":"2024-04-24T01:24:06.769994+0000","last_active":"2024-04-24T01:27:07.831397+0000","last_peered":"2024-04-24T01:27:07.831397+0000","last_clean":"2024-04-24T01:27:07.831397+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:07.831397+0000","last_undegraded":"2024-04-24T01:27:07.831397+0000","last_fullsized":"2024-04-24T01:27:07.831397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:03.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792482+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:24:39.792482+0000","last_peered":"2024-04-24T01:24:39.792482+0000","last_clean":"2024-04-24T01:24:39.792482+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:24:39.792482+0000","last_undegraded":"2024-04-24T01:24:39.792482+0000","last_fullsized":"2024-04-24T01:24:39.792482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:40.559182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343653+0000","last_change":"2024-04-24T01:24:00.732138+0000","last_active":"2024-04-24T01:27:10.343653+0000","last_peered":"2024-04-24T01:27:10.343653+0000","last_clean":"2024-04-24T01:27:10.343653+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:10.343653+0000","last_undegraded":"2024-04-24T01:27:10.343653+0000","last_fullsized":"2024-04-24T01:27:10.343653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:59.208377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894122+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:24:41.894122+0000","last_peered":"2024-04-24T01:24:41.894122+0000","last_clean":"2024-04-24T01:24:41.894122+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:24:41.894122+0000","last_undegraded":"2024-04-24T01:24:41.894122+0000","last_fullsized":"2024-04-24T01:24:41.894122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795147+0000","last_change":"2024-04-24T01:24:02.755459+0000","last_active":"2024-04-24T01:24:39.795147+0000","last_peered":"2024-04-24T01:24:39.795147+0000","last_clean":"2024-04-24T01:24:39.795147+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:24:39.795147+0000","last_undegraded":"2024-04-24T01:24:39.795147+0000","last_fullsized":"2024-04-24T01:24:39.795147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:03.880496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'62","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.122189+0000","last_change":"2024-04-24T01:24:04.753792+0000","last_active":"2024-04-24T01:26:08.122189+0000","last_peered":"2024-04-24T01:26:08.122189+0000","last_clean":"2024-04-24T01:26:08.122189+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:26:08.122189+0000","last_undegraded":"2024-04-24T01:26:08.122189+0000","last_fullsized":"2024-04-24T01:26:08.122189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:36.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841092+0000","last_change":"2024-04-24T01:24:06.770663+0000","last_active":"2024-04-24T01:24:39.841092+0000","last_peered":"2024-04-24T01:24:39.841092+0000","last_clean":"2024-04-24T01:24:39.841092+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:24:39.841092+0000","last_undegraded":"2024-04-24T01:24:39.841092+0000","last_fullsized":"2024-04-24T01:24:39.841092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:13:20.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797448+0000","last_change":"2024-04-24T01:24:08.769131+0000","last_active":"2024-04-24T01:24:39.797448+0000","last_peered":"2024-04-24T01:24:39.797448+0000","last_clean":"2024-04-24T01:24:39.797448+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:24:39.797448+0000","last_undegraded":"2024-04-24T01:24:39.797448+0000","last_fullsized":"2024-04-24T01:24:39.797448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:14.098220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311172+0000","last_change":"2024-04-24T01:24:00.729678+0000","last_active":"2024-04-24T01:27:10.311172+0000","last_peered":"2024-04-24T01:27:10.311172+0000","last_clean":"2024-04-24T01:27:10.311172+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:10.311172+0000","last_undegraded":"2024-04-24T01:27:10.311172+0000","last_fullsized":"2024-04-24T01:27:10.311172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.631103+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:25:25.631103+0000","last_peered":"2024-04-24T01:25:25.631103+0000","last_clean":"2024-04-24T01:25:25.631103+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:25:25.631103+0000","last_undegraded":"2024-04-24T01:25:25.631103+0000","last_fullsized":"2024-04-24T01:25:25.631103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:50.919310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791338+0000","last_change":"2024-04-24T01:24:02.753343+0000","last_active":"2024-04-24T01:24:39.791338+0000","last_peered":"2024-04-24T01:24:39.791338+0000","last_clean":"2024-04-24T01:24:39.791338+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:24:39.791338+0000","last_undegraded":"2024-04-24T01:24:39.791338+0000","last_fullsized":"2024-04-24T01:24:39.791338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.027557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'37","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976311+0000","last_change":"2024-04-24T01:24:04.759090+0000","last_active":"2024-04-24T01:26:31.976311+0000","last_peered":"2024-04-24T01:26:31.976311+0000","last_clean":"2024-04-24T01:26:31.976311+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:26:31.976311+0000","last_undegraded":"2024-04-24T01:26:31.976311+0000","last_fullsized":"2024-04-24T01:26:31.976311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:43.590882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792417+0000","last_change":"2024-04-24T01:24:06.765993+0000","last_active":"2024-04-24T01:24:39.792417+0000","last_peered":"2024-04-24T01:24:39.792417+0000","last_clean":"2024-04-24T01:24:39.792417+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:24:39.792417+0000","last_undegraded":"2024-04-24T01:24:39.792417+0000","last_fullsized":"2024-04-24T01:24:39.792417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:41.757073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792239+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:24:39.792239+0000","last_peered":"2024-04-24T01:24:39.792239+0000","last_clean":"2024-04-24T01:24:39.792239+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:24:39.792239+0000","last_undegraded":"2024-04-24T01:24:39.792239+0000","last_fullsized":"2024-04-24T01:24:39.792239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:09.221221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985926+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:26:28.985926+0000","last_peered":"2024-04-24T01:26:28.985926+0000","last_clean":"2024-04-24T01:26:28.985926+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:26:28.985926+0000","last_undegraded":"2024-04-24T01:26:28.985926+0000","last_fullsized":"2024-04-24T01:26:28.985926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:34.177576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843706+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:24:39.843706+0000","last_peered":"2024-04-24T01:24:39.843706+0000","last_clean":"2024-04-24T01:24:39.843706+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:24:39.843706+0000","last_undegraded":"2024-04-24T01:24:39.843706+0000","last_fullsized":"2024-04-24T01:24:39.843706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:10.215840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789419+0000","last_change":"2024-04-24T01:24:02.756957+0000","last_active":"2024-04-24T01:24:39.789419+0000","last_peered":"2024-04-24T01:24:39.789419+0000","last_clean":"2024-04-24T01:24:39.789419+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:24:39.789419+0000","last_undegraded":"2024-04-24T01:24:39.789419+0000","last_fullsized":"2024-04-24T01:24:39.789419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:38.961968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.147521+0000","last_change":"2024-04-24T01:24:04.761512+0000","last_active":"2024-04-24T01:26:08.147521+0000","last_peered":"2024-04-24T01:26:08.147521+0000","last_clean":"2024-04-24T01:26:08.147521+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:26:08.147521+0000","last_undegraded":"2024-04-24T01:26:08.147521+0000","last_fullsized":"2024-04-24T01:26:08.147521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:33.309938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793397+0000","last_change":"2024-04-24T01:24:06.770228+0000","last_active":"2024-04-24T01:24:39.793397+0000","last_peered":"2024-04-24T01:24:39.793397+0000","last_clean":"2024-04-24T01:24:39.793397+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:24:39.793397+0000","last_undegraded":"2024-04-24T01:24:39.793397+0000","last_fullsized":"2024-04-24T01:24:39.793397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:18:11.286272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.158027+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:08.158027+0000","last_peered":"2024-04-24T01:26:08.158027+0000","last_clean":"2024-04-24T01:26:08.158027+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:08.158027+0000","last_undegraded":"2024-04-24T01:26:08.158027+0000","last_fullsized":"2024-04-24T01:26:08.158027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:44.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.881602+0000","last_change":"2024-04-24T01:24:00.730610+0000","last_active":"2024-04-24T01:25:25.881602+0000","last_peered":"2024-04-24T01:25:25.881602+0000","last_clean":"2024-04-24T01:25:25.881602+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:25:25.881602+0000","last_undegraded":"2024-04-24T01:25:25.881602+0000","last_fullsized":"2024-04-24T01:25:25.881602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:38.644402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797330+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:24:39.797330+0000","last_peered":"2024-04-24T01:24:39.797330+0000","last_clean":"2024-04-24T01:24:39.797330+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:24:39.797330+0000","last_undegraded":"2024-04-24T01:24:39.797330+0000","last_fullsized":"2024-04-24T01:24:39.797330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.777248+0000","last_change":"2024-04-24T01:24:02.758075+0000","last_active":"2024-04-24T01:26:06.777248+0000","last_peered":"2024-04-24T01:26:06.777248+0000","last_clean":"2024-04-24T01:26:06.777248+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:26:06.777248+0000","last_undegraded":"2024-04-24T01:26:06.777248+0000","last_fullsized":"2024-04-24T01:26:06.777248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:03.864248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'45","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.661103+0000","last_change":"2024-04-24T01:24:04.761785+0000","last_active":"2024-04-24T01:27:09.661103+0000","last_peered":"2024-04-24T01:27:09.661103+0000","last_clean":"2024-04-24T01:27:09.661103+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:09.661103+0000","last_undegraded":"2024-04-24T01:27:09.661103+0000","last_fullsized":"2024-04-24T01:27:09.661103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:58.149475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842218+0000","last_change":"2024-04-24T01:24:06.770604+0000","last_active":"2024-04-24T01:24:39.842218+0000","last_peered":"2024-04-24T01:24:39.842218+0000","last_clean":"2024-04-24T01:24:39.842218+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:24:39.842218+0000","last_undegraded":"2024-04-24T01:24:39.842218+0000","last_fullsized":"2024-04-24T01:24:39.842218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:16.930856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.160611+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:08.160611+0000","last_peered":"2024-04-24T01:26:08.160611+0000","last_clean":"2024-04-24T01:26:08.160611+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:08.160611+0000","last_undegraded":"2024-04-24T01:26:08.160611+0000","last_fullsized":"2024-04-24T01:26:08.160611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:18.783056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642790+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:09.642790+0000","last_peered":"2024-04-24T01:26:09.642790+0000","last_clean":"2024-04-24T01:26:09.642790+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:09.642790+0000","last_undegraded":"2024-04-24T01:26:09.642790+0000","last_fullsized":"2024-04-24T01:26:09.642790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:11.472098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981484+0000","last_change":"2024-04-24T01:23:58.747335+0000","last_active":"2024-04-24T01:26:03.981484+0000","last_peered":"2024-04-24T01:26:03.981484+0000","last_clean":"2024-04-24T01:26:03.981484+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:26:03.981484+0000","last_undegraded":"2024-04-24T01:26:03.981484+0000","last_fullsized":"2024-04-24T01:26:03.981484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.641524+0000","last_change":"2024-04-24T01:24:00.732134+0000","last_active":"2024-04-24T01:25:25.641524+0000","last_peered":"2024-04-24T01:25:25.641524+0000","last_clean":"2024-04-24T01:25:25.641524+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:25:25.641524+0000","last_undegraded":"2024-04-24T01:25:25.641524+0000","last_fullsized":"2024-04-24T01:25:25.641524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:12.420444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894175+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:24:41.894175+0000","last_peered":"2024-04-24T01:24:41.894175+0000","last_clean":"2024-04-24T01:24:41.894175+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:24:41.894175+0000","last_undegraded":"2024-04-24T01:24:41.894175+0000","last_fullsized":"2024-04-24T01:24:41.894175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:34.164253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124466+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.124466+0000","last_peered":"2024-04-24T01:27:10.124466+0000","last_clean":"2024-04-24T01:27:10.124466+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.124466+0000","last_undegraded":"2024-04-24T01:27:10.124466+0000","last_fullsized":"2024-04-24T01:27:10.124466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:45.623313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793654+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:24:39.793654+0000","last_peered":"2024-04-24T01:24:39.793654+0000","last_clean":"2024-04-24T01:24:39.793654+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:24:39.793654+0000","last_undegraded":"2024-04-24T01:24:39.793654+0000","last_fullsized":"2024-04-24T01:24:39.793654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:36.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124201+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.124201+0000","last_peered":"2024-04-24T01:27:10.124201+0000","last_clean":"2024-04-24T01:27:10.124201+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.124201+0000","last_undegraded":"2024-04-24T01:27:10.124201+0000","last_fullsized":"2024-04-24T01:27:10.124201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:23.382109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843929+0000","last_change":"2024-04-24T01:23:58.747256+0000","last_active":"2024-04-24T01:24:39.843929+0000","last_peered":"2024-04-24T01:24:39.843929+0000","last_clean":"2024-04-24T01:24:39.843929+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:24:39.843929+0000","last_undegraded":"2024-04-24T01:24:39.843929+0000","last_fullsized":"2024-04-24T01:24:39.843929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:24.901113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311360+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.311360+0000","last_peered":"2024-04-24T01:27:10.311360+0000","last_clean":"2024-04-24T01:27:10.311360+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.311360+0000","last_undegraded":"2024-04-24T01:27:10.311360+0000","last_fullsized":"2024-04-24T01:27:10.311360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:23.445860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843749+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:24:39.843749+0000","last_peered":"2024-04-24T01:24:39.843749+0000","last_clean":"2024-04-24T01:24:39.843749+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:24:39.843749+0000","last_undegraded":"2024-04-24T01:24:39.843749+0000","last_fullsized":"2024-04-24T01:24:39.843749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:35.046540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262087+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.262087+0000","last_peered":"2024-04-24T01:27:10.262087+0000","last_clean":"2024-04-24T01:27:10.262087+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.262087+0000","last_undegraded":"2024-04-24T01:27:10.262087+0000","last_fullsized":"2024-04-24T01:27:10.262087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:40.138216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.541257+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.541257+0000","last_peered":"2024-04-24T01:26:09.541257+0000","last_clean":"2024-04-24T01:26:09.541257+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.541257+0000","last_undegraded":"2024-04-24T01:26:09.541257+0000","last_fullsized":"2024-04-24T01:26:09.541257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.879998+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:25:25.879998+0000","last_peered":"2024-04-24T01:25:25.879998+0000","last_clean":"2024-04-24T01:25:25.879998+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:25:25.879998+0000","last_undegraded":"2024-04-24T01:25:25.879998+0000","last_fullsized":"2024-04-24T01:25:25.879998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:09.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.338702+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.338702+0000","last_peered":"2024-04-24T01:27:10.338702+0000","last_clean":"2024-04-24T01:27:10.338702+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.338702+0000","last_undegraded":"2024-04-24T01:27:10.338702+0000","last_fullsized":"2024-04-24T01:27:10.338702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.125794+0000","last_change":"2024-04-24T01:24:00.744090+0000","last_active":"2024-04-24T01:27:10.125794+0000","last_peered":"2024-04-24T01:27:10.125794+0000","last_clean":"2024-04-24T01:27:10.125794+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:10.125794+0000","last_undegraded":"2024-04-24T01:27:10.125794+0000","last_fullsized":"2024-04-24T01:27:10.125794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:35.200859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.480239+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:09.480239+0000","last_peered":"2024-04-24T01:26:09.480239+0000","last_clean":"2024-04-24T01:26:09.480239+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:09.480239+0000","last_undegraded":"2024-04-24T01:26:09.480239+0000","last_fullsized":"2024-04-24T01:26:09.480239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:44.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314098+0000","last_change":"2024-04-24T01:24:00.745364+0000","last_active":"2024-04-24T01:27:10.314098+0000","last_peered":"2024-04-24T01:27:10.314098+0000","last_clean":"2024-04-24T01:27:10.314098+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:10.314098+0000","last_undegraded":"2024-04-24T01:27:10.314098+0000","last_fullsized":"2024-04-24T01:27:10.314098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:04.207670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789907+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:24:39.789907+0000","last_peered":"2024-04-24T01:24:39.789907+0000","last_clean":"2024-04-24T01:24:39.789907+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:24:39.789907+0000","last_undegraded":"2024-04-24T01:24:39.789907+0000","last_fullsized":"2024-04-24T01:24:39.789907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.471255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040648+0000","last_change":"2024-04-24T01:24:00.738594+0000","last_active":"2024-04-24T01:27:10.040648+0000","last_peered":"2024-04-24T01:27:10.040648+0000","last_clean":"2024-04-24T01:27:10.040648+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:10.040648+0000","last_undegraded":"2024-04-24T01:27:10.040648+0000","last_fullsized":"2024-04-24T01:27:10.040648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:05.644113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.972565+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:24:42.972565+0000","last_peered":"2024-04-24T01:24:42.972565+0000","last_clean":"2024-04-24T01:24:42.972565+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:24:42.972565+0000","last_undegraded":"2024-04-24T01:24:42.972565+0000","last_fullsized":"2024-04-24T01:24:42.972565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:08.200562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124410+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.124410+0000","last_peered":"2024-04-24T01:27:10.124410+0000","last_clean":"2024-04-24T01:27:10.124410+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.124410+0000","last_undegraded":"2024-04-24T01:27:10.124410+0000","last_fullsized":"2024-04-24T01:27:10.124410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:37.307723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252871+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.252871+0000","last_peered":"2024-04-24T01:27:10.252871+0000","last_clean":"2024-04-24T01:27:10.252871+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.252871+0000","last_undegraded":"2024-04-24T01:27:10.252871+0000","last_fullsized":"2024-04-24T01:27:10.252871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311477+0000","last_change":"2024-04-24T01:24:00.739108+0000","last_active":"2024-04-24T01:27:10.311477+0000","last_peered":"2024-04-24T01:27:10.311477+0000","last_clean":"2024-04-24T01:27:10.311477+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:10.311477+0000","last_undegraded":"2024-04-24T01:27:10.311477+0000","last_fullsized":"2024-04-24T01:27:10.311477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:35.209417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796505+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:24:39.796505+0000","last_peered":"2024-04-24T01:24:39.796505+0000","last_clean":"2024-04-24T01:24:39.796505+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:24:39.796505+0000","last_undegraded":"2024-04-24T01:24:39.796505+0000","last_fullsized":"2024-04-24T01:24:39.796505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984070+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:24:42.984070+0000","last_peered":"2024-04-24T01:24:42.984070+0000","last_clean":"2024-04-24T01:24:42.984070+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:24:42.984070+0000","last_undegraded":"2024-04-24T01:24:42.984070+0000","last_fullsized":"2024-04-24T01:24:42.984070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791579+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:24:39.791579+0000","last_peered":"2024-04-24T01:24:39.791579+0000","last_clean":"2024-04-24T01:24:39.791579+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:24:39.791579+0000","last_undegraded":"2024-04-24T01:24:39.791579+0000","last_fullsized":"2024-04-24T01:24:39.791579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:00:17.843103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983736+0000","last_change":"2024-04-24T01:24:00.745475+0000","last_active":"2024-04-24T01:26:18.983736+0000","last_peered":"2024-04-24T01:26:18.983736+0000","last_clean":"2024-04-24T01:26:18.983736+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:26:18.983736+0000","last_undegraded":"2024-04-24T01:26:18.983736+0000","last_fullsized":"2024-04-24T01:26:18.983736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:30.020085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793966+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:24:39.793966+0000","last_peered":"2024-04-24T01:24:39.793966+0000","last_clean":"2024-04-24T01:24:39.793966+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:24:39.793966+0000","last_undegraded":"2024-04-24T01:24:39.793966+0000","last_fullsized":"2024-04-24T01:24:39.793966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:31.252182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350752+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350752+0000","last_peered":"2024-04-24T01:27:10.350752+0000","last_clean":"2024-04-24T01:27:10.350752+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350752+0000","last_undegraded":"2024-04-24T01:27:10.350752+0000","last_fullsized":"2024-04-24T01:27:10.350752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:52.523705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793919+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:24:39.793919+0000","last_peered":"2024-04-24T01:24:39.793919+0000","last_clean":"2024-04-24T01:24:39.793919+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:24:39.793919+0000","last_undegraded":"2024-04-24T01:24:39.793919+0000","last_fullsized":"2024-04-24T01:24:39.793919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'11","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349775+0000","last_change":"2024-04-24T01:24:00.739611+0000","last_active":"2024-04-24T01:27:10.349775+0000","last_peered":"2024-04-24T01:27:10.349775+0000","last_clean":"2024-04-24T01:27:10.349775+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:10.349775+0000","last_undegraded":"2024-04-24T01:27:10.349775+0000","last_fullsized":"2024-04-24T01:27:10.349775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:19:58.147363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790857+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:24:39.790857+0000","last_peered":"2024-04-24T01:24:39.790857+0000","last_clean":"2024-04-24T01:24:39.790857+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:24:39.790857+0000","last_undegraded":"2024-04-24T01:24:39.790857+0000","last_fullsized":"2024-04-24T01:24:39.790857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:55.041236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791604+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:24:39.791604+0000","last_peered":"2024-04-24T01:24:39.791604+0000","last_clean":"2024-04-24T01:24:39.791604+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:24:39.791604+0000","last_undegraded":"2024-04-24T01:24:39.791604+0000","last_fullsized":"2024-04-24T01:24:39.791604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:25.351096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261937+0000","last_change":"2024-04-24T01:24:00.746896+0000","last_active":"2024-04-24T01:27:10.261937+0000","last_peered":"2024-04-24T01:27:10.261937+0000","last_clean":"2024-04-24T01:27:10.261937+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:10.261937+0000","last_undegraded":"2024-04-24T01:27:10.261937+0000","last_fullsized":"2024-04-24T01:27:10.261937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:49.762286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841409+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:24:39.841409+0000","last_peered":"2024-04-24T01:24:39.841409+0000","last_clean":"2024-04-24T01:24:39.841409+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:24:39.841409+0000","last_undegraded":"2024-04-24T01:24:39.841409+0000","last_fullsized":"2024-04-24T01:24:39.841409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:15.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.375679+0000","last_change":"2024-04-24T01:24:00.743656+0000","last_active":"2024-04-24T01:26:06.375679+0000","last_peered":"2024-04-24T01:26:06.375679+0000","last_clean":"2024-04-24T01:26:06.375679+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:26:06.375679+0000","last_undegraded":"2024-04-24T01:26:06.375679+0000","last_fullsized":"2024-04-24T01:26:06.375679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1691,"num_read_kb":1445,"num_write":725,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1473,"ondisk_log_size":1473,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44208,"kb_used_data":8872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327632,"statfs":{"total":96636764160,"available":96591495168,"internally_reserved":0,"allocated":9084928,"data_stored":8757155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44728,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327112,"statfs":{"total":96636764160,"available":96590962688,"internally_reserved":0,"allocated":9617408,"data_stored":9344390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44752,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327088,"statfs":{"total":96636764160,"available":96590938112,"internally_reserved":0,"allocated":9641984,"data_stored":9346589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9060352,"data_stored":8756282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:27:17.714 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T01:27:17.714 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:27:17.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e2969a640 1 Processor -- start 2024-04-24T01:27:17.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e2969a640 1 -- start start 2024-04-24T01:27:17.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e2969a640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e2412e5b0 0x7f3e2412e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e2969a640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e2406dde0 con 0x7f3e2412eed0 2024-04-24T01:27:17.840 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e2969a640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f3e2412f360 con 0x7f3e2412e5b0 2024-04-24T01:27:17.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e22ffd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f3e2412e5b0 0x7f3e2412e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e227fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f3e2412eed0 0x7f3e2412b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49174/0 (socket says 172.21.15.142:49174) 2024-04-24T01:27:17.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e227fc640 1 -- 172.21.15.142:0/2801736330 learned_addr learned my addr 172.21.15.142:0/2801736330 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:17.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e22ffd640 1 -- 172.21.15.142:0/2801736330 >> v1:172.21.15.142:6789/0 conn(0x7f3e2412eed0 legacy=0x7f3e2412b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.841 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.839+0000 7f3e22ffd640 1 -- 172.21.15.142:0/2801736330 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e24070280 con 0x7f3e2412e5b0 2024-04-24T01:27:17.843 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.840+0000 7f3e22ffd640 1 --2- 172.21.15.142:0/2801736330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2412e990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009720 tx=0x7f3e1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2534039e5f1a6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.840+0000 7f3e21ffb640 1 -- 172.21.15.142:0/2801736330 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e140316d0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.840+0000 7f3e21ffb640 1 -- 172.21.15.142:0/2801736330 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14037070 con 0x7f3e2412e5b0 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.840+0000 7f3e21ffb640 1 -- 172.21.15.142:0/2801736330 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e140319c0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 -- 172.21.15.142:0/2801736330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 msgr2=0x7f3e2412e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 --2- 172.21.15.142:0/2801736330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2412e990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009720 tx=0x7f3e1402b840 comp rx=0 tx=0).stop 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 -- 172.21.15.142:0/2801736330 shutdown_connections 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 --2- 172.21.15.142:0/2801736330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2412e990 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 -- 172.21.15.142:0/2801736330 >> 172.21.15.142:0/2801736330 conn(0x7f3e2409c7f0 msgr2=0x7f3e2409cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 -- 172.21.15.142:0/2801736330 shutdown_connections 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.841+0000 7f3e2969a640 1 -- 172.21.15.142:0/2801736330 wait complete. 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e2969a640 1 Processor -- start 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e2969a640 1 -- start start 2024-04-24T01:27:17.844 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e2969a640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e2969a640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2406ffc0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e22ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e22ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33522/0 (socket says 172.21.15.142:33522) 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.842+0000 7f3e22ffd640 1 -- 172.21.15.142:0/146810520 learned_addr learned my addr 172.21.15.142:0/146810520 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e22ffd640 1 -- 172.21.15.142:0/146810520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2411e9d0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e22ffd640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3e14034040 tx=0x7f3e140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e14032770 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e14032910 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2411cf90 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3e14032c30 con 0x7f3e2412e5b0 2024-04-24T01:27:17.845 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.843+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2411e2e0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3e1404c060 con 0x7f3e2412e5b0 2024-04-24T01:27:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e0b7fe640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 0x7f3e1003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f3e1402f050 con 0x7f3e2412e5b0 2024-04-24T01:27:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e24062da0 con 0x7f3e2412e5b0 2024-04-24T01:27:17.846 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e227fc640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 0x7f3e1003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:17.847 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.844+0000 7f3e227fc640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 0x7f3e1003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e18007fd0 tx=0x7f3e18007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:17.849 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:17.849+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f3e2411e9d0 con 0x7f3e2412e5b0 2024-04-24T01:27:18.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.019+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e2412b760 con 0x7f3e10038060 2024-04-24T01:27:18.034 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.034+0000 7f3e0b7fe640 1 -- 172.21.15.142:0/146810520 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665959 (secure 0 0 0) 0x7f3e2412b760 con 0x7f3e10038060 2024-04-24T01:27:18.042 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:18.047 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 msgr2=0x7f3e1003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 0x7f3e1003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3e18007fd0 tx=0x7f3e18007ac0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 msgr2=0x7f3e2411b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f3e14034040 tx=0x7f3e140046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 shutdown_connections 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f3e10038060 0x7f3e1003a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 --2- 172.21.15.142:0/146810520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3e2412e5b0 0x7f3e2411b6d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 >> 172.21.15.142:0/146810520 conn(0x7f3e2409c7f0 msgr2=0x7f3e241b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 shutdown_connections 2024-04-24T01:27:18.050 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.038+0000 7f3e2969a640 1 -- 172.21.15.142:0/146810520 wait complete. 2024-04-24T01:27:18.051 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-04-24T01:27:17.963201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":259,"num_object_clones":0,"num_object_copies":532,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":5201,"num_read_kb":4746,"num_write":2312,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4700,"ondisk_log_size":4700,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182032,"kb_used_data":36528,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305328,"statfs":{"total":386547056640,"available":386360655872,"internally_reserved":0,"allocated":37404672,"data_stored":36204416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":551,"num_read_kb":506,"num_write":400,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004549"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793282+0000","last_change":"2024-04-24T01:23:58.745975+0000","last_active":"2024-04-24T01:24:39.793282+0000","last_peered":"2024-04-24T01:24:39.793282+0000","last_clean":"2024-04-24T01:24:39.793282+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:24:39.793282+0000","last_undegraded":"2024-04-24T01:24:39.793282+0000","last_fullsized":"2024-04-24T01:24:39.793282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261969+0000","last_change":"2024-04-24T01:24:00.745235+0000","last_active":"2024-04-24T01:27:10.261969+0000","last_peered":"2024-04-24T01:27:10.261969+0000","last_clean":"2024-04-24T01:27:10.261969+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:10.261969+0000","last_undegraded":"2024-04-24T01:27:10.261969+0000","last_fullsized":"2024-04-24T01:27:10.261969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:45.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843868+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:24:39.843868+0000","last_peered":"2024-04-24T01:24:39.843868+0000","last_clean":"2024-04-24T01:24:39.843868+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:24:39.843868+0000","last_undegraded":"2024-04-24T01:24:39.843868+0000","last_fullsized":"2024-04-24T01:24:39.843868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:01.751302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.370886+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:24:42.370886+0000","last_peered":"2024-04-24T01:24:42.370886+0000","last_clean":"2024-04-24T01:24:42.370886+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:24:42.370886+0000","last_undegraded":"2024-04-24T01:24:42.370886+0000","last_fullsized":"2024-04-24T01:24:42.370886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:01.873024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794269+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:24:39.794269+0000","last_peered":"2024-04-24T01:24:39.794269+0000","last_clean":"2024-04-24T01:24:39.794269+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:24:39.794269+0000","last_undegraded":"2024-04-24T01:24:39.794269+0000","last_fullsized":"2024-04-24T01:24:39.794269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.373104+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:06.373104+0000","last_peered":"2024-04-24T01:26:06.373104+0000","last_clean":"2024-04-24T01:26:06.373104+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:06.373104+0000","last_undegraded":"2024-04-24T01:26:06.373104+0000","last_fullsized":"2024-04-24T01:26:06.373104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:58.173467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894191+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:24:41.894191+0000","last_peered":"2024-04-24T01:24:41.894191+0000","last_clean":"2024-04-24T01:24:41.894191+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:24:41.894191+0000","last_undegraded":"2024-04-24T01:24:41.894191+0000","last_fullsized":"2024-04-24T01:24:41.894191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370793+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:06.370793+0000","last_peered":"2024-04-24T01:26:06.370793+0000","last_clean":"2024-04-24T01:26:06.370793+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:06.370793+0000","last_undegraded":"2024-04-24T01:26:06.370793+0000","last_fullsized":"2024-04-24T01:26:06.370793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:36.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.966530+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:24:42.966530+0000","last_peered":"2024-04-24T01:24:42.966530+0000","last_clean":"2024-04-24T01:24:42.966530+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:24:42.966530+0000","last_undegraded":"2024-04-24T01:24:42.966530+0000","last_fullsized":"2024-04-24T01:24:42.966530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:46.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262034+0000","last_change":"2024-04-24T01:24:00.739114+0000","last_active":"2024-04-24T01:27:10.262034+0000","last_peered":"2024-04-24T01:27:10.262034+0000","last_clean":"2024-04-24T01:27:10.262034+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:10.262034+0000","last_undegraded":"2024-04-24T01:27:10.262034+0000","last_fullsized":"2024-04-24T01:27:10.262034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:15.071031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789367+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:24:39.789367+0000","last_peered":"2024-04-24T01:24:39.789367+0000","last_clean":"2024-04-24T01:24:39.789367+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:24:39.789367+0000","last_undegraded":"2024-04-24T01:24:39.789367+0000","last_fullsized":"2024-04-24T01:24:39.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:43.987882+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:26:43.987882+0000","last_peered":"2024-04-24T01:26:43.987882+0000","last_clean":"2024-04-24T01:26:43.987882+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:26:43.987882+0000","last_undegraded":"2024-04-24T01:26:43.987882+0000","last_fullsized":"2024-04-24T01:26:43.987882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:44.665563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.249789+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.249789+0000","last_peered":"2024-04-24T01:27:10.249789+0000","last_clean":"2024-04-24T01:27:10.249789+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.249789+0000","last_undegraded":"2024-04-24T01:27:10.249789+0000","last_fullsized":"2024-04-24T01:27:10.249789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:50.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642467+0000","last_change":"2024-04-24T01:24:00.745053+0000","last_active":"2024-04-24T01:26:09.642467+0000","last_peered":"2024-04-24T01:26:09.642467+0000","last_clean":"2024-04-24T01:26:09.642467+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:26:09.642467+0000","last_undegraded":"2024-04-24T01:26:09.642467+0000","last_fullsized":"2024-04-24T01:26:09.642467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841355+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:24:39.841355+0000","last_peered":"2024-04-24T01:24:39.841355+0000","last_clean":"2024-04-24T01:24:39.841355+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:24:39.841355+0000","last_undegraded":"2024-04-24T01:24:39.841355+0000","last_fullsized":"2024-04-24T01:24:39.841355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:59.075615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349980+0000","last_change":"2024-04-24T01:24:00.740054+0000","last_active":"2024-04-24T01:27:10.349980+0000","last_peered":"2024-04-24T01:27:10.349980+0000","last_clean":"2024-04-24T01:27:10.349980+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:10.349980+0000","last_undegraded":"2024-04-24T01:27:10.349980+0000","last_fullsized":"2024-04-24T01:27:10.349980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313995+0000","last_change":"2024-04-24T01:24:00.738224+0000","last_active":"2024-04-24T01:27:10.313995+0000","last_peered":"2024-04-24T01:27:10.313995+0000","last_clean":"2024-04-24T01:27:10.313995+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:10.313995+0000","last_undegraded":"2024-04-24T01:27:10.313995+0000","last_fullsized":"2024-04-24T01:27:10.313995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:35.336241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797425+0000","last_change":"2024-04-24T01:23:58.755611+0000","last_active":"2024-04-24T01:24:39.797425+0000","last_peered":"2024-04-24T01:24:39.797425+0000","last_clean":"2024-04-24T01:24:39.797425+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:24:39.797425+0000","last_undegraded":"2024-04-24T01:24:39.797425+0000","last_fullsized":"2024-04-24T01:24:39.797425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314134+0000","last_change":"2024-04-24T01:24:00.744762+0000","last_active":"2024-04-24T01:27:10.314134+0000","last_peered":"2024-04-24T01:27:10.314134+0000","last_clean":"2024-04-24T01:27:10.314134+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:10.314134+0000","last_undegraded":"2024-04-24T01:27:10.314134+0000","last_fullsized":"2024-04-24T01:27:10.314134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'3","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984616+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:26:23.984616+0000","last_peered":"2024-04-24T01:26:23.984616+0000","last_clean":"2024-04-24T01:26:23.984616+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:26:23.984616+0000","last_undegraded":"2024-04-24T01:26:23.984616+0000","last_fullsized":"2024-04-24T01:26:23.984616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":11,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984442+0000","last_change":"2024-04-24T01:24:00.745273+0000","last_active":"2024-04-24T01:24:42.984442+0000","last_peered":"2024-04-24T01:24:42.984442+0000","last_clean":"2024-04-24T01:24:42.984442+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:24:42.984442+0000","last_undegraded":"2024-04-24T01:24:42.984442+0000","last_fullsized":"2024-04-24T01:24:42.984442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:11.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.021107+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.021107+0000","last_peered":"2024-04-24T01:27:10.021107+0000","last_clean":"2024-04-24T01:27:10.021107+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.021107+0000","last_undegraded":"2024-04-24T01:27:10.021107+0000","last_fullsized":"2024-04-24T01:27:10.021107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320595+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.320595+0000","last_peered":"2024-04-24T01:27:10.320595+0000","last_clean":"2024-04-24T01:27:10.320595+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.320595+0000","last_undegraded":"2024-04-24T01:27:10.320595+0000","last_fullsized":"2024-04-24T01:27:10.320595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:40:35.960909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'7","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.255757+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:10.255757+0000","last_peered":"2024-04-24T01:27:10.255757+0000","last_clean":"2024-04-24T01:27:10.255757+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:10.255757+0000","last_undegraded":"2024-04-24T01:27:10.255757+0000","last_fullsized":"2024-04-24T01:27:10.255757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":39,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.037285+0000","last_change":"2024-04-24T01:24:00.740372+0000","last_active":"2024-04-24T01:27:10.037285+0000","last_peered":"2024-04-24T01:27:10.037285+0000","last_clean":"2024-04-24T01:27:10.037285+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:10.037285+0000","last_undegraded":"2024-04-24T01:27:10.037285+0000","last_fullsized":"2024-04-24T01:27:10.037285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:00.415935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844104+0000","last_change":"2024-04-24T01:23:58.747782+0000","last_active":"2024-04-24T01:24:39.844104+0000","last_peered":"2024-04-24T01:24:39.844104+0000","last_clean":"2024-04-24T01:24:39.844104+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:24:39.844104+0000","last_undegraded":"2024-04-24T01:24:39.844104+0000","last_fullsized":"2024-04-24T01:24:39.844104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:33.918132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349714+0000","last_change":"2024-04-24T01:24:00.744154+0000","last_active":"2024-04-24T01:27:10.349714+0000","last_peered":"2024-04-24T01:27:10.349714+0000","last_clean":"2024-04-24T01:27:10.349714+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:10.349714+0000","last_undegraded":"2024-04-24T01:27:10.349714+0000","last_fullsized":"2024-04-24T01:27:10.349714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:46.325470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.595508+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:09.595508+0000","last_peered":"2024-04-24T01:26:09.595508+0000","last_clean":"2024-04-24T01:26:09.595508+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:09.595508+0000","last_undegraded":"2024-04-24T01:26:09.595508+0000","last_fullsized":"2024-04-24T01:26:09.595508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:14.628366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.287302+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.287302+0000","last_peered":"2024-04-24T01:27:10.287302+0000","last_clean":"2024-04-24T01:27:10.287302+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.287302+0000","last_undegraded":"2024-04-24T01:27:10.287302+0000","last_fullsized":"2024-04-24T01:27:10.287302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:03.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039068+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.039068+0000","last_peered":"2024-04-24T01:27:10.039068+0000","last_clean":"2024-04-24T01:27:10.039068+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.039068+0000","last_undegraded":"2024-04-24T01:27:10.039068+0000","last_fullsized":"2024-04-24T01:27:10.039068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:59.847574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791248+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:24:39.791248+0000","last_peered":"2024-04-24T01:24:39.791248+0000","last_clean":"2024-04-24T01:24:39.791248+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:24:39.791248+0000","last_undegraded":"2024-04-24T01:24:39.791248+0000","last_fullsized":"2024-04-24T01:24:39.791248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:11.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793258+0000","last_change":"2024-04-24T01:24:02.754649+0000","last_active":"2024-04-24T01:24:39.793258+0000","last_peered":"2024-04-24T01:24:39.793258+0000","last_clean":"2024-04-24T01:24:39.793258+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:24:39.793258+0000","last_undegraded":"2024-04-24T01:24:39.793258+0000","last_fullsized":"2024-04-24T01:24:39.793258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:36.231675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'42","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.139951+0000","last_change":"2024-04-24T01:24:04.759269+0000","last_active":"2024-04-24T01:26:08.139951+0000","last_peered":"2024-04-24T01:26:08.139951+0000","last_clean":"2024-04-24T01:26:08.139951+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:26:08.139951+0000","last_undegraded":"2024-04-24T01:26:08.139951+0000","last_fullsized":"2024-04-24T01:26:08.139951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:48.568742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797301+0000","last_change":"2024-04-24T01:24:06.771210+0000","last_active":"2024-04-24T01:24:39.797301+0000","last_peered":"2024-04-24T01:24:39.797301+0000","last_clean":"2024-04-24T01:24:39.797301+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:24:39.797301+0000","last_undegraded":"2024-04-24T01:24:39.797301+0000","last_fullsized":"2024-04-24T01:24:39.797301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:42.412982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.649922+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:25:25.649922+0000","last_peered":"2024-04-24T01:25:25.649922+0000","last_clean":"2024-04-24T01:25:25.649922+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:25:25.649922+0000","last_undegraded":"2024-04-24T01:25:25.649922+0000","last_fullsized":"2024-04-24T01:25:25.649922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:32.845545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343531+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.343531+0000","last_peered":"2024-04-24T01:27:10.343531+0000","last_clean":"2024-04-24T01:27:10.343531+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.343531+0000","last_undegraded":"2024-04-24T01:27:10.343531+0000","last_fullsized":"2024-04-24T01:27:10.343531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:11.415544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789109+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:24:39.789109+0000","last_peered":"2024-04-24T01:24:39.789109+0000","last_clean":"2024-04-24T01:24:39.789109+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:24:39.789109+0000","last_undegraded":"2024-04-24T01:24:39.789109+0000","last_fullsized":"2024-04-24T01:24:39.789109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.800415+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:24:39.800415+0000","last_peered":"2024-04-24T01:24:39.800415+0000","last_clean":"2024-04-24T01:24:39.800415+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:24:39.800415+0000","last_undegraded":"2024-04-24T01:24:39.800415+0000","last_fullsized":"2024-04-24T01:24:39.800415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:27.933493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.644975+0000","last_change":"2024-04-24T01:24:04.754457+0000","last_active":"2024-04-24T01:26:09.644975+0000","last_peered":"2024-04-24T01:26:09.644975+0000","last_clean":"2024-04-24T01:26:09.644975+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:26:09.644975+0000","last_undegraded":"2024-04-24T01:26:09.644975+0000","last_fullsized":"2024-04-24T01:26:09.644975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:44.985335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796898+0000","last_change":"2024-04-24T01:24:06.767131+0000","last_active":"2024-04-24T01:24:39.796898+0000","last_peered":"2024-04-24T01:24:39.796898+0000","last_clean":"2024-04-24T01:24:39.796898+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:24:39.796898+0000","last_undegraded":"2024-04-24T01:24:39.796898+0000","last_fullsized":"2024-04-24T01:24:39.796898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:37.537173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841120+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:24:39.841120+0000","last_peered":"2024-04-24T01:24:39.841120+0000","last_clean":"2024-04-24T01:24:39.841120+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:24:39.841120+0000","last_undegraded":"2024-04-24T01:24:39.841120+0000","last_fullsized":"2024-04-24T01:24:39.841120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:30.549905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261903+0000","last_change":"2024-04-24T01:24:00.735337+0000","last_active":"2024-04-24T01:27:10.261903+0000","last_peered":"2024-04-24T01:27:10.261903+0000","last_clean":"2024-04-24T01:27:10.261903+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:10.261903+0000","last_undegraded":"2024-04-24T01:27:10.261903+0000","last_fullsized":"2024-04-24T01:27:10.261903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:23.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.969496+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:24:42.969496+0000","last_peered":"2024-04-24T01:24:42.969496+0000","last_clean":"2024-04-24T01:24:42.969496+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:24:42.969496+0000","last_undegraded":"2024-04-24T01:24:42.969496+0000","last_fullsized":"2024-04-24T01:24:42.969496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:01.497950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844317+0000","last_change":"2024-04-24T01:24:02.754545+0000","last_active":"2024-04-24T01:24:39.844317+0000","last_peered":"2024-04-24T01:24:39.844317+0000","last_clean":"2024-04-24T01:24:39.844317+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:24:39.844317+0000","last_undegraded":"2024-04-24T01:24:39.844317+0000","last_fullsized":"2024-04-24T01:24:39.844317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:28.692526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791153+0000","last_change":"2024-04-24T01:24:04.756975+0000","last_active":"2024-04-24T01:24:39.791153+0000","last_peered":"2024-04-24T01:24:39.791153+0000","last_clean":"2024-04-24T01:24:39.791153+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:24:39.791153+0000","last_undegraded":"2024-04-24T01:24:39.791153+0000","last_fullsized":"2024-04-24T01:24:39.791153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:05.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'282","reported_seq":421,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831485+0000","last_change":"2024-04-24T01:24:06.766289+0000","last_active":"2024-04-24T01:27:07.831485+0000","last_peered":"2024-04-24T01:27:07.831485+0000","last_clean":"2024-04-24T01:27:07.831485+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:07.831485+0000","last_undegraded":"2024-04-24T01:27:07.831485+0000","last_fullsized":"2024-04-24T01:27:07.831485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:56.567330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.056866+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.056866+0000","last_peered":"2024-04-24T01:27:10.056866+0000","last_clean":"2024-04-24T01:27:10.056866+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.056866+0000","last_undegraded":"2024-04-24T01:27:10.056866+0000","last_fullsized":"2024-04-24T01:27:10.056866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:09:23.826046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984471+0000","last_change":"2024-04-24T01:24:00.746538+0000","last_active":"2024-04-24T01:24:42.984471+0000","last_peered":"2024-04-24T01:24:42.984471+0000","last_clean":"2024-04-24T01:24:42.984471+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:24:42.984471+0000","last_undegraded":"2024-04-24T01:24:42.984471+0000","last_fullsized":"2024-04-24T01:24:42.984471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:42.978833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790051+0000","last_change":"2024-04-24T01:23:58.755957+0000","last_active":"2024-04-24T01:24:39.790051+0000","last_peered":"2024-04-24T01:24:39.790051+0000","last_clean":"2024-04-24T01:24:39.790051+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:24:39.790051+0000","last_undegraded":"2024-04-24T01:24:39.790051+0000","last_fullsized":"2024-04-24T01:24:39.790051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790172+0000","last_change":"2024-04-24T01:24:02.753656+0000","last_active":"2024-04-24T01:24:39.790172+0000","last_peered":"2024-04-24T01:24:39.790172+0000","last_clean":"2024-04-24T01:24:39.790172+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:24:39.790172+0000","last_undegraded":"2024-04-24T01:24:39.790172+0000","last_fullsized":"2024-04-24T01:24:39.790172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:33.516719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.134546+0000","last_change":"2024-04-24T01:24:04.759628+0000","last_active":"2024-04-24T01:26:08.134546+0000","last_peered":"2024-04-24T01:26:08.134546+0000","last_clean":"2024-04-24T01:26:08.134546+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:26:08.134546+0000","last_undegraded":"2024-04-24T01:26:08.134546+0000","last_fullsized":"2024-04-24T01:26:08.134546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:38.198064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.872756+0000","last_change":"2024-04-24T01:24:06.765145+0000","last_active":"2024-04-24T01:27:16.872756+0000","last_peered":"2024-04-24T01:27:16.872756+0000","last_clean":"2024-04-24T01:27:16.872756+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:16.872756+0000","last_undegraded":"2024-04-24T01:27:16.872756+0000","last_fullsized":"2024-04-24T01:27:16.872756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:35.968565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:43.536575+0000","last_change":"2024-04-24T01:24:00.737956+0000","last_active":"2024-04-24T01:24:43.536575+0000","last_peered":"2024-04-24T01:24:43.536575+0000","last_clean":"2024-04-24T01:24:43.536575+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:24:43.536575+0000","last_undegraded":"2024-04-24T01:24:43.536575+0000","last_fullsized":"2024-04-24T01:24:43.536575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:01.856776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793056+0000","last_change":"2024-04-24T01:23:58.744402+0000","last_active":"2024-04-24T01:24:39.793056+0000","last_peered":"2024-04-24T01:24:39.793056+0000","last_clean":"2024-04-24T01:24:39.793056+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:24:39.793056+0000","last_undegraded":"2024-04-24T01:24:39.793056+0000","last_fullsized":"2024-04-24T01:24:39.793056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794002+0000","last_change":"2024-04-24T01:24:02.760212+0000","last_active":"2024-04-24T01:24:39.794002+0000","last_peered":"2024-04-24T01:24:39.794002+0000","last_clean":"2024-04-24T01:24:39.794002+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:24:39.794002+0000","last_undegraded":"2024-04-24T01:24:39.794002+0000","last_fullsized":"2024-04-24T01:24:39.794002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:38.380237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'46","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.144588+0000","last_change":"2024-04-24T01:24:04.753455+0000","last_active":"2024-04-24T01:26:08.144588+0000","last_peered":"2024-04-24T01:26:08.144588+0000","last_clean":"2024-04-24T01:26:08.144588+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:26:08.144588+0000","last_undegraded":"2024-04-24T01:26:08.144588+0000","last_fullsized":"2024-04-24T01:26:08.144588+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:43.056736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":41,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843661+0000","last_change":"2024-04-24T01:24:06.765236+0000","last_active":"2024-04-24T01:24:39.843661+0000","last_peered":"2024-04-24T01:24:39.843661+0000","last_clean":"2024-04-24T01:24:39.843661+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:24:39.843661+0000","last_undegraded":"2024-04-24T01:24:39.843661+0000","last_fullsized":"2024-04-24T01:24:39.843661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:24.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.652091+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:25:25.652091+0000","last_peered":"2024-04-24T01:25:25.652091+0000","last_clean":"2024-04-24T01:25:25.652091+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:25:25.652091+0000","last_undegraded":"2024-04-24T01:25:25.652091+0000","last_fullsized":"2024-04-24T01:25:25.652091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:02.933343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.371033+0000","last_change":"2024-04-24T01:24:00.739375+0000","last_active":"2024-04-24T01:24:42.371033+0000","last_peered":"2024-04-24T01:24:42.371033+0000","last_clean":"2024-04-24T01:24:42.371033+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:24:42.371033+0000","last_undegraded":"2024-04-24T01:24:42.371033+0000","last_fullsized":"2024-04-24T01:24:42.371033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.996880+0000","last_change":"2024-04-24T01:23:58.747337+0000","last_active":"2024-04-24T01:27:09.996880+0000","last_peered":"2024-04-24T01:27:09.996880+0000","last_clean":"2024-04-24T01:27:09.996880+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:09.996880+0000","last_undegraded":"2024-04-24T01:27:09.996880+0000","last_fullsized":"2024-04-24T01:27:09.996880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:52.523923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'4","reported_seq":228,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.840659+0000","last_change":"2024-04-24T01:24:02.754621+0000","last_active":"2024-04-24T01:27:16.840659+0000","last_peered":"2024-04-24T01:27:16.840659+0000","last_clean":"2024-04-24T01:27:16.840659+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:16.840659+0000","last_undegraded":"2024-04-24T01:27:16.840659+0000","last_fullsized":"2024-04-24T01:27:16.840659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:50.938939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'36","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.124152+0000","last_change":"2024-04-24T01:24:04.757399+0000","last_active":"2024-04-24T01:26:08.124152+0000","last_peered":"2024-04-24T01:26:08.124152+0000","last_clean":"2024-04-24T01:26:08.124152+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:26:08.124152+0000","last_undegraded":"2024-04-24T01:26:08.124152+0000","last_fullsized":"2024-04-24T01:26:08.124152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:32.641634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842244+0000","last_change":"2024-04-24T01:24:06.770235+0000","last_active":"2024-04-24T01:24:39.842244+0000","last_peered":"2024-04-24T01:24:39.842244+0000","last_clean":"2024-04-24T01:24:39.842244+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:24:39.842244+0000","last_undegraded":"2024-04-24T01:24:39.842244+0000","last_fullsized":"2024-04-24T01:24:39.842244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:57.117920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:19.779279+0000","last_change":"2024-04-24T01:24:08.772727+0000","last_active":"2024-04-24T01:25:19.779279+0000","last_peered":"2024-04-24T01:25:19.779279+0000","last_clean":"2024-04-24T01:25:19.779279+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:25:19.779279+0000","last_undegraded":"2024-04-24T01:25:19.779279+0000","last_fullsized":"2024-04-24T01:25:19.779279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:52.582338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642683+0000","last_change":"2024-04-24T01:24:00.740217+0000","last_active":"2024-04-24T01:26:09.642683+0000","last_peered":"2024-04-24T01:26:09.642683+0000","last_clean":"2024-04-24T01:26:09.642683+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:26:09.642683+0000","last_undegraded":"2024-04-24T01:26:09.642683+0000","last_fullsized":"2024-04-24T01:26:09.642683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:44.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983645+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:26:13.983645+0000","last_peered":"2024-04-24T01:26:13.983645+0000","last_clean":"2024-04-24T01:26:13.983645+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:26:13.983645+0000","last_undegraded":"2024-04-24T01:26:13.983645+0000","last_fullsized":"2024-04-24T01:26:13.983645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:57.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842662+0000","last_change":"2024-04-24T01:24:02.755085+0000","last_active":"2024-04-24T01:24:39.842662+0000","last_peered":"2024-04-24T01:24:39.842662+0000","last_clean":"2024-04-24T01:24:39.842662+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:24:39.842662+0000","last_undegraded":"2024-04-24T01:24:39.842662+0000","last_fullsized":"2024-04-24T01:24:39.842662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:00.515637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'48","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.146601+0000","last_change":"2024-04-24T01:24:04.760716+0000","last_active":"2024-04-24T01:26:08.146601+0000","last_peered":"2024-04-24T01:26:08.146601+0000","last_clean":"2024-04-24T01:26:08.146601+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:26:08.146601+0000","last_undegraded":"2024-04-24T01:26:08.146601+0000","last_fullsized":"2024-04-24T01:26:08.146601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:02.956787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":56,"num_read_kb":45,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'284","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.873973+0000","last_change":"2024-04-24T01:24:06.770574+0000","last_active":"2024-04-24T01:27:16.873973+0000","last_peered":"2024-04-24T01:27:16.873973+0000","last_clean":"2024-04-24T01:27:16.873973+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:16.873973+0000","last_undegraded":"2024-04-24T01:27:16.873973+0000","last_fullsized":"2024-04-24T01:27:16.873973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:45:08.995703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842818+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:24:39.842818+0000","last_peered":"2024-04-24T01:24:39.842818+0000","last_clean":"2024-04-24T01:24:39.842818+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:24:39.842818+0000","last_undegraded":"2024-04-24T01:24:39.842818+0000","last_fullsized":"2024-04-24T01:24:39.842818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:07.197054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370607+0000","last_change":"2024-04-24T01:24:00.731534+0000","last_active":"2024-04-24T01:26:06.370607+0000","last_peered":"2024-04-24T01:26:06.370607+0000","last_clean":"2024-04-24T01:26:06.370607+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:26:06.370607+0000","last_undegraded":"2024-04-24T01:26:06.370607+0000","last_fullsized":"2024-04-24T01:26:06.370607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:02.215844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791221+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:24:39.791221+0000","last_peered":"2024-04-24T01:24:39.791221+0000","last_clean":"2024-04-24T01:24:39.791221+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:24:39.791221+0000","last_undegraded":"2024-04-24T01:24:39.791221+0000","last_fullsized":"2024-04-24T01:24:39.791221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:00.208350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841637+0000","last_change":"2024-04-24T01:24:02.754790+0000","last_active":"2024-04-24T01:24:39.841637+0000","last_peered":"2024-04-24T01:24:39.841637+0000","last_clean":"2024-04-24T01:24:39.841637+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:24:39.841637+0000","last_undegraded":"2024-04-24T01:24:39.841637+0000","last_fullsized":"2024-04-24T01:24:39.841637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:34.987188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'66","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.148643+0000","last_change":"2024-04-24T01:24:04.761320+0000","last_active":"2024-04-24T01:26:08.148643+0000","last_peered":"2024-04-24T01:26:08.148643+0000","last_clean":"2024-04-24T01:26:08.148643+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:26:08.148643+0000","last_undegraded":"2024-04-24T01:26:08.148643+0000","last_fullsized":"2024-04-24T01:26:08.148643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:36:40.993593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":67,"num_read_kb":56,"num_write":30,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841213+0000","last_change":"2024-04-24T01:24:06.769787+0000","last_active":"2024-04-24T01:24:39.841213+0000","last_peered":"2024-04-24T01:24:39.841213+0000","last_clean":"2024-04-24T01:24:39.841213+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:24:39.841213+0000","last_undegraded":"2024-04-24T01:24:39.841213+0000","last_fullsized":"2024-04-24T01:24:39.841213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:14.938788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.435601+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.435601+0000","last_peered":"2024-04-24T01:27:10.435601+0000","last_clean":"2024-04-24T01:27:10.435601+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.435601+0000","last_undegraded":"2024-04-24T01:27:10.435601+0000","last_fullsized":"2024-04-24T01:27:10.435601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:26.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039360+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.039360+0000","last_peered":"2024-04-24T01:27:10.039360+0000","last_clean":"2024-04-24T01:27:10.039360+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.039360+0000","last_undegraded":"2024-04-24T01:27:10.039360+0000","last_fullsized":"2024-04-24T01:27:10.039360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:50.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894208+0000","last_change":"2024-04-24T01:23:58.747661+0000","last_active":"2024-04-24T01:24:41.894208+0000","last_peered":"2024-04-24T01:24:41.894208+0000","last_clean":"2024-04-24T01:24:41.894208+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:24:41.894208+0000","last_undegraded":"2024-04-24T01:24:41.894208+0000","last_fullsized":"2024-04-24T01:24:41.894208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:15.213886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792715+0000","last_change":"2024-04-24T01:24:02.751285+0000","last_active":"2024-04-24T01:24:39.792715+0000","last_peered":"2024-04-24T01:24:39.792715+0000","last_clean":"2024-04-24T01:24:39.792715+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:24:39.792715+0000","last_undegraded":"2024-04-24T01:24:39.792715+0000","last_fullsized":"2024-04-24T01:24:39.792715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:30.582902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.128326+0000","last_change":"2024-04-24T01:24:04.757977+0000","last_active":"2024-04-24T01:26:08.128326+0000","last_peered":"2024-04-24T01:26:08.128326+0000","last_clean":"2024-04-24T01:26:08.128326+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:26:08.128326+0000","last_undegraded":"2024-04-24T01:26:08.128326+0000","last_fullsized":"2024-04-24T01:26:08.128326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:41.769486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":41,"num_read_kb":33,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790314+0000","last_change":"2024-04-24T01:24:06.762347+0000","last_active":"2024-04-24T01:24:39.790314+0000","last_peered":"2024-04-24T01:24:39.790314+0000","last_clean":"2024-04-24T01:24:39.790314+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:24:39.790314+0000","last_undegraded":"2024-04-24T01:24:39.790314+0000","last_fullsized":"2024-04-24T01:24:39.790314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:11.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982729+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:26:08.982729+0000","last_peered":"2024-04-24T01:26:08.982729+0000","last_clean":"2024-04-24T01:26:08.982729+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:26:08.982729+0000","last_undegraded":"2024-04-24T01:26:08.982729+0000","last_fullsized":"2024-04-24T01:26:08.982729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:24.366261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642598+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:09.642598+0000","last_peered":"2024-04-24T01:26:09.642598+0000","last_clean":"2024-04-24T01:26:09.642598+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:09.642598+0000","last_undegraded":"2024-04-24T01:26:09.642598+0000","last_fullsized":"2024-04-24T01:26:09.642598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:49.386770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794593+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:24:39.794593+0000","last_peered":"2024-04-24T01:24:39.794593+0000","last_clean":"2024-04-24T01:24:39.794593+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:24:39.794593+0000","last_undegraded":"2024-04-24T01:24:39.794593+0000","last_fullsized":"2024-04-24T01:24:39.794593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:58.408440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842272+0000","last_change":"2024-04-24T01:24:02.754670+0000","last_active":"2024-04-24T01:24:39.842272+0000","last_peered":"2024-04-24T01:24:39.842272+0000","last_clean":"2024-04-24T01:24:39.842272+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:24:39.842272+0000","last_undegraded":"2024-04-24T01:24:39.842272+0000","last_fullsized":"2024-04-24T01:24:39.842272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:43.302766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.155674+0000","last_change":"2024-04-24T01:24:04.752408+0000","last_active":"2024-04-24T01:26:08.155674+0000","last_peered":"2024-04-24T01:26:08.155674+0000","last_clean":"2024-04-24T01:26:08.155674+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:26:08.155674+0000","last_undegraded":"2024-04-24T01:26:08.155674+0000","last_fullsized":"2024-04-24T01:26:08.155674+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:05.893512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'282","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.439306+0000","last_change":"2024-04-24T01:24:06.768791+0000","last_active":"2024-04-24T01:27:10.439306+0000","last_peered":"2024-04-24T01:27:10.439306+0000","last_clean":"2024-04-24T01:27:10.439306+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:10.439306+0000","last_undegraded":"2024-04-24T01:27:10.439306+0000","last_fullsized":"2024-04-24T01:27:10.439306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:38.429385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974110+0000","last_change":"2024-04-24T01:24:08.768551+0000","last_active":"2024-04-24T01:26:16.974110+0000","last_peered":"2024-04-24T01:26:16.974110+0000","last_clean":"2024-04-24T01:26:16.974110+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:26:16.974110+0000","last_undegraded":"2024-04-24T01:26:16.974110+0000","last_fullsized":"2024-04-24T01:26:16.974110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.067146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343453+0000","last_change":"2024-04-24T01:24:00.740730+0000","last_active":"2024-04-24T01:27:10.343453+0000","last_peered":"2024-04-24T01:27:10.343453+0000","last_clean":"2024-04-24T01:27:10.343453+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:10.343453+0000","last_undegraded":"2024-04-24T01:27:10.343453+0000","last_fullsized":"2024-04-24T01:27:10.343453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.960520+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:24:42.960520+0000","last_peered":"2024-04-24T01:24:42.960520+0000","last_clean":"2024-04-24T01:24:42.960520+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:24:42.960520+0000","last_undegraded":"2024-04-24T01:24:42.960520+0000","last_fullsized":"2024-04-24T01:24:42.960520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:05:27.917471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.280792+0000","last_change":"2024-04-24T01:24:02.755990+0000","last_active":"2024-04-24T01:26:09.280792+0000","last_peered":"2024-04-24T01:26:09.280792+0000","last_clean":"2024-04-24T01:26:09.280792+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:26:09.280792+0000","last_undegraded":"2024-04-24T01:26:09.280792+0000","last_fullsized":"2024-04-24T01:26:09.280792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:13.423016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794664+0000","last_change":"2024-04-24T01:24:04.759964+0000","last_active":"2024-04-24T01:24:39.794664+0000","last_peered":"2024-04-24T01:24:39.794664+0000","last_clean":"2024-04-24T01:24:39.794664+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:24:39.794664+0000","last_undegraded":"2024-04-24T01:24:39.794664+0000","last_fullsized":"2024-04-24T01:24:39.794664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:57.073362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'282","reported_seq":459,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.398554+0000","last_change":"2024-04-24T01:24:06.769489+0000","last_active":"2024-04-24T01:27:10.398554+0000","last_peered":"2024-04-24T01:27:10.398554+0000","last_clean":"2024-04-24T01:27:10.398554+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:10.398554+0000","last_undegraded":"2024-04-24T01:27:10.398554+0000","last_fullsized":"2024-04-24T01:27:10.398554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:40.252129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.421794+0000","last_change":"2024-04-24T01:24:08.769465+0000","last_active":"2024-04-24T01:26:09.421794+0000","last_peered":"2024-04-24T01:26:09.421794+0000","last_clean":"2024-04-24T01:26:09.421794+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:26:09.421794+0000","last_undegraded":"2024-04-24T01:26:09.421794+0000","last_fullsized":"2024-04-24T01:26:09.421794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:49.696659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124448+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.124448+0000","last_peered":"2024-04-24T01:27:10.124448+0000","last_clean":"2024-04-24T01:27:10.124448+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.124448+0000","last_undegraded":"2024-04-24T01:27:10.124448+0000","last_fullsized":"2024-04-24T01:27:10.124448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:54:42.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790064+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:24:39.790064+0000","last_peered":"2024-04-24T01:24:39.790064+0000","last_clean":"2024-04-24T01:24:39.790064+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:24:39.790064+0000","last_undegraded":"2024-04-24T01:24:39.790064+0000","last_fullsized":"2024-04-24T01:24:39.790064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:51.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790262+0000","last_change":"2024-04-24T01:24:02.753182+0000","last_active":"2024-04-24T01:24:39.790262+0000","last_peered":"2024-04-24T01:24:39.790262+0000","last_clean":"2024-04-24T01:24:39.790262+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:24:39.790262+0000","last_undegraded":"2024-04-24T01:24:39.790262+0000","last_fullsized":"2024-04-24T01:24:39.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:38.392527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'40","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983864+0000","last_change":"2024-04-24T01:24:04.754866+0000","last_active":"2024-04-24T01:26:18.983864+0000","last_peered":"2024-04-24T01:26:18.983864+0000","last_clean":"2024-04-24T01:26:18.983864+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:26:18.983864+0000","last_undegraded":"2024-04-24T01:26:18.983864+0000","last_fullsized":"2024-04-24T01:26:18.983864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:19.241933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790987+0000","last_change":"2024-04-24T01:24:06.767120+0000","last_active":"2024-04-24T01:24:39.790987+0000","last_peered":"2024-04-24T01:24:39.790987+0000","last_clean":"2024-04-24T01:24:39.790987+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:24:39.790987+0000","last_undegraded":"2024-04-24T01:24:39.790987+0000","last_fullsized":"2024-04-24T01:24:39.790987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:09.566148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.375629+0000","last_change":"2024-04-24T01:24:08.772039+0000","last_active":"2024-04-24T01:27:10.375629+0000","last_peered":"2024-04-24T01:27:10.375629+0000","last_clean":"2024-04-24T01:27:10.375629+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:10.375629+0000","last_undegraded":"2024-04-24T01:27:10.375629+0000","last_fullsized":"2024-04-24T01:27:10.375629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:37.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046285+0000","last_change":"2024-04-24T01:24:00.747539+0000","last_active":"2024-04-24T01:27:10.046285+0000","last_peered":"2024-04-24T01:27:10.046285+0000","last_clean":"2024-04-24T01:27:10.046285+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:10.046285+0000","last_undegraded":"2024-04-24T01:27:10.046285+0000","last_fullsized":"2024-04-24T01:27:10.046285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:03.538221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789580+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:24:39.789580+0000","last_peered":"2024-04-24T01:24:39.789580+0000","last_clean":"2024-04-24T01:24:39.789580+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:24:39.789580+0000","last_undegraded":"2024-04-24T01:24:39.789580+0000","last_fullsized":"2024-04-24T01:24:39.789580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792236+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:24:39.792236+0000","last_peered":"2024-04-24T01:24:39.792236+0000","last_clean":"2024-04-24T01:24:39.792236+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:24:39.792236+0000","last_undegraded":"2024-04-24T01:24:39.792236+0000","last_fullsized":"2024-04-24T01:24:39.792236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:15.195026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793836+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:24:39.793836+0000","last_peered":"2024-04-24T01:24:39.793836+0000","last_clean":"2024-04-24T01:24:39.793836+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:24:39.793836+0000","last_undegraded":"2024-04-24T01:24:39.793836+0000","last_fullsized":"2024-04-24T01:24:39.793836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:25.383897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.801934+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:24:39.801934+0000","last_peered":"2024-04-24T01:24:39.801934+0000","last_clean":"2024-04-24T01:24:39.801934+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:24:39.801934+0000","last_undegraded":"2024-04-24T01:24:39.801934+0000","last_fullsized":"2024-04-24T01:24:39.801934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:39.300121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'82","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.153261+0000","last_change":"2024-04-24T01:24:04.758941+0000","last_active":"2024-04-24T01:26:08.153261+0000","last_peered":"2024-04-24T01:26:08.153261+0000","last_clean":"2024-04-24T01:26:08.153261+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:26:08.153261+0000","last_undegraded":"2024-04-24T01:26:08.153261+0000","last_fullsized":"2024-04-24T01:26:08.153261+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:28.497024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":63,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770234+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:03.262620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.353300+0000","last_change":"2024-04-24T01:24:08.768417+0000","last_active":"2024-04-24T01:27:10.353300+0000","last_peered":"2024-04-24T01:27:10.353300+0000","last_clean":"2024-04-24T01:27:10.353300+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:10.353300+0000","last_undegraded":"2024-04-24T01:27:10.353300+0000","last_fullsized":"2024-04-24T01:27:10.353300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:30.971611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'3","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983682+0000","last_change":"2024-04-24T01:24:00.735658+0000","last_active":"2024-04-24T01:26:13.983682+0000","last_peered":"2024-04-24T01:26:13.983682+0000","last_clean":"2024-04-24T01:26:13.983682+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:26:13.983682+0000","last_undegraded":"2024-04-24T01:26:13.983682+0000","last_fullsized":"2024-04-24T01:26:13.983682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:42.397476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789517+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:24:39.789517+0000","last_peered":"2024-04-24T01:24:39.789517+0000","last_clean":"2024-04-24T01:24:39.789517+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:24:39.789517+0000","last_undegraded":"2024-04-24T01:24:39.789517+0000","last_fullsized":"2024-04-24T01:24:39.789517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:48.109200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972617+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:26:06.972617+0000","last_peered":"2024-04-24T01:26:06.972617+0000","last_clean":"2024-04-24T01:26:06.972617+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:26:06.972617+0000","last_undegraded":"2024-04-24T01:26:06.972617+0000","last_fullsized":"2024-04-24T01:26:06.972617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:15.111274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790478+0000","last_change":"2024-04-24T01:24:02.754010+0000","last_active":"2024-04-24T01:24:39.790478+0000","last_peered":"2024-04-24T01:24:39.790478+0000","last_clean":"2024-04-24T01:24:39.790478+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:24:39.790478+0000","last_undegraded":"2024-04-24T01:24:39.790478+0000","last_fullsized":"2024-04-24T01:24:39.790478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:31.372135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'279","reported_seq":488,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831459+0000","last_change":"2024-04-24T01:24:04.762704+0000","last_active":"2024-04-24T01:27:07.831459+0000","last_peered":"2024-04-24T01:27:07.831459+0000","last_clean":"2024-04-24T01:27:07.831459+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:07.831459+0000","last_undegraded":"2024-04-24T01:27:07.831459+0000","last_fullsized":"2024-04-24T01:27:07.831459+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":279,"log_dups_size":0,"ondisk_log_size":279,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:37.274008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":366,"num_read_kb":350,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792861+0000","last_change":"2024-04-24T01:24:06.760509+0000","last_active":"2024-04-24T01:24:39.792861+0000","last_peered":"2024-04-24T01:24:39.792861+0000","last_clean":"2024-04-24T01:24:39.792861+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:24:39.792861+0000","last_undegraded":"2024-04-24T01:24:39.792861+0000","last_fullsized":"2024-04-24T01:24:39.792861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:08.522687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.647797+0000","last_change":"2024-04-24T01:24:08.773331+0000","last_active":"2024-04-24T01:25:25.647797+0000","last_peered":"2024-04-24T01:25:25.647797+0000","last_clean":"2024-04-24T01:25:25.647797+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:25:25.647797+0000","last_undegraded":"2024-04-24T01:25:25.647797+0000","last_fullsized":"2024-04-24T01:25:25.647797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.429035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261927+0000","last_change":"2024-04-24T01:24:00.746776+0000","last_active":"2024-04-24T01:27:10.261927+0000","last_peered":"2024-04-24T01:27:10.261927+0000","last_clean":"2024-04-24T01:27:10.261927+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:10.261927+0000","last_undegraded":"2024-04-24T01:27:10.261927+0000","last_fullsized":"2024-04-24T01:27:10.261927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:10.175248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789461+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:24:39.789461+0000","last_peered":"2024-04-24T01:24:39.789461+0000","last_clean":"2024-04-24T01:24:39.789461+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:24:39.789461+0000","last_undegraded":"2024-04-24T01:24:39.789461+0000","last_fullsized":"2024-04-24T01:24:39.789461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:09.383332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.840955+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:24:39.840955+0000","last_peered":"2024-04-24T01:24:39.840955+0000","last_clean":"2024-04-24T01:24:39.840955+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:24:39.840955+0000","last_undegraded":"2024-04-24T01:24:39.840955+0000","last_fullsized":"2024-04-24T01:24:39.840955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:24.635245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":219,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.281055+0000","last_change":"2024-04-24T01:24:02.752449+0000","last_active":"2024-04-24T01:26:09.281055+0000","last_peered":"2024-04-24T01:26:09.281055+0000","last_clean":"2024-04-24T01:26:09.281055+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:26:09.281055+0000","last_undegraded":"2024-04-24T01:26:09.281055+0000","last_fullsized":"2024-04-24T01:26:09.281055+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:25.280491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831477+0000","last_change":"2024-04-24T01:24:04.757333+0000","last_active":"2024-04-24T01:27:07.831477+0000","last_peered":"2024-04-24T01:27:07.831477+0000","last_clean":"2024-04-24T01:27:07.831477+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:07.831477+0000","last_undegraded":"2024-04-24T01:27:07.831477+0000","last_fullsized":"2024-04-24T01:27:07.831477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:05.189769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770584+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:27.982282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790216+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:24:39.790216+0000","last_peered":"2024-04-24T01:24:39.790216+0000","last_clean":"2024-04-24T01:24:39.790216+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:24:39.790216+0000","last_undegraded":"2024-04-24T01:24:39.790216+0000","last_fullsized":"2024-04-24T01:24:39.790216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:30.742533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349653+0000","last_change":"2024-04-24T01:24:00.731982+0000","last_active":"2024-04-24T01:27:10.349653+0000","last_peered":"2024-04-24T01:27:10.349653+0000","last_clean":"2024-04-24T01:27:10.349653+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:10.349653+0000","last_undegraded":"2024-04-24T01:27:10.349653+0000","last_fullsized":"2024-04-24T01:27:10.349653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:01.094309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793490+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:24:39.793490+0000","last_peered":"2024-04-24T01:24:39.793490+0000","last_clean":"2024-04-24T01:24:39.793490+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:24:39.793490+0000","last_undegraded":"2024-04-24T01:24:39.793490+0000","last_fullsized":"2024-04-24T01:24:39.793490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:52.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.618279+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.618279+0000","last_peered":"2024-04-24T01:26:09.618279+0000","last_clean":"2024-04-24T01:26:09.618279+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.618279+0000","last_undegraded":"2024-04-24T01:26:09.618279+0000","last_fullsized":"2024-04-24T01:26:09.618279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842816+0000","last_change":"2024-04-24T01:24:02.751517+0000","last_active":"2024-04-24T01:24:39.842816+0000","last_peered":"2024-04-24T01:24:39.842816+0000","last_clean":"2024-04-24T01:24:39.842816+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:24:39.842816+0000","last_undegraded":"2024-04-24T01:24:39.842816+0000","last_fullsized":"2024-04-24T01:24:39.842816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:05.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.655738+0000","last_change":"2024-04-24T01:24:04.760913+0000","last_active":"2024-04-24T01:27:09.655738+0000","last_peered":"2024-04-24T01:27:09.655738+0000","last_clean":"2024-04-24T01:27:09.655738+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:09.655738+0000","last_undegraded":"2024-04-24T01:27:09.655738+0000","last_fullsized":"2024-04-24T01:27:09.655738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:30.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790734+0000","last_change":"2024-04-24T01:24:06.760113+0000","last_active":"2024-04-24T01:24:39.790734+0000","last_peered":"2024-04-24T01:24:39.790734+0000","last_clean":"2024-04-24T01:24:39.790734+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:24:39.790734+0000","last_undegraded":"2024-04-24T01:24:39.790734+0000","last_fullsized":"2024-04-24T01:24:39.790734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:00.960850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.398901+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:09.398901+0000","last_peered":"2024-04-24T01:26:09.398901+0000","last_clean":"2024-04-24T01:26:09.398901+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:09.398901+0000","last_undegraded":"2024-04-24T01:26:09.398901+0000","last_fullsized":"2024-04-24T01:26:09.398901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:04.383799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040345+0000","last_change":"2024-04-24T01:24:00.742538+0000","last_active":"2024-04-24T01:27:10.040345+0000","last_peered":"2024-04-24T01:27:10.040345+0000","last_clean":"2024-04-24T01:27:10.040345+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:10.040345+0000","last_undegraded":"2024-04-24T01:27:10.040345+0000","last_fullsized":"2024-04-24T01:27:10.040345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:22.605289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.243741+0000","last_change":"2024-04-24T01:23:58.743583+0000","last_active":"2024-04-24T01:27:10.243741+0000","last_peered":"2024-04-24T01:27:10.243741+0000","last_clean":"2024-04-24T01:27:10.243741+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:10.243741+0000","last_undegraded":"2024-04-24T01:27:10.243741+0000","last_fullsized":"2024-04-24T01:27:10.243741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842590+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:24:39.842590+0000","last_peered":"2024-04-24T01:24:39.842590+0000","last_clean":"2024-04-24T01:24:39.842590+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:24:39.842590+0000","last_undegraded":"2024-04-24T01:24:39.842590+0000","last_fullsized":"2024-04-24T01:24:39.842590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:24.173468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.457421+0000","last_change":"2024-04-24T01:24:02.750475+0000","last_active":"2024-04-24T01:27:10.457421+0000","last_peered":"2024-04-24T01:27:10.457421+0000","last_clean":"2024-04-24T01:27:10.457421+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:10.457421+0000","last_undegraded":"2024-04-24T01:27:10.457421+0000","last_fullsized":"2024-04-24T01:27:10.457421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:41.546855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'78","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.938001+0000","last_change":"2024-04-24T01:24:04.759676+0000","last_active":"2024-04-24T01:27:16.938001+0000","last_peered":"2024-04-24T01:27:16.938001+0000","last_clean":"2024-04-24T01:27:16.938001+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:16.938001+0000","last_undegraded":"2024-04-24T01:27:16.938001+0000","last_fullsized":"2024-04-24T01:27:16.938001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:49.476095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":69,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788138+0000","last_change":"2024-04-24T01:24:06.768799+0000","last_active":"2024-04-24T01:24:39.788138+0000","last_peered":"2024-04-24T01:24:39.788138+0000","last_clean":"2024-04-24T01:24:39.788138+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:24:39.788138+0000","last_undegraded":"2024-04-24T01:24:39.788138+0000","last_fullsized":"2024-04-24T01:24:39.788138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:29.140123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.578357+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:09.578357+0000","last_peered":"2024-04-24T01:26:09.578357+0000","last_clean":"2024-04-24T01:26:09.578357+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:09.578357+0000","last_undegraded":"2024-04-24T01:26:09.578357+0000","last_fullsized":"2024-04-24T01:26:09.578357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:58.022650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269116+0000","last_change":"2024-04-24T01:24:00.740995+0000","last_active":"2024-04-24T01:27:10.269116+0000","last_peered":"2024-04-24T01:27:10.269116+0000","last_clean":"2024-04-24T01:27:10.269116+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:10.269116+0000","last_undegraded":"2024-04-24T01:27:10.269116+0000","last_fullsized":"2024-04-24T01:27:10.269116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:25.504403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843750+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:24:39.843750+0000","last_peered":"2024-04-24T01:24:39.843750+0000","last_clean":"2024-04-24T01:24:39.843750+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:24:39.843750+0000","last_undegraded":"2024-04-24T01:24:39.843750+0000","last_fullsized":"2024-04-24T01:24:39.843750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:33.415474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793649+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:24:39.793649+0000","last_peered":"2024-04-24T01:24:39.793649+0000","last_clean":"2024-04-24T01:24:39.793649+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:24:39.793649+0000","last_undegraded":"2024-04-24T01:24:39.793649+0000","last_fullsized":"2024-04-24T01:24:39.793649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:49:44.621596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793155+0000","last_change":"2024-04-24T01:24:02.753858+0000","last_active":"2024-04-24T01:24:39.793155+0000","last_peered":"2024-04-24T01:24:39.793155+0000","last_clean":"2024-04-24T01:24:39.793155+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:24:39.793155+0000","last_undegraded":"2024-04-24T01:24:39.793155+0000","last_fullsized":"2024-04-24T01:24:39.793155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:56.906730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794508+0000","last_change":"2024-04-24T01:24:04.761717+0000","last_active":"2024-04-24T01:24:39.794508+0000","last_peered":"2024-04-24T01:24:39.794508+0000","last_clean":"2024-04-24T01:24:39.794508+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:24:39.794508+0000","last_undegraded":"2024-04-24T01:24:39.794508+0000","last_fullsized":"2024-04-24T01:24:39.794508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.225449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'282","reported_seq":356,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448921+0000","last_change":"2024-04-24T01:24:06.769511+0000","last_active":"2024-04-24T01:27:10.448921+0000","last_peered":"2024-04-24T01:27:10.448921+0000","last_clean":"2024-04-24T01:27:10.448921+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:10.448921+0000","last_undegraded":"2024-04-24T01:27:10.448921+0000","last_fullsized":"2024-04-24T01:27:10.448921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:27.014536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.876452+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:25:25.876452+0000","last_peered":"2024-04-24T01:25:25.876452+0000","last_clean":"2024-04-24T01:25:25.876452+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:25:25.876452+0000","last_undegraded":"2024-04-24T01:25:25.876452+0000","last_fullsized":"2024-04-24T01:25:25.876452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.793963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791495+0000","last_change":"2024-04-24T01:24:00.748141+0000","last_active":"2024-04-24T01:24:39.791495+0000","last_peered":"2024-04-24T01:24:39.791495+0000","last_clean":"2024-04-24T01:24:39.791495+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:24:39.791495+0000","last_undegraded":"2024-04-24T01:24:39.791495+0000","last_fullsized":"2024-04-24T01:24:39.791495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:01.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791804+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:24:39.791804+0000","last_peered":"2024-04-24T01:24:39.791804+0000","last_clean":"2024-04-24T01:24:39.791804+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:24:39.791804+0000","last_undegraded":"2024-04-24T01:24:39.791804+0000","last_fullsized":"2024-04-24T01:24:39.791804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:42.186635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843585+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:24:39.843585+0000","last_peered":"2024-04-24T01:24:39.843585+0000","last_clean":"2024-04-24T01:24:39.843585+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:24:39.843585+0000","last_undegraded":"2024-04-24T01:24:39.843585+0000","last_fullsized":"2024-04-24T01:24:39.843585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.744197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.799913+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:24:39.799913+0000","last_peered":"2024-04-24T01:24:39.799913+0000","last_clean":"2024-04-24T01:24:39.799913+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:24:39.799913+0000","last_undegraded":"2024-04-24T01:24:39.799913+0000","last_fullsized":"2024-04-24T01:24:39.799913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.029820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794303+0000","last_change":"2024-04-24T01:24:04.761597+0000","last_active":"2024-04-24T01:24:39.794303+0000","last_peered":"2024-04-24T01:24:39.794303+0000","last_clean":"2024-04-24T01:24:39.794303+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:24:39.794303+0000","last_undegraded":"2024-04-24T01:24:39.794303+0000","last_fullsized":"2024-04-24T01:24:39.794303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:04.640275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.871565+0000","last_change":"2024-04-24T01:24:06.765101+0000","last_active":"2024-04-24T01:27:16.871565+0000","last_peered":"2024-04-24T01:27:16.871565+0000","last_clean":"2024-04-24T01:27:16.871565+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:16.871565+0000","last_undegraded":"2024-04-24T01:27:16.871565+0000","last_fullsized":"2024-04-24T01:27:16.871565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:06.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797965+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:24:39.797965+0000","last_peered":"2024-04-24T01:24:39.797965+0000","last_clean":"2024-04-24T01:24:39.797965+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:24:39.797965+0000","last_undegraded":"2024-04-24T01:24:39.797965+0000","last_fullsized":"2024-04-24T01:24:39.797965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:06.970384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.038450+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.038450+0000","last_peered":"2024-04-24T01:27:10.038450+0000","last_clean":"2024-04-24T01:27:10.038450+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.038450+0000","last_undegraded":"2024-04-24T01:27:10.038450+0000","last_fullsized":"2024-04-24T01:27:10.038450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.048730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797039+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:24:39.797039+0000","last_peered":"2024-04-24T01:24:39.797039+0000","last_clean":"2024-04-24T01:24:39.797039+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:24:39.797039+0000","last_undegraded":"2024-04-24T01:24:39.797039+0000","last_fullsized":"2024-04-24T01:24:39.797039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794665+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:24:39.794665+0000","last_peered":"2024-04-24T01:24:39.794665+0000","last_clean":"2024-04-24T01:24:39.794665+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:24:39.794665+0000","last_undegraded":"2024-04-24T01:24:39.794665+0000","last_fullsized":"2024-04-24T01:24:39.794665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.535319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789366+0000","last_change":"2024-04-24T01:24:02.755458+0000","last_active":"2024-04-24T01:24:39.789366+0000","last_peered":"2024-04-24T01:24:39.789366+0000","last_clean":"2024-04-24T01:24:39.789366+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:24:39.789366+0000","last_undegraded":"2024-04-24T01:24:39.789366+0000","last_fullsized":"2024-04-24T01:24:39.789366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:22.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'91","reported_seq":169,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.138976+0000","last_change":"2024-04-24T01:24:04.761852+0000","last_active":"2024-04-24T01:26:08.138976+0000","last_peered":"2024-04-24T01:26:08.138976+0000","last_clean":"2024-04-24T01:26:08.138976+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:26:08.138976+0000","last_undegraded":"2024-04-24T01:26:08.138976+0000","last_fullsized":"2024-04-24T01:26:08.138976+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:40.393254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":90,"num_read_kb":90,"num_write":38,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841291+0000","last_change":"2024-04-24T01:24:06.769694+0000","last_active":"2024-04-24T01:24:39.841291+0000","last_peered":"2024-04-24T01:24:39.841291+0000","last_clean":"2024-04-24T01:24:39.841291+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:24:39.841291+0000","last_undegraded":"2024-04-24T01:24:39.841291+0000","last_fullsized":"2024-04-24T01:24:39.841291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:24.633566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.127833+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.127833+0000","last_peered":"2024-04-24T01:27:10.127833+0000","last_clean":"2024-04-24T01:27:10.127833+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.127833+0000","last_undegraded":"2024-04-24T01:27:10.127833+0000","last_fullsized":"2024-04-24T01:27:10.127833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:29.020694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792868+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:24:39.792868+0000","last_peered":"2024-04-24T01:24:39.792868+0000","last_clean":"2024-04-24T01:24:39.792868+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:24:39.792868+0000","last_undegraded":"2024-04-24T01:24:39.792868+0000","last_fullsized":"2024-04-24T01:24:39.792868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:40.801219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984452+0000","last_change":"2024-04-24T01:24:00.738356+0000","last_active":"2024-04-24T01:26:23.984452+0000","last_peered":"2024-04-24T01:26:23.984452+0000","last_clean":"2024-04-24T01:26:23.984452+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:26:23.984452+0000","last_undegraded":"2024-04-24T01:26:23.984452+0000","last_fullsized":"2024-04-24T01:26:23.984452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:27.391392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791345+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:24:39.791345+0000","last_peered":"2024-04-24T01:24:39.791345+0000","last_clean":"2024-04-24T01:24:39.791345+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:24:39.791345+0000","last_undegraded":"2024-04-24T01:24:39.791345+0000","last_fullsized":"2024-04-24T01:24:39.791345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:47.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795254+0000","last_change":"2024-04-24T01:24:02.754871+0000","last_active":"2024-04-24T01:24:39.795254+0000","last_peered":"2024-04-24T01:24:39.795254+0000","last_clean":"2024-04-24T01:24:39.795254+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:24:39.795254+0000","last_undegraded":"2024-04-24T01:24:39.795254+0000","last_fullsized":"2024-04-24T01:24:39.795254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:06.026635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985063+0000","last_change":"2024-04-24T01:24:04.759052+0000","last_active":"2024-04-24T01:26:23.985063+0000","last_peered":"2024-04-24T01:26:23.985063+0000","last_clean":"2024-04-24T01:26:23.985063+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:26:23.985063+0000","last_undegraded":"2024-04-24T01:26:23.985063+0000","last_fullsized":"2024-04-24T01:26:23.985063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:10.084623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792919+0000","last_change":"2024-04-24T01:24:06.767554+0000","last_active":"2024-04-24T01:24:39.792919+0000","last_peered":"2024-04-24T01:24:39.792919+0000","last_clean":"2024-04-24T01:24:39.792919+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:24:39.792919+0000","last_undegraded":"2024-04-24T01:24:39.792919+0000","last_fullsized":"2024-04-24T01:24:39.792919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.395728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.739765+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:09.739765+0000","last_peered":"2024-04-24T01:27:09.739765+0000","last_clean":"2024-04-24T01:27:09.739765+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:09.739765+0000","last_undegraded":"2024-04-24T01:27:09.739765+0000","last_fullsized":"2024-04-24T01:27:09.739765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:31.337496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314081+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.314081+0000","last_peered":"2024-04-24T01:27:10.314081+0000","last_clean":"2024-04-24T01:27:10.314081+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.314081+0000","last_undegraded":"2024-04-24T01:27:10.314081+0000","last_fullsized":"2024-04-24T01:27:10.314081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984537+0000","last_change":"2024-04-24T01:23:58.742514+0000","last_active":"2024-04-24T01:26:23.984537+0000","last_peered":"2024-04-24T01:26:23.984537+0000","last_clean":"2024-04-24T01:26:23.984537+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:26:23.984537+0000","last_undegraded":"2024-04-24T01:26:23.984537+0000","last_fullsized":"2024-04-24T01:26:23.984537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792781+0000","last_change":"2024-04-24T01:24:02.753260+0000","last_active":"2024-04-24T01:24:39.792781+0000","last_peered":"2024-04-24T01:24:39.792781+0000","last_clean":"2024-04-24T01:24:39.792781+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:24:39.792781+0000","last_undegraded":"2024-04-24T01:24:39.792781+0000","last_fullsized":"2024-04-24T01:24:39.792781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:34.774605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.660299+0000","last_change":"2024-04-24T01:24:04.746990+0000","last_active":"2024-04-24T01:27:09.660299+0000","last_peered":"2024-04-24T01:27:09.660299+0000","last_clean":"2024-04-24T01:27:09.660299+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:09.660299+0000","last_undegraded":"2024-04-24T01:27:09.660299+0000","last_fullsized":"2024-04-24T01:27:09.660299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:37.157422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789266+0000","last_change":"2024-04-24T01:24:06.763815+0000","last_active":"2024-04-24T01:24:39.789266+0000","last_peered":"2024-04-24T01:24:39.789266+0000","last_clean":"2024-04-24T01:24:39.789266+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:24:39.789266+0000","last_undegraded":"2024-04-24T01:24:39.789266+0000","last_fullsized":"2024-04-24T01:24:39.789266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:48.425403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.639815+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:09.639815+0000","last_peered":"2024-04-24T01:26:09.639815+0000","last_clean":"2024-04-24T01:26:09.639815+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:09.639815+0000","last_undegraded":"2024-04-24T01:26:09.639815+0000","last_fullsized":"2024-04-24T01:26:09.639815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:43.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974876+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:26:21.974876+0000","last_peered":"2024-04-24T01:26:21.974876+0000","last_clean":"2024-04-24T01:26:21.974876+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:26:21.974876+0000","last_undegraded":"2024-04-24T01:26:21.974876+0000","last_fullsized":"2024-04-24T01:26:21.974876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:50.598466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793735+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:24:39.793735+0000","last_peered":"2024-04-24T01:24:39.793735+0000","last_clean":"2024-04-24T01:24:39.793735+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:24:39.793735+0000","last_undegraded":"2024-04-24T01:24:39.793735+0000","last_fullsized":"2024-04-24T01:24:39.793735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:26.434050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788571+0000","last_change":"2024-04-24T01:24:02.751458+0000","last_active":"2024-04-24T01:24:39.788571+0000","last_peered":"2024-04-24T01:24:39.788571+0000","last_clean":"2024-04-24T01:24:39.788571+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:24:39.788571+0000","last_undegraded":"2024-04-24T01:24:39.788571+0000","last_fullsized":"2024-04-24T01:24:39.788571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:42.145688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.978784+0000","last_change":"2024-04-24T01:24:04.755755+0000","last_active":"2024-04-24T01:27:16.978784+0000","last_peered":"2024-04-24T01:27:16.978784+0000","last_clean":"2024-04-24T01:27:16.978784+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:16.978784+0000","last_undegraded":"2024-04-24T01:27:16.978784+0000","last_fullsized":"2024-04-24T01:27:16.978784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:33.640976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795040+0000","last_change":"2024-04-24T01:24:06.769210+0000","last_active":"2024-04-24T01:24:39.795040+0000","last_peered":"2024-04-24T01:24:39.795040+0000","last_clean":"2024-04-24T01:24:39.795040+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:24:39.795040+0000","last_undegraded":"2024-04-24T01:24:39.795040+0000","last_fullsized":"2024-04-24T01:24:39.795040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:03.675110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790701+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:24:39.790701+0000","last_peered":"2024-04-24T01:24:39.790701+0000","last_clean":"2024-04-24T01:24:39.790701+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:24:39.790701+0000","last_undegraded":"2024-04-24T01:24:39.790701+0000","last_fullsized":"2024-04-24T01:24:39.790701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:18.860876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313998+0000","last_change":"2024-04-24T01:24:00.748273+0000","last_active":"2024-04-24T01:27:10.313998+0000","last_peered":"2024-04-24T01:27:10.313998+0000","last_clean":"2024-04-24T01:27:10.313998+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:10.313998+0000","last_undegraded":"2024-04-24T01:27:10.313998+0000","last_fullsized":"2024-04-24T01:27:10.313998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:39.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.349714+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:24:42.349714+0000","last_peered":"2024-04-24T01:24:42.349714+0000","last_clean":"2024-04-24T01:24:42.349714+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:24:42.349714+0000","last_undegraded":"2024-04-24T01:24:42.349714+0000","last_fullsized":"2024-04-24T01:24:42.349714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:55.545071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794708+0000","last_change":"2024-04-24T01:24:02.753232+0000","last_active":"2024-04-24T01:24:39.794708+0000","last_peered":"2024-04-24T01:24:39.794708+0000","last_clean":"2024-04-24T01:24:39.794708+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:24:39.794708+0000","last_undegraded":"2024-04-24T01:24:39.794708+0000","last_fullsized":"2024-04-24T01:24:39.794708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:59.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'30","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.130351+0000","last_change":"2024-04-24T01:24:04.749427+0000","last_active":"2024-04-24T01:26:08.130351+0000","last_peered":"2024-04-24T01:26:08.130351+0000","last_clean":"2024-04-24T01:26:08.130351+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:26:08.130351+0000","last_undegraded":"2024-04-24T01:26:08.130351+0000","last_fullsized":"2024-04-24T01:26:08.130351+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:20.707833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790257+0000","last_change":"2024-04-24T01:24:06.765858+0000","last_active":"2024-04-24T01:24:39.790257+0000","last_peered":"2024-04-24T01:24:39.790257+0000","last_clean":"2024-04-24T01:24:39.790257+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:24:39.790257+0000","last_undegraded":"2024-04-24T01:24:39.790257+0000","last_fullsized":"2024-04-24T01:24:39.790257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:41.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.712721+0000","last_change":"2024-04-24T01:24:00.736176+0000","last_active":"2024-04-24T01:24:42.712721+0000","last_peered":"2024-04-24T01:24:42.712721+0000","last_clean":"2024-04-24T01:24:42.712721+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:24:42.712721+0000","last_undegraded":"2024-04-24T01:24:42.712721+0000","last_fullsized":"2024-04-24T01:24:42.712721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:43.962305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789625+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:24:39.789625+0000","last_peered":"2024-04-24T01:24:39.789625+0000","last_clean":"2024-04-24T01:24:39.789625+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:24:39.789625+0000","last_undegraded":"2024-04-24T01:24:39.789625+0000","last_fullsized":"2024-04-24T01:24:39.789625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843577+0000","last_change":"2024-04-24T01:24:02.752935+0000","last_active":"2024-04-24T01:24:39.843577+0000","last_peered":"2024-04-24T01:24:39.843577+0000","last_clean":"2024-04-24T01:24:39.843577+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:24:39.843577+0000","last_undegraded":"2024-04-24T01:24:39.843577+0000","last_fullsized":"2024-04-24T01:24:39.843577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:47:05.280503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.966164+0000","last_change":"2024-04-24T01:24:04.754439+0000","last_active":"2024-04-24T01:27:16.966164+0000","last_peered":"2024-04-24T01:27:16.966164+0000","last_clean":"2024-04-24T01:27:16.966164+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:16.966164+0000","last_undegraded":"2024-04-24T01:27:16.966164+0000","last_fullsized":"2024-04-24T01:27:16.966164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:32.262142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790895+0000","last_change":"2024-04-24T01:24:06.765083+0000","last_active":"2024-04-24T01:24:39.790895+0000","last_peered":"2024-04-24T01:24:39.790895+0000","last_clean":"2024-04-24T01:24:39.790895+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:24:39.790895+0000","last_undegraded":"2024-04-24T01:24:39.790895+0000","last_fullsized":"2024-04-24T01:24:39.790895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:11.672040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.396373+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.396373+0000","last_peered":"2024-04-24T01:27:10.396373+0000","last_clean":"2024-04-24T01:27:10.396373+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.396373+0000","last_undegraded":"2024-04-24T01:27:10.396373+0000","last_fullsized":"2024-04-24T01:27:10.396373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:59.796477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314066+0000","last_change":"2024-04-24T01:24:00.746542+0000","last_active":"2024-04-24T01:27:10.314066+0000","last_peered":"2024-04-24T01:27:10.314066+0000","last_clean":"2024-04-24T01:27:10.314066+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:10.314066+0000","last_undegraded":"2024-04-24T01:27:10.314066+0000","last_fullsized":"2024-04-24T01:27:10.314066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:34:54.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984466+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:26:23.984466+0000","last_peered":"2024-04-24T01:26:23.984466+0000","last_clean":"2024-04-24T01:26:23.984466+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:26:23.984466+0000","last_undegraded":"2024-04-24T01:26:23.984466+0000","last_fullsized":"2024-04-24T01:26:23.984466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793348+0000","last_change":"2024-04-24T01:24:02.750800+0000","last_active":"2024-04-24T01:24:39.793348+0000","last_peered":"2024-04-24T01:24:39.793348+0000","last_clean":"2024-04-24T01:24:39.793348+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:24:39.793348+0000","last_undegraded":"2024-04-24T01:24:39.793348+0000","last_fullsized":"2024-04-24T01:24:39.793348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:37.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'36","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.131427+0000","last_change":"2024-04-24T01:24:04.758945+0000","last_active":"2024-04-24T01:26:08.131427+0000","last_peered":"2024-04-24T01:26:08.131427+0000","last_clean":"2024-04-24T01:26:08.131427+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:26:08.131427+0000","last_undegraded":"2024-04-24T01:26:08.131427+0000","last_fullsized":"2024-04-24T01:26:08.131427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:50.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796689+0000","last_change":"2024-04-24T01:24:06.771761+0000","last_active":"2024-04-24T01:24:39.796689+0000","last_peered":"2024-04-24T01:24:39.796689+0000","last_clean":"2024-04-24T01:24:39.796689+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:24:39.796689+0000","last_undegraded":"2024-04-24T01:24:39.796689+0000","last_fullsized":"2024-04-24T01:24:39.796689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:35.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792017+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:24:39.792017+0000","last_peered":"2024-04-24T01:24:39.792017+0000","last_clean":"2024-04-24T01:24:39.792017+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:24:39.792017+0000","last_undegraded":"2024-04-24T01:24:39.792017+0000","last_fullsized":"2024-04-24T01:24:39.792017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:33.305911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794785+0000","last_change":"2024-04-24T01:24:00.748328+0000","last_active":"2024-04-24T01:24:39.794785+0000","last_peered":"2024-04-24T01:24:39.794785+0000","last_clean":"2024-04-24T01:24:39.794785+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:24:39.794785+0000","last_undegraded":"2024-04-24T01:24:39.794785+0000","last_fullsized":"2024-04-24T01:24:39.794785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:32.401459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795365+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:24:39.795365+0000","last_peered":"2024-04-24T01:24:39.795365+0000","last_clean":"2024-04-24T01:24:39.795365+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:24:39.795365+0000","last_undegraded":"2024-04-24T01:24:39.795365+0000","last_fullsized":"2024-04-24T01:24:39.795365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791825+0000","last_change":"2024-04-24T01:24:02.751213+0000","last_active":"2024-04-24T01:24:39.791825+0000","last_peered":"2024-04-24T01:24:39.791825+0000","last_clean":"2024-04-24T01:24:39.791825+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:24:39.791825+0000","last_undegraded":"2024-04-24T01:24:39.791825+0000","last_fullsized":"2024-04-24T01:24:39.791825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:17.078503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.924271+0000","last_change":"2024-04-24T01:24:04.759228+0000","last_active":"2024-04-24T01:27:16.924271+0000","last_peered":"2024-04-24T01:27:16.924271+0000","last_clean":"2024-04-24T01:27:16.924271+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:16.924271+0000","last_undegraded":"2024-04-24T01:27:16.924271+0000","last_fullsized":"2024-04-24T01:27:16.924271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:35.649948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842771+0000","last_change":"2024-04-24T01:24:06.767031+0000","last_active":"2024-04-24T01:24:39.842771+0000","last_peered":"2024-04-24T01:24:39.842771+0000","last_clean":"2024-04-24T01:24:39.842771+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:24:39.842771+0000","last_undegraded":"2024-04-24T01:24:39.842771+0000","last_fullsized":"2024-04-24T01:24:39.842771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:10.767999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.638179+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:09.638179+0000","last_peered":"2024-04-24T01:26:09.638179+0000","last_clean":"2024-04-24T01:26:09.638179+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:09.638179+0000","last_undegraded":"2024-04-24T01:26:09.638179+0000","last_fullsized":"2024-04-24T01:26:09.638179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:34.213505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370705+0000","last_change":"2024-04-24T01:24:00.732301+0000","last_active":"2024-04-24T01:26:06.370705+0000","last_peered":"2024-04-24T01:26:06.370705+0000","last_clean":"2024-04-24T01:26:06.370705+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:26:06.370705+0000","last_undegraded":"2024-04-24T01:26:06.370705+0000","last_fullsized":"2024-04-24T01:26:06.370705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:24.753026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791433+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:24:39.791433+0000","last_peered":"2024-04-24T01:24:39.791433+0000","last_clean":"2024-04-24T01:24:39.791433+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:24:39.791433+0000","last_undegraded":"2024-04-24T01:24:39.791433+0000","last_fullsized":"2024-04-24T01:24:39.791433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:26.702951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797556+0000","last_change":"2024-04-24T01:24:02.753145+0000","last_active":"2024-04-24T01:24:39.797556+0000","last_peered":"2024-04-24T01:24:39.797556+0000","last_clean":"2024-04-24T01:24:39.797556+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:24:39.797556+0000","last_undegraded":"2024-04-24T01:24:39.797556+0000","last_fullsized":"2024-04-24T01:24:39.797556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:47.630785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790507+0000","last_change":"2024-04-24T01:24:04.759523+0000","last_active":"2024-04-24T01:24:39.790507+0000","last_peered":"2024-04-24T01:24:39.790507+0000","last_clean":"2024-04-24T01:24:39.790507+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:24:39.790507+0000","last_undegraded":"2024-04-24T01:24:39.790507+0000","last_fullsized":"2024-04-24T01:24:39.790507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:22:53.916052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'282","reported_seq":375,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831397+0000","last_change":"2024-04-24T01:24:06.769994+0000","last_active":"2024-04-24T01:27:07.831397+0000","last_peered":"2024-04-24T01:27:07.831397+0000","last_clean":"2024-04-24T01:27:07.831397+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:07.831397+0000","last_undegraded":"2024-04-24T01:27:07.831397+0000","last_fullsized":"2024-04-24T01:27:07.831397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:03.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792482+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:24:39.792482+0000","last_peered":"2024-04-24T01:24:39.792482+0000","last_clean":"2024-04-24T01:24:39.792482+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:24:39.792482+0000","last_undegraded":"2024-04-24T01:24:39.792482+0000","last_fullsized":"2024-04-24T01:24:39.792482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:40.559182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343653+0000","last_change":"2024-04-24T01:24:00.732138+0000","last_active":"2024-04-24T01:27:10.343653+0000","last_peered":"2024-04-24T01:27:10.343653+0000","last_clean":"2024-04-24T01:27:10.343653+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:10.343653+0000","last_undegraded":"2024-04-24T01:27:10.343653+0000","last_fullsized":"2024-04-24T01:27:10.343653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:59.208377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894122+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:24:41.894122+0000","last_peered":"2024-04-24T01:24:41.894122+0000","last_clean":"2024-04-24T01:24:41.894122+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:24:41.894122+0000","last_undegraded":"2024-04-24T01:24:41.894122+0000","last_fullsized":"2024-04-24T01:24:41.894122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795147+0000","last_change":"2024-04-24T01:24:02.755459+0000","last_active":"2024-04-24T01:24:39.795147+0000","last_peered":"2024-04-24T01:24:39.795147+0000","last_clean":"2024-04-24T01:24:39.795147+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:24:39.795147+0000","last_undegraded":"2024-04-24T01:24:39.795147+0000","last_fullsized":"2024-04-24T01:24:39.795147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:03.880496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'62","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.122189+0000","last_change":"2024-04-24T01:24:04.753792+0000","last_active":"2024-04-24T01:26:08.122189+0000","last_peered":"2024-04-24T01:26:08.122189+0000","last_clean":"2024-04-24T01:26:08.122189+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:26:08.122189+0000","last_undegraded":"2024-04-24T01:26:08.122189+0000","last_fullsized":"2024-04-24T01:26:08.122189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:36.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":74,"num_read_kb":61,"num_write":42,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841092+0000","last_change":"2024-04-24T01:24:06.770663+0000","last_active":"2024-04-24T01:24:39.841092+0000","last_peered":"2024-04-24T01:24:39.841092+0000","last_clean":"2024-04-24T01:24:39.841092+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:24:39.841092+0000","last_undegraded":"2024-04-24T01:24:39.841092+0000","last_fullsized":"2024-04-24T01:24:39.841092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:13:20.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797448+0000","last_change":"2024-04-24T01:24:08.769131+0000","last_active":"2024-04-24T01:24:39.797448+0000","last_peered":"2024-04-24T01:24:39.797448+0000","last_clean":"2024-04-24T01:24:39.797448+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:24:39.797448+0000","last_undegraded":"2024-04-24T01:24:39.797448+0000","last_fullsized":"2024-04-24T01:24:39.797448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:14.098220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311172+0000","last_change":"2024-04-24T01:24:00.729678+0000","last_active":"2024-04-24T01:27:10.311172+0000","last_peered":"2024-04-24T01:27:10.311172+0000","last_clean":"2024-04-24T01:27:10.311172+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:10.311172+0000","last_undegraded":"2024-04-24T01:27:10.311172+0000","last_fullsized":"2024-04-24T01:27:10.311172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.631103+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:25:25.631103+0000","last_peered":"2024-04-24T01:25:25.631103+0000","last_clean":"2024-04-24T01:25:25.631103+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:25:25.631103+0000","last_undegraded":"2024-04-24T01:25:25.631103+0000","last_fullsized":"2024-04-24T01:25:25.631103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:50.919310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791338+0000","last_change":"2024-04-24T01:24:02.753343+0000","last_active":"2024-04-24T01:24:39.791338+0000","last_peered":"2024-04-24T01:24:39.791338+0000","last_clean":"2024-04-24T01:24:39.791338+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:24:39.791338+0000","last_undegraded":"2024-04-24T01:24:39.791338+0000","last_fullsized":"2024-04-24T01:24:39.791338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.027557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'40","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.947862+0000","last_change":"2024-04-24T01:24:04.759090+0000","last_active":"2024-04-24T01:27:16.947862+0000","last_peered":"2024-04-24T01:27:16.947862+0000","last_clean":"2024-04-24T01:27:16.947862+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:16.947862+0000","last_undegraded":"2024-04-24T01:27:16.947862+0000","last_fullsized":"2024-04-24T01:27:16.947862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:43.590882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792417+0000","last_change":"2024-04-24T01:24:06.765993+0000","last_active":"2024-04-24T01:24:39.792417+0000","last_peered":"2024-04-24T01:24:39.792417+0000","last_clean":"2024-04-24T01:24:39.792417+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:24:39.792417+0000","last_undegraded":"2024-04-24T01:24:39.792417+0000","last_fullsized":"2024-04-24T01:24:39.792417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:41.757073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792239+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:24:39.792239+0000","last_peered":"2024-04-24T01:24:39.792239+0000","last_clean":"2024-04-24T01:24:39.792239+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:24:39.792239+0000","last_undegraded":"2024-04-24T01:24:39.792239+0000","last_fullsized":"2024-04-24T01:24:39.792239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:09.221221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985926+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:26:28.985926+0000","last_peered":"2024-04-24T01:26:28.985926+0000","last_clean":"2024-04-24T01:26:28.985926+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:26:28.985926+0000","last_undegraded":"2024-04-24T01:26:28.985926+0000","last_fullsized":"2024-04-24T01:26:28.985926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:34.177576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843706+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:24:39.843706+0000","last_peered":"2024-04-24T01:24:39.843706+0000","last_clean":"2024-04-24T01:24:39.843706+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:24:39.843706+0000","last_undegraded":"2024-04-24T01:24:39.843706+0000","last_fullsized":"2024-04-24T01:24:39.843706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:10.215840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789419+0000","last_change":"2024-04-24T01:24:02.756957+0000","last_active":"2024-04-24T01:24:39.789419+0000","last_peered":"2024-04-24T01:24:39.789419+0000","last_clean":"2024-04-24T01:24:39.789419+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:24:39.789419+0000","last_undegraded":"2024-04-24T01:24:39.789419+0000","last_fullsized":"2024-04-24T01:24:39.789419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:38.961968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'32","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.147521+0000","last_change":"2024-04-24T01:24:04.761512+0000","last_active":"2024-04-24T01:26:08.147521+0000","last_peered":"2024-04-24T01:26:08.147521+0000","last_clean":"2024-04-24T01:26:08.147521+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:26:08.147521+0000","last_undegraded":"2024-04-24T01:26:08.147521+0000","last_fullsized":"2024-04-24T01:26:08.147521+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:33.309938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":27,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793397+0000","last_change":"2024-04-24T01:24:06.770228+0000","last_active":"2024-04-24T01:24:39.793397+0000","last_peered":"2024-04-24T01:24:39.793397+0000","last_clean":"2024-04-24T01:24:39.793397+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:24:39.793397+0000","last_undegraded":"2024-04-24T01:24:39.793397+0000","last_fullsized":"2024-04-24T01:24:39.793397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:18:11.286272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.158027+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:08.158027+0000","last_peered":"2024-04-24T01:26:08.158027+0000","last_clean":"2024-04-24T01:26:08.158027+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:08.158027+0000","last_undegraded":"2024-04-24T01:26:08.158027+0000","last_fullsized":"2024-04-24T01:26:08.158027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:44.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.881602+0000","last_change":"2024-04-24T01:24:00.730610+0000","last_active":"2024-04-24T01:25:25.881602+0000","last_peered":"2024-04-24T01:25:25.881602+0000","last_clean":"2024-04-24T01:25:25.881602+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:25:25.881602+0000","last_undegraded":"2024-04-24T01:25:25.881602+0000","last_fullsized":"2024-04-24T01:25:25.881602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:38.644402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797330+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:24:39.797330+0000","last_peered":"2024-04-24T01:24:39.797330+0000","last_clean":"2024-04-24T01:24:39.797330+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:24:39.797330+0000","last_undegraded":"2024-04-24T01:24:39.797330+0000","last_fullsized":"2024-04-24T01:24:39.797330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.777248+0000","last_change":"2024-04-24T01:24:02.758075+0000","last_active":"2024-04-24T01:26:06.777248+0000","last_peered":"2024-04-24T01:26:06.777248+0000","last_clean":"2024-04-24T01:26:06.777248+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:26:06.777248+0000","last_undegraded":"2024-04-24T01:26:06.777248+0000","last_fullsized":"2024-04-24T01:26:06.777248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:03.864248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'45","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.661103+0000","last_change":"2024-04-24T01:24:04.761785+0000","last_active":"2024-04-24T01:27:09.661103+0000","last_peered":"2024-04-24T01:27:09.661103+0000","last_clean":"2024-04-24T01:27:09.661103+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:09.661103+0000","last_undegraded":"2024-04-24T01:27:09.661103+0000","last_fullsized":"2024-04-24T01:27:09.661103+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:58.149475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":52,"num_read_kb":46,"num_write":30,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842218+0000","last_change":"2024-04-24T01:24:06.770604+0000","last_active":"2024-04-24T01:24:39.842218+0000","last_peered":"2024-04-24T01:24:39.842218+0000","last_clean":"2024-04-24T01:24:39.842218+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:24:39.842218+0000","last_undegraded":"2024-04-24T01:24:39.842218+0000","last_fullsized":"2024-04-24T01:24:39.842218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:16.930856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.160611+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:08.160611+0000","last_peered":"2024-04-24T01:26:08.160611+0000","last_clean":"2024-04-24T01:26:08.160611+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:08.160611+0000","last_undegraded":"2024-04-24T01:26:08.160611+0000","last_fullsized":"2024-04-24T01:26:08.160611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:18.783056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642790+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:09.642790+0000","last_peered":"2024-04-24T01:26:09.642790+0000","last_clean":"2024-04-24T01:26:09.642790+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:09.642790+0000","last_undegraded":"2024-04-24T01:26:09.642790+0000","last_fullsized":"2024-04-24T01:26:09.642790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:11.472098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981484+0000","last_change":"2024-04-24T01:23:58.747335+0000","last_active":"2024-04-24T01:26:03.981484+0000","last_peered":"2024-04-24T01:26:03.981484+0000","last_clean":"2024-04-24T01:26:03.981484+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:26:03.981484+0000","last_undegraded":"2024-04-24T01:26:03.981484+0000","last_fullsized":"2024-04-24T01:26:03.981484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.641524+0000","last_change":"2024-04-24T01:24:00.732134+0000","last_active":"2024-04-24T01:25:25.641524+0000","last_peered":"2024-04-24T01:25:25.641524+0000","last_clean":"2024-04-24T01:25:25.641524+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:25:25.641524+0000","last_undegraded":"2024-04-24T01:25:25.641524+0000","last_fullsized":"2024-04-24T01:25:25.641524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:12.420444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894175+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:24:41.894175+0000","last_peered":"2024-04-24T01:24:41.894175+0000","last_clean":"2024-04-24T01:24:41.894175+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:24:41.894175+0000","last_undegraded":"2024-04-24T01:24:41.894175+0000","last_fullsized":"2024-04-24T01:24:41.894175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:34.164253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124466+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.124466+0000","last_peered":"2024-04-24T01:27:10.124466+0000","last_clean":"2024-04-24T01:27:10.124466+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.124466+0000","last_undegraded":"2024-04-24T01:27:10.124466+0000","last_fullsized":"2024-04-24T01:27:10.124466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:45.623313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793654+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:24:39.793654+0000","last_peered":"2024-04-24T01:24:39.793654+0000","last_clean":"2024-04-24T01:24:39.793654+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:24:39.793654+0000","last_undegraded":"2024-04-24T01:24:39.793654+0000","last_fullsized":"2024-04-24T01:24:39.793654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:36.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124201+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.124201+0000","last_peered":"2024-04-24T01:27:10.124201+0000","last_clean":"2024-04-24T01:27:10.124201+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.124201+0000","last_undegraded":"2024-04-24T01:27:10.124201+0000","last_fullsized":"2024-04-24T01:27:10.124201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:23.382109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843929+0000","last_change":"2024-04-24T01:23:58.747256+0000","last_active":"2024-04-24T01:24:39.843929+0000","last_peered":"2024-04-24T01:24:39.843929+0000","last_clean":"2024-04-24T01:24:39.843929+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:24:39.843929+0000","last_undegraded":"2024-04-24T01:24:39.843929+0000","last_fullsized":"2024-04-24T01:24:39.843929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:24.901113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311360+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.311360+0000","last_peered":"2024-04-24T01:27:10.311360+0000","last_clean":"2024-04-24T01:27:10.311360+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.311360+0000","last_undegraded":"2024-04-24T01:27:10.311360+0000","last_fullsized":"2024-04-24T01:27:10.311360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:23.445860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843749+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:24:39.843749+0000","last_peered":"2024-04-24T01:24:39.843749+0000","last_clean":"2024-04-24T01:24:39.843749+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:24:39.843749+0000","last_undegraded":"2024-04-24T01:24:39.843749+0000","last_fullsized":"2024-04-24T01:24:39.843749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:35.046540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262087+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.262087+0000","last_peered":"2024-04-24T01:27:10.262087+0000","last_clean":"2024-04-24T01:27:10.262087+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.262087+0000","last_undegraded":"2024-04-24T01:27:10.262087+0000","last_fullsized":"2024-04-24T01:27:10.262087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:40.138216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.541257+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.541257+0000","last_peered":"2024-04-24T01:26:09.541257+0000","last_clean":"2024-04-24T01:26:09.541257+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.541257+0000","last_undegraded":"2024-04-24T01:26:09.541257+0000","last_fullsized":"2024-04-24T01:26:09.541257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.879998+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:25:25.879998+0000","last_peered":"2024-04-24T01:25:25.879998+0000","last_clean":"2024-04-24T01:25:25.879998+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:25:25.879998+0000","last_undegraded":"2024-04-24T01:25:25.879998+0000","last_fullsized":"2024-04-24T01:25:25.879998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:09.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.338702+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.338702+0000","last_peered":"2024-04-24T01:27:10.338702+0000","last_clean":"2024-04-24T01:27:10.338702+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.338702+0000","last_undegraded":"2024-04-24T01:27:10.338702+0000","last_fullsized":"2024-04-24T01:27:10.338702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.125794+0000","last_change":"2024-04-24T01:24:00.744090+0000","last_active":"2024-04-24T01:27:10.125794+0000","last_peered":"2024-04-24T01:27:10.125794+0000","last_clean":"2024-04-24T01:27:10.125794+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:10.125794+0000","last_undegraded":"2024-04-24T01:27:10.125794+0000","last_fullsized":"2024-04-24T01:27:10.125794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:35.200859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.480239+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:09.480239+0000","last_peered":"2024-04-24T01:26:09.480239+0000","last_clean":"2024-04-24T01:26:09.480239+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:09.480239+0000","last_undegraded":"2024-04-24T01:26:09.480239+0000","last_fullsized":"2024-04-24T01:26:09.480239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:44.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314098+0000","last_change":"2024-04-24T01:24:00.745364+0000","last_active":"2024-04-24T01:27:10.314098+0000","last_peered":"2024-04-24T01:27:10.314098+0000","last_clean":"2024-04-24T01:27:10.314098+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:10.314098+0000","last_undegraded":"2024-04-24T01:27:10.314098+0000","last_fullsized":"2024-04-24T01:27:10.314098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:04.207670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789907+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:24:39.789907+0000","last_peered":"2024-04-24T01:24:39.789907+0000","last_clean":"2024-04-24T01:24:39.789907+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:24:39.789907+0000","last_undegraded":"2024-04-24T01:24:39.789907+0000","last_fullsized":"2024-04-24T01:24:39.789907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.471255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040648+0000","last_change":"2024-04-24T01:24:00.738594+0000","last_active":"2024-04-24T01:27:10.040648+0000","last_peered":"2024-04-24T01:27:10.040648+0000","last_clean":"2024-04-24T01:27:10.040648+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:10.040648+0000","last_undegraded":"2024-04-24T01:27:10.040648+0000","last_fullsized":"2024-04-24T01:27:10.040648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:05.644113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.972565+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:24:42.972565+0000","last_peered":"2024-04-24T01:24:42.972565+0000","last_clean":"2024-04-24T01:24:42.972565+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:24:42.972565+0000","last_undegraded":"2024-04-24T01:24:42.972565+0000","last_fullsized":"2024-04-24T01:24:42.972565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:08.200562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124410+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.124410+0000","last_peered":"2024-04-24T01:27:10.124410+0000","last_clean":"2024-04-24T01:27:10.124410+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.124410+0000","last_undegraded":"2024-04-24T01:27:10.124410+0000","last_fullsized":"2024-04-24T01:27:10.124410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:37.307723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252871+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.252871+0000","last_peered":"2024-04-24T01:27:10.252871+0000","last_clean":"2024-04-24T01:27:10.252871+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.252871+0000","last_undegraded":"2024-04-24T01:27:10.252871+0000","last_fullsized":"2024-04-24T01:27:10.252871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311477+0000","last_change":"2024-04-24T01:24:00.739108+0000","last_active":"2024-04-24T01:27:10.311477+0000","last_peered":"2024-04-24T01:27:10.311477+0000","last_clean":"2024-04-24T01:27:10.311477+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:10.311477+0000","last_undegraded":"2024-04-24T01:27:10.311477+0000","last_fullsized":"2024-04-24T01:27:10.311477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:35.209417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796505+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:24:39.796505+0000","last_peered":"2024-04-24T01:24:39.796505+0000","last_clean":"2024-04-24T01:24:39.796505+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:24:39.796505+0000","last_undegraded":"2024-04-24T01:24:39.796505+0000","last_fullsized":"2024-04-24T01:24:39.796505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984070+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:24:42.984070+0000","last_peered":"2024-04-24T01:24:42.984070+0000","last_clean":"2024-04-24T01:24:42.984070+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:24:42.984070+0000","last_undegraded":"2024-04-24T01:24:42.984070+0000","last_fullsized":"2024-04-24T01:24:42.984070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791579+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:24:39.791579+0000","last_peered":"2024-04-24T01:24:39.791579+0000","last_clean":"2024-04-24T01:24:39.791579+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:24:39.791579+0000","last_undegraded":"2024-04-24T01:24:39.791579+0000","last_fullsized":"2024-04-24T01:24:39.791579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:00:17.843103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983736+0000","last_change":"2024-04-24T01:24:00.745475+0000","last_active":"2024-04-24T01:26:18.983736+0000","last_peered":"2024-04-24T01:26:18.983736+0000","last_clean":"2024-04-24T01:26:18.983736+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:26:18.983736+0000","last_undegraded":"2024-04-24T01:26:18.983736+0000","last_fullsized":"2024-04-24T01:26:18.983736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:30.020085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793966+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:24:39.793966+0000","last_peered":"2024-04-24T01:24:39.793966+0000","last_clean":"2024-04-24T01:24:39.793966+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:24:39.793966+0000","last_undegraded":"2024-04-24T01:24:39.793966+0000","last_fullsized":"2024-04-24T01:24:39.793966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:31.252182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350752+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350752+0000","last_peered":"2024-04-24T01:27:10.350752+0000","last_clean":"2024-04-24T01:27:10.350752+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350752+0000","last_undegraded":"2024-04-24T01:27:10.350752+0000","last_fullsized":"2024-04-24T01:27:10.350752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:52.523705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793919+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:24:39.793919+0000","last_peered":"2024-04-24T01:24:39.793919+0000","last_clean":"2024-04-24T01:24:39.793919+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:24:39.793919+0000","last_undegraded":"2024-04-24T01:24:39.793919+0000","last_fullsized":"2024-04-24T01:24:39.793919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'11","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349775+0000","last_change":"2024-04-24T01:24:00.739611+0000","last_active":"2024-04-24T01:27:10.349775+0000","last_peered":"2024-04-24T01:27:10.349775+0000","last_clean":"2024-04-24T01:27:10.349775+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:10.349775+0000","last_undegraded":"2024-04-24T01:27:10.349775+0000","last_fullsized":"2024-04-24T01:27:10.349775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:19:58.147363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790857+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:24:39.790857+0000","last_peered":"2024-04-24T01:24:39.790857+0000","last_clean":"2024-04-24T01:24:39.790857+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:24:39.790857+0000","last_undegraded":"2024-04-24T01:24:39.790857+0000","last_fullsized":"2024-04-24T01:24:39.790857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:55.041236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791604+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:24:39.791604+0000","last_peered":"2024-04-24T01:24:39.791604+0000","last_clean":"2024-04-24T01:24:39.791604+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:24:39.791604+0000","last_undegraded":"2024-04-24T01:24:39.791604+0000","last_fullsized":"2024-04-24T01:24:39.791604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:25.351096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261937+0000","last_change":"2024-04-24T01:24:00.746896+0000","last_active":"2024-04-24T01:27:10.261937+0000","last_peered":"2024-04-24T01:27:10.261937+0000","last_clean":"2024-04-24T01:27:10.261937+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:10.261937+0000","last_undegraded":"2024-04-24T01:27:10.261937+0000","last_fullsized":"2024-04-24T01:27:10.261937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:49.762286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841409+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:24:39.841409+0000","last_peered":"2024-04-24T01:24:39.841409+0000","last_clean":"2024-04-24T01:24:39.841409+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:24:39.841409+0000","last_undegraded":"2024-04-24T01:24:39.841409+0000","last_fullsized":"2024-04-24T01:24:39.841409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:15.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.375679+0000","last_change":"2024-04-24T01:24:00.743656+0000","last_active":"2024-04-24T01:26:06.375679+0000","last_peered":"2024-04-24T01:26:06.375679+0000","last_clean":"2024-04-24T01:26:06.375679+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:26:06.375679+0000","last_undegraded":"2024-04-24T01:26:06.375679+0000","last_fullsized":"2024-04-24T01:26:06.375679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2262,"ondisk_log_size":2262,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1727,"num_read_kb":1481,"num_write":737,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1492,"ondisk_log_size":1492,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44208,"kb_used_data":8872,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327632,"statfs":{"total":96636764160,"available":96591495168,"internally_reserved":0,"allocated":9084928,"data_stored":8757155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640303,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44728,"kb_used_data":9392,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327112,"statfs":{"total":96636764160,"available":96590962688,"internally_reserved":0,"allocated":9617408,"data_stored":9344390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640301,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44752,"kb_used_data":9416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327088,"statfs":{"total":96636764160,"available":96590938112,"internally_reserved":0,"allocated":9641984,"data_stored":9346589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9060352,"data_stored":8756282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:27:18.060 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:27:18.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.186+0000 7fe05a321640 1 Processor -- start 2024-04-24T01:27:18.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.186+0000 7fe05a321640 1 -- start start 2024-04-24T01:27:18.189 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe05a321640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe05406fd50 0x7fe054133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe05a321640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe054133da0 con 0x7fe05406f260 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe05a321640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fe054070bc0 con 0x7fe05406fd50 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe0537fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fe05406fd50 0x7fe054133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe053fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fe05406f260 0x7fe05406f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49186/0 (socket says 172.21.15.142:49186) 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe053fff640 1 -- 172.21.15.142:0/726553802 learned_addr learned my addr 172.21.15.142:0/726553802 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe0537fe640 1 -- 172.21.15.142:0/726553802 >> v1:172.21.15.142:6789/0 conn(0x7fe05406f260 legacy=0x7fe05406f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.187+0000 7fe0537fe640 1 -- 172.21.15.142:0/726553802 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe054134f80 con 0x7fe05406fd50 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe0537fe640 1 --2- 172.21.15.142:0/726553802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406fd50 0x7fe054133860 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d79cd97d96f753 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe052ffd640 1 -- 172.21.15.142:0/726553802 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0480316d0 con 0x7fe05406fd50 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe052ffd640 1 -- 172.21.15.142:0/726553802 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe048037070 con 0x7fe05406fd50 2024-04-24T01:27:18.190 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe052ffd640 1 -- 172.21.15.142:0/726553802 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0480319c0 con 0x7fe05406fd50 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 -- 172.21.15.142:0/726553802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406fd50 msgr2=0x7fe054133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 --2- 172.21.15.142:0/726553802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406fd50 0x7fe054133860 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802b840 comp rx=0 tx=0).stop 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 -- 172.21.15.142:0/726553802 shutdown_connections 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 --2- 172.21.15.142:0/726553802 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406fd50 0x7fe054133860 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 -- 172.21.15.142:0/726553802 >> 172.21.15.142:0/726553802 conn(0x7fe05409e170 msgr2=0x7fe05406d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 -- 172.21.15.142:0/726553802 shutdown_connections 2024-04-24T01:27:18.191 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.188+0000 7fe05a321640 1 -- 172.21.15.142:0/726553802 wait complete. 2024-04-24T01:27:18.193 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.189+0000 7fe05a321640 1 Processor -- start 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.189+0000 7fe05a321640 1 -- start start 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe05a321640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe05a321640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fe054134300 con 0x7fe05406f260 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe053fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe053fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33540/0 (socket says 172.21.15.142:33540) 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe053fff640 1 -- 172.21.15.142:0/731385339 learned_addr learned my addr 172.21.15.142:0/731385339 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe053fff640 1 -- 172.21.15.142:0/731385339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05411b5e0 con 0x7fe05406f260 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe053fff640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c4a0 tx=0x7fe04400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe044017070 con 0x7fe05406f260 2024-04-24T01:27:18.194 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe044005c10 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05411c250 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe044007070 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.190+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05411c910 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.191+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe04401a070 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.191+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0540a18a0 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.192+0000 7fe050ff9640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 0x7fe04003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.192+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fe04404ad10 con 0x7fe05406f260 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.192+0000 7fe0537fe640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 0x7fe04003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:18.195 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.192+0000 7fe0537fe640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 0x7fe04003a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe048008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:18.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.196+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fe0540a18a0 con 0x7fe05406f260 2024-04-24T01:27:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.373+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe054062da0 con 0x7fe05406f260 2024-04-24T01:27:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.374+0000 7fe050ff9640 1 -- 172.21.15.142:0/731385339 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+20995 (secure 0 0 0) 0x7fe044007210 con 0x7fe05406f260 2024-04-24T01:27:18.375 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:18.375 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":34,"fsid":"aa5c51fd-2ac5-45d6-b08d-87c82c45b459","created":"2024-04-24T01:23:33.654176+0000","modified":"2024-04-24T01:24:39.782204+0000","last_up_change":"2024-04-24T01:23:43.655336+0000","last_in_change":"2024-04-24T01:23:34.737349+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:23:43.925915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:23:49.213537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T01:23:56.727330+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T01:23:59.053524+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T01:24:01.008257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T01:24:02.833194+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T01:24:04.781448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T01:24:06.858613+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46ae04bc-ac49-4710-9769-9890b8964b2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6801","nonce":3255114084}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6803","nonce":3255114084}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6807","nonce":3255114084}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3255114084},{"type":"v1","addr":"172.21.15.142:6805","nonce":3255114084}]},"public_addr":"172.21.15.142:6801/3255114084","cluster_addr":"172.21.15.142:6803/3255114084","heartbeat_back_addr":"172.21.15.142:6807/3255114084","heartbeat_front_addr":"172.21.15.142:6805/3255114084","state":["exists","up"]},{"osd":1,"uuid":"23cde981-9d17-4c9a-9dee-3c1d6092bce7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6801","nonce":461208471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6803","nonce":461208471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6807","nonce":461208471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":461208471},{"type":"v1","addr":"172.21.15.169:6805","nonce":461208471}]},"public_addr":"172.21.15.169:6801/461208471","cluster_addr":"172.21.15.169:6803/461208471","heartbeat_back_addr":"172.21.15.169:6807/461208471","heartbeat_front_addr":"172.21.15.169:6805/461208471","state":["exists","up"]},{"osd":2,"uuid":"c0d6289e-bcf6-4dc4-827d-955915326bc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6809","nonce":1447817104}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6811","nonce":1447817104}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6815","nonce":1447817104}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":1447817104},{"type":"v1","addr":"172.21.15.169:6813","nonce":1447817104}]},"public_addr":"172.21.15.169:6809/1447817104","cluster_addr":"172.21.15.169:6811/1447817104","heartbeat_back_addr":"172.21.15.169:6815/1447817104","heartbeat_front_addr":"172.21.15.169:6813/1447817104","state":["exists","up"]},{"osd":3,"uuid":"90c61569-11b6-46fd-b46f-dbb52c88ac8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6817","nonce":1313458488}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6819","nonce":1313458488}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6823","nonce":1313458488}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":1313458488},{"type":"v1","addr":"172.21.15.169:6821","nonce":1313458488}]},"public_addr":"172.21.15.169:6817/1313458488","cluster_addr":"172.21.15.169:6819/1313458488","heartbeat_back_addr":"172.21.15.169:6823/1313458488","heartbeat_front_addr":"172.21.15.169:6821/1313458488","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.781825+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.956820+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:40.009270+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T01:23:39.954872+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.c","mappings":[{"from":3,"to":0}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":2}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.14","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 msgr2=0x7fe04003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 0x7fe04003a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe048008030 comp rx=0 tx=0).stop 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 msgr2=0x7fe05412aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe04400c4a0 tx=0x7fe04400c960 comp rx=0 tx=0).stop 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 shutdown_connections 2024-04-24T01:27:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fe040038060 0x7fe04003a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 --2- 172.21.15.142:0/731385339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe05406f260 0x7fe05412aa30 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 >> 172.21.15.142:0/731385339 conn(0x7fe05409e170 msgr2=0x7fe05412edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 shutdown_connections 2024-04-24T01:27:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:18.376+0000 7fe05a321640 1 -- 172.21.15.142:0/731385339 wait complete. 2024-04-24T01:27:19.389 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T01:27:19.389 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:27:19.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddfd9cb640 1 Processor -- start 2024-04-24T01:27:19.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddfd9cb640 1 -- start start 2024-04-24T01:27:19.502 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddfd9cb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddf812e2f0 0x7fddf81306e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddfd9cb640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf806eac0 con 0x7fddf812b3d0 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddfd9cb640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fddf812af80 con 0x7fddf812e2f0 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf67fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddf812e2f0 0x7fddf81306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf6ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fddf812b3d0 0x7fddf812b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49188/0 (socket says 172.21.15.142:49188) 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf67fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fddf812e2f0 0x7fddf81306e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33542/0 (socket says 172.21.15.142:33542) 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf6ffd640 1 -- 172.21.15.142:0/1156272566 learned_addr learned my addr 172.21.15.142:0/1156272566 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf67fc640 1 -- 172.21.15.142:0/1156272566 >> v1:172.21.15.142:6789/0 conn(0x7fddf812b3d0 legacy=0x7fddf812b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf67fc640 1 -- 172.21.15.142:0/1156272566 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf812b1b0 con 0x7fddf812e2f0 2024-04-24T01:27:19.503 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.501+0000 7fddf5ffb640 1 -- 172.21.15.142:0/1156272566 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631247486 0 0) 0x7fddf806eac0 con 0x7fddf812b3d0 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.502+0000 7fddf67fc640 1 --2- 172.21.15.142:0/1156272566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812e2f0 0x7fddf81306e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fddec009720 tx=0x7fddec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df97aa9f3e32599 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.502+0000 7fddf5ffb640 1 -- 172.21.15.142:0/1156272566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec0316d0 con 0x7fddf812e2f0 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.502+0000 7fddf5ffb640 1 -- 172.21.15.142:0/1156272566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec037070 con 0x7fddf812e2f0 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.502+0000 7fddf5ffb640 1 -- 172.21.15.142:0/1156272566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fddec0319c0 con 0x7fddf812e2f0 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 -- 172.21.15.142:0/1156272566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812e2f0 msgr2=0x7fddf81306e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/1156272566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812e2f0 0x7fddf81306e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fddec009720 tx=0x7fddec02b840 comp rx=0 tx=0).stop 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 -- 172.21.15.142:0/1156272566 shutdown_connections 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/1156272566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812e2f0 0x7fddf81306e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 -- 172.21.15.142:0/1156272566 >> 172.21.15.142:0/1156272566 conn(0x7fddf8099510 msgr2=0x7fddf8099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.506 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 -- 172.21.15.142:0/1156272566 shutdown_connections 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.503+0000 7fddfd9cb640 1 -- 172.21.15.142:0/1156272566 wait complete. 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.504+0000 7fddfd9cb640 1 Processor -- start 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.504+0000 7fddfd9cb640 1 -- start start 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.504+0000 7fddfd9cb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.504+0000 7fddfd9cb640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8072480 con 0x7fddf812b3d0 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.504+0000 7fddf6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddf6ffd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33544/0 (socket says 172.21.15.142:33544) 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddf6ffd640 1 -- 172.21.15.142:0/2050500365 learned_addr learned my addr 172.21.15.142:0/2050500365 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddf6ffd640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf806f350 con 0x7fddf812b3d0 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddf6ffd640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdde800c420 tx=0x7fdde800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde8018070 con 0x7fddf812b3d0 2024-04-24T01:27:19.507 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde80074d0 con 0x7fddf812b3d0 2024-04-24T01:27:19.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf81275b0 con 0x7fddf812b3d0 2024-04-24T01:27:19.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde8004950 con 0x7fddf812b3d0 2024-04-24T01:27:19.508 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.505+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81c3330 con 0x7fddf812b3d0 2024-04-24T01:27:19.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdde801b070 con 0x7fddf812b3d0 2024-04-24T01:27:19.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fddf81306f0 con 0x7fddf812b3d0 2024-04-24T01:27:19.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 0x7fdde403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.509 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fdde804add0 con 0x7fddf812b3d0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 0x7fdde40469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdde8017ec0 con 0x7fdde4044530 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdde804d480 con 0x7fddf812b3d0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.506+0000 7fddf77fe640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 0x7fdde40469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.507+0000 7fddf67fc640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 0x7fdde403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.507+0000 7fddf77fe640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 0x7fdde40469d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.507+0000 7fddf67fc640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 0x7fdde403a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fddec009720 tx=0x7fddec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.510 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.507+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== osd.0 v2:172.21.15.142:6800/3255114084 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdde8017ec0 con 0x7fdde4044530 2024-04-24T01:27:19.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.520+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 --> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fddf8062da0 con 0x7fdde4044530 2024-04-24T01:27:19.521 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fdddffff640 1 -- 172.21.15.142:0/2050500365 <== osd.0 v2:172.21.15.142:6800/3255114084 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fddf8062da0 con 0x7fdde4044530 2024-04-24T01:27:19.521 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-24T01:27:19.521 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:27:19.522 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 msgr2=0x7fdde40469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 0x7fdde40469d0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 msgr2=0x7fdde403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 0x7fdde403a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fddec009720 tx=0x7fddec008030 comp rx=0 tx=0).stop 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 msgr2=0x7fddf81c2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdde800c420 tx=0x7fdde800c8e0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 shutdown_connections 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:6800/3255114084,v1:172.21.15.142:6801/3255114084] conn(0x7fdde4044530 0x7fdde40469d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.523 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fdde4038060 0x7fdde403a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 --2- 172.21.15.142:0/2050500365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddf812b3d0 0x7fddf81c2df0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 >> 172.21.15.142:0/2050500365 conn(0x7fddf8099510 msgr2=0x7fddf81298c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 shutdown_connections 2024-04-24T01:27:19.524 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.521+0000 7fddfd9cb640 1 -- 172.21.15.142:0/2050500365 wait complete. 2024-04-24T01:27:19.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T01:27:19.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d2b7bd640 1 Processor -- start 2024-04-24T01:27:19.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d2b7bd640 1 -- start start 2024-04-24T01:27:19.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d2b7bd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d241287d0 0x7f1d24130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.629 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d2b7bd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d24127b00 con 0x7f1d24127ce0 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d2b7bd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f1d240708e0 con 0x7f1d241287d0 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d28d58640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f1d241287d0 0x7f1d24130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d29559640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f1d24127ce0 0x7f1d241280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49194/0 (socket says 172.21.15.142:49194) 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.628+0000 7f1d29559640 1 -- 172.21.15.142:0/4101279288 learned_addr learned my addr 172.21.15.142:0/4101279288 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.629+0000 7f1d28d58640 1 -- 172.21.15.142:0/4101279288 >> v1:172.21.15.142:6789/0 conn(0x7f1d24127ce0 legacy=0x7f1d241280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.629+0000 7f1d1bfff640 1 -- 172.21.15.142:0/4101279288 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601506961 0 0) 0x7f1d20001110 con 0x7f1d24127ce0 2024-04-24T01:27:19.630 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.629+0000 7f1d28d58640 1 -- 172.21.15.142:0/4101279288 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d24098800 con 0x7f1d241287d0 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.629+0000 7f1d28d58640 1 --2- 172.21.15.142:0/4101279288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d241287d0 0x7f1d24130360 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009750 tx=0x7f1d1402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d997578159e6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d1bfff640 1 -- 172.21.15.142:0/4101279288 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d140316d0 con 0x7f1d241287d0 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d1bfff640 1 -- 172.21.15.142:0/4101279288 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d14037070 con 0x7f1d241287d0 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d1bfff640 1 -- 172.21.15.142:0/4101279288 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d140319c0 con 0x7f1d241287d0 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/4101279288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d241287d0 msgr2=0x7f1d24130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/4101279288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d241287d0 0x7f1d24130360 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009750 tx=0x7f1d1402b840 comp rx=0 tx=0).stop 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/4101279288 shutdown_connections 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/4101279288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d241287d0 0x7f1d24130360 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.633 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/4101279288 >> 172.21.15.142:0/4101279288 conn(0x7f1d24099680 msgr2=0x7f1d24099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/4101279288 shutdown_connections 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.630+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/4101279288 wait complete. 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d2b7bd640 1 Processor -- start 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d2b7bd640 1 -- start start 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d2b7bd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d2b7bd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2406faa0 con 0x7f1d24127ce0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d29559640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d29559640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33564/0 (socket says 172.21.15.142:33564) 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.631+0000 7f1d29559640 1 -- 172.21.15.142:0/2430951024 learned_addr learned my addr 172.21.15.142:0/2430951024 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d29559640 1 -- 172.21.15.142:0/2430951024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d24124a80 con 0x7f1d24127ce0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d29559640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c700 tx=0x7f1d2000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20018070 con 0x7f1d24127ce0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d200070d0 con 0x7f1d24127ce0 2024-04-24T01:27:19.634 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d24130250 con 0x7f1d24127ce0 2024-04-24T01:27:19.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d200073f0 con 0x7f1d24127ce0 2024-04-24T01:27:19.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.632+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2408a250 con 0x7f1d24127ce0 2024-04-24T01:27:19.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.633+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1d2001b070 con 0x7f1d24127ce0 2024-04-24T01:27:19.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.633+0000 7f1d19ffb640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 0x7f1d0803a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.635 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.633+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f1d2004add0 con 0x7f1d24127ce0 2024-04-24T01:27:19.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.633+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d24130820 con 0x7f1d24127ce0 2024-04-24T01:27:19.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.633+0000 7f1d28d58640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 0x7f1d0803a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.636 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.634+0000 7f1d28d58640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 0x7f1d0803a550 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d14036000 tx=0x7f1d14008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.638 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.638+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f1d24127b00 con 0x7f1d24127ce0 2024-04-24T01:27:19.810 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.810+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1d24062da0 con 0x7f1d08038090 2024-04-24T01:27:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.811+0000 7f1d19ffb640 1 -- 172.21.15.142:0/2430951024 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1d24062da0 con 0x7f1d08038090 2024-04-24T01:27:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 msgr2=0x7f1d0803a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 0x7f1d0803a550 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d14036000 tx=0x7f1d14008030 comp rx=0 tx=0).stop 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 msgr2=0x7f1d24122d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000c700 tx=0x7f1d2000cbc0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 shutdown_connections 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f1d08038090 0x7f1d0803a550 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 --2- 172.21.15.142:0/2430951024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1d24127ce0 0x7f1d24122d10 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 >> 172.21.15.142:0/2430951024 conn(0x7f1d24099680 msgr2=0x7f1d2406d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 shutdown_connections 2024-04-24T01:27:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.813+0000 7f1d2b7bd640 1 -- 172.21.15.142:0/2430951024 wait complete. 2024-04-24T01:27:19.824 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T01:27:19.824 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:27:19.924 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.923+0000 7f6f48ecd640 1 Processor -- start 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.923+0000 7f6f48ecd640 1 -- start start 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.923+0000 7f6f48ecd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f4412c3a0 0x7f6f4412c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.923+0000 7f6f48ecd640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4412c1a0 con 0x7f6f44113160 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.923+0000 7f6f48ecd640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4406ffe0 con 0x7f6f4412c3a0 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f4259c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f6f4412c3a0 0x7f6f4412c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f41d9b640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f6f44113160 0x7f6f4406e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49200/0 (socket says 172.21.15.142:49200) 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f41d9b640 1 -- 172.21.15.142:0/3319994612 learned_addr learned my addr 172.21.15.142:0/3319994612 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f4259c640 1 -- 172.21.15.142:0/3319994612 >> v1:172.21.15.142:6789/0 conn(0x7f6f44113160 legacy=0x7f6f4406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f4159a640 1 -- 172.21.15.142:0/3319994612 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850928683 0 0) 0x7f6f4412c1a0 con 0x7f6f44113160 2024-04-24T01:27:19.925 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.924+0000 7f6f4259c640 1 -- 172.21.15.142:0/3319994612 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f44072670 con 0x7f6f4412c3a0 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f4259c640 1 --2- 172.21.15.142:0/3319994612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f4412c3a0 0x7f6f4412c780 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009720 tx=0x7f6f3402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b2d784f1fcbe0d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f4159a640 1 -- 172.21.15.142:0/3319994612 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f340316d0 con 0x7f6f4412c3a0 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f4159a640 1 -- 172.21.15.142:0/3319994612 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34037070 con 0x7f6f4412c3a0 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f4159a640 1 -- 172.21.15.142:0/3319994612 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f340319c0 con 0x7f6f4412c3a0 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 -- 172.21.15.142:0/3319994612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f4412c3a0 msgr2=0x7f6f4412c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/3319994612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f4412c3a0 0x7f6f4412c780 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009720 tx=0x7f6f3402b840 comp rx=0 tx=0).stop 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 -- 172.21.15.142:0/3319994612 shutdown_connections 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/3319994612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f4412c3a0 0x7f6f4412c780 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 -- 172.21.15.142:0/3319994612 >> 172.21.15.142:0/3319994612 conn(0x7f6f44099510 msgr2=0x7f6f44099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 -- 172.21.15.142:0/3319994612 shutdown_connections 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.925+0000 7f6f48ecd640 1 -- 172.21.15.142:0/3319994612 wait complete. 2024-04-24T01:27:19.927 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.926+0000 7f6f48ecd640 1 Processor -- start 2024-04-24T01:27:19.928 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.926+0000 7f6f48ecd640 1 -- start start 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f48ecd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f48ecd640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4412ce40 con 0x7f6f44113160 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f4259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f4259c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33590/0 (socket says 172.21.15.142:33590) 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f4259c640 1 -- 172.21.15.142:0/2570102143 learned_addr learned my addr 172.21.15.142:0/2570102143 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f4259c640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f44115df0 con 0x7f6f44113160 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f4259c640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009720 tx=0x7f6f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f34004160 con 0x7f6f44113160 2024-04-24T01:27:19.930 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34004320 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f44128fd0 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f34032640 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.927+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f44115430 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.928+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f44062da0 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.928+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f340327e0 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.928+0000 7f6f32ffd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 0x7f6f2403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.928+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f6f3402f050 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f32ffd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 0x7f6f24046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f34044e70 con 0x7f6f240444d0 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6f3406fe60 con 0x7f6f44113160 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f41d9b640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 0x7f6f2403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f42d9d640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 0x7f6f24046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f42d9d640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 0x7f6f24046970 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.931 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.929+0000 7f6f41d9b640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 0x7f6f2403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f38000c00 tx=0x7f6f38007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:19.932 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.930+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== osd.1 v2:172.21.15.169:6800/461208471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f34044e70 con 0x7f6f240444d0 2024-04-24T01:27:19.943 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.943+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 --> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f4409b390 con 0x7f6f240444d0 2024-04-24T01:27:19.944 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.943+0000 7f6f32ffd640 1 -- 172.21.15.142:0/2570102143 <== osd.1 v2:172.21.15.169:6800/461208471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f3c00ad10 con 0x7f6f240444d0 2024-04-24T01:27:19.944 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-24T01:27:19.944 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:27:19.944 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-24T01:27:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 msgr2=0x7f6f24046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.945 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 0x7f6f24046970 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 msgr2=0x7f6f2403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 0x7f6f2403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f38000c00 tx=0x7f6f38007910 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 msgr2=0x7f6f44122310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009720 tx=0x7f6f340046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 shutdown_connections 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6800/461208471,v1:172.21.15.169:6801/461208471] conn(0x7f6f240444d0 0x7f6f24046970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f6f24038060 0x7f6f2403a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 --2- 172.21.15.142:0/2570102143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f44113160 0x7f6f44122310 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 >> 172.21.15.142:0/2570102143 conn(0x7f6f44099510 msgr2=0x7f6f4412ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 shutdown_connections 2024-04-24T01:27:19.946 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:19.944+0000 7f6f48ecd640 1 -- 172.21.15.142:0/2570102143 wait complete. 2024-04-24T01:27:19.955 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T01:27:20.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.051+0000 7f80c359f640 1 Processor -- start 2024-04-24T01:27:20.052 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.051+0000 7f80c359f640 1 -- start start 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c359f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80bc06e850 0x7f80bc06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c359f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80bc071220 con 0x7f80bc06f170 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c359f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f80bc06fb20 con 0x7f80bc06e850 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c0b3a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f80bc06f170 0x7f80bc12e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49206/0 (socket says 172.21.15.142:49206) 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c133b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f80bc06e850 0x7f80bc06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c0b3a640 1 -- 172.21.15.142:0/2717133344 learned_addr learned my addr 172.21.15.142:0/2717133344 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c133b640 1 -- 172.21.15.142:0/2717133344 >> v1:172.21.15.142:6789/0 conn(0x7f80bc06f170 legacy=0x7f80bc12e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80c133b640 1 -- 172.21.15.142:0/2717133344 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc06f8b0 con 0x7f80bc06e850 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.052+0000 7f80affff640 1 -- 172.21.15.142:0/2717133344 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089303965 0 0) 0x7f80b8001110 con 0x7f80bc06f170 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.053+0000 7f80c133b640 1 --2- 172.21.15.142:0/2717133344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc06ec30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009720 tx=0x7f80b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1370d6145c53398 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.054 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.053+0000 7f80affff640 1 -- 172.21.15.142:0/2717133344 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b00316d0 con 0x7f80bc06e850 2024-04-24T01:27:20.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.053+0000 7f80affff640 1 -- 172.21.15.142:0/2717133344 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b0037070 con 0x7f80bc06e850 2024-04-24T01:27:20.055 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.053+0000 7f80affff640 1 -- 172.21.15.142:0/2717133344 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b00319c0 con 0x7f80bc06e850 2024-04-24T01:27:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 -- 172.21.15.142:0/2717133344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 msgr2=0x7f80bc06ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 --2- 172.21.15.142:0/2717133344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc06ec30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009720 tx=0x7f80b002b840 comp rx=0 tx=0).stop 2024-04-24T01:27:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 -- 172.21.15.142:0/2717133344 shutdown_connections 2024-04-24T01:27:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 --2- 172.21.15.142:0/2717133344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc06ec30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.057 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 -- 172.21.15.142:0/2717133344 >> 172.21.15.142:0/2717133344 conn(0x7f80bc09d750 msgr2=0x7f80bc09db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 -- 172.21.15.142:0/2717133344 shutdown_connections 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.054+0000 7f80c359f640 1 -- 172.21.15.142:0/2717133344 wait complete. 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c359f640 1 Processor -- start 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c359f640 1 -- start start 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c359f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c359f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f80bc070b50 con 0x7f80bc06e850 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c133b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c133b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33610/0 (socket says 172.21.15.142:33610) 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c133b640 1 -- 172.21.15.142:0/3758746865 learned_addr learned my addr 172.21.15.142:0/3758746865 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c133b640 1 -- 172.21.15.142:0/3758746865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80bc1c3370 con 0x7f80bc06e850 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.055+0000 7f80c133b640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f80b0034040 tx=0x7f80b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.056+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b0032770 con 0x7f80bc06e850 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.056+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80b0032910 con 0x7f80bc06e850 2024-04-24T01:27:20.058 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.056+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80bc123e70 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.056+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80b0032c30 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.056+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80bc12c880 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.057+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f80b004c060 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.057+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80bc062da0 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.057+0000 7f80adffb640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 0x7f80a003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.057+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f80b002f050 con 0x7f80bc06e850 2024-04-24T01:27:20.059 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.057+0000 7f80c0b3a640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 0x7f80a003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.060 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.058+0000 7f80c0b3a640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 0x7f80a003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b8001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.062 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.061+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f80b0040070 con 0x7f80bc06e850 2024-04-24T01:27:20.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.235+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f80bc121e10 con 0x7f80a0038060 2024-04-24T01:27:20.236 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.236+0000 7f80adffb640 1 -- 172.21.15.142:0/3758746865 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80bc121e10 con 0x7f80a0038060 2024-04-24T01:27:20.236 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T01:27:20.238 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 msgr2=0x7f80a003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 0x7f80a003a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f80b8000c00 tx=0x7f80b8001250 comp rx=0 tx=0).stop 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 msgr2=0x7f80bc1c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f80b0034040 tx=0x7f80b00046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 shutdown_connections 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f80a0038060 0x7f80a003a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 --2- 172.21.15.142:0/3758746865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f80bc06e850 0x7f80bc1c37b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 >> 172.21.15.142:0/3758746865 conn(0x7f80bc09d750 msgr2=0x7f80bc12ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 shutdown_connections 2024-04-24T01:27:20.239 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.238+0000 7f80c359f640 1 -- 172.21.15.142:0/3758746865 wait complete. 2024-04-24T01:27:20.249 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T01:27:20.249 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:27:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.348+0000 7faf558e0640 1 Processor -- start 2024-04-24T01:27:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.348+0000 7faf558e0640 1 -- start start 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.348+0000 7faf558e0640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf5012b3d0 0x7faf5012b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.348+0000 7faf558e0640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf5006eac0 con 0x7faf500701f0 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.348+0000 7faf558e0640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7faf5012af80 con 0x7faf5012b3d0 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4effd640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7faf5012b3d0 0x7faf5012b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4e7fc640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7faf500701f0 0x7faf50070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49222/0 (socket says 172.21.15.142:49222) 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4e7fc640 1 -- 172.21.15.142:0/2528295517 learned_addr learned my addr 172.21.15.142:0/2528295517 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4effd640 1 -- 172.21.15.142:0/2528295517 >> v1:172.21.15.142:6789/0 conn(0x7faf500701f0 legacy=0x7faf50070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4effd640 1 -- 172.21.15.142:0/2528295517 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5012b1b0 con 0x7faf5012b3d0 2024-04-24T01:27:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.349+0000 7faf4dffb640 1 -- 172.21.15.142:0/2528295517 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549190492 0 0) 0x7faf5006eac0 con 0x7faf500701f0 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf4effd640 1 --2- 172.21.15.142:0/2528295517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5012b3d0 0x7faf5012b7b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faf40009d90 tx=0x7faf4002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f21b265de087721 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf4dffb640 1 -- 172.21.15.142:0/2528295517 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40039070 con 0x7faf5012b3d0 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf4dffb640 1 -- 172.21.15.142:0/2528295517 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4002cb10 con 0x7faf5012b3d0 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf4dffb640 1 -- 172.21.15.142:0/2528295517 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf4002ce10 con 0x7faf5012b3d0 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 -- 172.21.15.142:0/2528295517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5012b3d0 msgr2=0x7faf5012b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 --2- 172.21.15.142:0/2528295517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5012b3d0 0x7faf5012b7b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faf40009d90 tx=0x7faf4002beb0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 -- 172.21.15.142:0/2528295517 shutdown_connections 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 --2- 172.21.15.142:0/2528295517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf5012b3d0 0x7faf5012b7b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 -- 172.21.15.142:0/2528295517 >> 172.21.15.142:0/2528295517 conn(0x7faf50099510 msgr2=0x7faf50099920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 -- 172.21.15.142:0/2528295517 shutdown_connections 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.350+0000 7faf558e0640 1 -- 172.21.15.142:0/2528295517 wait complete. 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.351+0000 7faf558e0640 1 Processor -- start 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.351+0000 7faf558e0640 1 -- start start 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf558e0640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf558e0640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7faf50072480 con 0x7faf500701f0 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf4effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf4effd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33624/0 (socket says 172.21.15.142:33624) 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf4effd640 1 -- 172.21.15.142:0/463496700 learned_addr learned my addr 172.21.15.142:0/463496700 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf4effd640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf50129f00 con 0x7faf500701f0 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf4effd640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faf40009eb0 tx=0x7faf40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40044020 con 0x7faf500701f0 2024-04-24T01:27:20.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4003f5a0 con 0x7faf500701f0 2024-04-24T01:27:20.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf501287e0 con 0x7faf500701f0 2024-04-24T01:27:20.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf40039040 con 0x7faf500701f0 2024-04-24T01:27:20.355 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.352+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf50121b30 con 0x7faf500701f0 2024-04-24T01:27:20.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.353+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf50062da0 con 0x7faf500701f0 2024-04-24T01:27:20.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.353+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faf40047020 con 0x7faf500701f0 2024-04-24T01:27:20.356 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.353+0000 7faf37fff640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 0x7faf3c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.353+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7faf4006e8d0 con 0x7faf500701f0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf37fff640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 0x7faf3c046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf40035e50 con 0x7faf3c0444d0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faf400732a0 con 0x7faf500701f0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf4e7fc640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 0x7faf3c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf4f7fe640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 0x7faf3c046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf4e7fc640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 0x7faf3c03a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf44000c00 tx=0x7faf44007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.354+0000 7faf4f7fe640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 0x7faf3c046970 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.355+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== osd.2 v2:172.21.15.169:6808/1447817104 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf40035e50 con 0x7faf3c0444d0 2024-04-24T01:27:20.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.368+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 --> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7faf5012b3d0 con 0x7faf3c0444d0 2024-04-24T01:27:20.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf37fff640 1 -- 172.21.15.142:0/463496700 <== osd.2 v2:172.21.15.169:6808/1447817104 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7faf5012b3d0 con 0x7faf3c0444d0 2024-04-24T01:27:20.369 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-24T01:27:20.369 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:27:20.370 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-24T01:27:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 msgr2=0x7faf3c046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 0x7faf3c046970 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 msgr2=0x7faf3c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 0x7faf3c03a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7faf44000c00 tx=0x7faf44007910 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 msgr2=0x7faf50128d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faf40009eb0 tx=0x7faf40004a40 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 shutdown_connections 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6808/1447817104,v1:172.21.15.169:6809/1447817104] conn(0x7faf3c0444d0 0x7faf3c046970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7faf3c038060 0x7faf3c03a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 --2- 172.21.15.142:0/463496700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf500701f0 0x7faf50128d60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 >> 172.21.15.142:0/463496700 conn(0x7faf50099510 msgr2=0x7faf5006f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 shutdown_connections 2024-04-24T01:27:20.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.369+0000 7faf558e0640 1 -- 172.21.15.142:0/463496700 wait complete. 2024-04-24T01:27:20.380 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T01:27:20.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa494f00640 1 Processor -- start 2024-04-24T01:27:20.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa494f00640 1 -- start start 2024-04-24T01:27:20.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa494f00640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4901287d0 0x7fa490130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.477 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa494f00640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa490127b00 con 0x7fa490127ce0 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa494f00640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fa4900708e0 con 0x7fa4901287d0 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa48dd9b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fa4901287d0 0x7fa490130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa48e59c640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fa490127ce0 0x7fa4901280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49232/0 (socket says 172.21.15.142:49232) 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa48e59c640 1 -- 172.21.15.142:0/2488304670 learned_addr learned my addr 172.21.15.142:0/2488304670 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa48dd9b640 1 -- 172.21.15.142:0/2488304670 >> v1:172.21.15.142:6789/0 conn(0x7fa490127ce0 legacy=0x7fa4901280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.478 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.476+0000 7fa48dd9b640 1 -- 172.21.15.142:0/2488304670 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa490098800 con 0x7fa4901287d0 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.477+0000 7fa48dd9b640 1 --2- 172.21.15.142:0/2488304670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4901287d0 0x7fa490130360 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa484009750 tx=0x7fa48402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef2edb5a1ddee8b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.477+0000 7fa48d59a640 1 -- 172.21.15.142:0/2488304670 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840316d0 con 0x7fa4901287d0 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.477+0000 7fa48d59a640 1 -- 172.21.15.142:0/2488304670 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484037070 con 0x7fa4901287d0 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.477+0000 7fa48d59a640 1 -- 172.21.15.142:0/2488304670 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa4840319c0 con 0x7fa4901287d0 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 -- 172.21.15.142:0/2488304670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4901287d0 msgr2=0x7fa490130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 --2- 172.21.15.142:0/2488304670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4901287d0 0x7fa490130360 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa484009750 tx=0x7fa48402b840 comp rx=0 tx=0).stop 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 -- 172.21.15.142:0/2488304670 shutdown_connections 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 --2- 172.21.15.142:0/2488304670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa4901287d0 0x7fa490130360 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 -- 172.21.15.142:0/2488304670 >> 172.21.15.142:0/2488304670 conn(0x7fa490099680 msgr2=0x7fa490099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 -- 172.21.15.142:0/2488304670 shutdown_connections 2024-04-24T01:27:20.481 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.478+0000 7fa494f00640 1 -- 172.21.15.142:0/2488304670 wait complete. 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa494f00640 1 Processor -- start 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa494f00640 1 -- start start 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa494f00640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa494f00640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fa49006faa0 con 0x7fa490127ce0 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa48e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa48e59c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33628/0 (socket says 172.21.15.142:33628) 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.479+0000 7fa48e59c640 1 -- 172.21.15.142:0/1114961283 learned_addr learned my addr 172.21.15.142:0/1114961283 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa48e59c640 1 -- 172.21.15.142:0/1114961283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa49009c2e0 con 0x7fa490127ce0 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa48e59c640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c4a0 tx=0x7fa48800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.482 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa488017070 con 0x7fa490127ce0 2024-04-24T01:27:20.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa488005c10 con 0x7fa490127ce0 2024-04-24T01:27:20.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa49008c410 con 0x7fa490127ce0 2024-04-24T01:27:20.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa488007070 con 0x7fa490127ce0 2024-04-24T01:27:20.483 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.480+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa490125ed0 con 0x7fa490127ce0 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.481+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa48801a070 con 0x7fa490127ce0 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.481+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa490062da0 con 0x7fa490127ce0 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.481+0000 7fa47effd640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 0x7fa47003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.481+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fa48804aca0 con 0x7fa490127ce0 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.481+0000 7fa48dd9b640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 0x7fa47003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.484 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.482+0000 7fa48dd9b640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 0x7fa47003a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa484036000 tx=0x7fa484008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.486 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.486+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fa490127b00 con 0x7fa490127ce0 2024-04-24T01:27:20.659 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.658+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa49008bc00 con 0x7fa470038060 2024-04-24T01:27:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.659+0000 7fa47effd640 1 -- 172.21.15.142:0/1114961283 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa49008bc00 con 0x7fa470038060 2024-04-24T01:27:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T01:27:20.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 msgr2=0x7fa47003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 0x7fa47003a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa484036000 tx=0x7fa484008030 comp rx=0 tx=0).stop 2024-04-24T01:27:20.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 msgr2=0x7fa4901c31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c4a0 tx=0x7fa48800c960 comp rx=0 tx=0).stop 2024-04-24T01:27:20.662 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 shutdown_connections 2024-04-24T01:27:20.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fa470038060 0x7fa47003a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 --2- 172.21.15.142:0/1114961283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa490127ce0 0x7fa4901c31b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 >> 172.21.15.142:0/1114961283 conn(0x7fa490099680 msgr2=0x7fa490128e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 shutdown_connections 2024-04-24T01:27:20.663 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.661+0000 7fa494f00640 1 -- 172.21.15.142:0/1114961283 wait complete. 2024-04-24T01:27:20.673 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T01:27:20.673 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.773+0000 7f4fb313d640 1 Processor -- start 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.773+0000 7f4fb313d640 1 -- start start 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb313d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fac12e350 0x7f4fac12e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb313d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fac12f260 con 0x7f4fac12ee20 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb313d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f4fac06db00 con 0x7f4fac12e350 2024-04-24T01:27:20.775 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb0ed9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f4fac12e350 0x7f4fac12e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fabfff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f4fac12ee20 0x7f4fac12ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49242/0 (socket says 172.21.15.142:49242) 2024-04-24T01:27:20.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fabfff640 1 -- 172.21.15.142:0/945846299 learned_addr learned my addr 172.21.15.142:0/945846299 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:20.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb0ed9640 1 -- 172.21.15.142:0/945846299 >> v1:172.21.15.142:6789/0 conn(0x7f4fac12ee20 legacy=0x7f4fac12ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.776 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.774+0000 7f4fb0ed9640 1 -- 172.21.15.142:0/945846299 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac093140 con 0x7f4fac12e350 2024-04-24T01:27:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.775+0000 7f4fb0ed9640 1 --2- 172.21.15.142:0/945846299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac12e8e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009720 tx=0x7f4fa002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af68ca6653dfb63f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.778 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.775+0000 7f4fab7fe640 1 -- 172.21.15.142:0/945846299 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa00316d0 con 0x7f4fac12e350 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.775+0000 7f4fab7fe640 1 -- 172.21.15.142:0/945846299 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0037070 con 0x7f4fac12e350 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.775+0000 7f4fab7fe640 1 -- 172.21.15.142:0/945846299 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa00319c0 con 0x7f4fac12e350 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- 172.21.15.142:0/945846299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 msgr2=0x7f4fac12e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 --2- 172.21.15.142:0/945846299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac12e8e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009720 tx=0x7f4fa002b840 comp rx=0 tx=0).stop 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- 172.21.15.142:0/945846299 shutdown_connections 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 --2- 172.21.15.142:0/945846299 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac12e8e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- 172.21.15.142:0/945846299 >> 172.21.15.142:0/945846299 conn(0x7f4fac09fba0 msgr2=0x7f4fac09ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- 172.21.15.142:0/945846299 shutdown_connections 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- 172.21.15.142:0/945846299 wait complete. 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 Processor -- start 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.776+0000 7f4fb313d640 1 -- start start 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb313d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb313d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac12b6e0 con 0x7f4fac12e350 2024-04-24T01:27:20.779 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb0ed9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb0ed9640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33648/0 (socket says 172.21.15.142:33648) 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb0ed9640 1 -- 172.21.15.142:0/410633646 learned_addr learned my addr 172.21.15.142:0/410633646 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb0ed9640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac128180 con 0x7f4fac12e350 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.777+0000 7f4fb0ed9640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009720 tx=0x7f4fa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0032770 con 0x7f4fac12e350 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fa0032910 con 0x7f4fac12e350 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac128a80 con 0x7f4fac12e350 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fa0032bf0 con 0x7f4fac12e350 2024-04-24T01:27:20.780 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac0706c0 con 0x7f4fac12e350 2024-04-24T01:27:20.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4fac062da0 con 0x7f4fac12e350 2024-04-24T01:27:20.781 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.778+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4fa004d3f0 con 0x7f4fac12e350 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fa97fa640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 0x7f4f9003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f4fa002f050 con 0x7f4fac12e350 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fa97fa640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 0x7f4f900469d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fa0048ec0 con 0x7f4f90044530 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4fa0074050 con 0x7f4fac12e350 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fabfff640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 0x7f4f9003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fb16da640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 0x7f4f900469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fabfff640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 0x7f4f9003a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4f98007fd0 tx=0x7f4f98007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.779+0000 7f4fb16da640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 0x7f4f900469d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.782 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.780+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== osd.3 v2:172.21.15.169:6816/1313458488 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4fa0048ec0 con 0x7f4f90044530 2024-04-24T01:27:20.793 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.793+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 --> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4fac12b4f0 con 0x7f4f90044530 2024-04-24T01:27:20.794 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fa97fa640 1 -- 172.21.15.142:0/410633646 <== osd.3 v2:172.21.15.169:6816/1313458488 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4fac12b4f0 con 0x7f4f90044530 2024-04-24T01:27:20.794 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2024-04-24T01:27:20.794 INFO:teuthology.orchestra.run.smithi142.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T01:27:20.794 INFO:teuthology.orchestra.run.smithi142.stdout:} 2024-04-24T01:27:20.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 msgr2=0x7f4f900469d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.795 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 0x7f4f900469d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 msgr2=0x7f4f9003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 0x7f4f9003a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4f98007fd0 tx=0x7f4f98007ac0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 msgr2=0x7f4fac1bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f4fa0009720 tx=0x7f4fa00046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 shutdown_connections 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6816/1313458488,v1:172.21.15.169:6817/1313458488] conn(0x7f4f90044530 0x7f4f900469d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f4f90038060 0x7f4f9003a520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 --2- 172.21.15.142:0/410633646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fac12e350 0x7f4fac1bfc80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 >> 172.21.15.142:0/410633646 conn(0x7f4fac09fba0 msgr2=0x7f4fac12cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 shutdown_connections 2024-04-24T01:27:20.796 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.794+0000 7f4fb313d640 1 -- 172.21.15.142:0/410633646 wait complete. 2024-04-24T01:27:20.805 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T01:27:20.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.900+0000 7faba4798640 1 Processor -- start 2024-04-24T01:27:20.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.900+0000 7faba4798640 1 -- start start 2024-04-24T01:27:20.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba4798640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab9c06d7d0 0x7fab9c06dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.906 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba4798640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab9c0a08a0 con 0x7fab9c06e0f0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba4798640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fab9c06e560 con 0x7fab9c06d7d0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba2534640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fab9c06d7d0 0x7fab9c06dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba1d33640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fab9c06e0f0 0x7fab9c12e320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49256/0 (socket says 172.21.15.142:49256) 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba1d33640 1 -- 172.21.15.142:0/623161303 learned_addr learned my addr 172.21.15.142:0/623161303 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba2534640 1 -- 172.21.15.142:0/623161303 >> v1:172.21.15.142:6789/0 conn(0x7fab9c06e0f0 legacy=0x7fab9c12e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba1532640 1 -- 172.21.15.142:0/623161303 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3055453903 0 0) 0x7fab9c0a08a0 con 0x7fab9c06e0f0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.901+0000 7faba2534640 1 -- 172.21.15.142:0/623161303 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c06f6d0 con 0x7fab9c06d7d0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba2534640 1 --2- 172.21.15.142:0/623161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c06dbb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fab98009dc0 tx=0x7fab9802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a1a0e88412e333 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba1532640 1 -- 172.21.15.142:0/623161303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98039070 con 0x7fab9c06d7d0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba1532640 1 -- 172.21.15.142:0/623161303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9802cb80 con 0x7fab9c06d7d0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba1532640 1 -- 172.21.15.142:0/623161303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98034440 con 0x7fab9c06d7d0 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba4798640 1 -- 172.21.15.142:0/623161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 msgr2=0x7fab9c06dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:20.907 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.902+0000 7faba4798640 1 --2- 172.21.15.142:0/623161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c06dbb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fab98009dc0 tx=0x7fab9802bf20 comp rx=0 tx=0).stop 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 -- 172.21.15.142:0/623161303 shutdown_connections 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 --2- 172.21.15.142:0/623161303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c06dbb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 -- 172.21.15.142:0/623161303 >> 172.21.15.142:0/623161303 conn(0x7fab9c09ea70 msgr2=0x7fab9c09ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 -- 172.21.15.142:0/623161303 shutdown_connections 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 -- 172.21.15.142:0/623161303 wait complete. 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 Processor -- start 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.903+0000 7faba4798640 1 -- start start 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba4798640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba4798640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c12ebb0 con 0x7fab9c06d7d0 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba2534640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba2534640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33666/0 (socket says 172.21.15.142:33666) 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba2534640 1 -- 172.21.15.142:0/3012353487 learned_addr learned my addr 172.21.15.142:0/3012353487 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:20.908 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba2534640 1 -- 172.21.15.142:0/3012353487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c12b130 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba2534640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab98000f80 tx=0x7fab98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98044020 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9803f5a0 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c12bc60 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab98039040 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.904+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c08e780 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.905+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fab98047020 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.905+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c062da0 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.905+0000 7fab92ffd640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 0x7fab8003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.905+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fab9806e870 con 0x7fab9c06d7d0 2024-04-24T01:27:20.909 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.906+0000 7faba1d33640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 0x7fab8003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.906+0000 7faba1d33640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 0x7fab8003a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005880 tx=0x7fab8c007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:20.910 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:20.910+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fab9804e030 con 0x7fab9c06d7d0 2024-04-24T01:27:21.086 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.085+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fab9c12e9f0 con 0x7fab80038060 2024-04-24T01:27:21.087 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.087+0000 7fab92ffd640 1 -- 172.21.15.142:0/3012353487 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fab8c0058d0 con 0x7fab80038060 2024-04-24T01:27:21.087 INFO:teuthology.orchestra.run.smithi142.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.088+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 msgr2=0x7fab8003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 0x7fab8003a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fab8c005880 tx=0x7fab8c007970 comp rx=0 tx=0).stop 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 msgr2=0x7fab9c129470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fab98000f80 tx=0x7fab98004a40 comp rx=0 tx=0).stop 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 shutdown_connections 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fab80038060 0x7fab8003a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 --2- 172.21.15.142:0/3012353487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fab9c06d7d0 0x7fab9c129470 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 >> 172.21.15.142:0/3012353487 conn(0x7fab9c09ea70 msgr2=0x7fab9c09b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 shutdown_connections 2024-04-24T01:27:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.089+0000 7faba4798640 1 -- 172.21.15.142:0/3012353487 wait complete. 2024-04-24T01:27:21.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:27:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73cc03f640 1 Processor -- start 2024-04-24T01:27:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73cc03f640 1 -- start start 2024-04-24T01:27:21.196 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73cc03f640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73c4127ce0 0x7f73c41280c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73cc03f640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73c4127b00 con 0x7f73c4070100 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73cc03f640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f73c40708e0 con 0x7f73c4127ce0 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73c9ddb640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f73c4127ce0 0x7f73c41280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73c95da640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f73c4070100 0x7f73c412b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:49272/0 (socket says 172.21.15.142:49272) 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.195+0000 7f73c95da640 1 -- 172.21.15.142:0/3765081867 learned_addr learned my addr 172.21.15.142:0/3765081867 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.196+0000 7f73c9ddb640 1 -- 172.21.15.142:0/3765081867 >> v1:172.21.15.142:6789/0 conn(0x7f73c4070100 legacy=0x7f73c412b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.196+0000 7f73c9ddb640 1 -- 172.21.15.142:0/3765081867 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c4098800 con 0x7f73c4127ce0 2024-04-24T01:27:21.198 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.196+0000 7f73c9ddb640 1 --2- 172.21.15.142:0/3765081867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4127ce0 0x7f73c41280c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009720 tx=0x7f73c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6347d61e7592299 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.196+0000 7f73c8dd9640 1 -- 172.21.15.142:0/3765081867 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c00316d0 con 0x7f73c4127ce0 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73c8dd9640 1 -- 172.21.15.142:0/3765081867 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c0037070 con 0x7f73c4127ce0 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73c8dd9640 1 -- 172.21.15.142:0/3765081867 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c00319c0 con 0x7f73c4127ce0 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 -- 172.21.15.142:0/3765081867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4127ce0 msgr2=0x7f73c41280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 --2- 172.21.15.142:0/3765081867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4127ce0 0x7f73c41280c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009720 tx=0x7f73c002b840 comp rx=0 tx=0).stop 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 -- 172.21.15.142:0/3765081867 shutdown_connections 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 --2- 172.21.15.142:0/3765081867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4127ce0 0x7f73c41280c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 -- 172.21.15.142:0/3765081867 >> 172.21.15.142:0/3765081867 conn(0x7f73c4099680 msgr2=0x7f73c4099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 -- 172.21.15.142:0/3765081867 shutdown_connections 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.197+0000 7f73cc03f640 1 -- 172.21.15.142:0/3765081867 wait complete. 2024-04-24T01:27:21.199 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.198+0000 7f73cc03f640 1 Processor -- start 2024-04-24T01:27:21.200 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.198+0000 7f73cc03f640 1 -- start start 2024-04-24T01:27:21.201 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.198+0000 7f73cc03f640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.198+0000 7f73cc03f640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f73c4128780 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73c9ddb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73c9ddb640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33680/0 (socket says 172.21.15.142:33680) 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73c9ddb640 1 -- 172.21.15.142:0/973886016 learned_addr learned my addr 172.21.15.142:0/973886016 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73c9ddb640 1 -- 172.21.15.142:0/973886016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c408a580 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73c9ddb640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009720 tx=0x7f73c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c0032770 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73c0032910 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f73c0032bf0 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c4124b30 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.199+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c41257c0 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.200+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f73c004d3f0 con 0x7f73c4070100 2024-04-24T01:27:21.202 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.200+0000 7f73ba7fc640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 0x7f73a803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:21.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.200+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c4062da0 con 0x7f73c4070100 2024-04-24T01:27:21.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.200+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f73c002f050 con 0x7f73c4070100 2024-04-24T01:27:21.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.200+0000 7f73c95da640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 0x7f73a803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:21.203 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.201+0000 7f73c95da640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 0x7f73a803a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f73b4007fd0 tx=0x7f73b4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.205+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f73c4124b30 con 0x7f73c4070100 2024-04-24T01:27:21.376 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.376+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73c409ba00 con 0x7f73a8038060 2024-04-24T01:27:21.391 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.391+0000 7f73ba7fc640 1 -- 172.21.15.142:0/973886016 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665880 (secure 0 0 0) 0x7f73c409ba00 con 0x7f73a8038060 2024-04-24T01:27:21.400 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:21.405 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:27:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 msgr2=0x7f73a803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.408 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 0x7f73a803a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f73b4007fd0 tx=0x7f73b4007ac0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 msgr2=0x7f73c41bd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009720 tx=0x7f73c00046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 shutdown_connections 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f73a8038060 0x7f73a803a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 --2- 172.21.15.142:0/973886016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73c4070100 0x7f73c41bd8d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 >> 172.21.15.142:0/973886016 conn(0x7f73c4099680 msgr2=0x7f73c4070ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 shutdown_connections 2024-04-24T01:27:21.409 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:21.396+0000 7f73cc03f640 1 -- 172.21.15.142:0/973886016 wait complete. 2024-04-24T01:27:21.410 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-04-24T01:27:19.963745+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4795591,"num_objects":253,"num_object_clones":0,"num_object_copies":508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":253,"num_whiteouts":0,"num_read":5370,"num_read_kb":4920,"num_write":2370,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4799,"ondisk_log_size":4799,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160980,"kb_used_data":11308,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377326380,"statfs":{"total":386547056640,"available":386382213120,"internally_reserved":0,"allocated":11579392,"data_stored":10383906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4194489,"num_objects":3,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":720,"num_read_kb":680,"num_write":458,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004158"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793282+0000","last_change":"2024-04-24T01:23:58.745975+0000","last_active":"2024-04-24T01:24:39.793282+0000","last_peered":"2024-04-24T01:24:39.793282+0000","last_clean":"2024-04-24T01:24:39.793282+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:24:39.793282+0000","last_undegraded":"2024-04-24T01:24:39.793282+0000","last_fullsized":"2024-04-24T01:24:39.793282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261969+0000","last_change":"2024-04-24T01:24:00.745235+0000","last_active":"2024-04-24T01:27:10.261969+0000","last_peered":"2024-04-24T01:27:10.261969+0000","last_clean":"2024-04-24T01:27:10.261969+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:10.261969+0000","last_undegraded":"2024-04-24T01:27:10.261969+0000","last_fullsized":"2024-04-24T01:27:10.261969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:45.501029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843868+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:24:39.843868+0000","last_peered":"2024-04-24T01:24:39.843868+0000","last_clean":"2024-04-24T01:24:39.843868+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:24:39.843868+0000","last_undegraded":"2024-04-24T01:24:39.843868+0000","last_fullsized":"2024-04-24T01:24:39.843868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:01.751302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.370886+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:24:42.370886+0000","last_peered":"2024-04-24T01:24:42.370886+0000","last_clean":"2024-04-24T01:24:42.370886+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:24:42.370886+0000","last_undegraded":"2024-04-24T01:24:42.370886+0000","last_fullsized":"2024-04-24T01:24:42.370886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:01.873024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794269+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:24:39.794269+0000","last_peered":"2024-04-24T01:24:39.794269+0000","last_clean":"2024-04-24T01:24:39.794269+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:24:39.794269+0000","last_undegraded":"2024-04-24T01:24:39.794269+0000","last_fullsized":"2024-04-24T01:24:39.794269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.903777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.373104+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:06.373104+0000","last_peered":"2024-04-24T01:26:06.373104+0000","last_clean":"2024-04-24T01:26:06.373104+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:06.373104+0000","last_undegraded":"2024-04-24T01:26:06.373104+0000","last_fullsized":"2024-04-24T01:26:06.373104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:58.173467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894191+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:24:41.894191+0000","last_peered":"2024-04-24T01:24:41.894191+0000","last_clean":"2024-04-24T01:24:41.894191+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:24:41.894191+0000","last_undegraded":"2024-04-24T01:24:41.894191+0000","last_fullsized":"2024-04-24T01:24:41.894191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370793+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:06.370793+0000","last_peered":"2024-04-24T01:26:06.370793+0000","last_clean":"2024-04-24T01:26:06.370793+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:06.370793+0000","last_undegraded":"2024-04-24T01:26:06.370793+0000","last_fullsized":"2024-04-24T01:26:06.370793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:36.954496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.966530+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:24:42.966530+0000","last_peered":"2024-04-24T01:24:42.966530+0000","last_clean":"2024-04-24T01:24:42.966530+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:24:42.966530+0000","last_undegraded":"2024-04-24T01:24:42.966530+0000","last_fullsized":"2024-04-24T01:24:42.966530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:46.141931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":80,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262034+0000","last_change":"2024-04-24T01:24:00.739114+0000","last_active":"2024-04-24T01:27:10.262034+0000","last_peered":"2024-04-24T01:27:10.262034+0000","last_clean":"2024-04-24T01:27:10.262034+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:10.262034+0000","last_undegraded":"2024-04-24T01:27:10.262034+0000","last_fullsized":"2024-04-24T01:27:10.262034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:15.071031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789367+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:24:39.789367+0000","last_peered":"2024-04-24T01:24:39.789367+0000","last_clean":"2024-04-24T01:24:39.789367+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:24:39.789367+0000","last_undegraded":"2024-04-24T01:24:39.789367+0000","last_fullsized":"2024-04-24T01:24:39.789367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:43.987882+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:26:43.987882+0000","last_peered":"2024-04-24T01:26:43.987882+0000","last_clean":"2024-04-24T01:26:43.987882+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:26:43.987882+0000","last_undegraded":"2024-04-24T01:26:43.987882+0000","last_fullsized":"2024-04-24T01:26:43.987882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:31:44.665563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.249789+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.249789+0000","last_peered":"2024-04-24T01:27:10.249789+0000","last_clean":"2024-04-24T01:27:10.249789+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.249789+0000","last_undegraded":"2024-04-24T01:27:10.249789+0000","last_fullsized":"2024-04-24T01:27:10.249789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:27:50.957652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642467+0000","last_change":"2024-04-24T01:24:00.745053+0000","last_active":"2024-04-24T01:26:09.642467+0000","last_peered":"2024-04-24T01:26:09.642467+0000","last_clean":"2024-04-24T01:26:09.642467+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:26:09.642467+0000","last_undegraded":"2024-04-24T01:26:09.642467+0000","last_fullsized":"2024-04-24T01:26:09.642467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841355+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:24:39.841355+0000","last_peered":"2024-04-24T01:24:39.841355+0000","last_clean":"2024-04-24T01:24:39.841355+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:24:39.841355+0000","last_undegraded":"2024-04-24T01:24:39.841355+0000","last_fullsized":"2024-04-24T01:24:39.841355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:16:59.075615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349980+0000","last_change":"2024-04-24T01:24:00.740054+0000","last_active":"2024-04-24T01:27:10.349980+0000","last_peered":"2024-04-24T01:27:10.349980+0000","last_clean":"2024-04-24T01:27:10.349980+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:10.349980+0000","last_undegraded":"2024-04-24T01:27:10.349980+0000","last_fullsized":"2024-04-24T01:27:10.349980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313995+0000","last_change":"2024-04-24T01:24:00.738224+0000","last_active":"2024-04-24T01:27:10.313995+0000","last_peered":"2024-04-24T01:27:10.313995+0000","last_clean":"2024-04-24T01:27:10.313995+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:10.313995+0000","last_undegraded":"2024-04-24T01:27:10.313995+0000","last_fullsized":"2024-04-24T01:27:10.313995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:35.336241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797425+0000","last_change":"2024-04-24T01:23:58.755611+0000","last_active":"2024-04-24T01:24:39.797425+0000","last_peered":"2024-04-24T01:24:39.797425+0000","last_clean":"2024-04-24T01:24:39.797425+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:24:39.797425+0000","last_undegraded":"2024-04-24T01:24:39.797425+0000","last_fullsized":"2024-04-24T01:24:39.797425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:13.926524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314134+0000","last_change":"2024-04-24T01:24:00.744762+0000","last_active":"2024-04-24T01:27:10.314134+0000","last_peered":"2024-04-24T01:27:10.314134+0000","last_clean":"2024-04-24T01:27:10.314134+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:10.314134+0000","last_undegraded":"2024-04-24T01:27:10.314134+0000","last_fullsized":"2024-04-24T01:27:10.314134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:34.793664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.979842+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:27:09.979842+0000","last_peered":"2024-04-24T01:27:09.979842+0000","last_clean":"2024-04-24T01:27:09.979842+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:27:09.979842+0000","last_undegraded":"2024-04-24T01:27:09.979842+0000","last_fullsized":"2024-04-24T01:27:09.979842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984442+0000","last_change":"2024-04-24T01:24:00.745273+0000","last_active":"2024-04-24T01:24:42.984442+0000","last_peered":"2024-04-24T01:24:42.984442+0000","last_clean":"2024-04-24T01:24:42.984442+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:24:42.984442+0000","last_undegraded":"2024-04-24T01:24:42.984442+0000","last_fullsized":"2024-04-24T01:24:42.984442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:11.408864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.021107+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.021107+0000","last_peered":"2024-04-24T01:27:10.021107+0000","last_clean":"2024-04-24T01:27:10.021107+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.021107+0000","last_undegraded":"2024-04-24T01:27:10.021107+0000","last_fullsized":"2024-04-24T01:27:10.021107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320595+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.320595+0000","last_peered":"2024-04-24T01:27:10.320595+0000","last_clean":"2024-04-24T01:27:10.320595+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.320595+0000","last_undegraded":"2024-04-24T01:27:10.320595+0000","last_fullsized":"2024-04-24T01:27:10.320595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:40:35.960909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.258248+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:10.258248+0000","last_peered":"2024-04-24T01:27:10.258248+0000","last_clean":"2024-04-24T01:27:10.258248+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:10.258248+0000","last_undegraded":"2024-04-24T01:27:10.258248+0000","last_fullsized":"2024-04-24T01:27:10.258248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:10.300288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.037285+0000","last_change":"2024-04-24T01:24:00.740372+0000","last_active":"2024-04-24T01:27:10.037285+0000","last_peered":"2024-04-24T01:27:10.037285+0000","last_clean":"2024-04-24T01:27:10.037285+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:10.037285+0000","last_undegraded":"2024-04-24T01:27:10.037285+0000","last_fullsized":"2024-04-24T01:27:10.037285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:00.415935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844104+0000","last_change":"2024-04-24T01:23:58.747782+0000","last_active":"2024-04-24T01:24:39.844104+0000","last_peered":"2024-04-24T01:24:39.844104+0000","last_clean":"2024-04-24T01:24:39.844104+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:24:39.844104+0000","last_undegraded":"2024-04-24T01:24:39.844104+0000","last_fullsized":"2024-04-24T01:24:39.844104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:34:33.918132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349714+0000","last_change":"2024-04-24T01:24:00.744154+0000","last_active":"2024-04-24T01:27:10.349714+0000","last_peered":"2024-04-24T01:27:10.349714+0000","last_clean":"2024-04-24T01:27:10.349714+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:10.349714+0000","last_undegraded":"2024-04-24T01:27:10.349714+0000","last_fullsized":"2024-04-24T01:27:10.349714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:46.325470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.595508+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:09.595508+0000","last_peered":"2024-04-24T01:26:09.595508+0000","last_clean":"2024-04-24T01:26:09.595508+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:09.595508+0000","last_undegraded":"2024-04-24T01:26:09.595508+0000","last_fullsized":"2024-04-24T01:26:09.595508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:14.628366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":99,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.287302+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.287302+0000","last_peered":"2024-04-24T01:27:10.287302+0000","last_clean":"2024-04-24T01:27:10.287302+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.287302+0000","last_undegraded":"2024-04-24T01:27:10.287302+0000","last_fullsized":"2024-04-24T01:27:10.287302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:03.352776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039068+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.039068+0000","last_peered":"2024-04-24T01:27:10.039068+0000","last_clean":"2024-04-24T01:27:10.039068+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.039068+0000","last_undegraded":"2024-04-24T01:27:10.039068+0000","last_fullsized":"2024-04-24T01:27:10.039068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:59.847574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791248+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:24:39.791248+0000","last_peered":"2024-04-24T01:24:39.791248+0000","last_clean":"2024-04-24T01:24:39.791248+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:24:39.791248+0000","last_undegraded":"2024-04-24T01:24:39.791248+0000","last_fullsized":"2024-04-24T01:24:39.791248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:28:11.661466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793258+0000","last_change":"2024-04-24T01:24:02.754649+0000","last_active":"2024-04-24T01:24:39.793258+0000","last_peered":"2024-04-24T01:24:39.793258+0000","last_clean":"2024-04-24T01:24:39.793258+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:24:39.793258+0000","last_undegraded":"2024-04-24T01:24:39.793258+0000","last_fullsized":"2024-04-24T01:24:39.793258+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:36.231675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.997363+0000","last_change":"2024-04-24T01:24:04.759269+0000","last_active":"2024-04-24T01:27:16.997363+0000","last_peered":"2024-04-24T01:27:16.997363+0000","last_clean":"2024-04-24T01:27:16.997363+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:16.997363+0000","last_undegraded":"2024-04-24T01:27:16.997363+0000","last_fullsized":"2024-04-24T01:27:16.997363+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:48.568742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797301+0000","last_change":"2024-04-24T01:24:06.771210+0000","last_active":"2024-04-24T01:24:39.797301+0000","last_peered":"2024-04-24T01:24:39.797301+0000","last_clean":"2024-04-24T01:24:39.797301+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:24:39.797301+0000","last_undegraded":"2024-04-24T01:24:39.797301+0000","last_fullsized":"2024-04-24T01:24:39.797301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:42.412982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.649922+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:25:25.649922+0000","last_peered":"2024-04-24T01:25:25.649922+0000","last_clean":"2024-04-24T01:25:25.649922+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:25:25.649922+0000","last_undegraded":"2024-04-24T01:25:25.649922+0000","last_fullsized":"2024-04-24T01:25:25.649922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:35:32.845545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343531+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.343531+0000","last_peered":"2024-04-24T01:27:10.343531+0000","last_clean":"2024-04-24T01:27:10.343531+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.343531+0000","last_undegraded":"2024-04-24T01:27:10.343531+0000","last_fullsized":"2024-04-24T01:27:10.343531+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:11.415544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789109+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:24:39.789109+0000","last_peered":"2024-04-24T01:24:39.789109+0000","last_clean":"2024-04-24T01:24:39.789109+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:24:39.789109+0000","last_undegraded":"2024-04-24T01:24:39.789109+0000","last_fullsized":"2024-04-24T01:24:39.789109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.800415+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:24:39.800415+0000","last_peered":"2024-04-24T01:24:39.800415+0000","last_clean":"2024-04-24T01:24:39.800415+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:24:39.800415+0000","last_undegraded":"2024-04-24T01:24:39.800415+0000","last_fullsized":"2024-04-24T01:24:39.800415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:27.933493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.644975+0000","last_change":"2024-04-24T01:24:04.754457+0000","last_active":"2024-04-24T01:26:09.644975+0000","last_peered":"2024-04-24T01:26:09.644975+0000","last_clean":"2024-04-24T01:26:09.644975+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:26:09.644975+0000","last_undegraded":"2024-04-24T01:26:09.644975+0000","last_fullsized":"2024-04-24T01:26:09.644975+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:44.985335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796898+0000","last_change":"2024-04-24T01:24:06.767131+0000","last_active":"2024-04-24T01:24:39.796898+0000","last_peered":"2024-04-24T01:24:39.796898+0000","last_clean":"2024-04-24T01:24:39.796898+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:24:39.796898+0000","last_undegraded":"2024-04-24T01:24:39.796898+0000","last_fullsized":"2024-04-24T01:24:39.796898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:37.537173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841120+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:24:39.841120+0000","last_peered":"2024-04-24T01:24:39.841120+0000","last_clean":"2024-04-24T01:24:39.841120+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:24:39.841120+0000","last_undegraded":"2024-04-24T01:24:39.841120+0000","last_fullsized":"2024-04-24T01:24:39.841120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:30.549905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261903+0000","last_change":"2024-04-24T01:24:00.735337+0000","last_active":"2024-04-24T01:27:10.261903+0000","last_peered":"2024-04-24T01:27:10.261903+0000","last_clean":"2024-04-24T01:27:10.261903+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:10.261903+0000","last_undegraded":"2024-04-24T01:27:10.261903+0000","last_fullsized":"2024-04-24T01:27:10.261903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:23.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.969496+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:24:42.969496+0000","last_peered":"2024-04-24T01:24:42.969496+0000","last_clean":"2024-04-24T01:24:42.969496+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:24:42.969496+0000","last_undegraded":"2024-04-24T01:24:42.969496+0000","last_fullsized":"2024-04-24T01:24:42.969496+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:23:01.497950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.844317+0000","last_change":"2024-04-24T01:24:02.754545+0000","last_active":"2024-04-24T01:24:39.844317+0000","last_peered":"2024-04-24T01:24:39.844317+0000","last_clean":"2024-04-24T01:24:39.844317+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:24:39.844317+0000","last_undegraded":"2024-04-24T01:24:39.844317+0000","last_fullsized":"2024-04-24T01:24:39.844317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:28.692526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'23","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791153+0000","last_change":"2024-04-24T01:24:04.756975+0000","last_active":"2024-04-24T01:24:39.791153+0000","last_peered":"2024-04-24T01:24:39.791153+0000","last_clean":"2024-04-24T01:24:39.791153+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:24:39.791153+0000","last_undegraded":"2024-04-24T01:24:39.791153+0000","last_fullsized":"2024-04-24T01:24:39.791153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:05.877264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.869206+0000","last_change":"2024-04-24T01:24:06.766289+0000","last_active":"2024-04-24T01:27:16.869206+0000","last_peered":"2024-04-24T01:27:16.869206+0000","last_clean":"2024-04-24T01:27:16.869206+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:16.869206+0000","last_undegraded":"2024-04-24T01:27:16.869206+0000","last_fullsized":"2024-04-24T01:27:16.869206+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:56.567330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.056866+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.056866+0000","last_peered":"2024-04-24T01:27:10.056866+0000","last_clean":"2024-04-24T01:27:10.056866+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.056866+0000","last_undegraded":"2024-04-24T01:27:10.056866+0000","last_fullsized":"2024-04-24T01:27:10.056866+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:09:23.826046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984471+0000","last_change":"2024-04-24T01:24:00.746538+0000","last_active":"2024-04-24T01:24:42.984471+0000","last_peered":"2024-04-24T01:24:42.984471+0000","last_clean":"2024-04-24T01:24:42.984471+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:24:42.984471+0000","last_undegraded":"2024-04-24T01:24:42.984471+0000","last_fullsized":"2024-04-24T01:24:42.984471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:42.978833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790051+0000","last_change":"2024-04-24T01:23:58.755957+0000","last_active":"2024-04-24T01:24:39.790051+0000","last_peered":"2024-04-24T01:24:39.790051+0000","last_clean":"2024-04-24T01:24:39.790051+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:24:39.790051+0000","last_undegraded":"2024-04-24T01:24:39.790051+0000","last_fullsized":"2024-04-24T01:24:39.790051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790172+0000","last_change":"2024-04-24T01:24:02.753656+0000","last_active":"2024-04-24T01:24:39.790172+0000","last_peered":"2024-04-24T01:24:39.790172+0000","last_clean":"2024-04-24T01:24:39.790172+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:24:39.790172+0000","last_undegraded":"2024-04-24T01:24:39.790172+0000","last_fullsized":"2024-04-24T01:24:39.790172+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:49:33.516719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'39","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.981897+0000","last_change":"2024-04-24T01:24:04.759628+0000","last_active":"2024-04-24T01:27:16.981897+0000","last_peered":"2024-04-24T01:27:16.981897+0000","last_clean":"2024-04-24T01:27:16.981897+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:16.981897+0000","last_undegraded":"2024-04-24T01:27:16.981897+0000","last_fullsized":"2024-04-24T01:27:16.981897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:38.198064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'284","reported_seq":403,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.872756+0000","last_change":"2024-04-24T01:24:06.765145+0000","last_active":"2024-04-24T01:27:16.872756+0000","last_peered":"2024-04-24T01:27:16.872756+0000","last_clean":"2024-04-24T01:27:16.872756+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:16.872756+0000","last_undegraded":"2024-04-24T01:27:16.872756+0000","last_fullsized":"2024-04-24T01:27:16.872756+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:35.968565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:43.536575+0000","last_change":"2024-04-24T01:24:00.737956+0000","last_active":"2024-04-24T01:24:43.536575+0000","last_peered":"2024-04-24T01:24:43.536575+0000","last_clean":"2024-04-24T01:24:43.536575+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:24:43.536575+0000","last_undegraded":"2024-04-24T01:24:43.536575+0000","last_fullsized":"2024-04-24T01:24:43.536575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:01.856776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793056+0000","last_change":"2024-04-24T01:23:58.744402+0000","last_active":"2024-04-24T01:24:39.793056+0000","last_peered":"2024-04-24T01:24:39.793056+0000","last_clean":"2024-04-24T01:24:39.793056+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:24:39.793056+0000","last_undegraded":"2024-04-24T01:24:39.793056+0000","last_fullsized":"2024-04-24T01:24:39.793056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794002+0000","last_change":"2024-04-24T01:24:02.760212+0000","last_active":"2024-04-24T01:24:39.794002+0000","last_peered":"2024-04-24T01:24:39.794002+0000","last_clean":"2024-04-24T01:24:39.794002+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:24:39.794002+0000","last_undegraded":"2024-04-24T01:24:39.794002+0000","last_fullsized":"2024-04-24T01:24:39.794002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:38.380237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'49","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.009420+0000","last_change":"2024-04-24T01:24:04.753455+0000","last_active":"2024-04-24T01:27:17.009420+0000","last_peered":"2024-04-24T01:27:17.009420+0000","last_clean":"2024-04-24T01:27:17.009420+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:17.009420+0000","last_undegraded":"2024-04-24T01:27:17.009420+0000","last_fullsized":"2024-04-24T01:27:17.009420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:43.056736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843661+0000","last_change":"2024-04-24T01:24:06.765236+0000","last_active":"2024-04-24T01:24:39.843661+0000","last_peered":"2024-04-24T01:24:39.843661+0000","last_clean":"2024-04-24T01:24:39.843661+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:24:39.843661+0000","last_undegraded":"2024-04-24T01:24:39.843661+0000","last_fullsized":"2024-04-24T01:24:39.843661+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:24.267869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.652091+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:25:25.652091+0000","last_peered":"2024-04-24T01:25:25.652091+0000","last_clean":"2024-04-24T01:25:25.652091+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:25:25.652091+0000","last_undegraded":"2024-04-24T01:25:25.652091+0000","last_fullsized":"2024-04-24T01:25:25.652091+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:02.933343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.371033+0000","last_change":"2024-04-24T01:24:00.739375+0000","last_active":"2024-04-24T01:24:42.371033+0000","last_peered":"2024-04-24T01:24:42.371033+0000","last_clean":"2024-04-24T01:24:42.371033+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:24:42.371033+0000","last_undegraded":"2024-04-24T01:24:42.371033+0000","last_fullsized":"2024-04-24T01:24:42.371033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:43.478749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.996880+0000","last_change":"2024-04-24T01:23:58.747337+0000","last_active":"2024-04-24T01:27:09.996880+0000","last_peered":"2024-04-24T01:27:09.996880+0000","last_clean":"2024-04-24T01:27:09.996880+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:09.996880+0000","last_undegraded":"2024-04-24T01:27:09.996880+0000","last_fullsized":"2024-04-24T01:27:09.996880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:00:52.523923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'4","reported_seq":228,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.840659+0000","last_change":"2024-04-24T01:24:02.754621+0000","last_active":"2024-04-24T01:27:16.840659+0000","last_peered":"2024-04-24T01:27:16.840659+0000","last_clean":"2024-04-24T01:27:16.840659+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:16.840659+0000","last_undegraded":"2024-04-24T01:27:16.840659+0000","last_fullsized":"2024-04-24T01:27:16.840659+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:02:50.938939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'39","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.950753+0000","last_change":"2024-04-24T01:24:04.757399+0000","last_active":"2024-04-24T01:27:16.950753+0000","last_peered":"2024-04-24T01:27:16.950753+0000","last_clean":"2024-04-24T01:27:16.950753+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:16.950753+0000","last_undegraded":"2024-04-24T01:27:16.950753+0000","last_fullsized":"2024-04-24T01:27:16.950753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:33:32.641634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842244+0000","last_change":"2024-04-24T01:24:06.770235+0000","last_active":"2024-04-24T01:24:39.842244+0000","last_peered":"2024-04-24T01:24:39.842244+0000","last_clean":"2024-04-24T01:24:39.842244+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:24:39.842244+0000","last_undegraded":"2024-04-24T01:24:39.842244+0000","last_fullsized":"2024-04-24T01:24:39.842244+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:57.117920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:19.779279+0000","last_change":"2024-04-24T01:24:08.772727+0000","last_active":"2024-04-24T01:25:19.779279+0000","last_peered":"2024-04-24T01:25:19.779279+0000","last_clean":"2024-04-24T01:25:19.779279+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:25:19.779279+0000","last_undegraded":"2024-04-24T01:25:19.779279+0000","last_fullsized":"2024-04-24T01:25:19.779279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:52.582338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642683+0000","last_change":"2024-04-24T01:24:00.740217+0000","last_active":"2024-04-24T01:26:09.642683+0000","last_peered":"2024-04-24T01:26:09.642683+0000","last_clean":"2024-04-24T01:26:09.642683+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:26:09.642683+0000","last_undegraded":"2024-04-24T01:26:09.642683+0000","last_fullsized":"2024-04-24T01:26:09.642683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:44.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.952871+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:27:09.952871+0000","last_peered":"2024-04-24T01:27:09.952871+0000","last_clean":"2024-04-24T01:27:09.952871+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:27:09.952871+0000","last_undegraded":"2024-04-24T01:27:09.952871+0000","last_fullsized":"2024-04-24T01:27:09.952871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:57.200882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842662+0000","last_change":"2024-04-24T01:24:02.755085+0000","last_active":"2024-04-24T01:24:39.842662+0000","last_peered":"2024-04-24T01:24:39.842662+0000","last_clean":"2024-04-24T01:24:39.842662+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:24:39.842662+0000","last_undegraded":"2024-04-24T01:24:39.842662+0000","last_fullsized":"2024-04-24T01:24:39.842662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:48:00.515637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'51","reported_seq":112,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.914297+0000","last_change":"2024-04-24T01:24:04.760716+0000","last_active":"2024-04-24T01:27:16.914297+0000","last_peered":"2024-04-24T01:27:16.914297+0000","last_clean":"2024-04-24T01:27:16.914297+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:16.914297+0000","last_undegraded":"2024-04-24T01:27:16.914297+0000","last_fullsized":"2024-04-24T01:27:16.914297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:02.956787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'284","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.873973+0000","last_change":"2024-04-24T01:24:06.770574+0000","last_active":"2024-04-24T01:27:16.873973+0000","last_peered":"2024-04-24T01:27:16.873973+0000","last_clean":"2024-04-24T01:27:16.873973+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:16.873973+0000","last_undegraded":"2024-04-24T01:27:16.873973+0000","last_fullsized":"2024-04-24T01:27:16.873973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:45:08.995703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842818+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:24:39.842818+0000","last_peered":"2024-04-24T01:24:39.842818+0000","last_clean":"2024-04-24T01:24:39.842818+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:24:39.842818+0000","last_undegraded":"2024-04-24T01:24:39.842818+0000","last_fullsized":"2024-04-24T01:24:39.842818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:07.197054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370607+0000","last_change":"2024-04-24T01:24:00.731534+0000","last_active":"2024-04-24T01:26:06.370607+0000","last_peered":"2024-04-24T01:26:06.370607+0000","last_clean":"2024-04-24T01:26:06.370607+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:26:06.370607+0000","last_undegraded":"2024-04-24T01:26:06.370607+0000","last_fullsized":"2024-04-24T01:26:06.370607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:02.215844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791221+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:24:39.791221+0000","last_peered":"2024-04-24T01:24:39.791221+0000","last_clean":"2024-04-24T01:24:39.791221+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:24:39.791221+0000","last_undegraded":"2024-04-24T01:24:39.791221+0000","last_fullsized":"2024-04-24T01:24:39.791221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:00.208350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841637+0000","last_change":"2024-04-24T01:24:02.754790+0000","last_active":"2024-04-24T01:24:39.841637+0000","last_peered":"2024-04-24T01:24:39.841637+0000","last_clean":"2024-04-24T01:24:39.841637+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:24:39.841637+0000","last_undegraded":"2024-04-24T01:24:39.841637+0000","last_fullsized":"2024-04-24T01:24:39.841637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:34.987188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":148,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.959141+0000","last_change":"2024-04-24T01:24:04.761320+0000","last_active":"2024-04-24T01:27:16.959141+0000","last_peered":"2024-04-24T01:27:16.959141+0000","last_clean":"2024-04-24T01:27:16.959141+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:16.959141+0000","last_undegraded":"2024-04-24T01:27:16.959141+0000","last_fullsized":"2024-04-24T01:27:16.959141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:36:40.993593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841213+0000","last_change":"2024-04-24T01:24:06.769787+0000","last_active":"2024-04-24T01:24:39.841213+0000","last_peered":"2024-04-24T01:24:39.841213+0000","last_clean":"2024-04-24T01:24:39.841213+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:24:39.841213+0000","last_undegraded":"2024-04-24T01:24:39.841213+0000","last_fullsized":"2024-04-24T01:24:39.841213+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:14.938788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.435601+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.435601+0000","last_peered":"2024-04-24T01:27:10.435601+0000","last_clean":"2024-04-24T01:27:10.435601+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.435601+0000","last_undegraded":"2024-04-24T01:27:10.435601+0000","last_fullsized":"2024-04-24T01:27:10.435601+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:26.048216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.039360+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.039360+0000","last_peered":"2024-04-24T01:27:10.039360+0000","last_clean":"2024-04-24T01:27:10.039360+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.039360+0000","last_undegraded":"2024-04-24T01:27:10.039360+0000","last_fullsized":"2024-04-24T01:27:10.039360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:23:50.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894208+0000","last_change":"2024-04-24T01:23:58.747661+0000","last_active":"2024-04-24T01:24:41.894208+0000","last_peered":"2024-04-24T01:24:41.894208+0000","last_clean":"2024-04-24T01:24:41.894208+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:24:41.894208+0000","last_undegraded":"2024-04-24T01:24:41.894208+0000","last_fullsized":"2024-04-24T01:24:41.894208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:52:15.213886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792715+0000","last_change":"2024-04-24T01:24:02.751285+0000","last_active":"2024-04-24T01:24:39.792715+0000","last_peered":"2024-04-24T01:24:39.792715+0000","last_clean":"2024-04-24T01:24:39.792715+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:24:39.792715+0000","last_undegraded":"2024-04-24T01:24:39.792715+0000","last_fullsized":"2024-04-24T01:24:39.792715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:30.582902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'42","reported_seq":95,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.962338+0000","last_change":"2024-04-24T01:24:04.757977+0000","last_active":"2024-04-24T01:27:16.962338+0000","last_peered":"2024-04-24T01:27:16.962338+0000","last_clean":"2024-04-24T01:27:16.962338+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:16.962338+0000","last_undegraded":"2024-04-24T01:27:16.962338+0000","last_fullsized":"2024-04-24T01:27:16.962338+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:41.769486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790314+0000","last_change":"2024-04-24T01:24:06.762347+0000","last_active":"2024-04-24T01:24:39.790314+0000","last_peered":"2024-04-24T01:24:39.790314+0000","last_clean":"2024-04-24T01:24:39.790314+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:24:39.790314+0000","last_undegraded":"2024-04-24T01:24:39.790314+0000","last_fullsized":"2024-04-24T01:24:39.790314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:11.885145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982729+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:26:08.982729+0000","last_peered":"2024-04-24T01:26:08.982729+0000","last_clean":"2024-04-24T01:26:08.982729+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:26:08.982729+0000","last_undegraded":"2024-04-24T01:26:08.982729+0000","last_fullsized":"2024-04-24T01:26:08.982729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:43:24.366261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642598+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:09.642598+0000","last_peered":"2024-04-24T01:26:09.642598+0000","last_clean":"2024-04-24T01:26:09.642598+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:09.642598+0000","last_undegraded":"2024-04-24T01:26:09.642598+0000","last_fullsized":"2024-04-24T01:26:09.642598+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:25:49.386770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794593+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:24:39.794593+0000","last_peered":"2024-04-24T01:24:39.794593+0000","last_clean":"2024-04-24T01:24:39.794593+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:24:39.794593+0000","last_undegraded":"2024-04-24T01:24:39.794593+0000","last_fullsized":"2024-04-24T01:24:39.794593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:58.408440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842272+0000","last_change":"2024-04-24T01:24:02.754670+0000","last_active":"2024-04-24T01:24:39.842272+0000","last_peered":"2024-04-24T01:24:39.842272+0000","last_clean":"2024-04-24T01:24:39.842272+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:24:39.842272+0000","last_undegraded":"2024-04-24T01:24:39.842272+0000","last_fullsized":"2024-04-24T01:24:39.842272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:17:43.302766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.941040+0000","last_change":"2024-04-24T01:24:04.752408+0000","last_active":"2024-04-24T01:27:16.941040+0000","last_peered":"2024-04-24T01:27:16.941040+0000","last_clean":"2024-04-24T01:27:16.941040+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:16.941040+0000","last_undegraded":"2024-04-24T01:27:16.941040+0000","last_fullsized":"2024-04-24T01:27:16.941040+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:05.893512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":406,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.869979+0000","last_change":"2024-04-24T01:24:06.768791+0000","last_active":"2024-04-24T01:27:16.869979+0000","last_peered":"2024-04-24T01:27:16.869979+0000","last_clean":"2024-04-24T01:27:16.869979+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:16.869979+0000","last_undegraded":"2024-04-24T01:27:16.869979+0000","last_fullsized":"2024-04-24T01:27:16.869979+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:38.429385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974110+0000","last_change":"2024-04-24T01:24:08.768551+0000","last_active":"2024-04-24T01:26:16.974110+0000","last_peered":"2024-04-24T01:26:16.974110+0000","last_clean":"2024-04-24T01:26:16.974110+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:26:16.974110+0000","last_undegraded":"2024-04-24T01:26:16.974110+0000","last_fullsized":"2024-04-24T01:26:16.974110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.067146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343453+0000","last_change":"2024-04-24T01:24:00.740730+0000","last_active":"2024-04-24T01:27:10.343453+0000","last_peered":"2024-04-24T01:27:10.343453+0000","last_clean":"2024-04-24T01:27:10.343453+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:10.343453+0000","last_undegraded":"2024-04-24T01:27:10.343453+0000","last_fullsized":"2024-04-24T01:27:10.343453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.960520+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:24:42.960520+0000","last_peered":"2024-04-24T01:24:42.960520+0000","last_clean":"2024-04-24T01:24:42.960520+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:24:42.960520+0000","last_undegraded":"2024-04-24T01:24:42.960520+0000","last_fullsized":"2024-04-24T01:24:42.960520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:05:27.917471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'3","reported_seq":417,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.850530+0000","last_change":"2024-04-24T01:24:02.755990+0000","last_active":"2024-04-24T01:27:16.850530+0000","last_peered":"2024-04-24T01:27:16.850530+0000","last_clean":"2024-04-24T01:27:16.850530+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:16.850530+0000","last_undegraded":"2024-04-24T01:27:16.850530+0000","last_fullsized":"2024-04-24T01:27:16.850530+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:13.423016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794664+0000","last_change":"2024-04-24T01:24:04.759964+0000","last_active":"2024-04-24T01:24:39.794664+0000","last_peered":"2024-04-24T01:24:39.794664+0000","last_clean":"2024-04-24T01:24:39.794664+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:24:39.794664+0000","last_undegraded":"2024-04-24T01:24:39.794664+0000","last_fullsized":"2024-04-24T01:24:39.794664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:57.073362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":462,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.871410+0000","last_change":"2024-04-24T01:24:06.769489+0000","last_active":"2024-04-24T01:27:16.871410+0000","last_peered":"2024-04-24T01:27:16.871410+0000","last_clean":"2024-04-24T01:27:16.871410+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:16.871410+0000","last_undegraded":"2024-04-24T01:27:16.871410+0000","last_fullsized":"2024-04-24T01:27:16.871410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:40.252129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.421794+0000","last_change":"2024-04-24T01:24:08.769465+0000","last_active":"2024-04-24T01:26:09.421794+0000","last_peered":"2024-04-24T01:26:09.421794+0000","last_clean":"2024-04-24T01:26:09.421794+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:26:09.421794+0000","last_undegraded":"2024-04-24T01:26:09.421794+0000","last_fullsized":"2024-04-24T01:26:09.421794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:49.696659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124448+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.124448+0000","last_peered":"2024-04-24T01:27:10.124448+0000","last_clean":"2024-04-24T01:27:10.124448+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.124448+0000","last_undegraded":"2024-04-24T01:27:10.124448+0000","last_fullsized":"2024-04-24T01:27:10.124448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:54:42.532198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790064+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:24:39.790064+0000","last_peered":"2024-04-24T01:24:39.790064+0000","last_clean":"2024-04-24T01:24:39.790064+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:24:39.790064+0000","last_undegraded":"2024-04-24T01:24:39.790064+0000","last_fullsized":"2024-04-24T01:24:39.790064+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:51.859022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790262+0000","last_change":"2024-04-24T01:24:02.753182+0000","last_active":"2024-04-24T01:24:39.790262+0000","last_peered":"2024-04-24T01:24:39.790262+0000","last_clean":"2024-04-24T01:24:39.790262+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:24:39.790262+0000","last_undegraded":"2024-04-24T01:24:39.790262+0000","last_fullsized":"2024-04-24T01:24:39.790262+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:38.392527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'43","reported_seq":93,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.000543+0000","last_change":"2024-04-24T01:24:04.754866+0000","last_active":"2024-04-24T01:27:17.000543+0000","last_peered":"2024-04-24T01:27:17.000543+0000","last_clean":"2024-04-24T01:27:17.000543+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:17.000543+0000","last_undegraded":"2024-04-24T01:27:17.000543+0000","last_fullsized":"2024-04-24T01:27:17.000543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:19.241933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790987+0000","last_change":"2024-04-24T01:24:06.767120+0000","last_active":"2024-04-24T01:24:39.790987+0000","last_peered":"2024-04-24T01:24:39.790987+0000","last_clean":"2024-04-24T01:24:39.790987+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:24:39.790987+0000","last_undegraded":"2024-04-24T01:24:39.790987+0000","last_fullsized":"2024-04-24T01:24:39.790987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:09.566148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.375629+0000","last_change":"2024-04-24T01:24:08.772039+0000","last_active":"2024-04-24T01:27:10.375629+0000","last_peered":"2024-04-24T01:27:10.375629+0000","last_clean":"2024-04-24T01:27:10.375629+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:10.375629+0000","last_undegraded":"2024-04-24T01:27:10.375629+0000","last_fullsized":"2024-04-24T01:27:10.375629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:37.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046285+0000","last_change":"2024-04-24T01:24:00.747539+0000","last_active":"2024-04-24T01:27:10.046285+0000","last_peered":"2024-04-24T01:27:10.046285+0000","last_clean":"2024-04-24T01:27:10.046285+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:10.046285+0000","last_undegraded":"2024-04-24T01:27:10.046285+0000","last_fullsized":"2024-04-24T01:27:10.046285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:39:03.538221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":202,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789580+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:24:39.789580+0000","last_peered":"2024-04-24T01:24:39.789580+0000","last_clean":"2024-04-24T01:24:39.789580+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:24:39.789580+0000","last_undegraded":"2024-04-24T01:24:39.789580+0000","last_fullsized":"2024-04-24T01:24:39.789580+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:48.933633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792236+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:24:39.792236+0000","last_peered":"2024-04-24T01:24:39.792236+0000","last_clean":"2024-04-24T01:24:39.792236+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:24:39.792236+0000","last_undegraded":"2024-04-24T01:24:39.792236+0000","last_fullsized":"2024-04-24T01:24:39.792236+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:55:15.195026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793836+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:24:39.793836+0000","last_peered":"2024-04-24T01:24:39.793836+0000","last_clean":"2024-04-24T01:24:39.793836+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:24:39.793836+0000","last_undegraded":"2024-04-24T01:24:39.793836+0000","last_fullsized":"2024-04-24T01:24:39.793836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:25.383897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.801934+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:24:39.801934+0000","last_peered":"2024-04-24T01:24:39.801934+0000","last_clean":"2024-04-24T01:24:39.801934+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:24:39.801934+0000","last_undegraded":"2024-04-24T01:24:39.801934+0000","last_fullsized":"2024-04-24T01:24:39.801934+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:57:39.300121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'91","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.006485+0000","last_change":"2024-04-24T01:24:04.758941+0000","last_active":"2024-04-24T01:27:17.006485+0000","last_peered":"2024-04-24T01:27:17.006485+0000","last_clean":"2024-04-24T01:27:17.006485+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:17.006485+0000","last_undegraded":"2024-04-24T01:27:17.006485+0000","last_fullsized":"2024-04-24T01:27:17.006485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:44:28.497024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770234+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:03.262620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":163,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.353300+0000","last_change":"2024-04-24T01:24:08.768417+0000","last_active":"2024-04-24T01:27:10.353300+0000","last_peered":"2024-04-24T01:27:10.353300+0000","last_clean":"2024-04-24T01:27:10.353300+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:10.353300+0000","last_undegraded":"2024-04-24T01:27:10.353300+0000","last_fullsized":"2024-04-24T01:27:10.353300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:30.971611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'3","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983682+0000","last_change":"2024-04-24T01:24:00.735658+0000","last_active":"2024-04-24T01:26:13.983682+0000","last_peered":"2024-04-24T01:26:13.983682+0000","last_clean":"2024-04-24T01:26:13.983682+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:26:13.983682+0000","last_undegraded":"2024-04-24T01:26:13.983682+0000","last_fullsized":"2024-04-24T01:26:13.983682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:42.397476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789517+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:24:39.789517+0000","last_peered":"2024-04-24T01:24:39.789517+0000","last_clean":"2024-04-24T01:24:39.789517+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:24:39.789517+0000","last_undegraded":"2024-04-24T01:24:39.789517+0000","last_fullsized":"2024-04-24T01:24:39.789517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:50:48.109200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'1","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972617+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:26:06.972617+0000","last_peered":"2024-04-24T01:26:06.972617+0000","last_clean":"2024-04-24T01:26:06.972617+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:26:06.972617+0000","last_undegraded":"2024-04-24T01:26:06.972617+0000","last_fullsized":"2024-04-24T01:26:06.972617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:13:15.111274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790478+0000","last_change":"2024-04-24T01:24:02.754010+0000","last_active":"2024-04-24T01:24:39.790478+0000","last_peered":"2024-04-24T01:24:39.790478+0000","last_clean":"2024-04-24T01:24:39.790478+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:24:39.790478+0000","last_undegraded":"2024-04-24T01:24:39.790478+0000","last_fullsized":"2024-04-24T01:24:39.790478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:31.372135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'290","reported_seq":512,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.004476+0000","last_change":"2024-04-24T01:24:04.762704+0000","last_active":"2024-04-24T01:27:17.004476+0000","last_peered":"2024-04-24T01:27:17.004476+0000","last_clean":"2024-04-24T01:27:17.004476+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:17.004476+0000","last_undegraded":"2024-04-24T01:27:17.004476+0000","last_fullsized":"2024-04-24T01:27:17.004476+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:37.274008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792861+0000","last_change":"2024-04-24T01:24:06.760509+0000","last_active":"2024-04-24T01:24:39.792861+0000","last_peered":"2024-04-24T01:24:39.792861+0000","last_clean":"2024-04-24T01:24:39.792861+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:24:39.792861+0000","last_undegraded":"2024-04-24T01:24:39.792861+0000","last_fullsized":"2024-04-24T01:24:39.792861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:08.522687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.647797+0000","last_change":"2024-04-24T01:24:08.773331+0000","last_active":"2024-04-24T01:25:25.647797+0000","last_peered":"2024-04-24T01:25:25.647797+0000","last_clean":"2024-04-24T01:25:25.647797+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:25:25.647797+0000","last_undegraded":"2024-04-24T01:25:25.647797+0000","last_fullsized":"2024-04-24T01:25:25.647797+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:33.429035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261927+0000","last_change":"2024-04-24T01:24:00.746776+0000","last_active":"2024-04-24T01:27:10.261927+0000","last_peered":"2024-04-24T01:27:10.261927+0000","last_clean":"2024-04-24T01:27:10.261927+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:10.261927+0000","last_undegraded":"2024-04-24T01:27:10.261927+0000","last_fullsized":"2024-04-24T01:27:10.261927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:55:10.175248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789461+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:24:39.789461+0000","last_peered":"2024-04-24T01:24:39.789461+0000","last_clean":"2024-04-24T01:24:39.789461+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:24:39.789461+0000","last_undegraded":"2024-04-24T01:24:39.789461+0000","last_fullsized":"2024-04-24T01:24:39.789461+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:09.383332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.840955+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:24:39.840955+0000","last_peered":"2024-04-24T01:24:39.840955+0000","last_clean":"2024-04-24T01:24:39.840955+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:24:39.840955+0000","last_undegraded":"2024-04-24T01:24:39.840955+0000","last_fullsized":"2024-04-24T01:24:39.840955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:20:24.635245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":221,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.841790+0000","last_change":"2024-04-24T01:24:02.752449+0000","last_active":"2024-04-24T01:27:16.841790+0000","last_peered":"2024-04-24T01:27:16.841790+0000","last_clean":"2024-04-24T01:27:16.841790+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:16.841790+0000","last_undegraded":"2024-04-24T01:27:16.841790+0000","last_fullsized":"2024-04-24T01:27:16.841790+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:25.280491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:07.831477+0000","last_change":"2024-04-24T01:24:04.757333+0000","last_active":"2024-04-24T01:27:07.831477+0000","last_peered":"2024-04-24T01:27:07.831477+0000","last_clean":"2024-04-24T01:27:07.831477+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:07.831477+0000","last_undegraded":"2024-04-24T01:27:07.831477+0000","last_fullsized":"2024-04-24T01:27:07.831477+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:05.189769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842889+0000","last_change":"2024-04-24T01:24:06.770584+0000","last_active":"2024-04-24T01:24:39.842889+0000","last_peered":"2024-04-24T01:24:39.842889+0000","last_clean":"2024-04-24T01:24:39.842889+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:24:39.842889+0000","last_undegraded":"2024-04-24T01:24:39.842889+0000","last_fullsized":"2024-04-24T01:24:39.842889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:27.982282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790216+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:24:39.790216+0000","last_peered":"2024-04-24T01:24:39.790216+0000","last_clean":"2024-04-24T01:24:39.790216+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:24:39.790216+0000","last_undegraded":"2024-04-24T01:24:39.790216+0000","last_fullsized":"2024-04-24T01:24:39.790216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:30:30.742533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349653+0000","last_change":"2024-04-24T01:24:00.731982+0000","last_active":"2024-04-24T01:27:10.349653+0000","last_peered":"2024-04-24T01:27:10.349653+0000","last_clean":"2024-04-24T01:27:10.349653+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:10.349653+0000","last_undegraded":"2024-04-24T01:27:10.349653+0000","last_fullsized":"2024-04-24T01:27:10.349653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:01.094309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793490+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:24:39.793490+0000","last_peered":"2024-04-24T01:24:39.793490+0000","last_clean":"2024-04-24T01:24:39.793490+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:24:39.793490+0000","last_undegraded":"2024-04-24T01:24:39.793490+0000","last_fullsized":"2024-04-24T01:24:39.793490+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:52.890188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.618279+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.618279+0000","last_peered":"2024-04-24T01:26:09.618279+0000","last_clean":"2024-04-24T01:26:09.618279+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.618279+0000","last_undegraded":"2024-04-24T01:26:09.618279+0000","last_fullsized":"2024-04-24T01:26:09.618279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:13.792055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842816+0000","last_change":"2024-04-24T01:24:02.751517+0000","last_active":"2024-04-24T01:24:39.842816+0000","last_peered":"2024-04-24T01:24:39.842816+0000","last_clean":"2024-04-24T01:24:39.842816+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:24:39.842816+0000","last_undegraded":"2024-04-24T01:24:39.842816+0000","last_fullsized":"2024-04-24T01:24:39.842816+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:05.022610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.655738+0000","last_change":"2024-04-24T01:24:04.760913+0000","last_active":"2024-04-24T01:27:09.655738+0000","last_peered":"2024-04-24T01:27:09.655738+0000","last_clean":"2024-04-24T01:27:09.655738+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:09.655738+0000","last_undegraded":"2024-04-24T01:27:09.655738+0000","last_fullsized":"2024-04-24T01:27:09.655738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:30.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790734+0000","last_change":"2024-04-24T01:24:06.760113+0000","last_active":"2024-04-24T01:24:39.790734+0000","last_peered":"2024-04-24T01:24:39.790734+0000","last_clean":"2024-04-24T01:24:39.790734+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:24:39.790734+0000","last_undegraded":"2024-04-24T01:24:39.790734+0000","last_fullsized":"2024-04-24T01:24:39.790734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:20:00.960850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.398901+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:09.398901+0000","last_peered":"2024-04-24T01:26:09.398901+0000","last_clean":"2024-04-24T01:26:09.398901+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:09.398901+0000","last_undegraded":"2024-04-24T01:26:09.398901+0000","last_fullsized":"2024-04-24T01:26:09.398901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:04.383799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040345+0000","last_change":"2024-04-24T01:24:00.742538+0000","last_active":"2024-04-24T01:27:10.040345+0000","last_peered":"2024-04-24T01:27:10.040345+0000","last_clean":"2024-04-24T01:27:10.040345+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:10.040345+0000","last_undegraded":"2024-04-24T01:27:10.040345+0000","last_fullsized":"2024-04-24T01:27:10.040345+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:22.605289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.243741+0000","last_change":"2024-04-24T01:23:58.743583+0000","last_active":"2024-04-24T01:27:10.243741+0000","last_peered":"2024-04-24T01:27:10.243741+0000","last_clean":"2024-04-24T01:27:10.243741+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:10.243741+0000","last_undegraded":"2024-04-24T01:27:10.243741+0000","last_fullsized":"2024-04-24T01:27:10.243741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842590+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:24:39.842590+0000","last_peered":"2024-04-24T01:24:39.842590+0000","last_clean":"2024-04-24T01:24:39.842590+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:24:39.842590+0000","last_undegraded":"2024-04-24T01:24:39.842590+0000","last_fullsized":"2024-04-24T01:24:39.842590+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:07:24.173468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.457421+0000","last_change":"2024-04-24T01:24:02.750475+0000","last_active":"2024-04-24T01:27:10.457421+0000","last_peered":"2024-04-24T01:27:10.457421+0000","last_clean":"2024-04-24T01:27:10.457421+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:10.457421+0000","last_undegraded":"2024-04-24T01:27:10.457421+0000","last_fullsized":"2024-04-24T01:27:10.457421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:41.546855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'78","reported_seq":153,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.938001+0000","last_change":"2024-04-24T01:24:04.759676+0000","last_active":"2024-04-24T01:27:16.938001+0000","last_peered":"2024-04-24T01:27:16.938001+0000","last_clean":"2024-04-24T01:27:16.938001+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:16.938001+0000","last_undegraded":"2024-04-24T01:27:16.938001+0000","last_fullsized":"2024-04-24T01:27:16.938001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:43:49.476095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":83,"num_read_kb":69,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788138+0000","last_change":"2024-04-24T01:24:06.768799+0000","last_active":"2024-04-24T01:24:39.788138+0000","last_peered":"2024-04-24T01:24:39.788138+0000","last_clean":"2024-04-24T01:24:39.788138+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:24:39.788138+0000","last_undegraded":"2024-04-24T01:24:39.788138+0000","last_fullsized":"2024-04-24T01:24:39.788138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:29.140123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.578357+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:09.578357+0000","last_peered":"2024-04-24T01:26:09.578357+0000","last_clean":"2024-04-24T01:26:09.578357+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:09.578357+0000","last_undegraded":"2024-04-24T01:26:09.578357+0000","last_fullsized":"2024-04-24T01:26:09.578357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:58.022650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269116+0000","last_change":"2024-04-24T01:24:00.740995+0000","last_active":"2024-04-24T01:27:10.269116+0000","last_peered":"2024-04-24T01:27:10.269116+0000","last_clean":"2024-04-24T01:27:10.269116+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:10.269116+0000","last_undegraded":"2024-04-24T01:27:10.269116+0000","last_fullsized":"2024-04-24T01:27:10.269116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:12:25.504403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843750+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:24:39.843750+0000","last_peered":"2024-04-24T01:24:39.843750+0000","last_clean":"2024-04-24T01:24:39.843750+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:24:39.843750+0000","last_undegraded":"2024-04-24T01:24:39.843750+0000","last_fullsized":"2024-04-24T01:24:39.843750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:33.415474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793649+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:24:39.793649+0000","last_peered":"2024-04-24T01:24:39.793649+0000","last_clean":"2024-04-24T01:24:39.793649+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:24:39.793649+0000","last_undegraded":"2024-04-24T01:24:39.793649+0000","last_fullsized":"2024-04-24T01:24:39.793649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:49:44.621596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793155+0000","last_change":"2024-04-24T01:24:02.753858+0000","last_active":"2024-04-24T01:24:39.793155+0000","last_peered":"2024-04-24T01:24:39.793155+0000","last_clean":"2024-04-24T01:24:39.793155+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:24:39.793155+0000","last_undegraded":"2024-04-24T01:24:39.793155+0000","last_fullsized":"2024-04-24T01:24:39.793155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:56.906730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794508+0000","last_change":"2024-04-24T01:24:04.761717+0000","last_active":"2024-04-24T01:24:39.794508+0000","last_peered":"2024-04-24T01:24:39.794508+0000","last_clean":"2024-04-24T01:24:39.794508+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:24:39.794508+0000","last_undegraded":"2024-04-24T01:24:39.794508+0000","last_fullsized":"2024-04-24T01:24:39.794508+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:33.225449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":359,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.867667+0000","last_change":"2024-04-24T01:24:06.769511+0000","last_active":"2024-04-24T01:27:16.867667+0000","last_peered":"2024-04-24T01:27:16.867667+0000","last_clean":"2024-04-24T01:27:16.867667+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:16.867667+0000","last_undegraded":"2024-04-24T01:27:16.867667+0000","last_fullsized":"2024-04-24T01:27:16.867667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:27.014536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.876452+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:25:25.876452+0000","last_peered":"2024-04-24T01:25:25.876452+0000","last_clean":"2024-04-24T01:25:25.876452+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:25:25.876452+0000","last_undegraded":"2024-04-24T01:25:25.876452+0000","last_fullsized":"2024-04-24T01:25:25.876452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:27:11.793963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791495+0000","last_change":"2024-04-24T01:24:00.748141+0000","last_active":"2024-04-24T01:24:39.791495+0000","last_peered":"2024-04-24T01:24:39.791495+0000","last_clean":"2024-04-24T01:24:39.791495+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:24:39.791495+0000","last_undegraded":"2024-04-24T01:24:39.791495+0000","last_fullsized":"2024-04-24T01:24:39.791495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:01.169281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791804+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:24:39.791804+0000","last_peered":"2024-04-24T01:24:39.791804+0000","last_clean":"2024-04-24T01:24:39.791804+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:24:39.791804+0000","last_undegraded":"2024-04-24T01:24:39.791804+0000","last_fullsized":"2024-04-24T01:24:39.791804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:08:42.186635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843585+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:24:39.843585+0000","last_peered":"2024-04-24T01:24:39.843585+0000","last_clean":"2024-04-24T01:24:39.843585+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:24:39.843585+0000","last_undegraded":"2024-04-24T01:24:39.843585+0000","last_fullsized":"2024-04-24T01:24:39.843585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:42.744197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.799913+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:24:39.799913+0000","last_peered":"2024-04-24T01:24:39.799913+0000","last_clean":"2024-04-24T01:24:39.799913+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:24:39.799913+0000","last_undegraded":"2024-04-24T01:24:39.799913+0000","last_fullsized":"2024-04-24T01:24:39.799913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:58.029820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794303+0000","last_change":"2024-04-24T01:24:04.761597+0000","last_active":"2024-04-24T01:24:39.794303+0000","last_peered":"2024-04-24T01:24:39.794303+0000","last_clean":"2024-04-24T01:24:39.794303+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:24:39.794303+0000","last_undegraded":"2024-04-24T01:24:39.794303+0000","last_fullsized":"2024-04-24T01:24:39.794303+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:05:04.640275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'284","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.871565+0000","last_change":"2024-04-24T01:24:06.765101+0000","last_active":"2024-04-24T01:27:16.871565+0000","last_peered":"2024-04-24T01:27:16.871565+0000","last_clean":"2024-04-24T01:27:16.871565+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:16.871565+0000","last_undegraded":"2024-04-24T01:27:16.871565+0000","last_fullsized":"2024-04-24T01:27:16.871565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:06.216648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797965+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:24:39.797965+0000","last_peered":"2024-04-24T01:24:39.797965+0000","last_clean":"2024-04-24T01:24:39.797965+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:24:39.797965+0000","last_undegraded":"2024-04-24T01:24:39.797965+0000","last_fullsized":"2024-04-24T01:24:39.797965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:26:06.970384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.038450+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.038450+0000","last_peered":"2024-04-24T01:27:10.038450+0000","last_clean":"2024-04-24T01:27:10.038450+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.038450+0000","last_undegraded":"2024-04-24T01:27:10.038450+0000","last_fullsized":"2024-04-24T01:27:10.038450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:57.048730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797039+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:24:39.797039+0000","last_peered":"2024-04-24T01:24:39.797039+0000","last_clean":"2024-04-24T01:24:39.797039+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:24:39.797039+0000","last_undegraded":"2024-04-24T01:24:39.797039+0000","last_fullsized":"2024-04-24T01:24:39.797039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:32.082427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794665+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:24:39.794665+0000","last_peered":"2024-04-24T01:24:39.794665+0000","last_clean":"2024-04-24T01:24:39.794665+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:24:39.794665+0000","last_undegraded":"2024-04-24T01:24:39.794665+0000","last_fullsized":"2024-04-24T01:24:39.794665+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:58.535319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789366+0000","last_change":"2024-04-24T01:24:02.755458+0000","last_active":"2024-04-24T01:24:39.789366+0000","last_peered":"2024-04-24T01:24:39.789366+0000","last_clean":"2024-04-24T01:24:39.789366+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:24:39.789366+0000","last_undegraded":"2024-04-24T01:24:39.789366+0000","last_fullsized":"2024-04-24T01:24:39.789366+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:22.994081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'100","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.994429+0000","last_change":"2024-04-24T01:24:04.761852+0000","last_active":"2024-04-24T01:27:16.994429+0000","last_peered":"2024-04-24T01:27:16.994429+0000","last_clean":"2024-04-24T01:27:16.994429+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:16.994429+0000","last_undegraded":"2024-04-24T01:27:16.994429+0000","last_fullsized":"2024-04-24T01:27:16.994429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:24:40.393254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841291+0000","last_change":"2024-04-24T01:24:06.769694+0000","last_active":"2024-04-24T01:24:39.841291+0000","last_peered":"2024-04-24T01:24:39.841291+0000","last_clean":"2024-04-24T01:24:39.841291+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:24:39.841291+0000","last_undegraded":"2024-04-24T01:24:39.841291+0000","last_fullsized":"2024-04-24T01:24:39.841291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:39:24.633566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.127833+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.127833+0000","last_peered":"2024-04-24T01:27:10.127833+0000","last_clean":"2024-04-24T01:27:10.127833+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.127833+0000","last_undegraded":"2024-04-24T01:27:10.127833+0000","last_fullsized":"2024-04-24T01:27:10.127833+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:29.020694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792868+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:24:39.792868+0000","last_peered":"2024-04-24T01:24:39.792868+0000","last_clean":"2024-04-24T01:24:39.792868+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:24:39.792868+0000","last_undegraded":"2024-04-24T01:24:39.792868+0000","last_fullsized":"2024-04-24T01:24:39.792868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:40.801219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'5","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984452+0000","last_change":"2024-04-24T01:24:00.738356+0000","last_active":"2024-04-24T01:26:23.984452+0000","last_peered":"2024-04-24T01:26:23.984452+0000","last_clean":"2024-04-24T01:26:23.984452+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:26:23.984452+0000","last_undegraded":"2024-04-24T01:26:23.984452+0000","last_fullsized":"2024-04-24T01:26:23.984452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:17:27.391392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791345+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:24:39.791345+0000","last_peered":"2024-04-24T01:24:39.791345+0000","last_clean":"2024-04-24T01:24:39.791345+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:24:39.791345+0000","last_undegraded":"2024-04-24T01:24:39.791345+0000","last_fullsized":"2024-04-24T01:24:39.791345+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:47.693790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795254+0000","last_change":"2024-04-24T01:24:02.754871+0000","last_active":"2024-04-24T01:24:39.795254+0000","last_peered":"2024-04-24T01:24:39.795254+0000","last_clean":"2024-04-24T01:24:39.795254+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:24:39.795254+0000","last_undegraded":"2024-04-24T01:24:39.795254+0000","last_fullsized":"2024-04-24T01:24:39.795254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:45:06.026635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'43","reported_seq":96,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.020510+0000","last_change":"2024-04-24T01:24:04.759052+0000","last_active":"2024-04-24T01:27:17.020510+0000","last_peered":"2024-04-24T01:27:17.020510+0000","last_clean":"2024-04-24T01:27:17.020510+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:17.020510+0000","last_undegraded":"2024-04-24T01:27:17.020510+0000","last_fullsized":"2024-04-24T01:27:17.020510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:10.084623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792919+0000","last_change":"2024-04-24T01:24:06.767554+0000","last_active":"2024-04-24T01:24:39.792919+0000","last_peered":"2024-04-24T01:24:39.792919+0000","last_clean":"2024-04-24T01:24:39.792919+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:24:39.792919+0000","last_undegraded":"2024-04-24T01:24:39.792919+0000","last_fullsized":"2024-04-24T01:24:39.792919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:09.395728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.739765+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:09.739765+0000","last_peered":"2024-04-24T01:27:09.739765+0000","last_clean":"2024-04-24T01:27:09.739765+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:09.739765+0000","last_undegraded":"2024-04-24T01:27:09.739765+0000","last_fullsized":"2024-04-24T01:27:09.739765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:31.337496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314081+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.314081+0000","last_peered":"2024-04-24T01:27:10.314081+0000","last_clean":"2024-04-24T01:27:10.314081+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.314081+0000","last_undegraded":"2024-04-24T01:27:10.314081+0000","last_fullsized":"2024-04-24T01:27:10.314081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:44:53.866516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.965255+0000","last_change":"2024-04-24T01:23:58.742514+0000","last_active":"2024-04-24T01:27:09.965255+0000","last_peered":"2024-04-24T01:27:09.965255+0000","last_clean":"2024-04-24T01:27:09.965255+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:09.965255+0000","last_undegraded":"2024-04-24T01:27:09.965255+0000","last_fullsized":"2024-04-24T01:27:09.965255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:45.516323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792781+0000","last_change":"2024-04-24T01:24:02.753260+0000","last_active":"2024-04-24T01:24:39.792781+0000","last_peered":"2024-04-24T01:24:39.792781+0000","last_clean":"2024-04-24T01:24:39.792781+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:24:39.792781+0000","last_undegraded":"2024-04-24T01:24:39.792781+0000","last_fullsized":"2024-04-24T01:24:39.792781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:18:34.774605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"33'6","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.660299+0000","last_change":"2024-04-24T01:24:04.746990+0000","last_active":"2024-04-24T01:27:09.660299+0000","last_peered":"2024-04-24T01:27:09.660299+0000","last_clean":"2024-04-24T01:27:09.660299+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:09.660299+0000","last_undegraded":"2024-04-24T01:27:09.660299+0000","last_fullsized":"2024-04-24T01:27:09.660299+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:56:37.157422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789266+0000","last_change":"2024-04-24T01:24:06.763815+0000","last_active":"2024-04-24T01:24:39.789266+0000","last_peered":"2024-04-24T01:24:39.789266+0000","last_clean":"2024-04-24T01:24:39.789266+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:24:39.789266+0000","last_undegraded":"2024-04-24T01:24:39.789266+0000","last_fullsized":"2024-04-24T01:24:39.789266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:48.425403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.639815+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:09.639815+0000","last_peered":"2024-04-24T01:26:09.639815+0000","last_clean":"2024-04-24T01:26:09.639815+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:09.639815+0000","last_undegraded":"2024-04-24T01:26:09.639815+0000","last_fullsized":"2024-04-24T01:26:09.639815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:28:43.903926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974876+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:26:21.974876+0000","last_peered":"2024-04-24T01:26:21.974876+0000","last_clean":"2024-04-24T01:26:21.974876+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:26:21.974876+0000","last_undegraded":"2024-04-24T01:26:21.974876+0000","last_fullsized":"2024-04-24T01:26:21.974876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:50.598466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793735+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:24:39.793735+0000","last_peered":"2024-04-24T01:24:39.793735+0000","last_clean":"2024-04-24T01:24:39.793735+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:24:39.793735+0000","last_undegraded":"2024-04-24T01:24:39.793735+0000","last_fullsized":"2024-04-24T01:24:39.793735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:26.434050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.788571+0000","last_change":"2024-04-24T01:24:02.751458+0000","last_active":"2024-04-24T01:24:39.788571+0000","last_peered":"2024-04-24T01:24:39.788571+0000","last_clean":"2024-04-24T01:24:39.788571+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:24:39.788571+0000","last_undegraded":"2024-04-24T01:24:39.788571+0000","last_fullsized":"2024-04-24T01:24:39.788571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:42.145688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.978784+0000","last_change":"2024-04-24T01:24:04.755755+0000","last_active":"2024-04-24T01:27:16.978784+0000","last_peered":"2024-04-24T01:27:16.978784+0000","last_clean":"2024-04-24T01:27:16.978784+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:16.978784+0000","last_undegraded":"2024-04-24T01:27:16.978784+0000","last_fullsized":"2024-04-24T01:27:16.978784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:33.640976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795040+0000","last_change":"2024-04-24T01:24:06.769210+0000","last_active":"2024-04-24T01:24:39.795040+0000","last_peered":"2024-04-24T01:24:39.795040+0000","last_clean":"2024-04-24T01:24:39.795040+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:24:39.795040+0000","last_undegraded":"2024-04-24T01:24:39.795040+0000","last_fullsized":"2024-04-24T01:24:39.795040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:03.675110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790701+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:24:39.790701+0000","last_peered":"2024-04-24T01:24:39.790701+0000","last_clean":"2024-04-24T01:24:39.790701+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:24:39.790701+0000","last_undegraded":"2024-04-24T01:24:39.790701+0000","last_fullsized":"2024-04-24T01:24:39.790701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:18.860876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.313998+0000","last_change":"2024-04-24T01:24:00.748273+0000","last_active":"2024-04-24T01:27:10.313998+0000","last_peered":"2024-04-24T01:27:10.313998+0000","last_clean":"2024-04-24T01:27:10.313998+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:10.313998+0000","last_undegraded":"2024-04-24T01:27:10.313998+0000","last_fullsized":"2024-04-24T01:27:10.313998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:25:39.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.349714+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:24:42.349714+0000","last_peered":"2024-04-24T01:24:42.349714+0000","last_clean":"2024-04-24T01:24:42.349714+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:24:42.349714+0000","last_undegraded":"2024-04-24T01:24:42.349714+0000","last_fullsized":"2024-04-24T01:24:42.349714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:26:55.545071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794708+0000","last_change":"2024-04-24T01:24:02.753232+0000","last_active":"2024-04-24T01:24:39.794708+0000","last_peered":"2024-04-24T01:24:39.794708+0000","last_clean":"2024-04-24T01:24:39.794708+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:24:39.794708+0000","last_undegraded":"2024-04-24T01:24:39.794708+0000","last_fullsized":"2024-04-24T01:24:39.794708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:13:59.654655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'33","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.969438+0000","last_change":"2024-04-24T01:24:04.749427+0000","last_active":"2024-04-24T01:27:16.969438+0000","last_peered":"2024-04-24T01:27:16.969438+0000","last_clean":"2024-04-24T01:27:16.969438+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:16.969438+0000","last_undegraded":"2024-04-24T01:27:16.969438+0000","last_fullsized":"2024-04-24T01:27:16.969438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:20.707833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790257+0000","last_change":"2024-04-24T01:24:06.765858+0000","last_active":"2024-04-24T01:24:39.790257+0000","last_peered":"2024-04-24T01:24:39.790257+0000","last_clean":"2024-04-24T01:24:39.790257+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:24:39.790257+0000","last_undegraded":"2024-04-24T01:24:39.790257+0000","last_fullsized":"2024-04-24T01:24:39.790257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:41.364167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.712721+0000","last_change":"2024-04-24T01:24:00.736176+0000","last_active":"2024-04-24T01:24:42.712721+0000","last_peered":"2024-04-24T01:24:42.712721+0000","last_clean":"2024-04-24T01:24:42.712721+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:24:42.712721+0000","last_undegraded":"2024-04-24T01:24:42.712721+0000","last_fullsized":"2024-04-24T01:24:42.712721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:38:43.962305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789625+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:24:39.789625+0000","last_peered":"2024-04-24T01:24:39.789625+0000","last_clean":"2024-04-24T01:24:39.789625+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:24:39.789625+0000","last_undegraded":"2024-04-24T01:24:39.789625+0000","last_fullsized":"2024-04-24T01:24:39.789625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:32.786170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843577+0000","last_change":"2024-04-24T01:24:02.752935+0000","last_active":"2024-04-24T01:24:39.843577+0000","last_peered":"2024-04-24T01:24:39.843577+0000","last_clean":"2024-04-24T01:24:39.843577+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:24:39.843577+0000","last_undegraded":"2024-04-24T01:24:39.843577+0000","last_fullsized":"2024-04-24T01:24:39.843577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:47:05.280503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'66","reported_seq":136,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.966164+0000","last_change":"2024-04-24T01:24:04.754439+0000","last_active":"2024-04-24T01:27:16.966164+0000","last_peered":"2024-04-24T01:27:16.966164+0000","last_clean":"2024-04-24T01:27:16.966164+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:16.966164+0000","last_undegraded":"2024-04-24T01:27:16.966164+0000","last_fullsized":"2024-04-24T01:27:16.966164+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:32.262142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790895+0000","last_change":"2024-04-24T01:24:06.765083+0000","last_active":"2024-04-24T01:24:39.790895+0000","last_peered":"2024-04-24T01:24:39.790895+0000","last_clean":"2024-04-24T01:24:39.790895+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:24:39.790895+0000","last_undegraded":"2024-04-24T01:24:39.790895+0000","last_fullsized":"2024-04-24T01:24:39.790895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:11.672040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.396373+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.396373+0000","last_peered":"2024-04-24T01:27:10.396373+0000","last_clean":"2024-04-24T01:27:10.396373+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.396373+0000","last_undegraded":"2024-04-24T01:27:10.396373+0000","last_fullsized":"2024-04-24T01:27:10.396373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:54:59.796477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314066+0000","last_change":"2024-04-24T01:24:00.746542+0000","last_active":"2024-04-24T01:27:10.314066+0000","last_peered":"2024-04-24T01:27:10.314066+0000","last_clean":"2024-04-24T01:27:10.314066+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:10.314066+0000","last_undegraded":"2024-04-24T01:27:10.314066+0000","last_fullsized":"2024-04-24T01:27:10.314066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:34:54.816912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.984095+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:27:09.984095+0000","last_peered":"2024-04-24T01:27:09.984095+0000","last_clean":"2024-04-24T01:27:09.984095+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:27:09.984095+0000","last_undegraded":"2024-04-24T01:27:09.984095+0000","last_fullsized":"2024-04-24T01:27:09.984095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793348+0000","last_change":"2024-04-24T01:24:02.750800+0000","last_active":"2024-04-24T01:24:39.793348+0000","last_peered":"2024-04-24T01:24:39.793348+0000","last_clean":"2024-04-24T01:24:39.793348+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:24:39.793348+0000","last_undegraded":"2024-04-24T01:24:39.793348+0000","last_fullsized":"2024-04-24T01:24:39.793348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:37.216889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'39","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.972647+0000","last_change":"2024-04-24T01:24:04.758945+0000","last_active":"2024-04-24T01:27:16.972647+0000","last_peered":"2024-04-24T01:27:16.972647+0000","last_clean":"2024-04-24T01:27:16.972647+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:16.972647+0000","last_undegraded":"2024-04-24T01:27:16.972647+0000","last_fullsized":"2024-04-24T01:27:16.972647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:50.691232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796689+0000","last_change":"2024-04-24T01:24:06.771761+0000","last_active":"2024-04-24T01:24:39.796689+0000","last_peered":"2024-04-24T01:24:39.796689+0000","last_clean":"2024-04-24T01:24:39.796689+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:24:39.796689+0000","last_undegraded":"2024-04-24T01:24:39.796689+0000","last_fullsized":"2024-04-24T01:24:39.796689+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:35.392589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792017+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:24:39.792017+0000","last_peered":"2024-04-24T01:24:39.792017+0000","last_clean":"2024-04-24T01:24:39.792017+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:24:39.792017+0000","last_undegraded":"2024-04-24T01:24:39.792017+0000","last_fullsized":"2024-04-24T01:24:39.792017+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:33.305911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.794785+0000","last_change":"2024-04-24T01:24:00.748328+0000","last_active":"2024-04-24T01:24:39.794785+0000","last_peered":"2024-04-24T01:24:39.794785+0000","last_clean":"2024-04-24T01:24:39.794785+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:24:39.794785+0000","last_undegraded":"2024-04-24T01:24:39.794785+0000","last_fullsized":"2024-04-24T01:24:39.794785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:32.401459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795365+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:24:39.795365+0000","last_peered":"2024-04-24T01:24:39.795365+0000","last_clean":"2024-04-24T01:24:39.795365+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:24:39.795365+0000","last_undegraded":"2024-04-24T01:24:39.795365+0000","last_fullsized":"2024-04-24T01:24:39.795365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:35:49.339231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791825+0000","last_change":"2024-04-24T01:24:02.751213+0000","last_active":"2024-04-24T01:24:39.791825+0000","last_peered":"2024-04-24T01:24:39.791825+0000","last_clean":"2024-04-24T01:24:39.791825+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:24:39.791825+0000","last_undegraded":"2024-04-24T01:24:39.791825+0000","last_fullsized":"2024-04-24T01:24:39.791825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:17.078503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'41","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.924271+0000","last_change":"2024-04-24T01:24:04.759228+0000","last_active":"2024-04-24T01:27:16.924271+0000","last_peered":"2024-04-24T01:27:16.924271+0000","last_clean":"2024-04-24T01:27:16.924271+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:16.924271+0000","last_undegraded":"2024-04-24T01:27:16.924271+0000","last_fullsized":"2024-04-24T01:27:16.924271+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:35.649948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842771+0000","last_change":"2024-04-24T01:24:06.767031+0000","last_active":"2024-04-24T01:24:39.842771+0000","last_peered":"2024-04-24T01:24:39.842771+0000","last_clean":"2024-04-24T01:24:39.842771+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:24:39.842771+0000","last_undegraded":"2024-04-24T01:24:39.842771+0000","last_fullsized":"2024-04-24T01:24:39.842771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:10.767999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.638179+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:09.638179+0000","last_peered":"2024-04-24T01:26:09.638179+0000","last_clean":"2024-04-24T01:26:09.638179+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:09.638179+0000","last_undegraded":"2024-04-24T01:26:09.638179+0000","last_fullsized":"2024-04-24T01:26:09.638179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:34.213505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.370705+0000","last_change":"2024-04-24T01:24:00.732301+0000","last_active":"2024-04-24T01:26:06.370705+0000","last_peered":"2024-04-24T01:26:06.370705+0000","last_clean":"2024-04-24T01:26:06.370705+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:26:06.370705+0000","last_undegraded":"2024-04-24T01:26:06.370705+0000","last_fullsized":"2024-04-24T01:26:06.370705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:05:24.753026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791433+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:24:39.791433+0000","last_peered":"2024-04-24T01:24:39.791433+0000","last_clean":"2024-04-24T01:24:39.791433+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:24:39.791433+0000","last_undegraded":"2024-04-24T01:24:39.791433+0000","last_fullsized":"2024-04-24T01:24:39.791433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:26.702951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797556+0000","last_change":"2024-04-24T01:24:02.753145+0000","last_active":"2024-04-24T01:24:39.797556+0000","last_peered":"2024-04-24T01:24:39.797556+0000","last_clean":"2024-04-24T01:24:39.797556+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:24:39.797556+0000","last_undegraded":"2024-04-24T01:24:39.797556+0000","last_fullsized":"2024-04-24T01:24:39.797556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:47.630785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'16","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790507+0000","last_change":"2024-04-24T01:24:04.759523+0000","last_active":"2024-04-24T01:24:39.790507+0000","last_peered":"2024-04-24T01:24:39.790507+0000","last_clean":"2024-04-24T01:24:39.790507+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:24:39.790507+0000","last_undegraded":"2024-04-24T01:24:39.790507+0000","last_fullsized":"2024-04-24T01:24:39.790507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:22:53.916052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":378,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.865729+0000","last_change":"2024-04-24T01:24:06.769994+0000","last_active":"2024-04-24T01:27:16.865729+0000","last_peered":"2024-04-24T01:27:16.865729+0000","last_clean":"2024-04-24T01:27:16.865729+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:16.865729+0000","last_undegraded":"2024-04-24T01:27:16.865729+0000","last_fullsized":"2024-04-24T01:27:16.865729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:30:03.784242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792482+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:24:39.792482+0000","last_peered":"2024-04-24T01:24:39.792482+0000","last_clean":"2024-04-24T01:24:39.792482+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:24:39.792482+0000","last_undegraded":"2024-04-24T01:24:39.792482+0000","last_fullsized":"2024-04-24T01:24:39.792482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:31:40.559182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.343653+0000","last_change":"2024-04-24T01:24:00.732138+0000","last_active":"2024-04-24T01:27:10.343653+0000","last_peered":"2024-04-24T01:27:10.343653+0000","last_clean":"2024-04-24T01:27:10.343653+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:10.343653+0000","last_undegraded":"2024-04-24T01:27:10.343653+0000","last_fullsized":"2024-04-24T01:27:10.343653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:59.208377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894122+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:24:41.894122+0000","last_peered":"2024-04-24T01:24:41.894122+0000","last_clean":"2024-04-24T01:24:41.894122+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:24:41.894122+0000","last_undegraded":"2024-04-24T01:24:41.894122+0000","last_fullsized":"2024-04-24T01:24:41.894122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.795147+0000","last_change":"2024-04-24T01:24:02.755459+0000","last_active":"2024-04-24T01:24:39.795147+0000","last_peered":"2024-04-24T01:24:39.795147+0000","last_clean":"2024-04-24T01:24:39.795147+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:24:39.795147+0000","last_undegraded":"2024-04-24T01:24:39.795147+0000","last_fullsized":"2024-04-24T01:24:39.795147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:03.880496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'65","reported_seq":138,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.944489+0000","last_change":"2024-04-24T01:24:04.753792+0000","last_active":"2024-04-24T01:27:16.944489+0000","last_peered":"2024-04-24T01:27:16.944489+0000","last_clean":"2024-04-24T01:27:16.944489+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:16.944489+0000","last_undegraded":"2024-04-24T01:27:16.944489+0000","last_fullsized":"2024-04-24T01:27:16.944489+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:36.421947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841092+0000","last_change":"2024-04-24T01:24:06.770663+0000","last_active":"2024-04-24T01:24:39.841092+0000","last_peered":"2024-04-24T01:24:39.841092+0000","last_clean":"2024-04-24T01:24:39.841092+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:24:39.841092+0000","last_undegraded":"2024-04-24T01:24:39.841092+0000","last_fullsized":"2024-04-24T01:24:39.841092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:13:20.491695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797448+0000","last_change":"2024-04-24T01:24:08.769131+0000","last_active":"2024-04-24T01:24:39.797448+0000","last_peered":"2024-04-24T01:24:39.797448+0000","last_clean":"2024-04-24T01:24:39.797448+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:24:39.797448+0000","last_undegraded":"2024-04-24T01:24:39.797448+0000","last_fullsized":"2024-04-24T01:24:39.797448+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:14.098220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311172+0000","last_change":"2024-04-24T01:24:00.729678+0000","last_active":"2024-04-24T01:27:10.311172+0000","last_peered":"2024-04-24T01:27:10.311172+0000","last_clean":"2024-04-24T01:27:10.311172+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:10.311172+0000","last_undegraded":"2024-04-24T01:27:10.311172+0000","last_fullsized":"2024-04-24T01:27:10.311172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.631103+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:25:25.631103+0000","last_peered":"2024-04-24T01:25:25.631103+0000","last_clean":"2024-04-24T01:25:25.631103+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:25:25.631103+0000","last_undegraded":"2024-04-24T01:25:25.631103+0000","last_fullsized":"2024-04-24T01:25:25.631103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:59:50.919310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791338+0000","last_change":"2024-04-24T01:24:02.753343+0000","last_active":"2024-04-24T01:24:39.791338+0000","last_peered":"2024-04-24T01:24:39.791338+0000","last_clean":"2024-04-24T01:24:39.791338+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:24:39.791338+0000","last_undegraded":"2024-04-24T01:24:39.791338+0000","last_fullsized":"2024-04-24T01:24:39.791338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:32.027557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'40","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.947862+0000","last_change":"2024-04-24T01:24:04.759090+0000","last_active":"2024-04-24T01:27:16.947862+0000","last_peered":"2024-04-24T01:27:16.947862+0000","last_clean":"2024-04-24T01:27:16.947862+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:16.947862+0000","last_undegraded":"2024-04-24T01:27:16.947862+0000","last_fullsized":"2024-04-24T01:27:16.947862+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:04:43.590882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792417+0000","last_change":"2024-04-24T01:24:06.765993+0000","last_active":"2024-04-24T01:24:39.792417+0000","last_peered":"2024-04-24T01:24:39.792417+0000","last_clean":"2024-04-24T01:24:39.792417+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:24:39.792417+0000","last_undegraded":"2024-04-24T01:24:39.792417+0000","last_fullsized":"2024-04-24T01:24:39.792417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:24:41.757073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.792239+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:24:39.792239+0000","last_peered":"2024-04-24T01:24:39.792239+0000","last_clean":"2024-04-24T01:24:39.792239+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:24:39.792239+0000","last_undegraded":"2024-04-24T01:24:39.792239+0000","last_fullsized":"2024-04-24T01:24:39.792239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:19:09.221221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985926+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:26:28.985926+0000","last_peered":"2024-04-24T01:26:28.985926+0000","last_clean":"2024-04-24T01:26:28.985926+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:26:28.985926+0000","last_undegraded":"2024-04-24T01:26:28.985926+0000","last_fullsized":"2024-04-24T01:26:28.985926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:34.177576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843706+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:24:39.843706+0000","last_peered":"2024-04-24T01:24:39.843706+0000","last_clean":"2024-04-24T01:24:39.843706+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:24:39.843706+0000","last_undegraded":"2024-04-24T01:24:39.843706+0000","last_fullsized":"2024-04-24T01:24:39.843706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:10.215840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789419+0000","last_change":"2024-04-24T01:24:02.756957+0000","last_active":"2024-04-24T01:24:39.789419+0000","last_peered":"2024-04-24T01:24:39.789419+0000","last_clean":"2024-04-24T01:24:39.789419+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:24:39.789419+0000","last_undegraded":"2024-04-24T01:24:39.789419+0000","last_fullsized":"2024-04-24T01:24:39.789419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:08:38.961968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'35","reported_seq":85,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.917183+0000","last_change":"2024-04-24T01:24:04.761512+0000","last_active":"2024-04-24T01:27:16.917183+0000","last_peered":"2024-04-24T01:27:16.917183+0000","last_clean":"2024-04-24T01:27:16.917183+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:16.917183+0000","last_undegraded":"2024-04-24T01:27:16.917183+0000","last_fullsized":"2024-04-24T01:27:16.917183+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:33.309938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793397+0000","last_change":"2024-04-24T01:24:06.770228+0000","last_active":"2024-04-24T01:24:39.793397+0000","last_peered":"2024-04-24T01:24:39.793397+0000","last_clean":"2024-04-24T01:24:39.793397+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:24:39.793397+0000","last_undegraded":"2024-04-24T01:24:39.793397+0000","last_fullsized":"2024-04-24T01:24:39.793397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:18:11.286272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.158027+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:08.158027+0000","last_peered":"2024-04-24T01:26:08.158027+0000","last_clean":"2024-04-24T01:26:08.158027+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:08.158027+0000","last_undegraded":"2024-04-24T01:26:08.158027+0000","last_fullsized":"2024-04-24T01:26:08.158027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:36:44.996906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.881602+0000","last_change":"2024-04-24T01:24:00.730610+0000","last_active":"2024-04-24T01:25:25.881602+0000","last_peered":"2024-04-24T01:25:25.881602+0000","last_clean":"2024-04-24T01:25:25.881602+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:25:25.881602+0000","last_undegraded":"2024-04-24T01:25:25.881602+0000","last_fullsized":"2024-04-24T01:25:25.881602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:38.644402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.797330+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:24:39.797330+0000","last_peered":"2024-04-24T01:24:39.797330+0000","last_clean":"2024-04-24T01:24:39.797330+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:24:39.797330+0000","last_undegraded":"2024-04-24T01:24:39.797330+0000","last_fullsized":"2024-04-24T01:24:39.797330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:22.880245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'2","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.777248+0000","last_change":"2024-04-24T01:24:02.758075+0000","last_active":"2024-04-24T01:26:06.777248+0000","last_peered":"2024-04-24T01:26:06.777248+0000","last_clean":"2024-04-24T01:26:06.777248+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:26:06.777248+0000","last_undegraded":"2024-04-24T01:26:06.777248+0000","last_fullsized":"2024-04-24T01:26:06.777248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:03.864248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'48","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.927682+0000","last_change":"2024-04-24T01:24:04.761785+0000","last_active":"2024-04-24T01:27:16.927682+0000","last_peered":"2024-04-24T01:27:16.927682+0000","last_clean":"2024-04-24T01:27:16.927682+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:16.927682+0000","last_undegraded":"2024-04-24T01:27:16.927682+0000","last_fullsized":"2024-04-24T01:27:16.927682+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:37:58.149475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.842218+0000","last_change":"2024-04-24T01:24:06.770604+0000","last_active":"2024-04-24T01:24:39.842218+0000","last_peered":"2024-04-24T01:24:39.842218+0000","last_clean":"2024-04-24T01:24:39.842218+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:24:39.842218+0000","last_undegraded":"2024-04-24T01:24:39.842218+0000","last_fullsized":"2024-04-24T01:24:39.842218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:50:16.930856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.160611+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:08.160611+0000","last_peered":"2024-04-24T01:26:08.160611+0000","last_clean":"2024-04-24T01:26:08.160611+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:08.160611+0000","last_undegraded":"2024-04-24T01:26:08.160611+0000","last_fullsized":"2024-04-24T01:26:08.160611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:18.783056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.642790+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:09.642790+0000","last_peered":"2024-04-24T01:26:09.642790+0000","last_clean":"2024-04-24T01:26:09.642790+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:09.642790+0000","last_undegraded":"2024-04-24T01:26:09.642790+0000","last_fullsized":"2024-04-24T01:26:09.642790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:11.472098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.972568+0000","last_change":"2024-04-24T01:23:58.747335+0000","last_active":"2024-04-24T01:27:09.972568+0000","last_peered":"2024-04-24T01:27:09.972568+0000","last_clean":"2024-04-24T01:27:09.972568+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:09.972568+0000","last_undegraded":"2024-04-24T01:27:09.972568+0000","last_fullsized":"2024-04-24T01:27:09.972568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:28.014557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.641524+0000","last_change":"2024-04-24T01:24:00.732134+0000","last_active":"2024-04-24T01:25:25.641524+0000","last_peered":"2024-04-24T01:25:25.641524+0000","last_clean":"2024-04-24T01:25:25.641524+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:25:25.641524+0000","last_undegraded":"2024-04-24T01:25:25.641524+0000","last_fullsized":"2024-04-24T01:25:25.641524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:12.420444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:41.894175+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:24:41.894175+0000","last_peered":"2024-04-24T01:24:41.894175+0000","last_clean":"2024-04-24T01:24:41.894175+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:24:41.894175+0000","last_undegraded":"2024-04-24T01:24:41.894175+0000","last_fullsized":"2024-04-24T01:24:41.894175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:34.164253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124466+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.124466+0000","last_peered":"2024-04-24T01:27:10.124466+0000","last_clean":"2024-04-24T01:27:10.124466+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.124466+0000","last_undegraded":"2024-04-24T01:27:10.124466+0000","last_fullsized":"2024-04-24T01:27:10.124466+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:45.623313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793654+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:24:39.793654+0000","last_peered":"2024-04-24T01:24:39.793654+0000","last_clean":"2024-04-24T01:24:39.793654+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:24:39.793654+0000","last_undegraded":"2024-04-24T01:24:39.793654+0000","last_fullsized":"2024-04-24T01:24:39.793654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:58:36.636908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124201+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.124201+0000","last_peered":"2024-04-24T01:27:10.124201+0000","last_clean":"2024-04-24T01:27:10.124201+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.124201+0000","last_undegraded":"2024-04-24T01:27:10.124201+0000","last_fullsized":"2024-04-24T01:27:10.124201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:23.382109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843929+0000","last_change":"2024-04-24T01:23:58.747256+0000","last_active":"2024-04-24T01:24:39.843929+0000","last_peered":"2024-04-24T01:24:39.843929+0000","last_clean":"2024-04-24T01:24:39.843929+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:24:39.843929+0000","last_undegraded":"2024-04-24T01:24:39.843929+0000","last_fullsized":"2024-04-24T01:24:39.843929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:24.901113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311360+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.311360+0000","last_peered":"2024-04-24T01:27:10.311360+0000","last_clean":"2024-04-24T01:27:10.311360+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.311360+0000","last_undegraded":"2024-04-24T01:27:10.311360+0000","last_fullsized":"2024-04-24T01:27:10.311360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:23.445860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.843749+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:24:39.843749+0000","last_peered":"2024-04-24T01:24:39.843749+0000","last_clean":"2024-04-24T01:24:39.843749+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:24:39.843749+0000","last_undegraded":"2024-04-24T01:24:39.843749+0000","last_fullsized":"2024-04-24T01:24:39.843749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:12:35.046540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.262087+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.262087+0000","last_peered":"2024-04-24T01:27:10.262087+0000","last_clean":"2024-04-24T01:27:10.262087+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.262087+0000","last_undegraded":"2024-04-24T01:27:10.262087+0000","last_fullsized":"2024-04-24T01:27:10.262087+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:17:40.138216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.541257+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.541257+0000","last_peered":"2024-04-24T01:26:09.541257+0000","last_clean":"2024-04-24T01:26:09.541257+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.541257+0000","last_undegraded":"2024-04-24T01:26:09.541257+0000","last_fullsized":"2024-04-24T01:26:09.541257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:25.879998+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:25:25.879998+0000","last_peered":"2024-04-24T01:25:25.879998+0000","last_clean":"2024-04-24T01:25:25.879998+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:25:25.879998+0000","last_undegraded":"2024-04-24T01:25:25.879998+0000","last_fullsized":"2024-04-24T01:25:25.879998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:44:09.030361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.338702+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.338702+0000","last_peered":"2024-04-24T01:27:10.338702+0000","last_clean":"2024-04-24T01:27:10.338702+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.338702+0000","last_undegraded":"2024-04-24T01:27:10.338702+0000","last_fullsized":"2024-04-24T01:27:10.338702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:10.351052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.125794+0000","last_change":"2024-04-24T01:24:00.744090+0000","last_active":"2024-04-24T01:27:10.125794+0000","last_peered":"2024-04-24T01:27:10.125794+0000","last_clean":"2024-04-24T01:27:10.125794+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:10.125794+0000","last_undegraded":"2024-04-24T01:27:10.125794+0000","last_fullsized":"2024-04-24T01:27:10.125794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:35.200859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.480239+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:09.480239+0000","last_peered":"2024-04-24T01:26:09.480239+0000","last_clean":"2024-04-24T01:26:09.480239+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:09.480239+0000","last_undegraded":"2024-04-24T01:26:09.480239+0000","last_fullsized":"2024-04-24T01:26:09.480239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:34:44.713837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.314098+0000","last_change":"2024-04-24T01:24:00.745364+0000","last_active":"2024-04-24T01:27:10.314098+0000","last_peered":"2024-04-24T01:27:10.314098+0000","last_clean":"2024-04-24T01:27:10.314098+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:10.314098+0000","last_undegraded":"2024-04-24T01:27:10.314098+0000","last_fullsized":"2024-04-24T01:27:10.314098+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:57:04.207670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.789907+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:24:39.789907+0000","last_peered":"2024-04-24T01:24:39.789907+0000","last_clean":"2024-04-24T01:24:39.789907+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:24:39.789907+0000","last_undegraded":"2024-04-24T01:24:39.789907+0000","last_fullsized":"2024-04-24T01:24:39.789907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:41.471255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.040648+0000","last_change":"2024-04-24T01:24:00.738594+0000","last_active":"2024-04-24T01:27:10.040648+0000","last_peered":"2024-04-24T01:27:10.040648+0000","last_clean":"2024-04-24T01:27:10.040648+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:10.040648+0000","last_undegraded":"2024-04-24T01:27:10.040648+0000","last_fullsized":"2024-04-24T01:27:10.040648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:05.644113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.972565+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:24:42.972565+0000","last_peered":"2024-04-24T01:24:42.972565+0000","last_clean":"2024-04-24T01:24:42.972565+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:24:42.972565+0000","last_undegraded":"2024-04-24T01:24:42.972565+0000","last_fullsized":"2024-04-24T01:24:42.972565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:08.200562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.124410+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.124410+0000","last_peered":"2024-04-24T01:27:10.124410+0000","last_clean":"2024-04-24T01:27:10.124410+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.124410+0000","last_undegraded":"2024-04-24T01:27:10.124410+0000","last_fullsized":"2024-04-24T01:27:10.124410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:06:37.307723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252871+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.252871+0000","last_peered":"2024-04-24T01:27:10.252871+0000","last_clean":"2024-04-24T01:27:10.252871+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.252871+0000","last_undegraded":"2024-04-24T01:27:10.252871+0000","last_fullsized":"2024-04-24T01:27:10.252871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:39.730372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.311477+0000","last_change":"2024-04-24T01:24:00.739108+0000","last_active":"2024-04-24T01:27:10.311477+0000","last_peered":"2024-04-24T01:27:10.311477+0000","last_clean":"2024-04-24T01:27:10.311477+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:10.311477+0000","last_undegraded":"2024-04-24T01:27:10.311477+0000","last_fullsized":"2024-04-24T01:27:10.311477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:35.209417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.796505+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:24:39.796505+0000","last_peered":"2024-04-24T01:24:39.796505+0000","last_clean":"2024-04-24T01:24:39.796505+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:24:39.796505+0000","last_undegraded":"2024-04-24T01:24:39.796505+0000","last_fullsized":"2024-04-24T01:24:39.796505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:24.212604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:42.984070+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:24:42.984070+0000","last_peered":"2024-04-24T01:24:42.984070+0000","last_clean":"2024-04-24T01:24:42.984070+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:24:42.984070+0000","last_undegraded":"2024-04-24T01:24:42.984070+0000","last_fullsized":"2024-04-24T01:24:42.984070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:27.358590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791579+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:24:39.791579+0000","last_peered":"2024-04-24T01:24:39.791579+0000","last_clean":"2024-04-24T01:24:39.791579+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:24:39.791579+0000","last_undegraded":"2024-04-24T01:24:39.791579+0000","last_fullsized":"2024-04-24T01:24:39.791579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:00:17.843103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'7","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983736+0000","last_change":"2024-04-24T01:24:00.745475+0000","last_active":"2024-04-24T01:26:18.983736+0000","last_peered":"2024-04-24T01:26:18.983736+0000","last_clean":"2024-04-24T01:26:18.983736+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:26:18.983736+0000","last_undegraded":"2024-04-24T01:26:18.983736+0000","last_fullsized":"2024-04-24T01:26:18.983736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:13:30.020085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793966+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:24:39.793966+0000","last_peered":"2024-04-24T01:24:39.793966+0000","last_clean":"2024-04-24T01:24:39.793966+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:24:39.793966+0000","last_undegraded":"2024-04-24T01:24:39.793966+0000","last_fullsized":"2024-04-24T01:24:39.793966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:31.252182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350752+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350752+0000","last_peered":"2024-04-24T01:27:10.350752+0000","last_clean":"2024-04-24T01:27:10.350752+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350752+0000","last_undegraded":"2024-04-24T01:27:10.350752+0000","last_fullsized":"2024-04-24T01:27:10.350752+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:54:52.523705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.793919+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:24:39.793919+0000","last_peered":"2024-04-24T01:24:39.793919+0000","last_clean":"2024-04-24T01:24:39.793919+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:24:39.793919+0000","last_undegraded":"2024-04-24T01:24:39.793919+0000","last_fullsized":"2024-04-24T01:24:39.793919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:10:43.609139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'11","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349775+0000","last_change":"2024-04-24T01:24:00.739611+0000","last_active":"2024-04-24T01:27:10.349775+0000","last_peered":"2024-04-24T01:27:10.349775+0000","last_clean":"2024-04-24T01:27:10.349775+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:10.349775+0000","last_undegraded":"2024-04-24T01:27:10.349775+0000","last_fullsized":"2024-04-24T01:27:10.349775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:19:58.147363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.790857+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:24:39.790857+0000","last_peered":"2024-04-24T01:24:39.790857+0000","last_clean":"2024-04-24T01:24:39.790857+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:24:39.790857+0000","last_undegraded":"2024-04-24T01:24:39.790857+0000","last_fullsized":"2024-04-24T01:24:39.790857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:55.041236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.791604+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:24:39.791604+0000","last_peered":"2024-04-24T01:24:39.791604+0000","last_clean":"2024-04-24T01:24:39.791604+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:24:39.791604+0000","last_undegraded":"2024-04-24T01:24:39.791604+0000","last_fullsized":"2024-04-24T01:24:39.791604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:44:25.351096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.261937+0000","last_change":"2024-04-24T01:24:00.746896+0000","last_active":"2024-04-24T01:27:10.261937+0000","last_peered":"2024-04-24T01:27:10.261937+0000","last_clean":"2024-04-24T01:27:10.261937+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:10.261937+0000","last_undegraded":"2024-04-24T01:27:10.261937+0000","last_fullsized":"2024-04-24T01:27:10.261937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:49.762286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:24:39.841409+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:24:39.841409+0000","last_peered":"2024-04-24T01:24:39.841409+0000","last_clean":"2024-04-24T01:24:39.841409+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:24:39.841409+0000","last_undegraded":"2024-04-24T01:24:39.841409+0000","last_fullsized":"2024-04-24T01:24:39.841409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:00:15.930526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.375679+0000","last_change":"2024-04-24T01:24:00.743656+0000","last_active":"2024-04-24T01:26:06.375679+0000","last_peered":"2024-04-24T01:26:06.375679+0000","last_clean":"2024-04-24T01:26:06.375679+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:26:06.375679+0000","last_undegraded":"2024-04-24T01:26:06.375679+0000","last_fullsized":"2024-04-24T01:26:06.375679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:23.273019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2277,"ondisk_log_size":2277,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1883,"num_read_kb":1648,"num_write":789,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1570,"ondisk_log_size":1570,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":87,"num_write":315,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640304,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39964,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331876,"statfs":{"total":96636764160,"available":96595841024,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640302,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36348,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335492,"statfs":{"total":96636764160,"available":96599543808,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48344,"kb_used_data":8848,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323496,"statfs":{"total":96636764160,"available":96587259904,"internally_reserved":0,"allocated":9060352,"data_stored":8756282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:27:21.423 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.423 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.423 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.423 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.423 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.424 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.425 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.426 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.427 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.428 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.429 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.430 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.431 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.432 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.433 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.433 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.433 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.433 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.434 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.434 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.434 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.434 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.435 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.435 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.435 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.435 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.436 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.436 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.436 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.437 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.437 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.437 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.437 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.438 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:23:44.656300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=44, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.438 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.438 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.438 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.439 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.439 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.439 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.439 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.440 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.440 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.440 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.440 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.441 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.441 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.441 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.441 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.441 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.442 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.442 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.442 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.442 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.443 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.443 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.443 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.443 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.444 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.444 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.444 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.444 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.445 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.445 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.445 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.445 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.445 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.446 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.446 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.446 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.447 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.447 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.447 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.448 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.448 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.448 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.448 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.449 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.449 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.449 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.450 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.450 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.450 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.451 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.451 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.451 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.451 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.452 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.452 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.453 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.453 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.453 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.453 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.454 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.454 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.454 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.455 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.455 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.455 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.456 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.456 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.456 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.457 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.457 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.457 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.458 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.458 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.459 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.459 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.459 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.460 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.460 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.460 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.461 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.461 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.461 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.461 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.461 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.462 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.462 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.462 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.462 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.463 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.463 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.463 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.464 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.464 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.464 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.464 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.465 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.465 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.465 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.465 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.465 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.466 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.466 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.466 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.466 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.467 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.467 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.467 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.467 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.468 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.468 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.468 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.468 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.468 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.469 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.469 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.469 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.469 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.470 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.470 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.470 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.470 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.471 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.471 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.471 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.471 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.472 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.472 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.472 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.472 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.472 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.473 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.473 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.473 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.473 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.474 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.474 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.474 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.474 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.475 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.475 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.475 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.475 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.476 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.476 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.476 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.476 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.476 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.477 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.477 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.478 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.478 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.478 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.478 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.479 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.479 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.479 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.479 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.480 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.480 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.480 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.480 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.481 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.481 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:21.481 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:27:22.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-24T01:27:41.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e5a074640 1 Processor -- start 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e5a074640 1 -- start start 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e5a074640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e54096430 0x7f2e54096810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e5a074640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e54098800 con 0x7f2e54071090 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e5a074640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f2e54071930 con 0x7f2e54096430 2024-04-24T01:27:41.591 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e537fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f2e54096430 0x7f2e54096810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e52ffd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f2e54071090 0x7f2e5406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:55448/0 (socket says 172.21.15.142:55448) 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.589+0000 7f2e52ffd640 1 -- 172.21.15.142:0/2879246684 learned_addr learned my addr 172.21.15.142:0/2879246684 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.590+0000 7f2e537fe640 1 -- 172.21.15.142:0/2879246684 >> v1:172.21.15.142:6789/0 conn(0x7f2e54071090 legacy=0x7f2e5406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.590+0000 7f2e537fe640 1 -- 172.21.15.142:0/2879246684 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e54071f50 con 0x7f2e54096430 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.590+0000 7f2e537fe640 1 --2- 172.21.15.142:0/2879246684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54096430 0x7f2e54096810 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009720 tx=0x7f2e4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781a01a0065b1bb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.590+0000 7f2e527fc640 1 -- 172.21.15.142:0/2879246684 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e440316d0 con 0x7f2e54096430 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e527fc640 1 -- 172.21.15.142:0/2879246684 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44037070 con 0x7f2e54096430 2024-04-24T01:27:41.592 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e527fc640 1 -- 172.21.15.142:0/2879246684 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e440319c0 con 0x7f2e54096430 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 -- 172.21.15.142:0/2879246684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54096430 msgr2=0x7f2e54096810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 --2- 172.21.15.142:0/2879246684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54096430 0x7f2e54096810 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009720 tx=0x7f2e4402b840 comp rx=0 tx=0).stop 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 -- 172.21.15.142:0/2879246684 shutdown_connections 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 --2- 172.21.15.142:0/2879246684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54096430 0x7f2e54096810 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 -- 172.21.15.142:0/2879246684 >> 172.21.15.142:0/2879246684 conn(0x7f2e54099680 msgr2=0x7f2e54099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 -- 172.21.15.142:0/2879246684 shutdown_connections 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.591+0000 7f2e5a074640 1 -- 172.21.15.142:0/2879246684 wait complete. 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.592+0000 7f2e5a074640 1 Processor -- start 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.592+0000 7f2e5a074640 1 -- start start 2024-04-24T01:27:41.598 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e5a074640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e5a074640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f2e54096d50 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e537fe640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48074/0 (socket says 172.21.15.142:48074) 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e537fe640 1 -- 172.21.15.142:0/1001211749 learned_addr learned my addr 172.21.15.142:0/1001211749 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e537fe640 1 -- 172.21.15.142:0/1001211749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5408b990 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e537fe640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2e44034040 tx=0x7f2e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e44032770 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e44032930 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e44032c50 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e54126530 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.593+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5408c620 con 0x7f2e54071090 2024-04-24T01:27:41.599 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.594+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2e4404c060 con 0x7f2e54071090 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.594+0000 7f2e3bfff640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 0x7f2e4003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.594+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e54062da0 con 0x7f2e54071090 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.594+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f2e4402f050 con 0x7f2e54071090 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.595+0000 7f2e52ffd640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 0x7f2e4003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.595+0000 7f2e52ffd640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 0x7f2e4003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:27:41.600 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.599+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f2e44040070 con 0x7f2e54071090 2024-04-24T01:27:41.770 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.769+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2e5406c170 con 0x7f2e40038060 2024-04-24T01:27:41.786 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.786+0000 7f2e3bfff640 1 -- 172.21.15.142:0/1001211749 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658870 (secure 0 0 0) 0x7f2e5406c170 con 0x7f2e40038060 2024-04-24T01:27:41.795 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:27:41.801 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 msgr2=0x7f2e4003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 0x7f2e4003a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48007ac0 comp rx=0 tx=0).stop 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 msgr2=0x7f2e54089f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2e44034040 tx=0x7f2e440046c0 comp rx=0 tx=0).stop 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 shutdown_connections 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f2e40038060 0x7f2e4003a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 --2- 172.21.15.142:0/1001211749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e54071090 0x7f2e54089f90 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 >> 172.21.15.142:0/1001211749 conn(0x7f2e54099680 msgr2=0x7f2e5409b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 shutdown_connections 2024-04-24T01:27:41.804 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:27:41.791+0000 7f2e5a074640 1 -- 172.21.15.142:0/1001211749 wait complete. 2024-04-24T01:27:41.805 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-24T01:27:39.970193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5377,"num_read_kb":4926,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4950,"ondisk_log_size":4950,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156728,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330632,"statfs":{"total":386547056640,"available":386386567168,"internally_reserved":0,"allocated":2973696,"data_stored":1778210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003723"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981645+0000","last_change":"2024-04-24T01:23:58.745975+0000","last_active":"2024-04-24T01:26:03.981645+0000","last_peered":"2024-04-24T01:26:03.981645+0000","last_clean":"2024-04-24T01:26:03.981645+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:26:03.981645+0000","last_undegraded":"2024-04-24T01:26:03.981645+0000","last_fullsized":"2024-04-24T01:26:03.981645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.268944+0000","last_change":"2024-04-24T01:24:00.745235+0000","last_active":"2024-04-24T01:27:10.268944+0000","last_peered":"2024-04-24T01:27:10.268944+0000","last_clean":"2024-04-24T01:27:10.268944+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:10.268944+0000","last_undegraded":"2024-04-24T01:27:10.268944+0000","last_fullsized":"2024-04-24T01:27:10.268944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972758+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:26:06.972758+0000","last_peered":"2024-04-24T01:26:06.972758+0000","last_clean":"2024-04-24T01:26:06.972758+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:26:06.972758+0000","last_undegraded":"2024-04-24T01:26:06.972758+0000","last_fullsized":"2024-04-24T01:26:06.972758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986785+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:26:33.986785+0000","last_peered":"2024-04-24T01:26:33.986785+0000","last_clean":"2024-04-24T01:26:33.986785+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:26:33.986785+0000","last_undegraded":"2024-04-24T01:26:33.986785+0000","last_fullsized":"2024-04-24T01:26:33.986785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982195+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:26:03.982195+0000","last_peered":"2024-04-24T01:26:03.982195+0000","last_clean":"2024-04-24T01:26:03.982195+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:26:03.982195+0000","last_undegraded":"2024-04-24T01:26:03.982195+0000","last_fullsized":"2024-04-24T01:26:03.982195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986836+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:33.986836+0000","last_peered":"2024-04-24T01:26:33.986836+0000","last_clean":"2024-04-24T01:26:33.986836+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:33.986836+0000","last_undegraded":"2024-04-24T01:26:33.986836+0000","last_fullsized":"2024-04-24T01:26:33.986836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.980753+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:25:58.980753+0000","last_peered":"2024-04-24T01:25:58.980753+0000","last_clean":"2024-04-24T01:25:58.980753+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:25:58.980753+0000","last_undegraded":"2024-04-24T01:25:58.980753+0000","last_fullsized":"2024-04-24T01:25:58.980753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986880+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:33.986880+0000","last_peered":"2024-04-24T01:26:33.986880+0000","last_clean":"2024-04-24T01:26:33.986880+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:33.986880+0000","last_undegraded":"2024-04-24T01:26:33.986880+0000","last_fullsized":"2024-04-24T01:26:33.986880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986012+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:26:28.986012+0000","last_peered":"2024-04-24T01:26:28.986012+0000","last_clean":"2024-04-24T01:26:28.986012+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:26:28.986012+0000","last_undegraded":"2024-04-24T01:26:28.986012+0000","last_fullsized":"2024-04-24T01:26:28.986012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.271131+0000","last_change":"2024-04-24T01:24:00.739114+0000","last_active":"2024-04-24T01:27:10.271131+0000","last_peered":"2024-04-24T01:27:10.271131+0000","last_clean":"2024-04-24T01:27:10.271131+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:10.271131+0000","last_undegraded":"2024-04-24T01:27:10.271131+0000","last_fullsized":"2024-04-24T01:27:10.271131+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985447+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:26:28.985447+0000","last_peered":"2024-04-24T01:26:28.985447+0000","last_clean":"2024-04-24T01:26:28.985447+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:26:28.985447+0000","last_undegraded":"2024-04-24T01:26:28.985447+0000","last_fullsized":"2024-04-24T01:26:28.985447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395319+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:27:10.395319+0000","last_peered":"2024-04-24T01:27:10.395319+0000","last_clean":"2024-04-24T01:27:10.395319+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:27:10.395319+0000","last_undegraded":"2024-04-24T01:27:10.395319+0000","last_fullsized":"2024-04-24T01:27:10.395319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252437+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.252437+0000","last_peered":"2024-04-24T01:27:10.252437+0000","last_clean":"2024-04-24T01:27:10.252437+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.252437+0000","last_undegraded":"2024-04-24T01:27:10.252437+0000","last_fullsized":"2024-04-24T01:27:10.252437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395339+0000","last_change":"2024-04-24T01:24:00.745053+0000","last_active":"2024-04-24T01:27:10.395339+0000","last_peered":"2024-04-24T01:27:10.395339+0000","last_clean":"2024-04-24T01:27:10.395339+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:27:10.395339+0000","last_undegraded":"2024-04-24T01:27:10.395339+0000","last_fullsized":"2024-04-24T01:27:10.395339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976354+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:26:31.976354+0000","last_peered":"2024-04-24T01:26:31.976354+0000","last_clean":"2024-04-24T01:26:31.976354+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:26:31.976354+0000","last_undegraded":"2024-04-24T01:26:31.976354+0000","last_fullsized":"2024-04-24T01:26:31.976354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350652+0000","last_change":"2024-04-24T01:24:00.740054+0000","last_active":"2024-04-24T01:27:10.350652+0000","last_peered":"2024-04-24T01:27:10.350652+0000","last_clean":"2024-04-24T01:27:10.350652+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:10.350652+0000","last_undegraded":"2024-04-24T01:27:10.350652+0000","last_fullsized":"2024-04-24T01:27:10.350652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.323381+0000","last_change":"2024-04-24T01:24:00.738224+0000","last_active":"2024-04-24T01:27:10.323381+0000","last_peered":"2024-04-24T01:27:10.323381+0000","last_clean":"2024-04-24T01:27:10.323381+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:10.323381+0000","last_undegraded":"2024-04-24T01:27:10.323381+0000","last_fullsized":"2024-04-24T01:27:10.323381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984742+0000","last_change":"2024-04-24T01:23:58.755611+0000","last_active":"2024-04-24T01:26:23.984742+0000","last_peered":"2024-04-24T01:26:23.984742+0000","last_clean":"2024-04-24T01:26:23.984742+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:26:23.984742+0000","last_undegraded":"2024-04-24T01:26:23.984742+0000","last_fullsized":"2024-04-24T01:26:23.984742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320728+0000","last_change":"2024-04-24T01:24:00.744762+0000","last_active":"2024-04-24T01:27:10.320728+0000","last_peered":"2024-04-24T01:27:10.320728+0000","last_clean":"2024-04-24T01:27:10.320728+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:10.320728+0000","last_undegraded":"2024-04-24T01:27:10.320728+0000","last_fullsized":"2024-04-24T01:27:10.320728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016693+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:27:17.016693+0000","last_peered":"2024-04-24T01:27:17.016693+0000","last_clean":"2024-04-24T01:27:17.016693+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:27:17.016693+0000","last_undegraded":"2024-04-24T01:27:17.016693+0000","last_fullsized":"2024-04-24T01:27:17.016693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984567+0000","last_change":"2024-04-24T01:24:00.745273+0000","last_active":"2024-04-24T01:26:23.984567+0000","last_peered":"2024-04-24T01:26:23.984567+0000","last_clean":"2024-04-24T01:26:23.984567+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:26:23.984567+0000","last_undegraded":"2024-04-24T01:26:23.984567+0000","last_fullsized":"2024-04-24T01:26:23.984567+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.024017+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.024017+0000","last_peered":"2024-04-24T01:27:10.024017+0000","last_clean":"2024-04-24T01:27:10.024017+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.024017+0000","last_undegraded":"2024-04-24T01:27:10.024017+0000","last_fullsized":"2024-04-24T01:27:10.024017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394994+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.394994+0000","last_peered":"2024-04-24T01:27:10.394994+0000","last_clean":"2024-04-24T01:27:10.394994+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.394994+0000","last_undegraded":"2024-04-24T01:27:10.394994+0000","last_fullsized":"2024-04-24T01:27:10.394994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016717+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:17.016717+0000","last_peered":"2024-04-24T01:27:17.016717+0000","last_clean":"2024-04-24T01:27:17.016717+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:17.016717+0000","last_undegraded":"2024-04-24T01:27:17.016717+0000","last_fullsized":"2024-04-24T01:27:17.016717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046915+0000","last_change":"2024-04-24T01:24:00.740372+0000","last_active":"2024-04-24T01:27:10.046915+0000","last_peered":"2024-04-24T01:27:10.046915+0000","last_clean":"2024-04-24T01:27:10.046915+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:10.046915+0000","last_undegraded":"2024-04-24T01:27:10.046915+0000","last_fullsized":"2024-04-24T01:27:10.046915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975575+0000","last_change":"2024-04-24T01:23:58.747782+0000","last_active":"2024-04-24T01:26:26.975575+0000","last_peered":"2024-04-24T01:26:26.975575+0000","last_clean":"2024-04-24T01:26:26.975575+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:26:26.975575+0000","last_undegraded":"2024-04-24T01:26:26.975575+0000","last_fullsized":"2024-04-24T01:26:26.975575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350566+0000","last_change":"2024-04-24T01:24:00.744154+0000","last_active":"2024-04-24T01:27:10.350566+0000","last_peered":"2024-04-24T01:27:10.350566+0000","last_clean":"2024-04-24T01:27:10.350566+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:10.350566+0000","last_undegraded":"2024-04-24T01:27:10.350566+0000","last_fullsized":"2024-04-24T01:27:10.350566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984316+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:18.984316+0000","last_peered":"2024-04-24T01:26:18.984316+0000","last_clean":"2024-04-24T01:26:18.984316+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:18.984316+0000","last_undegraded":"2024-04-24T01:26:18.984316+0000","last_fullsized":"2024-04-24T01:26:18.984316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.358630+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.358630+0000","last_peered":"2024-04-24T01:27:10.358630+0000","last_clean":"2024-04-24T01:27:10.358630+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.358630+0000","last_undegraded":"2024-04-24T01:27:10.358630+0000","last_fullsized":"2024-04-24T01:27:10.358630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046287+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.046287+0000","last_peered":"2024-04-24T01:27:10.046287+0000","last_clean":"2024-04-24T01:27:10.046287+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.046287+0000","last_undegraded":"2024-04-24T01:27:10.046287+0000","last_fullsized":"2024-04-24T01:27:10.046287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984350+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:26:18.984350+0000","last_peered":"2024-04-24T01:26:18.984350+0000","last_clean":"2024-04-24T01:26:18.984350+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:26:18.984350+0000","last_undegraded":"2024-04-24T01:26:18.984350+0000","last_fullsized":"2024-04-24T01:26:18.984350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.182402+0000","last_change":"2024-04-24T01:27:22.182426+0000","last_active":"2024-04-24T01:27:22.182402+0000","last_peered":"2024-04-24T01:27:22.182402+0000","last_clean":"2024-04-24T01:27:22.182402+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:27:22.182402+0000","last_undegraded":"2024-04-24T01:27:22.182402+0000","last_fullsized":"2024-04-24T01:27:22.182402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.182314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:53.198026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.018890+0000","last_change":"2024-04-24T01:27:33.018949+0000","last_active":"2024-04-24T01:27:33.018890+0000","last_peered":"2024-04-24T01:27:33.018890+0000","last_clean":"2024-04-24T01:27:33.018890+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:33.018890+0000","last_undegraded":"2024-04-24T01:27:33.018890+0000","last_fullsized":"2024-04-24T01:27:33.018890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.018804+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:06.024098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.763614+0000","last_change":"2024-04-24T01:27:29.763639+0000","last_active":"2024-04-24T01:27:29.763614+0000","last_peered":"2024-04-24T01:27:29.763614+0000","last_clean":"2024-04-24T01:27:29.763614+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:27:29.763614+0000","last_undegraded":"2024-04-24T01:27:29.763614+0000","last_fullsized":"2024-04-24T01:27:29.763614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.763505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:56.480614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986264+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:26:33.986264+0000","last_peered":"2024-04-24T01:26:33.986264+0000","last_clean":"2024-04-24T01:26:33.986264+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:26:33.986264+0000","last_undegraded":"2024-04-24T01:26:33.986264+0000","last_fullsized":"2024-04-24T01:26:33.986264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349450+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.349450+0000","last_peered":"2024-04-24T01:27:10.349450+0000","last_clean":"2024-04-24T01:27:10.349450+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.349450+0000","last_undegraded":"2024-04-24T01:27:10.349450+0000","last_fullsized":"2024-04-24T01:27:10.349450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983729+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:26:18.983729+0000","last_peered":"2024-04-24T01:26:18.983729+0000","last_clean":"2024-04-24T01:26:18.983729+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:26:18.983729+0000","last_undegraded":"2024-04-24T01:26:18.983729+0000","last_fullsized":"2024-04-24T01:26:18.983729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:58.990047+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:26:58.990047+0000","last_peered":"2024-04-24T01:26:58.990047+0000","last_clean":"2024-04-24T01:26:58.990047+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:26:58.990047+0000","last_undegraded":"2024-04-24T01:26:58.990047+0000","last_fullsized":"2024-04-24T01:26:58.990047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'17","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.795733+0000","last_change":"2024-04-24T01:27:28.795795+0000","last_active":"2024-04-24T01:27:28.795733+0000","last_peered":"2024-04-24T01:27:28.795733+0000","last_clean":"2024-04-24T01:27:28.795733+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:27:28.795733+0000","last_undegraded":"2024-04-24T01:27:28.795733+0000","last_fullsized":"2024-04-24T01:27:28.795733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.795617+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:13.586689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.807223+0000","last_change":"2024-04-24T01:27:22.807246+0000","last_active":"2024-04-24T01:27:22.807223+0000","last_peered":"2024-04-24T01:27:22.807223+0000","last_clean":"2024-04-24T01:27:22.807223+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:27:22.807223+0000","last_undegraded":"2024-04-24T01:27:22.807223+0000","last_fullsized":"2024-04-24T01:27:22.807223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.807114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:58.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977684+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:26:41.977684+0000","last_peered":"2024-04-24T01:26:41.977684+0000","last_clean":"2024-04-24T01:26:41.977684+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:26:41.977684+0000","last_undegraded":"2024-04-24T01:26:41.977684+0000","last_fullsized":"2024-04-24T01:26:41.977684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.268392+0000","last_change":"2024-04-24T01:24:00.735337+0000","last_active":"2024-04-24T01:27:10.268392+0000","last_peered":"2024-04-24T01:27:10.268392+0000","last_clean":"2024-04-24T01:27:10.268392+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:10.268392+0000","last_undegraded":"2024-04-24T01:27:10.268392+0000","last_fullsized":"2024-04-24T01:27:10.268392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984281+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:26:18.984281+0000","last_peered":"2024-04-24T01:26:18.984281+0000","last_clean":"2024-04-24T01:26:18.984281+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:26:18.984281+0000","last_undegraded":"2024-04-24T01:26:18.984281+0000","last_fullsized":"2024-04-24T01:26:18.984281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975670+0000","last_change":"2024-04-24T01:24:02.754545+0000","last_active":"2024-04-24T01:26:26.975670+0000","last_peered":"2024-04-24T01:26:26.975670+0000","last_clean":"2024-04-24T01:26:26.975670+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:26:26.975670+0000","last_undegraded":"2024-04-24T01:26:26.975670+0000","last_fullsized":"2024-04-24T01:26:26.975670+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.914958+0000","last_change":"2024-04-24T01:27:28.914998+0000","last_active":"2024-04-24T01:27:28.914958+0000","last_peered":"2024-04-24T01:27:28.914958+0000","last_clean":"2024-04-24T01:27:28.914958+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:27:28.914958+0000","last_undegraded":"2024-04-24T01:27:28.914958+0000","last_fullsized":"2024-04-24T01:27:28.914958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.914874+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:31.978701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.026875+0000","last_change":"2024-04-24T01:24:06.766289+0000","last_active":"2024-04-24T01:27:17.026875+0000","last_peered":"2024-04-24T01:27:17.026875+0000","last_clean":"2024-04-24T01:27:17.026875+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:17.026875+0000","last_undegraded":"2024-04-24T01:27:17.026875+0000","last_fullsized":"2024-04-24T01:27:17.026875+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.266343+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.266343+0000","last_peered":"2024-04-24T01:27:10.266343+0000","last_clean":"2024-04-24T01:27:10.266343+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.266343+0000","last_undegraded":"2024-04-24T01:27:10.266343+0000","last_fullsized":"2024-04-24T01:27:10.266343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975661+0000","last_change":"2024-04-24T01:24:00.746538+0000","last_active":"2024-04-24T01:26:26.975661+0000","last_peered":"2024-04-24T01:26:26.975661+0000","last_clean":"2024-04-24T01:26:26.975661+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:26:26.975661+0000","last_undegraded":"2024-04-24T01:26:26.975661+0000","last_fullsized":"2024-04-24T01:26:26.975661+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983662+0000","last_change":"2024-04-24T01:23:58.755957+0000","last_active":"2024-04-24T01:26:18.983662+0000","last_peered":"2024-04-24T01:26:18.983662+0000","last_clean":"2024-04-24T01:26:18.983662+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:26:18.983662+0000","last_undegraded":"2024-04-24T01:26:18.983662+0000","last_fullsized":"2024-04-24T01:26:18.983662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.157564+0000","last_change":"2024-04-24T01:27:28.157587+0000","last_active":"2024-04-24T01:27:28.157564+0000","last_peered":"2024-04-24T01:27:28.157564+0000","last_clean":"2024-04-24T01:27:28.157564+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:27:28.157564+0000","last_undegraded":"2024-04-24T01:27:28.157564+0000","last_fullsized":"2024-04-24T01:27:28.157564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.157467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:47.159396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.890012+0000","last_change":"2024-04-24T01:27:26.890053+0000","last_active":"2024-04-24T01:27:26.890012+0000","last_peered":"2024-04-24T01:27:26.890012+0000","last_clean":"2024-04-24T01:27:26.890012+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:26.890012+0000","last_undegraded":"2024-04-24T01:27:26.890012+0000","last_fullsized":"2024-04-24T01:27:26.890012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.889929+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:10.323651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.070103+0000","last_change":"2024-04-24T01:27:24.070163+0000","last_active":"2024-04-24T01:27:24.070103+0000","last_peered":"2024-04-24T01:27:24.070103+0000","last_clean":"2024-04-24T01:27:24.070103+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:24.070103+0000","last_undegraded":"2024-04-24T01:27:24.070103+0000","last_fullsized":"2024-04-24T01:27:24.070103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.069989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:46.537881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983494+0000","last_change":"2024-04-24T01:24:00.737956+0000","last_active":"2024-04-24T01:26:13.983494+0000","last_peered":"2024-04-24T01:26:13.983494+0000","last_clean":"2024-04-24T01:26:13.983494+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:26:13.983494+0000","last_undegraded":"2024-04-24T01:26:13.983494+0000","last_fullsized":"2024-04-24T01:26:13.983494+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983116+0000","last_change":"2024-04-24T01:23:58.744402+0000","last_active":"2024-04-24T01:26:13.983116+0000","last_peered":"2024-04-24T01:26:13.983116+0000","last_clean":"2024-04-24T01:26:13.983116+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:26:13.983116+0000","last_undegraded":"2024-04-24T01:26:13.983116+0000","last_fullsized":"2024-04-24T01:26:13.983116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.724484+0000","last_change":"2024-04-24T01:27:31.724506+0000","last_active":"2024-04-24T01:27:31.724484+0000","last_peered":"2024-04-24T01:27:31.724484+0000","last_clean":"2024-04-24T01:27:31.724484+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:27:31.724484+0000","last_undegraded":"2024-04-24T01:27:31.724484+0000","last_fullsized":"2024-04-24T01:27:31.724484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.724380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:37.609422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.950424+0000","last_change":"2024-04-24T01:27:30.950474+0000","last_active":"2024-04-24T01:27:30.950424+0000","last_peered":"2024-04-24T01:27:30.950424+0000","last_clean":"2024-04-24T01:27:30.950424+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:30.950424+0000","last_undegraded":"2024-04-24T01:27:30.950424+0000","last_fullsized":"2024-04-24T01:27:30.950424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.950337+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:06.885598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.107865+0000","last_change":"2024-04-24T01:27:23.107889+0000","last_active":"2024-04-24T01:27:23.107865+0000","last_peered":"2024-04-24T01:27:23.107865+0000","last_clean":"2024-04-24T01:27:23.107865+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:27:23.107865+0000","last_undegraded":"2024-04-24T01:27:23.107865+0000","last_fullsized":"2024-04-24T01:27:23.107865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.107773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:16.379160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983007+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:26:13.983007+0000","last_peered":"2024-04-24T01:26:13.983007+0000","last_clean":"2024-04-24T01:26:13.983007+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:26:13.983007+0000","last_undegraded":"2024-04-24T01:26:13.983007+0000","last_fullsized":"2024-04-24T01:26:13.983007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.982913+0000","last_change":"2024-04-24T01:24:00.739375+0000","last_active":"2024-04-24T01:26:13.982913+0000","last_peered":"2024-04-24T01:26:13.982913+0000","last_clean":"2024-04-24T01:26:13.982913+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:26:13.982913+0000","last_undegraded":"2024-04-24T01:26:13.982913+0000","last_fullsized":"2024-04-24T01:26:13.982913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.004006+0000","last_change":"2024-04-24T01:23:58.747337+0000","last_active":"2024-04-24T01:27:10.004006+0000","last_peered":"2024-04-24T01:27:10.004006+0000","last_clean":"2024-04-24T01:27:10.004006+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:10.004006+0000","last_undegraded":"2024-04-24T01:27:10.004006+0000","last_fullsized":"2024-04-24T01:27:10.004006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'4","reported_seq":229,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.851453+0000","last_change":"2024-04-24T01:24:02.754621+0000","last_active":"2024-04-24T01:27:16.851453+0000","last_peered":"2024-04-24T01:27:16.851453+0000","last_clean":"2024-04-24T01:27:16.851453+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:16.851453+0000","last_undegraded":"2024-04-24T01:27:16.851453+0000","last_fullsized":"2024-04-24T01:27:16.851453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.146590+0000","last_change":"2024-04-24T01:27:23.146630+0000","last_active":"2024-04-24T01:27:23.146590+0000","last_peered":"2024-04-24T01:27:23.146590+0000","last_clean":"2024-04-24T01:27:23.146590+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:23.146590+0000","last_undegraded":"2024-04-24T01:27:23.146590+0000","last_fullsized":"2024-04-24T01:27:23.146590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.146508+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:42.897359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.041435+0000","last_change":"2024-04-24T01:27:25.041459+0000","last_active":"2024-04-24T01:27:25.041435+0000","last_peered":"2024-04-24T01:27:25.041435+0000","last_clean":"2024-04-24T01:27:25.041435+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:27:25.041435+0000","last_undegraded":"2024-04-24T01:27:25.041435+0000","last_fullsized":"2024-04-24T01:27:25.041435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.041335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.527549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'5","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983034+0000","last_change":"2024-04-24T01:24:08.772727+0000","last_active":"2024-04-24T01:26:13.983034+0000","last_peered":"2024-04-24T01:26:13.983034+0000","last_clean":"2024-04-24T01:26:13.983034+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:26:13.983034+0000","last_undegraded":"2024-04-24T01:26:13.983034+0000","last_fullsized":"2024-04-24T01:26:13.983034+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.982967+0000","last_change":"2024-04-24T01:24:00.740217+0000","last_active":"2024-04-24T01:26:13.982967+0000","last_peered":"2024-04-24T01:26:13.982967+0000","last_clean":"2024-04-24T01:26:13.982967+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:26:13.982967+0000","last_undegraded":"2024-04-24T01:26:13.982967+0000","last_fullsized":"2024-04-24T01:26:13.982967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.015141+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:27:17.015141+0000","last_peered":"2024-04-24T01:27:17.015141+0000","last_clean":"2024-04-24T01:27:17.015141+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:27:17.015141+0000","last_undegraded":"2024-04-24T01:27:17.015141+0000","last_fullsized":"2024-04-24T01:27:17.015141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.208929+0000","last_change":"2024-04-24T01:27:35.208971+0000","last_active":"2024-04-24T01:27:35.208929+0000","last_peered":"2024-04-24T01:27:35.208929+0000","last_clean":"2024-04-24T01:27:35.208929+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:27:35.208929+0000","last_undegraded":"2024-04-24T01:27:35.208929+0000","last_fullsized":"2024-04-24T01:27:35.208929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:53.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'51","reported_seq":113,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.915229+0000","last_change":"2024-04-24T01:24:04.760716+0000","last_active":"2024-04-24T01:27:16.915229+0000","last_peered":"2024-04-24T01:27:16.915229+0000","last_clean":"2024-04-24T01:27:16.915229+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:16.915229+0000","last_undegraded":"2024-04-24T01:27:16.915229+0000","last_fullsized":"2024-04-24T01:27:16.915229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.193180+0000","last_change":"2024-04-24T01:27:33.193209+0000","last_active":"2024-04-24T01:27:33.193180+0000","last_peered":"2024-04-24T01:27:33.193180+0000","last_clean":"2024-04-24T01:27:33.193180+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:33.193180+0000","last_undegraded":"2024-04-24T01:27:33.193180+0000","last_fullsized":"2024-04-24T01:27:33.193180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.193083+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:14.827477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974950+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:26:21.974950+0000","last_peered":"2024-04-24T01:26:21.974950+0000","last_clean":"2024-04-24T01:26:21.974950+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:26:21.974950+0000","last_undegraded":"2024-04-24T01:26:21.974950+0000","last_fullsized":"2024-04-24T01:26:21.974950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983772+0000","last_change":"2024-04-24T01:24:00.731534+0000","last_active":"2024-04-24T01:26:18.983772+0000","last_peered":"2024-04-24T01:26:18.983772+0000","last_clean":"2024-04-24T01:26:18.983772+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:26:18.983772+0000","last_undegraded":"2024-04-24T01:26:18.983772+0000","last_fullsized":"2024-04-24T01:26:18.983772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983579+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:26:13.983579+0000","last_peered":"2024-04-24T01:26:13.983579+0000","last_clean":"2024-04-24T01:26:13.983579+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:26:13.983579+0000","last_undegraded":"2024-04-24T01:26:13.983579+0000","last_fullsized":"2024-04-24T01:26:13.983579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.200419+0000","last_change":"2024-04-24T01:27:36.200442+0000","last_active":"2024-04-24T01:27:36.200419+0000","last_peered":"2024-04-24T01:27:36.200419+0000","last_clean":"2024-04-24T01:27:36.200419+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:27:36.200419+0000","last_undegraded":"2024-04-24T01:27:36.200419+0000","last_fullsized":"2024-04-24T01:27:36.200419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.200293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.864662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'72","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.960004+0000","last_change":"2024-04-24T01:24:04.761320+0000","last_active":"2024-04-24T01:27:16.960004+0000","last_peered":"2024-04-24T01:27:16.960004+0000","last_clean":"2024-04-24T01:27:16.960004+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:16.960004+0000","last_undegraded":"2024-04-24T01:27:16.960004+0000","last_fullsized":"2024-04-24T01:27:16.960004+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.070100+0000","last_change":"2024-04-24T01:27:21.070118+0000","last_active":"2024-04-24T01:27:21.070100+0000","last_peered":"2024-04-24T01:27:21.070100+0000","last_clean":"2024-04-24T01:27:21.070100+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:27:21.070100+0000","last_undegraded":"2024-04-24T01:27:21.070100+0000","last_fullsized":"2024-04-24T01:27:21.070100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.070033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:24.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.438803+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.438803+0000","last_peered":"2024-04-24T01:27:10.438803+0000","last_clean":"2024-04-24T01:27:10.438803+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.438803+0000","last_undegraded":"2024-04-24T01:27:10.438803+0000","last_fullsized":"2024-04-24T01:27:10.438803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046489+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.046489+0000","last_peered":"2024-04-24T01:27:10.046489+0000","last_clean":"2024-04-24T01:27:10.046489+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.046489+0000","last_undegraded":"2024-04-24T01:27:10.046489+0000","last_fullsized":"2024-04-24T01:27:10.046489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974186+0000","last_change":"2024-04-24T01:23:58.747661+0000","last_active":"2024-04-24T01:26:16.974186+0000","last_peered":"2024-04-24T01:26:16.974186+0000","last_clean":"2024-04-24T01:26:16.974186+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:26:16.974186+0000","last_undegraded":"2024-04-24T01:26:16.974186+0000","last_fullsized":"2024-04-24T01:26:16.974186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983830+0000","last_change":"2024-04-24T01:24:02.751285+0000","last_active":"2024-04-24T01:26:18.983830+0000","last_peered":"2024-04-24T01:26:18.983830+0000","last_clean":"2024-04-24T01:26:18.983830+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:26:18.983830+0000","last_undegraded":"2024-04-24T01:26:18.983830+0000","last_fullsized":"2024-04-24T01:26:18.983830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.795231+0000","last_change":"2024-04-24T01:27:26.795265+0000","last_active":"2024-04-24T01:27:26.795231+0000","last_peered":"2024-04-24T01:27:26.795231+0000","last_clean":"2024-04-24T01:27:26.795231+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:26.795231+0000","last_undegraded":"2024-04-24T01:27:26.795231+0000","last_fullsized":"2024-04-24T01:27:26.795231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.795151+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:53.921283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985230+0000","last_change":"2024-04-24T01:24:06.762347+0000","last_active":"2024-04-24T01:26:23.985230+0000","last_peered":"2024-04-24T01:26:23.985230+0000","last_clean":"2024-04-24T01:26:23.985230+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:26:23.985230+0000","last_undegraded":"2024-04-24T01:26:23.985230+0000","last_fullsized":"2024-04-24T01:26:23.985230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.398022+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:27:10.398022+0000","last_peered":"2024-04-24T01:27:10.398022+0000","last_clean":"2024-04-24T01:27:10.398022+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:27:10.398022+0000","last_undegraded":"2024-04-24T01:27:10.398022+0000","last_fullsized":"2024-04-24T01:27:10.398022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:53.989481+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:53.989481+0000","last_peered":"2024-04-24T01:26:53.989481+0000","last_clean":"2024-04-24T01:26:53.989481+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:53.989481+0000","last_undegraded":"2024-04-24T01:26:53.989481+0000","last_fullsized":"2024-04-24T01:26:53.989481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982856+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:26:08.982856+0000","last_peered":"2024-04-24T01:26:08.982856+0000","last_clean":"2024-04-24T01:26:08.982856+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:26:08.982856+0000","last_undegraded":"2024-04-24T01:26:08.982856+0000","last_fullsized":"2024-04-24T01:26:08.982856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974206+0000","last_change":"2024-04-24T01:24:02.754670+0000","last_active":"2024-04-24T01:26:16.974206+0000","last_peered":"2024-04-24T01:26:16.974206+0000","last_clean":"2024-04-24T01:26:16.974206+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:26:16.974206+0000","last_undegraded":"2024-04-24T01:26:16.974206+0000","last_fullsized":"2024-04-24T01:26:16.974206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.930905+0000","last_change":"2024-04-24T01:27:31.930974+0000","last_active":"2024-04-24T01:27:31.930905+0000","last_peered":"2024-04-24T01:27:31.930905+0000","last_clean":"2024-04-24T01:27:31.930905+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:31.930905+0000","last_undegraded":"2024-04-24T01:27:31.930905+0000","last_fullsized":"2024-04-24T01:27:31.930905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.930805+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:07.030096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.862402+0000","last_change":"2024-04-24T01:27:25.862447+0000","last_active":"2024-04-24T01:27:25.862402+0000","last_peered":"2024-04-24T01:27:25.862402+0000","last_clean":"2024-04-24T01:27:25.862402+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:25.862402+0000","last_undegraded":"2024-04-24T01:27:25.862402+0000","last_fullsized":"2024-04-24T01:27:25.862402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.862292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:06.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'14","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.399769+0000","last_change":"2024-04-24T01:24:08.768551+0000","last_active":"2024-04-24T01:27:10.399769+0000","last_peered":"2024-04-24T01:27:10.399769+0000","last_clean":"2024-04-24T01:27:10.399769+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:27:10.399769+0000","last_undegraded":"2024-04-24T01:27:10.399769+0000","last_fullsized":"2024-04-24T01:27:10.399769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349583+0000","last_change":"2024-04-24T01:24:00.740730+0000","last_active":"2024-04-24T01:27:10.349583+0000","last_peered":"2024-04-24T01:27:10.349583+0000","last_clean":"2024-04-24T01:27:10.349583+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:10.349583+0000","last_undegraded":"2024-04-24T01:27:10.349583+0000","last_fullsized":"2024-04-24T01:27:10.349583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982814+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:26:08.982814+0000","last_peered":"2024-04-24T01:26:08.982814+0000","last_clean":"2024-04-24T01:26:08.982814+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:26:08.982814+0000","last_undegraded":"2024-04-24T01:26:08.982814+0000","last_fullsized":"2024-04-24T01:26:08.982814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.716636+0000","last_change":"2024-04-24T01:27:35.716690+0000","last_active":"2024-04-24T01:27:35.716636+0000","last_peered":"2024-04-24T01:27:35.716636+0000","last_clean":"2024-04-24T01:27:35.716636+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:35.716636+0000","last_undegraded":"2024-04-24T01:27:35.716636+0000","last_fullsized":"2024-04-24T01:27:35.716636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.716538+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:45.474001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984387+0000","last_change":"2024-04-24T01:24:04.759964+0000","last_active":"2024-04-24T01:26:18.984387+0000","last_peered":"2024-04-24T01:26:18.984387+0000","last_clean":"2024-04-24T01:26:18.984387+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:26:18.984387+0000","last_undegraded":"2024-04-24T01:26:18.984387+0000","last_fullsized":"2024-04-24T01:26:18.984387+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.819819+0000","last_change":"2024-04-24T01:27:21.819879+0000","last_active":"2024-04-24T01:27:21.819819+0000","last_peered":"2024-04-24T01:27:21.819819+0000","last_clean":"2024-04-24T01:27:21.819819+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:21.819819+0000","last_undegraded":"2024-04-24T01:27:21.819819+0000","last_fullsized":"2024-04-24T01:27:21.819819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.819685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:51.931578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.982951+0000","last_change":"2024-04-24T01:24:08.769465+0000","last_active":"2024-04-24T01:26:13.982951+0000","last_peered":"2024-04-24T01:26:13.982951+0000","last_clean":"2024-04-24T01:26:13.982951+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:26:13.982951+0000","last_undegraded":"2024-04-24T01:26:13.982951+0000","last_fullsized":"2024-04-24T01:26:13.982951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.131655+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.131655+0000","last_peered":"2024-04-24T01:27:10.131655+0000","last_clean":"2024-04-24T01:27:10.131655+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.131655+0000","last_undegraded":"2024-04-24T01:27:10.131655+0000","last_fullsized":"2024-04-24T01:27:10.131655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982774+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:26:08.982774+0000","last_peered":"2024-04-24T01:26:08.982774+0000","last_clean":"2024-04-24T01:26:08.982774+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:26:08.982774+0000","last_undegraded":"2024-04-24T01:26:08.982774+0000","last_fullsized":"2024-04-24T01:26:08.982774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.040401+0000","last_change":"2024-04-24T01:27:32.040427+0000","last_active":"2024-04-24T01:27:32.040401+0000","last_peered":"2024-04-24T01:27:32.040401+0000","last_clean":"2024-04-24T01:27:32.040401+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:27:32.040401+0000","last_undegraded":"2024-04-24T01:27:32.040401+0000","last_fullsized":"2024-04-24T01:27:32.040401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.040303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:24.647469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.833944+0000","last_change":"2024-04-24T01:27:27.834021+0000","last_active":"2024-04-24T01:27:27.833944+0000","last_peered":"2024-04-24T01:27:27.833944+0000","last_clean":"2024-04-24T01:27:27.833944+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:27.833944+0000","last_undegraded":"2024-04-24T01:27:27.833944+0000","last_fullsized":"2024-04-24T01:27:27.833944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.833839+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:51:49.939141+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.839877+0000","last_change":"2024-04-24T01:27:21.839921+0000","last_active":"2024-04-24T01:27:21.839877+0000","last_peered":"2024-04-24T01:27:21.839877+0000","last_clean":"2024-04-24T01:27:21.839877+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:27:21.839877+0000","last_undegraded":"2024-04-24T01:27:21.839877+0000","last_fullsized":"2024-04-24T01:27:21.839877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:25.887464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'8","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.437260+0000","last_change":"2024-04-24T01:24:08.772039+0000","last_active":"2024-04-24T01:27:10.437260+0000","last_peered":"2024-04-24T01:27:10.437260+0000","last_clean":"2024-04-24T01:27:10.437260+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:10.437260+0000","last_undegraded":"2024-04-24T01:27:10.437260+0000","last_fullsized":"2024-04-24T01:27:10.437260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.009823+0000","last_change":"2024-04-24T01:27:38.009852+0000","last_active":"2024-04-24T01:27:38.009823+0000","last_peered":"2024-04-24T01:27:38.009823+0000","last_clean":"2024-04-24T01:27:38.009823+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:38.009823+0000","last_undegraded":"2024-04-24T01:27:38.009823+0000","last_fullsized":"2024-04-24T01:27:38.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.009727+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:13.773436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":203,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:48.979195+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:25:48.979195+0000","last_peered":"2024-04-24T01:25:48.979195+0000","last_clean":"2024-04-24T01:25:48.979195+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:25:48.979195+0000","last_undegraded":"2024-04-24T01:25:48.979195+0000","last_fullsized":"2024-04-24T01:25:48.979195+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981411+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:25:58.981411+0000","last_peered":"2024-04-24T01:25:58.981411+0000","last_clean":"2024-04-24T01:25:58.981411+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:25:58.981411+0000","last_undegraded":"2024-04-24T01:25:58.981411+0000","last_fullsized":"2024-04-24T01:25:58.981411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982127+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:26:03.982127+0000","last_peered":"2024-04-24T01:26:03.982127+0000","last_clean":"2024-04-24T01:26:03.982127+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:26:03.982127+0000","last_undegraded":"2024-04-24T01:26:03.982127+0000","last_fullsized":"2024-04-24T01:26:03.982127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982209+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:26:08.982209+0000","last_peered":"2024-04-24T01:26:08.982209+0000","last_clean":"2024-04-24T01:26:08.982209+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:26:08.982209+0000","last_undegraded":"2024-04-24T01:26:08.982209+0000","last_fullsized":"2024-04-24T01:26:08.982209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.123880+0000","last_change":"2024-04-24T01:27:27.123918+0000","last_active":"2024-04-24T01:27:27.123880+0000","last_peered":"2024-04-24T01:27:27.123880+0000","last_clean":"2024-04-24T01:27:27.123880+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:27.123880+0000","last_undegraded":"2024-04-24T01:27:27.123880+0000","last_fullsized":"2024-04-24T01:27:27.123880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.123786+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:04.256795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.112064+0000","last_change":"2024-04-24T01:27:29.112111+0000","last_active":"2024-04-24T01:27:29.112064+0000","last_peered":"2024-04-24T01:27:29.112064+0000","last_clean":"2024-04-24T01:27:29.112064+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:27:29.112064+0000","last_undegraded":"2024-04-24T01:27:29.112064+0000","last_fullsized":"2024-04-24T01:27:29.112064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.111929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:30.720342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.978903+0000","last_change":"2024-04-24T01:27:37.978931+0000","last_active":"2024-04-24T01:27:37.978903+0000","last_peered":"2024-04-24T01:27:37.978903+0000","last_clean":"2024-04-24T01:27:37.978903+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:37.978903+0000","last_undegraded":"2024-04-24T01:27:37.978903+0000","last_fullsized":"2024-04-24T01:27:37.978903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.978807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:55.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'3","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394796+0000","last_change":"2024-04-24T01:24:00.735658+0000","last_active":"2024-04-24T01:27:10.394796+0000","last_peered":"2024-04-24T01:27:10.394796+0000","last_clean":"2024-04-24T01:27:10.394796+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:27:10.394796+0000","last_undegraded":"2024-04-24T01:27:10.394796+0000","last_fullsized":"2024-04-24T01:27:10.394796+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:53.980610+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:25:53.980610+0000","last_peered":"2024-04-24T01:25:53.980610+0000","last_clean":"2024-04-24T01:25:53.980610+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:25:53.980610+0000","last_undegraded":"2024-04-24T01:25:53.980610+0000","last_fullsized":"2024-04-24T01:25:53.980610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.015048+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:27:17.015048+0000","last_peered":"2024-04-24T01:27:17.015048+0000","last_clean":"2024-04-24T01:27:17.015048+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:27:17.015048+0000","last_undegraded":"2024-04-24T01:27:17.015048+0000","last_fullsized":"2024-04-24T01:27:17.015048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.112830+0000","last_change":"2024-04-24T01:27:24.112872+0000","last_active":"2024-04-24T01:27:24.112830+0000","last_peered":"2024-04-24T01:27:24.112830+0000","last_clean":"2024-04-24T01:27:24.112830+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:27:24.112830+0000","last_undegraded":"2024-04-24T01:27:24.112830+0000","last_fullsized":"2024-04-24T01:27:24.112830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.112716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:45.026444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":528,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.829554+0000","last_change":"2024-04-24T01:27:23.829636+0000","last_active":"2024-04-24T01:27:23.829554+0000","last_peered":"2024-04-24T01:27:23.829554+0000","last_clean":"2024-04-24T01:27:23.829554+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:23.829554+0000","last_undegraded":"2024-04-24T01:27:23.829554+0000","last_fullsized":"2024-04-24T01:27:23.829554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.829451+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:41.027361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983607+0000","last_change":"2024-04-24T01:24:06.760509+0000","last_active":"2024-04-24T01:26:13.983607+0000","last_peered":"2024-04-24T01:26:13.983607+0000","last_clean":"2024-04-24T01:26:13.983607+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:26:13.983607+0000","last_undegraded":"2024-04-24T01:26:13.983607+0000","last_fullsized":"2024-04-24T01:26:13.983607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983698+0000","last_change":"2024-04-24T01:24:08.773331+0000","last_active":"2024-04-24T01:26:18.983698+0000","last_peered":"2024-04-24T01:26:18.983698+0000","last_clean":"2024-04-24T01:26:18.983698+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:26:18.983698+0000","last_undegraded":"2024-04-24T01:26:18.983698+0000","last_fullsized":"2024-04-24T01:26:18.983698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.271211+0000","last_change":"2024-04-24T01:24:00.746776+0000","last_active":"2024-04-24T01:27:10.271211+0000","last_peered":"2024-04-24T01:27:10.271211+0000","last_clean":"2024-04-24T01:27:10.271211+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:10.271211+0000","last_undegraded":"2024-04-24T01:27:10.271211+0000","last_fullsized":"2024-04-24T01:27:10.271211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:53.980032+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:25:53.980032+0000","last_peered":"2024-04-24T01:25:53.980032+0000","last_clean":"2024-04-24T01:25:53.980032+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:25:53.980032+0000","last_undegraded":"2024-04-24T01:25:53.980032+0000","last_fullsized":"2024-04-24T01:25:53.980032+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.971927+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:26:01.971927+0000","last_peered":"2024-04-24T01:26:01.971927+0000","last_clean":"2024-04-24T01:26:01.971927+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:26:01.971927+0000","last_undegraded":"2024-04-24T01:26:01.971927+0000","last_fullsized":"2024-04-24T01:26:01.971927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'4","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.917102+0000","last_change":"2024-04-24T01:27:35.917133+0000","last_active":"2024-04-24T01:27:35.917102+0000","last_peered":"2024-04-24T01:27:35.917102+0000","last_clean":"2024-04-24T01:27:35.917102+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:35.917102+0000","last_undegraded":"2024-04-24T01:27:35.917102+0000","last_fullsized":"2024-04-24T01:27:35.917102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.916997+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:07.090816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.905563+0000","last_change":"2024-04-24T01:27:27.905612+0000","last_active":"2024-04-24T01:27:27.905563+0000","last_peered":"2024-04-24T01:27:27.905563+0000","last_clean":"2024-04-24T01:27:27.905563+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:27.905563+0000","last_undegraded":"2024-04-24T01:27:27.905563+0000","last_fullsized":"2024-04-24T01:27:27.905563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.905478+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:29.454916+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973428+0000","last_change":"2024-04-24T01:24:06.770584+0000","last_active":"2024-04-24T01:26:11.973428+0000","last_peered":"2024-04-24T01:26:11.973428+0000","last_clean":"2024-04-24T01:26:11.973428+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:26:11.973428+0000","last_undegraded":"2024-04-24T01:26:11.973428+0000","last_fullsized":"2024-04-24T01:26:11.973428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985117+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:26:23.985117+0000","last_peered":"2024-04-24T01:26:23.985117+0000","last_clean":"2024-04-24T01:26:23.985117+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:26:23.985117+0000","last_undegraded":"2024-04-24T01:26:23.985117+0000","last_fullsized":"2024-04-24T01:26:23.985117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'7","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395011+0000","last_change":"2024-04-24T01:24:00.731982+0000","last_active":"2024-04-24T01:27:10.395011+0000","last_peered":"2024-04-24T01:27:10.395011+0000","last_clean":"2024-04-24T01:27:10.395011+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:10.395011+0000","last_undegraded":"2024-04-24T01:27:10.395011+0000","last_fullsized":"2024-04-24T01:27:10.395011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:53.980672+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:25:53.980672+0000","last_peered":"2024-04-24T01:25:53.980672+0000","last_clean":"2024-04-24T01:25:53.980672+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:25:53.980672+0000","last_undegraded":"2024-04-24T01:25:53.980672+0000","last_fullsized":"2024-04-24T01:25:53.980672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.620927+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.620927+0000","last_peered":"2024-04-24T01:26:09.620927+0000","last_clean":"2024-04-24T01:26:09.620927+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.620927+0000","last_undegraded":"2024-04-24T01:26:09.620927+0000","last_fullsized":"2024-04-24T01:26:09.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972731+0000","last_change":"2024-04-24T01:24:02.751517+0000","last_active":"2024-04-24T01:26:06.972731+0000","last_peered":"2024-04-24T01:26:06.972731+0000","last_clean":"2024-04-24T01:26:06.972731+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:26:06.972731+0000","last_undegraded":"2024-04-24T01:26:06.972731+0000","last_fullsized":"2024-04-24T01:26:06.972731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'14","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:09.671697+0000","last_change":"2024-04-24T01:24:04.760913+0000","last_active":"2024-04-24T01:27:09.671697+0000","last_peered":"2024-04-24T01:27:09.671697+0000","last_clean":"2024-04-24T01:27:09.671697+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:09.671697+0000","last_undegraded":"2024-04-24T01:27:09.671697+0000","last_fullsized":"2024-04-24T01:27:09.671697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984447+0000","last_change":"2024-04-24T01:24:06.760113+0000","last_active":"2024-04-24T01:26:18.984447+0000","last_peered":"2024-04-24T01:26:18.984447+0000","last_clean":"2024-04-24T01:26:18.984447+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:26:18.984447+0000","last_undegraded":"2024-04-24T01:26:18.984447+0000","last_fullsized":"2024-04-24T01:26:18.984447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983635+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:18.983635+0000","last_peered":"2024-04-24T01:26:18.983635+0000","last_clean":"2024-04-24T01:26:18.983635+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:18.983635+0000","last_undegraded":"2024-04-24T01:26:18.983635+0000","last_fullsized":"2024-04-24T01:26:18.983635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046939+0000","last_change":"2024-04-24T01:24:00.742538+0000","last_active":"2024-04-24T01:27:10.046939+0000","last_peered":"2024-04-24T01:27:10.046939+0000","last_clean":"2024-04-24T01:27:10.046939+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:10.046939+0000","last_undegraded":"2024-04-24T01:27:10.046939+0000","last_fullsized":"2024-04-24T01:27:10.046939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.246200+0000","last_change":"2024-04-24T01:23:58.743583+0000","last_active":"2024-04-24T01:27:10.246200+0000","last_peered":"2024-04-24T01:27:10.246200+0000","last_clean":"2024-04-24T01:27:10.246200+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:10.246200+0000","last_undegraded":"2024-04-24T01:27:10.246200+0000","last_fullsized":"2024-04-24T01:27:10.246200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:56.971200+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:25:56.971200+0000","last_peered":"2024-04-24T01:25:56.971200+0000","last_clean":"2024-04-24T01:25:56.971200+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:25:56.971200+0000","last_undegraded":"2024-04-24T01:25:56.971200+0000","last_fullsized":"2024-04-24T01:25:56.971200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'1","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.862851+0000","last_change":"2024-04-24T01:24:02.750475+0000","last_active":"2024-04-24T01:27:16.862851+0000","last_peered":"2024-04-24T01:27:16.862851+0000","last_clean":"2024-04-24T01:27:16.862851+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:16.862851+0000","last_undegraded":"2024-04-24T01:27:16.862851+0000","last_fullsized":"2024-04-24T01:27:16.862851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'88","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.086818+0000","last_change":"2024-04-24T01:27:27.086861+0000","last_active":"2024-04-24T01:27:27.086818+0000","last_peered":"2024-04-24T01:27:27.086818+0000","last_clean":"2024-04-24T01:27:27.086818+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:27.086818+0000","last_undegraded":"2024-04-24T01:27:27.086818+0000","last_fullsized":"2024-04-24T01:27:27.086818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'88","last_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_deep_scrub":"34'88","last_deep_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.086724+0000","objects_scrubbed":11,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:32.526409+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.902314+0000","last_change":"2024-04-24T01:27:29.902351+0000","last_active":"2024-04-24T01:27:29.902314+0000","last_peered":"2024-04-24T01:27:29.902314+0000","last_clean":"2024-04-24T01:27:29.902314+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:27:29.902314+0000","last_undegraded":"2024-04-24T01:27:29.902314+0000","last_fullsized":"2024-04-24T01:27:29.902314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.902169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:02.390606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975643+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:26.975643+0000","last_peered":"2024-04-24T01:26:26.975643+0000","last_clean":"2024-04-24T01:26:26.975643+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:26.975643+0000","last_undegraded":"2024-04-24T01:26:26.975643+0000","last_fullsized":"2024-04-24T01:26:26.975643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.271230+0000","last_change":"2024-04-24T01:24:00.740995+0000","last_active":"2024-04-24T01:27:10.271230+0000","last_peered":"2024-04-24T01:27:10.271230+0000","last_clean":"2024-04-24T01:27:10.271230+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:10.271230+0000","last_undegraded":"2024-04-24T01:27:10.271230+0000","last_fullsized":"2024-04-24T01:27:10.271230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972707+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:26:06.972707+0000","last_peered":"2024-04-24T01:26:06.972707+0000","last_clean":"2024-04-24T01:26:06.972707+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:26:06.972707+0000","last_undegraded":"2024-04-24T01:26:06.972707+0000","last_fullsized":"2024-04-24T01:26:06.972707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981455+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:25:58.981455+0000","last_peered":"2024-04-24T01:25:58.981455+0000","last_clean":"2024-04-24T01:25:58.981455+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:25:58.981455+0000","last_undegraded":"2024-04-24T01:25:58.981455+0000","last_fullsized":"2024-04-24T01:25:58.981455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.079185+0000","last_change":"2024-04-24T01:27:26.079211+0000","last_active":"2024-04-24T01:27:26.079185+0000","last_peered":"2024-04-24T01:27:26.079185+0000","last_clean":"2024-04-24T01:27:26.079185+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:27:26.079185+0000","last_undegraded":"2024-04-24T01:27:26.079185+0000","last_fullsized":"2024-04-24T01:27:26.079185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.079098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:16:40.353572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.825386+0000","last_change":"2024-04-24T01:27:24.825422+0000","last_active":"2024-04-24T01:27:24.825386+0000","last_peered":"2024-04-24T01:27:24.825386+0000","last_clean":"2024-04-24T01:27:24.825386+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:27:24.825386+0000","last_undegraded":"2024-04-24T01:27:24.825386+0000","last_fullsized":"2024-04-24T01:27:24.825386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.825285+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:34.030557+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.840941+0000","last_change":"2024-04-24T01:27:25.840969+0000","last_active":"2024-04-24T01:27:25.840941+0000","last_peered":"2024-04-24T01:27:25.840941+0000","last_clean":"2024-04-24T01:27:25.840941+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:25.840941+0000","last_undegraded":"2024-04-24T01:27:25.840941+0000","last_fullsized":"2024-04-24T01:27:25.840941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.840846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:46:26.499751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985221+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:26:23.985221+0000","last_peered":"2024-04-24T01:26:23.985221+0000","last_clean":"2024-04-24T01:26:23.985221+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:26:23.985221+0000","last_undegraded":"2024-04-24T01:26:23.985221+0000","last_fullsized":"2024-04-24T01:26:23.985221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.981788+0000","last_change":"2024-04-24T01:27:36.981815+0000","last_active":"2024-04-24T01:27:36.981788+0000","last_peered":"2024-04-24T01:27:36.981788+0000","last_clean":"2024-04-24T01:27:36.981788+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:27:36.981788+0000","last_undegraded":"2024-04-24T01:27:36.981788+0000","last_fullsized":"2024-04-24T01:27:36.981788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.981689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:02.218699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982949+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:26:08.982949+0000","last_peered":"2024-04-24T01:26:08.982949+0000","last_clean":"2024-04-24T01:26:08.982949+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:26:08.982949+0000","last_undegraded":"2024-04-24T01:26:08.982949+0000","last_fullsized":"2024-04-24T01:26:08.982949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.972093+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:26:01.972093+0000","last_peered":"2024-04-24T01:26:01.972093+0000","last_clean":"2024-04-24T01:26:01.972093+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:26:01.972093+0000","last_undegraded":"2024-04-24T01:26:01.972093+0000","last_fullsized":"2024-04-24T01:26:01.972093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982795+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:26:08.982795+0000","last_peered":"2024-04-24T01:26:08.982795+0000","last_clean":"2024-04-24T01:26:08.982795+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:26:08.982795+0000","last_undegraded":"2024-04-24T01:26:08.982795+0000","last_fullsized":"2024-04-24T01:26:08.982795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'16","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982845+0000","last_change":"2024-04-24T01:24:04.761597+0000","last_active":"2024-04-24T01:26:08.982845+0000","last_peered":"2024-04-24T01:26:08.982845+0000","last_clean":"2024-04-24T01:26:08.982845+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:26:08.982845+0000","last_undegraded":"2024-04-24T01:26:08.982845+0000","last_fullsized":"2024-04-24T01:26:08.982845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.031895+0000","last_change":"2024-04-24T01:27:26.031922+0000","last_active":"2024-04-24T01:27:26.031895+0000","last_peered":"2024-04-24T01:27:26.031895+0000","last_clean":"2024-04-24T01:27:26.031895+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:26.031895+0000","last_undegraded":"2024-04-24T01:27:26.031895+0000","last_fullsized":"2024-04-24T01:27:26.031895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.031809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:08.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984605+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:26:23.984605+0000","last_peered":"2024-04-24T01:26:23.984605+0000","last_clean":"2024-04-24T01:26:23.984605+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:26:23.984605+0000","last_undegraded":"2024-04-24T01:26:23.984605+0000","last_fullsized":"2024-04-24T01:26:23.984605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.047151+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.047151+0000","last_peered":"2024-04-24T01:27:10.047151+0000","last_clean":"2024-04-24T01:27:10.047151+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.047151+0000","last_undegraded":"2024-04-24T01:27:10.047151+0000","last_fullsized":"2024-04-24T01:27:10.047151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982263+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:26:08.982263+0000","last_peered":"2024-04-24T01:26:08.982263+0000","last_clean":"2024-04-24T01:26:08.982263+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:26:08.982263+0000","last_undegraded":"2024-04-24T01:26:08.982263+0000","last_fullsized":"2024-04-24T01:26:08.982263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981505+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:25:58.981505+0000","last_peered":"2024-04-24T01:25:58.981505+0000","last_clean":"2024-04-24T01:25:58.981505+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:25:58.981505+0000","last_undegraded":"2024-04-24T01:25:58.981505+0000","last_fullsized":"2024-04-24T01:25:58.981505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.157265+0000","last_change":"2024-04-24T01:27:21.157304+0000","last_active":"2024-04-24T01:27:21.157265+0000","last_peered":"2024-04-24T01:27:21.157265+0000","last_clean":"2024-04-24T01:27:21.157265+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:27:21.157265+0000","last_undegraded":"2024-04-24T01:27:21.157265+0000","last_fullsized":"2024-04-24T01:27:21.157265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.157174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:08.856778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.850671+0000","last_change":"2024-04-24T01:27:24.850725+0000","last_active":"2024-04-24T01:27:24.850671+0000","last_peered":"2024-04-24T01:27:24.850671+0000","last_clean":"2024-04-24T01:27:24.850671+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:24.850671+0000","last_undegraded":"2024-04-24T01:27:24.850671+0000","last_fullsized":"2024-04-24T01:27:24.850671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.850572+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:25.939996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.111901+0000","last_change":"2024-04-24T01:27:20.111936+0000","last_active":"2024-04-24T01:27:20.111901+0000","last_peered":"2024-04-24T01:27:20.111901+0000","last_clean":"2024-04-24T01:27:20.111901+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:27:20.111901+0000","last_undegraded":"2024-04-24T01:27:20.111901+0000","last_fullsized":"2024-04-24T01:27:20.111901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.111793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:00.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.136819+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.136819+0000","last_peered":"2024-04-24T01:27:10.136819+0000","last_clean":"2024-04-24T01:27:10.136819+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.136819+0000","last_undegraded":"2024-04-24T01:27:10.136819+0000","last_fullsized":"2024-04-24T01:27:10.136819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983103+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:26:13.983103+0000","last_peered":"2024-04-24T01:26:13.983103+0000","last_clean":"2024-04-24T01:26:13.983103+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:26:13.983103+0000","last_undegraded":"2024-04-24T01:26:13.983103+0000","last_fullsized":"2024-04-24T01:26:13.983103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'5","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395074+0000","last_change":"2024-04-24T01:24:00.738356+0000","last_active":"2024-04-24T01:27:10.395074+0000","last_peered":"2024-04-24T01:27:10.395074+0000","last_clean":"2024-04-24T01:27:10.395074+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:27:10.395074+0000","last_undegraded":"2024-04-24T01:27:10.395074+0000","last_fullsized":"2024-04-24T01:27:10.395074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984372+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:26:18.984372+0000","last_peered":"2024-04-24T01:26:18.984372+0000","last_clean":"2024-04-24T01:26:18.984372+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:26:18.984372+0000","last_undegraded":"2024-04-24T01:26:18.984372+0000","last_fullsized":"2024-04-24T01:26:18.984372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.764420+0000","last_change":"2024-04-24T01:27:38.764441+0000","last_active":"2024-04-24T01:27:38.764420+0000","last_peered":"2024-04-24T01:27:38.764420+0000","last_clean":"2024-04-24T01:27:38.764420+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:27:38.764420+0000","last_undegraded":"2024-04-24T01:27:38.764420+0000","last_fullsized":"2024-04-24T01:27:38.764420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.764324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:54.262419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.087710+0000","last_change":"2024-04-24T01:27:31.087751+0000","last_active":"2024-04-24T01:27:31.087710+0000","last_peered":"2024-04-24T01:27:31.087710+0000","last_clean":"2024-04-24T01:27:31.087710+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:31.087710+0000","last_undegraded":"2024-04-24T01:27:31.087710+0000","last_fullsized":"2024-04-24T01:27:31.087710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.087607+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:17.401970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985890+0000","last_change":"2024-04-24T01:24:06.767554+0000","last_active":"2024-04-24T01:26:28.985890+0000","last_peered":"2024-04-24T01:26:28.985890+0000","last_clean":"2024-04-24T01:26:28.985890+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:26:28.985890+0000","last_undegraded":"2024-04-24T01:26:28.985890+0000","last_fullsized":"2024-04-24T01:26:28.985890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.043852+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:10.043852+0000","last_peered":"2024-04-24T01:27:10.043852+0000","last_clean":"2024-04-24T01:27:10.043852+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:10.043852+0000","last_undegraded":"2024-04-24T01:27:10.043852+0000","last_fullsized":"2024-04-24T01:27:10.043852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320685+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.320685+0000","last_peered":"2024-04-24T01:27:10.320685+0000","last_clean":"2024-04-24T01:27:10.320685+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.320685+0000","last_undegraded":"2024-04-24T01:27:10.320685+0000","last_fullsized":"2024-04-24T01:27:10.320685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016711+0000","last_change":"2024-04-24T01:23:58.742514+0000","last_active":"2024-04-24T01:27:17.016711+0000","last_peered":"2024-04-24T01:27:17.016711+0000","last_clean":"2024-04-24T01:27:17.016711+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:17.016711+0000","last_undegraded":"2024-04-24T01:27:17.016711+0000","last_fullsized":"2024-04-24T01:27:17.016711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.142890+0000","last_change":"2024-04-24T01:27:29.142915+0000","last_active":"2024-04-24T01:27:29.142890+0000","last_peered":"2024-04-24T01:27:29.142890+0000","last_clean":"2024-04-24T01:27:29.142890+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:27:29.142890+0000","last_undegraded":"2024-04-24T01:27:29.142890+0000","last_fullsized":"2024-04-24T01:27:29.142890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.142798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:45.905908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.183889+0000","last_change":"2024-04-24T01:27:34.183920+0000","last_active":"2024-04-24T01:27:34.183889+0000","last_peered":"2024-04-24T01:27:34.183889+0000","last_clean":"2024-04-24T01:27:34.183889+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:34.183889+0000","last_undegraded":"2024-04-24T01:27:34.183889+0000","last_fullsized":"2024-04-24T01:27:34.183889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.183806+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:12.698513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.807860+0000","last_change":"2024-04-24T01:27:23.807924+0000","last_active":"2024-04-24T01:27:23.807860+0000","last_peered":"2024-04-24T01:27:23.807860+0000","last_clean":"2024-04-24T01:27:23.807860+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:27:23.807860+0000","last_undegraded":"2024-04-24T01:27:23.807860+0000","last_fullsized":"2024-04-24T01:27:23.807860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.807746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:16.346274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977765+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:41.977765+0000","last_peered":"2024-04-24T01:26:41.977765+0000","last_clean":"2024-04-24T01:26:41.977765+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:41.977765+0000","last_undegraded":"2024-04-24T01:26:41.977765+0000","last_fullsized":"2024-04-24T01:26:41.977765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395049+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:27:10.395049+0000","last_peered":"2024-04-24T01:27:10.395049+0000","last_clean":"2024-04-24T01:27:10.395049+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:27:10.395049+0000","last_undegraded":"2024-04-24T01:27:10.395049+0000","last_fullsized":"2024-04-24T01:27:10.395049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984600+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:26:23.984600+0000","last_peered":"2024-04-24T01:26:23.984600+0000","last_clean":"2024-04-24T01:26:23.984600+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:26:23.984600+0000","last_undegraded":"2024-04-24T01:26:23.984600+0000","last_fullsized":"2024-04-24T01:26:23.984600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.931167+0000","last_change":"2024-04-24T01:27:36.931202+0000","last_active":"2024-04-24T01:27:36.931167+0000","last_peered":"2024-04-24T01:27:36.931167+0000","last_clean":"2024-04-24T01:27:36.931167+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:27:36.931167+0000","last_undegraded":"2024-04-24T01:27:36.931167+0000","last_fullsized":"2024-04-24T01:27:36.931167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.931078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:03.648188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.196789+0000","last_change":"2024-04-24T01:27:31.196826+0000","last_active":"2024-04-24T01:27:31.196789+0000","last_peered":"2024-04-24T01:27:31.196789+0000","last_clean":"2024-04-24T01:27:31.196789+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:31.196789+0000","last_undegraded":"2024-04-24T01:27:31.196789+0000","last_fullsized":"2024-04-24T01:27:31.196789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.196709+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:14:11.522611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.807230+0000","last_change":"2024-04-24T01:27:20.807267+0000","last_active":"2024-04-24T01:27:20.807230+0000","last_peered":"2024-04-24T01:27:20.807230+0000","last_clean":"2024-04-24T01:27:20.807230+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:27:20.807230+0000","last_undegraded":"2024-04-24T01:27:20.807230+0000","last_fullsized":"2024-04-24T01:27:20.807230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.807118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:36.350177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:38.987613+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:26:38.987613+0000","last_peered":"2024-04-24T01:26:38.987613+0000","last_clean":"2024-04-24T01:26:38.987613+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:26:38.987613+0000","last_undegraded":"2024-04-24T01:26:38.987613+0000","last_fullsized":"2024-04-24T01:26:38.987613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.969576+0000","last_change":"2024-04-24T01:27:35.969607+0000","last_active":"2024-04-24T01:27:35.969576+0000","last_peered":"2024-04-24T01:27:35.969576+0000","last_clean":"2024-04-24T01:27:35.969576+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:35.969576+0000","last_undegraded":"2024-04-24T01:27:35.969576+0000","last_fullsized":"2024-04-24T01:27:35.969576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.969453+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:40.292715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984717+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:26:23.984717+0000","last_peered":"2024-04-24T01:26:23.984717+0000","last_clean":"2024-04-24T01:26:23.984717+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:26:23.984717+0000","last_undegraded":"2024-04-24T01:26:23.984717+0000","last_fullsized":"2024-04-24T01:26:23.984717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.118350+0000","last_change":"2024-04-24T01:27:30.118393+0000","last_active":"2024-04-24T01:27:30.118350+0000","last_peered":"2024-04-24T01:27:30.118350+0000","last_clean":"2024-04-24T01:27:30.118350+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:27:30.118350+0000","last_undegraded":"2024-04-24T01:27:30.118350+0000","last_fullsized":"2024-04-24T01:27:30.118350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.118234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:34.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.933092+0000","last_change":"2024-04-24T01:27:32.933125+0000","last_active":"2024-04-24T01:27:32.933092+0000","last_peered":"2024-04-24T01:27:32.933092+0000","last_clean":"2024-04-24T01:27:32.933092+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:32.933092+0000","last_undegraded":"2024-04-24T01:27:32.933092+0000","last_fullsized":"2024-04-24T01:27:32.933092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.933012+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:06:06.750907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.831039+0000","last_change":"2024-04-24T01:27:20.831064+0000","last_active":"2024-04-24T01:27:20.831039+0000","last_peered":"2024-04-24T01:27:20.831039+0000","last_clean":"2024-04-24T01:27:20.831039+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:27:20.831039+0000","last_undegraded":"2024-04-24T01:27:20.831039+0000","last_fullsized":"2024-04-24T01:27:20.831039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.830957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:31.945556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982941+0000","last_change":"2024-04-24T01:24:00.736176+0000","last_active":"2024-04-24T01:26:08.982941+0000","last_peered":"2024-04-24T01:26:08.982941+0000","last_clean":"2024-04-24T01:26:08.982941+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:26:08.982941+0000","last_undegraded":"2024-04-24T01:26:08.982941+0000","last_fullsized":"2024-04-24T01:26:08.982941+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985004+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:26:23.985004+0000","last_peered":"2024-04-24T01:26:23.985004+0000","last_clean":"2024-04-24T01:26:23.985004+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:26:23.985004+0000","last_undegraded":"2024-04-24T01:26:23.985004+0000","last_fullsized":"2024-04-24T01:26:23.985004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.972079+0000","last_change":"2024-04-24T01:24:02.752935+0000","last_active":"2024-04-24T01:26:01.972079+0000","last_peered":"2024-04-24T01:26:01.972079+0000","last_clean":"2024-04-24T01:26:01.972079+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:26:01.972079+0000","last_undegraded":"2024-04-24T01:26:01.972079+0000","last_fullsized":"2024-04-24T01:26:01.972079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.233047+0000","last_change":"2024-04-24T01:27:32.233080+0000","last_active":"2024-04-24T01:27:32.233047+0000","last_peered":"2024-04-24T01:27:32.233047+0000","last_clean":"2024-04-24T01:27:32.233047+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:32.233047+0000","last_undegraded":"2024-04-24T01:27:32.233047+0000","last_fullsized":"2024-04-24T01:27:32.233047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.232954+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:33.771403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.841600+0000","last_change":"2024-04-24T01:27:22.841624+0000","last_active":"2024-04-24T01:27:22.841600+0000","last_peered":"2024-04-24T01:27:22.841600+0000","last_clean":"2024-04-24T01:27:22.841600+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:27:22.841600+0000","last_undegraded":"2024-04-24T01:27:22.841600+0000","last_fullsized":"2024-04-24T01:27:22.841600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.841514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:44.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448352+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.448352+0000","last_peered":"2024-04-24T01:27:10.448352+0000","last_clean":"2024-04-24T01:27:10.448352+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.448352+0000","last_undegraded":"2024-04-24T01:27:10.448352+0000","last_fullsized":"2024-04-24T01:27:10.448352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320749+0000","last_change":"2024-04-24T01:24:00.746542+0000","last_active":"2024-04-24T01:27:10.320749+0000","last_peered":"2024-04-24T01:27:10.320749+0000","last_clean":"2024-04-24T01:27:10.320749+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:10.320749+0000","last_undegraded":"2024-04-24T01:27:10.320749+0000","last_fullsized":"2024-04-24T01:27:10.320749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016819+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:27:17.016819+0000","last_peered":"2024-04-24T01:27:17.016819+0000","last_clean":"2024-04-24T01:27:17.016819+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:27:17.016819+0000","last_undegraded":"2024-04-24T01:27:17.016819+0000","last_fullsized":"2024-04-24T01:27:17.016819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982311+0000","last_change":"2024-04-24T01:24:02.750800+0000","last_active":"2024-04-24T01:26:08.982311+0000","last_peered":"2024-04-24T01:26:08.982311+0000","last_clean":"2024-04-24T01:26:08.982311+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:26:08.982311+0000","last_undegraded":"2024-04-24T01:26:08.982311+0000","last_fullsized":"2024-04-24T01:26:08.982311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.087296+0000","last_change":"2024-04-24T01:27:25.087358+0000","last_active":"2024-04-24T01:27:25.087296+0000","last_peered":"2024-04-24T01:27:25.087296+0000","last_clean":"2024-04-24T01:27:25.087296+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:25.087296+0000","last_undegraded":"2024-04-24T01:27:25.087296+0000","last_fullsized":"2024-04-24T01:27:25.087296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.087202+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:18.223546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.735703+0000","last_change":"2024-04-24T01:27:33.735761+0000","last_active":"2024-04-24T01:27:33.735703+0000","last_peered":"2024-04-24T01:27:33.735703+0000","last_clean":"2024-04-24T01:27:33.735703+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:27:33.735703+0000","last_undegraded":"2024-04-24T01:27:33.735703+0000","last_fullsized":"2024-04-24T01:27:33.735703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.735599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:44.989596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985964+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:26:28.985964+0000","last_peered":"2024-04-24T01:26:28.985964+0000","last_clean":"2024-04-24T01:26:28.985964+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:26:28.985964+0000","last_undegraded":"2024-04-24T01:26:28.985964+0000","last_fullsized":"2024-04-24T01:26:28.985964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.973256+0000","last_change":"2024-04-24T01:27:33.973301+0000","last_active":"2024-04-24T01:27:33.973256+0000","last_peered":"2024-04-24T01:27:33.973256+0000","last_clean":"2024-04-24T01:27:33.973256+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:27:33.973256+0000","last_undegraded":"2024-04-24T01:27:33.973256+0000","last_fullsized":"2024-04-24T01:27:33.973256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.973155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:28.429349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985527+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:26:28.985527+0000","last_peered":"2024-04-24T01:26:28.985527+0000","last_clean":"2024-04-24T01:26:28.985527+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:26:28.985527+0000","last_undegraded":"2024-04-24T01:26:28.985527+0000","last_fullsized":"2024-04-24T01:26:28.985527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986305+0000","last_change":"2024-04-24T01:24:02.751213+0000","last_active":"2024-04-24T01:26:33.986305+0000","last_peered":"2024-04-24T01:26:33.986305+0000","last_clean":"2024-04-24T01:26:33.986305+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:26:33.986305+0000","last_undegraded":"2024-04-24T01:26:33.986305+0000","last_fullsized":"2024-04-24T01:26:33.986305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.098321+0000","last_change":"2024-04-24T01:27:28.098384+0000","last_active":"2024-04-24T01:27:28.098321+0000","last_peered":"2024-04-24T01:27:28.098321+0000","last_clean":"2024-04-24T01:27:28.098321+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:28.098321+0000","last_undegraded":"2024-04-24T01:27:28.098321+0000","last_fullsized":"2024-04-24T01:27:28.098321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.098205+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:13.672642+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.091400+0000","last_change":"2024-04-24T01:27:22.091423+0000","last_active":"2024-04-24T01:27:22.091400+0000","last_peered":"2024-04-24T01:27:22.091400+0000","last_clean":"2024-04-24T01:27:22.091400+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:27:22.091400+0000","last_undegraded":"2024-04-24T01:27:22.091400+0000","last_fullsized":"2024-04-24T01:27:22.091400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.091312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:42.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985951+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:28.985951+0000","last_peered":"2024-04-24T01:26:28.985951+0000","last_clean":"2024-04-24T01:26:28.985951+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:28.985951+0000","last_undegraded":"2024-04-24T01:26:28.985951+0000","last_fullsized":"2024-04-24T01:26:28.985951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976431+0000","last_change":"2024-04-24T01:24:00.732301+0000","last_active":"2024-04-24T01:26:31.976431+0000","last_peered":"2024-04-24T01:26:31.976431+0000","last_clean":"2024-04-24T01:26:31.976431+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:26:31.976431+0000","last_undegraded":"2024-04-24T01:26:31.976431+0000","last_fullsized":"2024-04-24T01:26:31.976431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986002+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:26:28.986002+0000","last_peered":"2024-04-24T01:26:28.986002+0000","last_clean":"2024-04-24T01:26:28.986002+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:26:28.986002+0000","last_undegraded":"2024-04-24T01:26:28.986002+0000","last_fullsized":"2024-04-24T01:26:28.986002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986379+0000","last_change":"2024-04-24T01:24:02.753145+0000","last_active":"2024-04-24T01:26:33.986379+0000","last_peered":"2024-04-24T01:26:33.986379+0000","last_clean":"2024-04-24T01:26:33.986379+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:26:33.986379+0000","last_undegraded":"2024-04-24T01:26:33.986379+0000","last_fullsized":"2024-04-24T01:26:33.986379+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.983543+0000","last_change":"2024-04-24T01:27:34.983586+0000","last_active":"2024-04-24T01:27:34.983543+0000","last_peered":"2024-04-24T01:27:34.983543+0000","last_clean":"2024-04-24T01:27:34.983543+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:27:34.983543+0000","last_undegraded":"2024-04-24T01:27:34.983543+0000","last_fullsized":"2024-04-24T01:27:34.983543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.983448+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:01.670877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.929151+0000","last_change":"2024-04-24T01:27:33.929176+0000","last_active":"2024-04-24T01:27:33.929151+0000","last_peered":"2024-04-24T01:27:33.929151+0000","last_clean":"2024-04-24T01:27:33.929151+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:33.929151+0000","last_undegraded":"2024-04-24T01:27:33.929151+0000","last_fullsized":"2024-04-24T01:27:33.929151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.929072+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:18.783745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985841+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:26:28.985841+0000","last_peered":"2024-04-24T01:26:28.985841+0000","last_clean":"2024-04-24T01:26:28.985841+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:26:28.985841+0000","last_undegraded":"2024-04-24T01:26:28.985841+0000","last_fullsized":"2024-04-24T01:26:28.985841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349900+0000","last_change":"2024-04-24T01:24:00.732138+0000","last_active":"2024-04-24T01:27:10.349900+0000","last_peered":"2024-04-24T01:27:10.349900+0000","last_clean":"2024-04-24T01:27:10.349900+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:10.349900+0000","last_undegraded":"2024-04-24T01:27:10.349900+0000","last_fullsized":"2024-04-24T01:27:10.349900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985561+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:26:28.985561+0000","last_peered":"2024-04-24T01:26:28.985561+0000","last_clean":"2024-04-24T01:26:28.985561+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:26:28.985561+0000","last_undegraded":"2024-04-24T01:26:28.985561+0000","last_fullsized":"2024-04-24T01:26:28.985561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.756543+0000","last_change":"2024-04-24T01:27:36.756588+0000","last_active":"2024-04-24T01:27:36.756543+0000","last_peered":"2024-04-24T01:27:36.756543+0000","last_clean":"2024-04-24T01:27:36.756543+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:27:36.756543+0000","last_undegraded":"2024-04-24T01:27:36.756543+0000","last_fullsized":"2024-04-24T01:27:36.756543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.756455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:22.449180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.761744+0000","last_change":"2024-04-24T01:27:30.761800+0000","last_active":"2024-04-24T01:27:30.761744+0000","last_peered":"2024-04-24T01:27:30.761744+0000","last_clean":"2024-04-24T01:27:30.761744+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:30.761744+0000","last_undegraded":"2024-04-24T01:27:30.761744+0000","last_fullsized":"2024-04-24T01:27:30.761744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.761661+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:48.545704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976341+0000","last_change":"2024-04-24T01:24:06.770663+0000","last_active":"2024-04-24T01:26:31.976341+0000","last_peered":"2024-04-24T01:26:31.976341+0000","last_clean":"2024-04-24T01:26:31.976341+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:26:31.976341+0000","last_undegraded":"2024-04-24T01:26:31.976341+0000","last_fullsized":"2024-04-24T01:26:31.976341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.739909+0000","last_change":"2024-04-24T01:27:37.739935+0000","last_active":"2024-04-24T01:27:37.739909+0000","last_peered":"2024-04-24T01:27:37.739909+0000","last_clean":"2024-04-24T01:27:37.739909+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:27:37.739909+0000","last_undegraded":"2024-04-24T01:27:37.739909+0000","last_fullsized":"2024-04-24T01:27:37.739909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.739820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:34.597803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.321174+0000","last_change":"2024-04-24T01:24:00.729678+0000","last_active":"2024-04-24T01:27:10.321174+0000","last_peered":"2024-04-24T01:27:10.321174+0000","last_clean":"2024-04-24T01:27:10.321174+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:10.321174+0000","last_undegraded":"2024-04-24T01:27:10.321174+0000","last_fullsized":"2024-04-24T01:27:10.321174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986062+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:26:28.986062+0000","last_peered":"2024-04-24T01:26:28.986062+0000","last_clean":"2024-04-24T01:26:28.986062+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:26:28.986062+0000","last_undegraded":"2024-04-24T01:26:28.986062+0000","last_fullsized":"2024-04-24T01:26:28.986062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.913584+0000","last_change":"2024-04-24T01:27:34.913612+0000","last_active":"2024-04-24T01:27:34.913584+0000","last_peered":"2024-04-24T01:27:34.913584+0000","last_clean":"2024-04-24T01:27:34.913584+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:27:34.913584+0000","last_undegraded":"2024-04-24T01:27:34.913584+0000","last_fullsized":"2024-04-24T01:27:34.913584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.913487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:18.229615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.156326+0000","last_change":"2024-04-24T01:27:30.156369+0000","last_active":"2024-04-24T01:27:30.156326+0000","last_peered":"2024-04-24T01:27:30.156326+0000","last_clean":"2024-04-24T01:27:30.156326+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:30.156326+0000","last_undegraded":"2024-04-24T01:27:30.156326+0000","last_fullsized":"2024-04-24T01:27:30.156326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.156230+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:37.955468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986735+0000","last_change":"2024-04-24T01:24:06.765993+0000","last_active":"2024-04-24T01:26:33.986735+0000","last_peered":"2024-04-24T01:26:33.986735+0000","last_clean":"2024-04-24T01:26:33.986735+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:26:33.986735+0000","last_undegraded":"2024-04-24T01:26:33.986735+0000","last_fullsized":"2024-04-24T01:26:33.986735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986980+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:26:33.986980+0000","last_peered":"2024-04-24T01:26:33.986980+0000","last_clean":"2024-04-24T01:26:33.986980+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:26:33.986980+0000","last_undegraded":"2024-04-24T01:26:33.986980+0000","last_fullsized":"2024-04-24T01:26:33.986980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394981+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:27:10.394981+0000","last_peered":"2024-04-24T01:27:10.394981+0000","last_clean":"2024-04-24T01:27:10.394981+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:27:10.394981+0000","last_undegraded":"2024-04-24T01:27:10.394981+0000","last_fullsized":"2024-04-24T01:27:10.394981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.972102+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:26:01.972102+0000","last_peered":"2024-04-24T01:26:01.972102+0000","last_clean":"2024-04-24T01:26:01.972102+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:26:01.972102+0000","last_undegraded":"2024-04-24T01:26:01.972102+0000","last_fullsized":"2024-04-24T01:26:01.972102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.755391+0000","last_change":"2024-04-24T01:27:34.755417+0000","last_active":"2024-04-24T01:27:34.755391+0000","last_peered":"2024-04-24T01:27:34.755391+0000","last_clean":"2024-04-24T01:27:34.755391+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:27:34.755391+0000","last_undegraded":"2024-04-24T01:27:34.755391+0000","last_fullsized":"2024-04-24T01:27:34.755391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.755296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:32.167294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'35","reported_seq":86,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.918053+0000","last_change":"2024-04-24T01:24:04.761512+0000","last_active":"2024-04-24T01:27:16.918053+0000","last_peered":"2024-04-24T01:27:16.918053+0000","last_clean":"2024-04-24T01:27:16.918053+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:16.918053+0000","last_undegraded":"2024-04-24T01:27:16.918053+0000","last_fullsized":"2024-04-24T01:27:16.918053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:38.987555+0000","last_change":"2024-04-24T01:24:06.770228+0000","last_active":"2024-04-24T01:26:38.987555+0000","last_peered":"2024-04-24T01:26:38.987555+0000","last_clean":"2024-04-24T01:26:38.987555+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:26:38.987555+0000","last_undegraded":"2024-04-24T01:26:38.987555+0000","last_fullsized":"2024-04-24T01:26:38.987555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986917+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:33.986917+0000","last_peered":"2024-04-24T01:26:33.986917+0000","last_clean":"2024-04-24T01:26:33.986917+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:33.986917+0000","last_undegraded":"2024-04-24T01:26:33.986917+0000","last_fullsized":"2024-04-24T01:26:33.986917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985372+0000","last_change":"2024-04-24T01:24:00.730610+0000","last_active":"2024-04-24T01:26:28.985372+0000","last_peered":"2024-04-24T01:26:28.985372+0000","last_clean":"2024-04-24T01:26:28.985372+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:26:28.985372+0000","last_undegraded":"2024-04-24T01:26:28.985372+0000","last_fullsized":"2024-04-24T01:26:28.985372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981615+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:26:03.981615+0000","last_peered":"2024-04-24T01:26:03.981615+0000","last_clean":"2024-04-24T01:26:03.981615+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:26:03.981615+0000","last_undegraded":"2024-04-24T01:26:03.981615+0000","last_fullsized":"2024-04-24T01:26:03.981615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.719484+0000","last_change":"2024-04-24T01:27:32.719516+0000","last_active":"2024-04-24T01:27:32.719484+0000","last_peered":"2024-04-24T01:27:32.719484+0000","last_clean":"2024-04-24T01:27:32.719484+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:27:32.719484+0000","last_undegraded":"2024-04-24T01:27:32.719484+0000","last_fullsized":"2024-04-24T01:27:32.719484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.719397+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:10.815530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'48","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:16.928645+0000","last_change":"2024-04-24T01:24:04.761785+0000","last_active":"2024-04-24T01:27:16.928645+0000","last_peered":"2024-04-24T01:27:16.928645+0000","last_clean":"2024-04-24T01:27:16.928645+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:16.928645+0000","last_undegraded":"2024-04-24T01:27:16.928645+0000","last_fullsized":"2024-04-24T01:27:16.928645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:03.732680+0000","last_clean_scrub_stamp":"2024-04-24T01:24:03.732680+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:36.976986+0000","last_change":"2024-04-24T01:24:06.770604+0000","last_active":"2024-04-24T01:26:36.976986+0000","last_peered":"2024-04-24T01:26:36.976986+0000","last_clean":"2024-04-24T01:26:36.976986+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:26:36.976986+0000","last_undegraded":"2024-04-24T01:26:36.976986+0000","last_fullsized":"2024-04-24T01:26:36.976986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:05.740119+0000","last_clean_scrub_stamp":"2024-04-24T01:24:05.740119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986026+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:28.986026+0000","last_peered":"2024-04-24T01:26:28.986026+0000","last_clean":"2024-04-24T01:26:28.986026+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:28.986026+0000","last_undegraded":"2024-04-24T01:26:28.986026+0000","last_fullsized":"2024-04-24T01:26:28.986026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983091+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:13.983091+0000","last_peered":"2024-04-24T01:26:13.983091+0000","last_clean":"2024-04-24T01:26:13.983091+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:13.983091+0000","last_undegraded":"2024-04-24T01:26:13.983091+0000","last_fullsized":"2024-04-24T01:26:13.983091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016794+0000","last_change":"2024-04-24T01:23:58.747335+0000","last_active":"2024-04-24T01:27:17.016794+0000","last_peered":"2024-04-24T01:27:17.016794+0000","last_clean":"2024-04-24T01:27:17.016794+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:17.016794+0000","last_undegraded":"2024-04-24T01:27:17.016794+0000","last_fullsized":"2024-04-24T01:27:17.016794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973508+0000","last_change":"2024-04-24T01:24:00.732134+0000","last_active":"2024-04-24T01:26:11.973508+0000","last_peered":"2024-04-24T01:26:11.973508+0000","last_clean":"2024-04-24T01:26:11.973508+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:26:11.973508+0000","last_undegraded":"2024-04-24T01:26:11.973508+0000","last_fullsized":"2024-04-24T01:26:11.973508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972607+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:26:06.972607+0000","last_peered":"2024-04-24T01:26:06.972607+0000","last_clean":"2024-04-24T01:26:06.972607+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:26:06.972607+0000","last_undegraded":"2024-04-24T01:26:06.972607+0000","last_fullsized":"2024-04-24T01:26:06.972607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.133042+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.133042+0000","last_peered":"2024-04-24T01:27:10.133042+0000","last_clean":"2024-04-24T01:27:10.133042+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.133042+0000","last_undegraded":"2024-04-24T01:27:10.133042+0000","last_fullsized":"2024-04-24T01:27:10.133042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982114+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:26:03.982114+0000","last_peered":"2024-04-24T01:26:03.982114+0000","last_clean":"2024-04-24T01:26:03.982114+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:26:03.982114+0000","last_undegraded":"2024-04-24T01:26:03.982114+0000","last_fullsized":"2024-04-24T01:26:03.982114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.132527+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.132527+0000","last_peered":"2024-04-24T01:27:10.132527+0000","last_clean":"2024-04-24T01:27:10.132527+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.132527+0000","last_undegraded":"2024-04-24T01:27:10.132527+0000","last_fullsized":"2024-04-24T01:27:10.132527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972688+0000","last_change":"2024-04-24T01:23:58.747256+0000","last_active":"2024-04-24T01:26:06.972688+0000","last_peered":"2024-04-24T01:26:06.972688+0000","last_clean":"2024-04-24T01:26:06.972688+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:26:06.972688+0000","last_undegraded":"2024-04-24T01:26:06.972688+0000","last_fullsized":"2024-04-24T01:26:06.972688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320624+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.320624+0000","last_peered":"2024-04-24T01:27:10.320624+0000","last_clean":"2024-04-24T01:27:10.320624+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.320624+0000","last_undegraded":"2024-04-24T01:27:10.320624+0000","last_fullsized":"2024-04-24T01:27:10.320624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973452+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:26:11.973452+0000","last_peered":"2024-04-24T01:26:11.973452+0000","last_clean":"2024-04-24T01:26:11.973452+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:26:11.973452+0000","last_undegraded":"2024-04-24T01:26:11.973452+0000","last_fullsized":"2024-04-24T01:26:11.973452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269069+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.269069+0000","last_peered":"2024-04-24T01:27:10.269069+0000","last_clean":"2024-04-24T01:27:10.269069+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.269069+0000","last_undegraded":"2024-04-24T01:27:10.269069+0000","last_fullsized":"2024-04-24T01:27:10.269069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.543852+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.543852+0000","last_peered":"2024-04-24T01:26:09.543852+0000","last_clean":"2024-04-24T01:26:09.543852+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.543852+0000","last_undegraded":"2024-04-24T01:26:09.543852+0000","last_fullsized":"2024-04-24T01:26:09.543852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972634+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:26:06.972634+0000","last_peered":"2024-04-24T01:26:06.972634+0000","last_clean":"2024-04-24T01:26:06.972634+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:26:06.972634+0000","last_undegraded":"2024-04-24T01:26:06.972634+0000","last_fullsized":"2024-04-24T01:26:06.972634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.341095+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.341095+0000","last_peered":"2024-04-24T01:27:10.341095+0000","last_clean":"2024-04-24T01:27:10.341095+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.341095+0000","last_undegraded":"2024-04-24T01:27:10.341095+0000","last_fullsized":"2024-04-24T01:27:10.341095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.132989+0000","last_change":"2024-04-24T01:24:00.744090+0000","last_active":"2024-04-24T01:27:10.132989+0000","last_peered":"2024-04-24T01:27:10.132989+0000","last_clean":"2024-04-24T01:27:10.132989+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:10.132989+0000","last_undegraded":"2024-04-24T01:27:10.132989+0000","last_fullsized":"2024-04-24T01:27:10.132989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973534+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:11.973534+0000","last_peered":"2024-04-24T01:26:11.973534+0000","last_clean":"2024-04-24T01:26:11.973534+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:11.973534+0000","last_undegraded":"2024-04-24T01:26:11.973534+0000","last_fullsized":"2024-04-24T01:26:11.973534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320725+0000","last_change":"2024-04-24T01:24:00.745364+0000","last_active":"2024-04-24T01:27:10.320725+0000","last_peered":"2024-04-24T01:27:10.320725+0000","last_clean":"2024-04-24T01:27:10.320725+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:10.320725+0000","last_undegraded":"2024-04-24T01:27:10.320725+0000","last_fullsized":"2024-04-24T01:27:10.320725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982757+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:26:08.982757+0000","last_peered":"2024-04-24T01:26:08.982757+0000","last_clean":"2024-04-24T01:26:08.982757+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:26:08.982757+0000","last_undegraded":"2024-04-24T01:26:08.982757+0000","last_fullsized":"2024-04-24T01:26:08.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.047096+0000","last_change":"2024-04-24T01:24:00.738594+0000","last_active":"2024-04-24T01:27:10.047096+0000","last_peered":"2024-04-24T01:27:10.047096+0000","last_clean":"2024-04-24T01:27:10.047096+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:10.047096+0000","last_undegraded":"2024-04-24T01:27:10.047096+0000","last_fullsized":"2024-04-24T01:27:10.047096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974123+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:26:16.974123+0000","last_peered":"2024-04-24T01:26:16.974123+0000","last_clean":"2024-04-24T01:26:16.974123+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:26:16.974123+0000","last_undegraded":"2024-04-24T01:26:16.974123+0000","last_fullsized":"2024-04-24T01:26:16.974123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.131621+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.131621+0000","last_peered":"2024-04-24T01:27:10.131621+0000","last_clean":"2024-04-24T01:27:10.131621+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.131621+0000","last_undegraded":"2024-04-24T01:27:10.131621+0000","last_fullsized":"2024-04-24T01:27:10.131621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.255364+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.255364+0000","last_peered":"2024-04-24T01:27:10.255364+0000","last_clean":"2024-04-24T01:27:10.255364+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.255364+0000","last_undegraded":"2024-04-24T01:27:10.255364+0000","last_fullsized":"2024-04-24T01:27:10.255364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.321036+0000","last_change":"2024-04-24T01:24:00.739108+0000","last_active":"2024-04-24T01:27:10.321036+0000","last_peered":"2024-04-24T01:27:10.321036+0000","last_clean":"2024-04-24T01:27:10.321036+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:10.321036+0000","last_undegraded":"2024-04-24T01:27:10.321036+0000","last_fullsized":"2024-04-24T01:27:10.321036+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.982977+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:26:13.982977+0000","last_peered":"2024-04-24T01:26:13.982977+0000","last_clean":"2024-04-24T01:26:13.982977+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:26:13.982977+0000","last_undegraded":"2024-04-24T01:26:13.982977+0000","last_fullsized":"2024-04-24T01:26:13.982977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983775+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:26:18.983775+0000","last_peered":"2024-04-24T01:26:18.983775+0000","last_clean":"2024-04-24T01:26:18.983775+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:26:18.983775+0000","last_undegraded":"2024-04-24T01:26:18.983775+0000","last_fullsized":"2024-04-24T01:26:18.983775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983594+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:26:13.983594+0000","last_peered":"2024-04-24T01:26:13.983594+0000","last_clean":"2024-04-24T01:26:13.983594+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:26:13.983594+0000","last_undegraded":"2024-04-24T01:26:13.983594+0000","last_fullsized":"2024-04-24T01:26:13.983594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'7","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395008+0000","last_change":"2024-04-24T01:24:00.745475+0000","last_active":"2024-04-24T01:27:10.395008+0000","last_peered":"2024-04-24T01:27:10.395008+0000","last_clean":"2024-04-24T01:27:10.395008+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:27:10.395008+0000","last_undegraded":"2024-04-24T01:27:10.395008+0000","last_fullsized":"2024-04-24T01:27:10.395008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983635+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:26:13.983635+0000","last_peered":"2024-04-24T01:26:13.983635+0000","last_clean":"2024-04-24T01:26:13.983635+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:26:13.983635+0000","last_undegraded":"2024-04-24T01:26:13.983635+0000","last_fullsized":"2024-04-24T01:26:13.983635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350890+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350890+0000","last_peered":"2024-04-24T01:27:10.350890+0000","last_clean":"2024-04-24T01:27:10.350890+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350890+0000","last_undegraded":"2024-04-24T01:27:10.350890+0000","last_fullsized":"2024-04-24T01:27:10.350890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983882+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:26:18.983882+0000","last_peered":"2024-04-24T01:26:18.983882+0000","last_clean":"2024-04-24T01:26:18.983882+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:26:18.983882+0000","last_undegraded":"2024-04-24T01:26:18.983882+0000","last_fullsized":"2024-04-24T01:26:18.983882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'11","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394464+0000","last_change":"2024-04-24T01:24:00.739611+0000","last_active":"2024-04-24T01:27:10.394464+0000","last_peered":"2024-04-24T01:27:10.394464+0000","last_clean":"2024-04-24T01:27:10.394464+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:10.394464+0000","last_undegraded":"2024-04-24T01:27:10.394464+0000","last_fullsized":"2024-04-24T01:27:10.394464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984456+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:26:18.984456+0000","last_peered":"2024-04-24T01:26:18.984456+0000","last_clean":"2024-04-24T01:26:18.984456+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:26:18.984456+0000","last_undegraded":"2024-04-24T01:26:18.984456+0000","last_fullsized":"2024-04-24T01:26:18.984456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984249+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:26:18.984249+0000","last_peered":"2024-04-24T01:26:18.984249+0000","last_clean":"2024-04-24T01:26:18.984249+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:26:18.984249+0000","last_undegraded":"2024-04-24T01:26:18.984249+0000","last_fullsized":"2024-04-24T01:26:18.984249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.271216+0000","last_change":"2024-04-24T01:24:00.746896+0000","last_active":"2024-04-24T01:27:10.271216+0000","last_peered":"2024-04-24T01:27:10.271216+0000","last_clean":"2024-04-24T01:27:10.271216+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:10.271216+0000","last_undegraded":"2024-04-24T01:27:10.271216+0000","last_fullsized":"2024-04-24T01:27:10.271216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974849+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:26:21.974849+0000","last_peered":"2024-04-24T01:26:21.974849+0000","last_clean":"2024-04-24T01:26:21.974849+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:26:21.974849+0000","last_undegraded":"2024-04-24T01:26:21.974849+0000","last_fullsized":"2024-04-24T01:26:21.974849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985611+0000","last_change":"2024-04-24T01:24:00.743656+0000","last_active":"2024-04-24T01:26:28.985611+0000","last_peered":"2024-04-24T01:26:28.985611+0000","last_clean":"2024-04-24T01:26:28.985611+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:26:28.985611+0000","last_undegraded":"2024-04-24T01:26:28.985611+0000","last_fullsized":"2024-04-24T01:26:28.985611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1204,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1712,"ondisk_log_size":1712,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640308,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640306,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36344,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335496,"statfs":{"total":96636764160,"available":96599547904,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":454656,"data_stored":150586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:27:41.855 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.855 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.855 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.856 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.857 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.858 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.859 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.859 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.859 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.859 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.859 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.860 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.861 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.862 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.863 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:23:44.656300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=44, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.864 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.865 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.866 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.866 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.866 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.866 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.867 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.867 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.867 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.867 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.868 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.869 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.870 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.870 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.870 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.870 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.870 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.871 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.872 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.872 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.872 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.872 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.872 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.873 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.874 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.874 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.874 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.874 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.874 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.875 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.875 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.875 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.875 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.876 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.876 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.876 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.876 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.877 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.877 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.877 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.877 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.877 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.878 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.878 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.878 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.878 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.879 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.879 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T01:24:03.732680+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=3, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.879 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-24T01:24:05.740119+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=5, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.879 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.880 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.880 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.880 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.880 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.880 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.881 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.881 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.881 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.881 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.882 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.883 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.884 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.885 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.885 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.885 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.885 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.885 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.886 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.886 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.886 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.886 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:27:41.886 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:28:01.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.995+0000 7f8a1653b640 1 Processor -- start 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.995+0000 7f8a1653b640 1 -- start start 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a1653b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a1006fd50 0x7f8a10133860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a1653b640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a10133da0 con 0x7f8a1006f260 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a1653b640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8a10070bc0 con 0x7f8a1006fd50 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a1006fd50 0x7f8a10133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0ffff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8a1006f260 0x7f8a1006f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:35614/0 (socket says 172.21.15.142:35614) 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0f7fe640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8a1006fd50 0x7f8a10133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39958/0 (socket says 172.21.15.142:39958) 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0ffff640 1 -- 172.21.15.142:0/356666725 learned_addr learned my addr 172.21.15.142:0/356666725 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:28:01.997 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0f7fe640 1 -- 172.21.15.142:0/356666725 >> v1:172.21.15.142:6789/0 conn(0x7f8a1006f260 legacy=0x7f8a1006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0effd640 1 -- 172.21.15.142:0/356666725 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498407658 0 0) 0x7f8a10133da0 con 0x7f8a1006f260 2024-04-24T01:28:01.998 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.996+0000 7f8a0f7fe640 1 -- 172.21.15.142:0/356666725 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a10134f80 con 0x7f8a1006fd50 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.997+0000 7f8a0f7fe640 1 --2- 172.21.15.142:0/356666725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006fd50 0x7f8a10133860 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009720 tx=0x7f8a0402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edae2461d0f87044 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.997+0000 7f8a0effd640 1 -- 172.21.15.142:0/356666725 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a040316d0 con 0x7f8a1006fd50 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.997+0000 7f8a0effd640 1 -- 172.21.15.142:0/356666725 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a04037070 con 0x7f8a1006fd50 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.997+0000 7f8a0effd640 1 -- 172.21.15.142:0/356666725 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a040319c0 con 0x7f8a1006fd50 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 -- 172.21.15.142:0/356666725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006fd50 msgr2=0x7f8a10133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 --2- 172.21.15.142:0/356666725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006fd50 0x7f8a10133860 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009720 tx=0x7f8a0402b840 comp rx=0 tx=0).stop 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 -- 172.21.15.142:0/356666725 shutdown_connections 2024-04-24T01:28:01.999 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 --2- 172.21.15.142:0/356666725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006fd50 0x7f8a10133860 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 -- 172.21.15.142:0/356666725 >> 172.21.15.142:0/356666725 conn(0x7f8a1009e170 msgr2=0x7f8a1006d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 -- 172.21.15.142:0/356666725 shutdown_connections 2024-04-24T01:28:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.998+0000 7f8a1653b640 1 -- 172.21.15.142:0/356666725 wait complete. 2024-04-24T01:28:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a1653b640 1 Processor -- start 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a1653b640 1 -- start start 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a1653b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a1653b640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10134300 con 0x7f8a1006f260 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a0ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a0ffff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39968/0 (socket says 172.21.15.142:39968) 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:01.999+0000 7f8a0ffff640 1 -- 172.21.15.142:0/1797450536 learned_addr learned my addr 172.21.15.142:0/1797450536 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a0ffff640 1 -- 172.21.15.142:0/1797450536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a10130bf0 con 0x7f8a1006f260 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a0ffff640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c420 tx=0x7f8a0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00018070 con 0x7f8a1006f260 2024-04-24T01:28:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a000074d0 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a00004950 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a101333a0 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.000+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a101315d0 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.001+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8a0001b070 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.001+0000 7f8a0cff9640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 0x7f89fc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.001+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a100a18a0 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.001+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8a0004ada0 con 0x7f8a1006f260 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.001+0000 7f8a0f7fe640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 0x7f89fc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.002+0000 7f8a0f7fe640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 0x7f89fc03a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009720 tx=0x7f8a04008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:02.006 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.006+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f8a100a18a0 con 0x7f8a1006f260 2024-04-24T01:28:02.177 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.176+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a10062da0 con 0x7f89fc038060 2024-04-24T01:28:02.192 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.192+0000 7f8a0cff9640 1 -- 172.21.15.142:0/1797450536 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+662006 (secure 0 0 0) 0x7f8a10062da0 con 0x7f89fc038060 2024-04-24T01:28:02.201 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:28:02.206 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 msgr2=0x7f89fc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 0x7f89fc03a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009720 tx=0x7f8a04008030 comp rx=0 tx=0).stop 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 msgr2=0x7f8a10124320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c420 tx=0x7f8a0000c8e0 comp rx=0 tx=0).stop 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 shutdown_connections 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f89fc038060 0x7f89fc03a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:02.209 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 --2- 172.21.15.142:0/1797450536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a1006f260 0x7f8a10124320 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:02.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.196+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 >> 172.21.15.142:0/1797450536 conn(0x7f8a1009e170 msgr2=0x7f8a1009e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:02.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.197+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 shutdown_connections 2024-04-24T01:28:02.210 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:02.197+0000 7f8a1653b640 1 -- 172.21.15.142:0/1797450536 wait complete. 2024-04-24T01:28:02.210 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-24T01:28:01.977118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5377,"num_read_kb":4926,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5004,"ondisk_log_size":5004,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160888,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326472,"statfs":{"total":386547056640,"available":386382307328,"internally_reserved":0,"allocated":2973696,"data_stored":1778210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.114984+0000","last_change":"2024-04-24T01:27:51.115018+0000","last_active":"2024-04-24T01:27:51.114984+0000","last_peered":"2024-04-24T01:27:51.114984+0000","last_clean":"2024-04-24T01:27:51.114984+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:27:51.114984+0000","last_undegraded":"2024-04-24T01:27:51.114984+0000","last_fullsized":"2024-04-24T01:27:51.114984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.114886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:37.582826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.756639+0000","last_change":"2024-04-24T01:27:44.756666+0000","last_active":"2024-04-24T01:27:44.756639+0000","last_peered":"2024-04-24T01:27:44.756639+0000","last_clean":"2024-04-24T01:27:44.756639+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:44.756639+0000","last_undegraded":"2024-04-24T01:27:44.756639+0000","last_fullsized":"2024-04-24T01:27:44.756639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.756553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:43.777959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972758+0000","last_change":"2024-04-24T01:23:58.743661+0000","last_active":"2024-04-24T01:26:06.972758+0000","last_peered":"2024-04-24T01:26:06.972758+0000","last_clean":"2024-04-24T01:26:06.972758+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:26:06.972758+0000","last_undegraded":"2024-04-24T01:26:06.972758+0000","last_fullsized":"2024-04-24T01:26:06.972758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986785+0000","last_change":"2024-04-24T01:24:00.735126+0000","last_active":"2024-04-24T01:26:33.986785+0000","last_peered":"2024-04-24T01:26:33.986785+0000","last_clean":"2024-04-24T01:26:33.986785+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:26:33.986785+0000","last_undegraded":"2024-04-24T01:26:33.986785+0000","last_fullsized":"2024-04-24T01:26:33.986785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982195+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:26:03.982195+0000","last_peered":"2024-04-24T01:26:03.982195+0000","last_clean":"2024-04-24T01:26:03.982195+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:26:03.982195+0000","last_undegraded":"2024-04-24T01:26:03.982195+0000","last_fullsized":"2024-04-24T01:26:03.982195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986836+0000","last_change":"2024-04-24T01:24:00.734956+0000","last_active":"2024-04-24T01:26:33.986836+0000","last_peered":"2024-04-24T01:26:33.986836+0000","last_clean":"2024-04-24T01:26:33.986836+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:26:33.986836+0000","last_undegraded":"2024-04-24T01:26:33.986836+0000","last_fullsized":"2024-04-24T01:26:33.986836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.661110+0000","last_change":"2024-04-24T01:23:58.736599+0000","last_active":"2024-04-24T01:27:20.661110+0000","last_peered":"2024-04-24T01:27:20.661110+0000","last_clean":"2024-04-24T01:27:20.661110+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:27:20.661110+0000","last_undegraded":"2024-04-24T01:27:20.661110+0000","last_fullsized":"2024-04-24T01:27:20.661110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986880+0000","last_change":"2024-04-24T01:24:00.732729+0000","last_active":"2024-04-24T01:26:33.986880+0000","last_peered":"2024-04-24T01:26:33.986880+0000","last_clean":"2024-04-24T01:26:33.986880+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:26:33.986880+0000","last_undegraded":"2024-04-24T01:26:33.986880+0000","last_fullsized":"2024-04-24T01:26:33.986880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986012+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:26:28.986012+0000","last_peered":"2024-04-24T01:26:28.986012+0000","last_clean":"2024-04-24T01:26:28.986012+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:26:28.986012+0000","last_undegraded":"2024-04-24T01:26:28.986012+0000","last_fullsized":"2024-04-24T01:26:28.986012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":89,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.722149+0000","last_change":"2024-04-24T01:27:52.722184+0000","last_active":"2024-04-24T01:27:52.722149+0000","last_peered":"2024-04-24T01:27:52.722149+0000","last_clean":"2024-04-24T01:27:52.722149+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:52.722149+0000","last_undegraded":"2024-04-24T01:27:52.722149+0000","last_fullsized":"2024-04-24T01:27:52.722149+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.722064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.178258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985447+0000","last_change":"2024-04-24T01:23:58.740489+0000","last_active":"2024-04-24T01:26:28.985447+0000","last_peered":"2024-04-24T01:26:28.985447+0000","last_clean":"2024-04-24T01:26:28.985447+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:26:28.985447+0000","last_undegraded":"2024-04-24T01:26:28.985447+0000","last_fullsized":"2024-04-24T01:26:28.985447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395319+0000","last_change":"2024-04-24T01:24:39.801967+0000","last_active":"2024-04-24T01:27:10.395319+0000","last_peered":"2024-04-24T01:27:10.395319+0000","last_clean":"2024-04-24T01:27:10.395319+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:27:10.395319+0000","last_undegraded":"2024-04-24T01:27:10.395319+0000","last_fullsized":"2024-04-24T01:27:10.395319+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252437+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.252437+0000","last_peered":"2024-04-24T01:27:10.252437+0000","last_clean":"2024-04-24T01:27:10.252437+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.252437+0000","last_undegraded":"2024-04-24T01:27:10.252437+0000","last_fullsized":"2024-04-24T01:27:10.252437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.056641+0000","last_change":"2024-04-24T01:27:43.056694+0000","last_active":"2024-04-24T01:27:43.056641+0000","last_peered":"2024-04-24T01:27:43.056641+0000","last_clean":"2024-04-24T01:27:43.056641+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:27:43.056641+0000","last_undegraded":"2024-04-24T01:27:43.056641+0000","last_fullsized":"2024-04-24T01:27:43.056641+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.056528+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:52.813992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:31.976354+0000","last_change":"2024-04-24T01:23:58.743360+0000","last_active":"2024-04-24T01:26:31.976354+0000","last_peered":"2024-04-24T01:26:31.976354+0000","last_clean":"2024-04-24T01:26:31.976354+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:26:31.976354+0000","last_undegraded":"2024-04-24T01:26:31.976354+0000","last_fullsized":"2024-04-24T01:26:31.976354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.084000+0000","last_change":"2024-04-24T01:27:52.084049+0000","last_active":"2024-04-24T01:27:52.084000+0000","last_peered":"2024-04-24T01:27:52.084000+0000","last_clean":"2024-04-24T01:27:52.084000+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:52.084000+0000","last_undegraded":"2024-04-24T01:27:52.084000+0000","last_fullsized":"2024-04-24T01:27:52.084000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.083901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:30.781693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.864119+0000","last_change":"2024-04-24T01:27:52.864145+0000","last_active":"2024-04-24T01:27:52.864119+0000","last_peered":"2024-04-24T01:27:52.864119+0000","last_clean":"2024-04-24T01:27:52.864119+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:52.864119+0000","last_undegraded":"2024-04-24T01:27:52.864119+0000","last_fullsized":"2024-04-24T01:27:52.864119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.864012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:12.175983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.808596+0000","last_change":"2024-04-24T01:27:58.808645+0000","last_active":"2024-04-24T01:27:58.808596+0000","last_peered":"2024-04-24T01:27:58.808596+0000","last_clean":"2024-04-24T01:27:58.808596+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:27:58.808596+0000","last_undegraded":"2024-04-24T01:27:58.808596+0000","last_fullsized":"2024-04-24T01:27:58.808596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.808475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:39.876266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.733646+0000","last_change":"2024-04-24T01:27:46.733689+0000","last_active":"2024-04-24T01:27:46.733646+0000","last_peered":"2024-04-24T01:27:46.733646+0000","last_clean":"2024-04-24T01:27:46.733646+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:46.733646+0000","last_undegraded":"2024-04-24T01:27:46.733646+0000","last_fullsized":"2024-04-24T01:27:46.733646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.733535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:05.735464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016693+0000","last_change":"2024-04-24T01:23:58.738116+0000","last_active":"2024-04-24T01:27:17.016693+0000","last_peered":"2024-04-24T01:27:17.016693+0000","last_clean":"2024-04-24T01:27:17.016693+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:27:17.016693+0000","last_undegraded":"2024-04-24T01:27:17.016693+0000","last_fullsized":"2024-04-24T01:27:17.016693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.777724+0000","last_change":"2024-04-24T01:27:43.777752+0000","last_active":"2024-04-24T01:27:43.777724+0000","last_peered":"2024-04-24T01:27:43.777724+0000","last_clean":"2024-04-24T01:27:43.777724+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:27:43.777724+0000","last_undegraded":"2024-04-24T01:27:43.777724+0000","last_fullsized":"2024-04-24T01:27:43.777724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.777633+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:36.913978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.024017+0000","last_change":"2024-04-24T01:23:58.752732+0000","last_active":"2024-04-24T01:27:10.024017+0000","last_peered":"2024-04-24T01:27:10.024017+0000","last_clean":"2024-04-24T01:27:10.024017+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:27:10.024017+0000","last_undegraded":"2024-04-24T01:27:10.024017+0000","last_fullsized":"2024-04-24T01:27:10.024017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'11","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394994+0000","last_change":"2024-04-24T01:24:00.738538+0000","last_active":"2024-04-24T01:27:10.394994+0000","last_peered":"2024-04-24T01:27:10.394994+0000","last_clean":"2024-04-24T01:27:10.394994+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:27:10.394994+0000","last_undegraded":"2024-04-24T01:27:10.394994+0000","last_fullsized":"2024-04-24T01:27:10.394994+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016717+0000","last_change":"2024-04-24T01:23:58.752433+0000","last_active":"2024-04-24T01:27:17.016717+0000","last_peered":"2024-04-24T01:27:17.016717+0000","last_clean":"2024-04-24T01:27:17.016717+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:27:17.016717+0000","last_undegraded":"2024-04-24T01:27:17.016717+0000","last_fullsized":"2024-04-24T01:27:17.016717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.040944+0000","last_change":"2024-04-24T01:27:56.040969+0000","last_active":"2024-04-24T01:27:56.040944+0000","last_peered":"2024-04-24T01:27:56.040944+0000","last_clean":"2024-04-24T01:27:56.040944+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:56.040944+0000","last_undegraded":"2024-04-24T01:27:56.040944+0000","last_fullsized":"2024-04-24T01:27:56.040944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.040837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:12.454785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.307397+0000","last_change":"2024-04-24T01:27:52.307427+0000","last_active":"2024-04-24T01:27:52.307397+0000","last_peered":"2024-04-24T01:27:52.307397+0000","last_clean":"2024-04-24T01:27:52.307397+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:27:52.307397+0000","last_undegraded":"2024-04-24T01:27:52.307397+0000","last_fullsized":"2024-04-24T01:27:52.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.307307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:07.610661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.760656+0000","last_change":"2024-04-24T01:27:47.760706+0000","last_active":"2024-04-24T01:27:47.760656+0000","last_peered":"2024-04-24T01:27:47.760656+0000","last_clean":"2024-04-24T01:27:47.760656+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:47.760656+0000","last_undegraded":"2024-04-24T01:27:47.760656+0000","last_fullsized":"2024-04-24T01:27:47.760656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.760550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:24:04.523660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984316+0000","last_change":"2024-04-24T01:23:58.760423+0000","last_active":"2024-04-24T01:26:18.984316+0000","last_peered":"2024-04-24T01:26:18.984316+0000","last_clean":"2024-04-24T01:26:18.984316+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:26:18.984316+0000","last_undegraded":"2024-04-24T01:26:18.984316+0000","last_fullsized":"2024-04-24T01:26:18.984316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'35","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.358630+0000","last_change":"2024-04-24T01:24:08.779081+0000","last_active":"2024-04-24T01:27:10.358630+0000","last_peered":"2024-04-24T01:27:10.358630+0000","last_clean":"2024-04-24T01:27:10.358630+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:27:10.358630+0000","last_undegraded":"2024-04-24T01:27:10.358630+0000","last_fullsized":"2024-04-24T01:27:10.358630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046287+0000","last_change":"2024-04-24T01:24:00.732626+0000","last_active":"2024-04-24T01:27:10.046287+0000","last_peered":"2024-04-24T01:27:10.046287+0000","last_clean":"2024-04-24T01:27:10.046287+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:27:10.046287+0000","last_undegraded":"2024-04-24T01:27:10.046287+0000","last_fullsized":"2024-04-24T01:27:10.046287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984350+0000","last_change":"2024-04-24T01:23:58.761729+0000","last_active":"2024-04-24T01:26:18.984350+0000","last_peered":"2024-04-24T01:26:18.984350+0000","last_clean":"2024-04-24T01:26:18.984350+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:26:18.984350+0000","last_undegraded":"2024-04-24T01:26:18.984350+0000","last_fullsized":"2024-04-24T01:26:18.984350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.182402+0000","last_change":"2024-04-24T01:27:22.182426+0000","last_active":"2024-04-24T01:27:22.182402+0000","last_peered":"2024-04-24T01:27:22.182402+0000","last_clean":"2024-04-24T01:27:22.182402+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:27:22.182402+0000","last_undegraded":"2024-04-24T01:27:22.182402+0000","last_fullsized":"2024-04-24T01:27:22.182402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.182314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:53.198026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.018890+0000","last_change":"2024-04-24T01:27:33.018949+0000","last_active":"2024-04-24T01:27:33.018890+0000","last_peered":"2024-04-24T01:27:33.018890+0000","last_clean":"2024-04-24T01:27:33.018890+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:33.018890+0000","last_undegraded":"2024-04-24T01:27:33.018890+0000","last_fullsized":"2024-04-24T01:27:33.018890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.018804+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:06.024098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.763614+0000","last_change":"2024-04-24T01:27:29.763639+0000","last_active":"2024-04-24T01:27:29.763614+0000","last_peered":"2024-04-24T01:27:29.763614+0000","last_clean":"2024-04-24T01:27:29.763614+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:27:29.763614+0000","last_undegraded":"2024-04-24T01:27:29.763614+0000","last_fullsized":"2024-04-24T01:27:29.763614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.763505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:56.480614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986264+0000","last_change":"2024-04-24T01:24:08.778873+0000","last_active":"2024-04-24T01:26:33.986264+0000","last_peered":"2024-04-24T01:26:33.986264+0000","last_clean":"2024-04-24T01:26:33.986264+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:26:33.986264+0000","last_undegraded":"2024-04-24T01:26:33.986264+0000","last_fullsized":"2024-04-24T01:26:33.986264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.349450+0000","last_change":"2024-04-24T01:24:00.733211+0000","last_active":"2024-04-24T01:27:10.349450+0000","last_peered":"2024-04-24T01:27:10.349450+0000","last_clean":"2024-04-24T01:27:10.349450+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:27:10.349450+0000","last_undegraded":"2024-04-24T01:27:10.349450+0000","last_fullsized":"2024-04-24T01:27:10.349450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983729+0000","last_change":"2024-04-24T01:23:58.741284+0000","last_active":"2024-04-24T01:26:18.983729+0000","last_peered":"2024-04-24T01:26:18.983729+0000","last_clean":"2024-04-24T01:26:18.983729+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:26:18.983729+0000","last_undegraded":"2024-04-24T01:26:18.983729+0000","last_fullsized":"2024-04-24T01:26:18.983729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:58.990047+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:26:58.990047+0000","last_peered":"2024-04-24T01:26:58.990047+0000","last_clean":"2024-04-24T01:26:58.990047+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:26:58.990047+0000","last_undegraded":"2024-04-24T01:26:58.990047+0000","last_fullsized":"2024-04-24T01:26:58.990047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'17","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.795733+0000","last_change":"2024-04-24T01:27:28.795795+0000","last_active":"2024-04-24T01:27:28.795733+0000","last_peered":"2024-04-24T01:27:28.795733+0000","last_clean":"2024-04-24T01:27:28.795733+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:27:28.795733+0000","last_undegraded":"2024-04-24T01:27:28.795733+0000","last_fullsized":"2024-04-24T01:27:28.795733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.795617+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:13.586689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.807223+0000","last_change":"2024-04-24T01:27:22.807246+0000","last_active":"2024-04-24T01:27:22.807223+0000","last_peered":"2024-04-24T01:27:22.807223+0000","last_clean":"2024-04-24T01:27:22.807223+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:27:22.807223+0000","last_undegraded":"2024-04-24T01:27:22.807223+0000","last_fullsized":"2024-04-24T01:27:22.807223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.807114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:58.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977684+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:26:41.977684+0000","last_peered":"2024-04-24T01:26:41.977684+0000","last_clean":"2024-04-24T01:26:41.977684+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:26:41.977684+0000","last_undegraded":"2024-04-24T01:26:41.977684+0000","last_fullsized":"2024-04-24T01:26:41.977684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.977361+0000","last_change":"2024-04-24T01:27:57.977385+0000","last_active":"2024-04-24T01:27:57.977361+0000","last_peered":"2024-04-24T01:27:57.977361+0000","last_clean":"2024-04-24T01:27:57.977361+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:57.977361+0000","last_undegraded":"2024-04-24T01:27:57.977361+0000","last_fullsized":"2024-04-24T01:27:57.977361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.977272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:19.588675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984281+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:26:18.984281+0000","last_peered":"2024-04-24T01:26:18.984281+0000","last_clean":"2024-04-24T01:26:18.984281+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:26:18.984281+0000","last_undegraded":"2024-04-24T01:26:18.984281+0000","last_fullsized":"2024-04-24T01:26:18.984281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.283661+0000","last_change":"2024-04-24T01:27:39.283686+0000","last_active":"2024-04-24T01:27:39.283661+0000","last_peered":"2024-04-24T01:27:39.283661+0000","last_clean":"2024-04-24T01:27:39.283661+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:27:39.283661+0000","last_undegraded":"2024-04-24T01:27:39.283661+0000","last_fullsized":"2024-04-24T01:27:39.283661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.283571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:27.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.914958+0000","last_change":"2024-04-24T01:27:28.914998+0000","last_active":"2024-04-24T01:27:28.914958+0000","last_peered":"2024-04-24T01:27:28.914958+0000","last_clean":"2024-04-24T01:27:28.914958+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:27:28.914958+0000","last_undegraded":"2024-04-24T01:27:28.914958+0000","last_fullsized":"2024-04-24T01:27:28.914958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.914874+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:31.978701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.904111+0000","last_change":"2024-04-24T01:27:46.904142+0000","last_active":"2024-04-24T01:27:46.904111+0000","last_peered":"2024-04-24T01:27:46.904111+0000","last_clean":"2024-04-24T01:27:46.904111+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:46.904111+0000","last_undegraded":"2024-04-24T01:27:46.904111+0000","last_fullsized":"2024-04-24T01:27:46.904111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.904020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:50.414459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.266343+0000","last_change":"2024-04-24T01:24:08.772616+0000","last_active":"2024-04-24T01:27:10.266343+0000","last_peered":"2024-04-24T01:27:10.266343+0000","last_clean":"2024-04-24T01:27:10.266343+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:27:10.266343+0000","last_undegraded":"2024-04-24T01:27:10.266343+0000","last_fullsized":"2024-04-24T01:27:10.266343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.273861+0000","last_change":"2024-04-24T01:27:50.273889+0000","last_active":"2024-04-24T01:27:50.273861+0000","last_peered":"2024-04-24T01:27:50.273861+0000","last_clean":"2024-04-24T01:27:50.273861+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:27:50.273861+0000","last_undegraded":"2024-04-24T01:27:50.273861+0000","last_fullsized":"2024-04-24T01:27:50.273861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.273766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:54:42.265021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.812203+0000","last_change":"2024-04-24T01:27:56.812248+0000","last_active":"2024-04-24T01:27:56.812203+0000","last_peered":"2024-04-24T01:27:56.812203+0000","last_clean":"2024-04-24T01:27:56.812203+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:27:56.812203+0000","last_undegraded":"2024-04-24T01:27:56.812203+0000","last_fullsized":"2024-04-24T01:27:56.812203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.812089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:46.064127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.157564+0000","last_change":"2024-04-24T01:27:28.157587+0000","last_active":"2024-04-24T01:27:28.157564+0000","last_peered":"2024-04-24T01:27:28.157564+0000","last_clean":"2024-04-24T01:27:28.157564+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:27:28.157564+0000","last_undegraded":"2024-04-24T01:27:28.157564+0000","last_fullsized":"2024-04-24T01:27:28.157564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.157467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:47.159396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.890012+0000","last_change":"2024-04-24T01:27:26.890053+0000","last_active":"2024-04-24T01:27:26.890012+0000","last_peered":"2024-04-24T01:27:26.890012+0000","last_clean":"2024-04-24T01:27:26.890012+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:26.890012+0000","last_undegraded":"2024-04-24T01:27:26.890012+0000","last_fullsized":"2024-04-24T01:27:26.890012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.889929+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:10.323651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.070103+0000","last_change":"2024-04-24T01:27:24.070163+0000","last_active":"2024-04-24T01:27:24.070103+0000","last_peered":"2024-04-24T01:27:24.070103+0000","last_clean":"2024-04-24T01:27:24.070103+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:24.070103+0000","last_undegraded":"2024-04-24T01:27:24.070103+0000","last_fullsized":"2024-04-24T01:27:24.070103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.069989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:46.537881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.899015+0000","last_change":"2024-04-24T01:27:53.899047+0000","last_active":"2024-04-24T01:27:53.899015+0000","last_peered":"2024-04-24T01:27:53.899015+0000","last_clean":"2024-04-24T01:27:53.899015+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:27:53.899015+0000","last_undegraded":"2024-04-24T01:27:53.899015+0000","last_fullsized":"2024-04-24T01:27:53.899015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.898918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:49.273306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.068824+0000","last_change":"2024-04-24T01:27:53.068848+0000","last_active":"2024-04-24T01:27:53.068824+0000","last_peered":"2024-04-24T01:27:53.068824+0000","last_clean":"2024-04-24T01:27:53.068824+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:27:53.068824+0000","last_undegraded":"2024-04-24T01:27:53.068824+0000","last_fullsized":"2024-04-24T01:27:53.068824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.068721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:30.201730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.724484+0000","last_change":"2024-04-24T01:27:31.724506+0000","last_active":"2024-04-24T01:27:31.724484+0000","last_peered":"2024-04-24T01:27:31.724484+0000","last_clean":"2024-04-24T01:27:31.724484+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:27:31.724484+0000","last_undegraded":"2024-04-24T01:27:31.724484+0000","last_fullsized":"2024-04-24T01:27:31.724484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.724380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:37.609422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.950424+0000","last_change":"2024-04-24T01:27:30.950474+0000","last_active":"2024-04-24T01:27:30.950424+0000","last_peered":"2024-04-24T01:27:30.950424+0000","last_clean":"2024-04-24T01:27:30.950424+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:30.950424+0000","last_undegraded":"2024-04-24T01:27:30.950424+0000","last_fullsized":"2024-04-24T01:27:30.950424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.950337+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:06.885598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.107865+0000","last_change":"2024-04-24T01:27:23.107889+0000","last_active":"2024-04-24T01:27:23.107865+0000","last_peered":"2024-04-24T01:27:23.107865+0000","last_clean":"2024-04-24T01:27:23.107865+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:27:23.107865+0000","last_undegraded":"2024-04-24T01:27:23.107865+0000","last_fullsized":"2024-04-24T01:27:23.107865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.107773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:16.379160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983007+0000","last_change":"2024-04-24T01:24:08.776596+0000","last_active":"2024-04-24T01:26:13.983007+0000","last_peered":"2024-04-24T01:26:13.983007+0000","last_clean":"2024-04-24T01:26:13.983007+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:26:13.983007+0000","last_undegraded":"2024-04-24T01:26:13.983007+0000","last_fullsized":"2024-04-24T01:26:13.983007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.703758+0000","last_change":"2024-04-24T01:27:51.703790+0000","last_active":"2024-04-24T01:27:51.703758+0000","last_peered":"2024-04-24T01:27:51.703758+0000","last_clean":"2024-04-24T01:27:51.703758+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:27:51.703758+0000","last_undegraded":"2024-04-24T01:27:51.703758+0000","last_fullsized":"2024-04-24T01:27:51.703758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.703677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:59.808919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.113009+0000","last_change":"2024-04-24T01:27:49.113076+0000","last_active":"2024-04-24T01:27:49.113009+0000","last_peered":"2024-04-24T01:27:49.113009+0000","last_clean":"2024-04-24T01:27:49.113009+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:49.113009+0000","last_undegraded":"2024-04-24T01:27:49.113009+0000","last_fullsized":"2024-04-24T01:27:49.113009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.112893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:26.748726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.312333+0000","last_change":"2024-04-24T01:27:40.312374+0000","last_active":"2024-04-24T01:27:40.312333+0000","last_peered":"2024-04-24T01:27:40.312333+0000","last_clean":"2024-04-24T01:27:40.312333+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:40.312333+0000","last_undegraded":"2024-04-24T01:27:40.312333+0000","last_fullsized":"2024-04-24T01:27:40.312333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.312210+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:26.075351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.146590+0000","last_change":"2024-04-24T01:27:23.146630+0000","last_active":"2024-04-24T01:27:23.146590+0000","last_peered":"2024-04-24T01:27:23.146590+0000","last_clean":"2024-04-24T01:27:23.146590+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:23.146590+0000","last_undegraded":"2024-04-24T01:27:23.146590+0000","last_fullsized":"2024-04-24T01:27:23.146590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.146508+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:42.897359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.041435+0000","last_change":"2024-04-24T01:27:25.041459+0000","last_active":"2024-04-24T01:27:25.041435+0000","last_peered":"2024-04-24T01:27:25.041435+0000","last_clean":"2024-04-24T01:27:25.041435+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:27:25.041435+0000","last_undegraded":"2024-04-24T01:27:25.041435+0000","last_fullsized":"2024-04-24T01:27:25.041435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.041335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.527549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.764031+0000","last_change":"2024-04-24T01:27:45.764060+0000","last_active":"2024-04-24T01:27:45.764031+0000","last_peered":"2024-04-24T01:27:45.764031+0000","last_clean":"2024-04-24T01:27:45.764031+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:27:45.764031+0000","last_undegraded":"2024-04-24T01:27:45.764031+0000","last_fullsized":"2024-04-24T01:27:45.764031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.763949+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:24.155072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.048341+0000","last_change":"2024-04-24T01:27:54.048365+0000","last_active":"2024-04-24T01:27:54.048341+0000","last_peered":"2024-04-24T01:27:54.048341+0000","last_clean":"2024-04-24T01:27:54.048341+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:27:54.048341+0000","last_undegraded":"2024-04-24T01:27:54.048341+0000","last_fullsized":"2024-04-24T01:27:54.048341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.048229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:34:31.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.015141+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:27:17.015141+0000","last_peered":"2024-04-24T01:27:17.015141+0000","last_clean":"2024-04-24T01:27:17.015141+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:27:17.015141+0000","last_undegraded":"2024-04-24T01:27:17.015141+0000","last_fullsized":"2024-04-24T01:27:17.015141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.208929+0000","last_change":"2024-04-24T01:27:35.208971+0000","last_active":"2024-04-24T01:27:35.208929+0000","last_peered":"2024-04-24T01:27:35.208929+0000","last_clean":"2024-04-24T01:27:35.208929+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:27:35.208929+0000","last_undegraded":"2024-04-24T01:27:35.208929+0000","last_fullsized":"2024-04-24T01:27:35.208929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:53.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.868537+0000","last_change":"2024-04-24T01:27:51.868587+0000","last_active":"2024-04-24T01:27:51.868537+0000","last_peered":"2024-04-24T01:27:51.868537+0000","last_clean":"2024-04-24T01:27:51.868537+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:51.868537+0000","last_undegraded":"2024-04-24T01:27:51.868537+0000","last_fullsized":"2024-04-24T01:27:51.868537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.868449+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:02.837512+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.193180+0000","last_change":"2024-04-24T01:27:33.193209+0000","last_active":"2024-04-24T01:27:33.193180+0000","last_peered":"2024-04-24T01:27:33.193180+0000","last_clean":"2024-04-24T01:27:33.193180+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:33.193180+0000","last_undegraded":"2024-04-24T01:27:33.193180+0000","last_fullsized":"2024-04-24T01:27:33.193180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.193083+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:14.827477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974950+0000","last_change":"2024-04-24T01:24:08.768571+0000","last_active":"2024-04-24T01:26:21.974950+0000","last_peered":"2024-04-24T01:26:21.974950+0000","last_clean":"2024-04-24T01:26:21.974950+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:26:21.974950+0000","last_undegraded":"2024-04-24T01:26:21.974950+0000","last_fullsized":"2024-04-24T01:26:21.974950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.095920+0000","last_change":"2024-04-24T01:27:46.095967+0000","last_active":"2024-04-24T01:27:46.095920+0000","last_peered":"2024-04-24T01:27:46.095920+0000","last_clean":"2024-04-24T01:27:46.095920+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:27:46.095920+0000","last_undegraded":"2024-04-24T01:27:46.095920+0000","last_fullsized":"2024-04-24T01:27:46.095920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.095813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:43:01.593908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983579+0000","last_change":"2024-04-24T01:23:58.764595+0000","last_active":"2024-04-24T01:26:13.983579+0000","last_peered":"2024-04-24T01:26:13.983579+0000","last_clean":"2024-04-24T01:26:13.983579+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:26:13.983579+0000","last_undegraded":"2024-04-24T01:26:13.983579+0000","last_fullsized":"2024-04-24T01:26:13.983579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.200419+0000","last_change":"2024-04-24T01:27:36.200442+0000","last_active":"2024-04-24T01:27:36.200419+0000","last_peered":"2024-04-24T01:27:36.200419+0000","last_clean":"2024-04-24T01:27:36.200419+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:27:36.200419+0000","last_undegraded":"2024-04-24T01:27:36.200419+0000","last_fullsized":"2024-04-24T01:27:36.200419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.200293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.864662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.888539+0000","last_change":"2024-04-24T01:27:48.888578+0000","last_active":"2024-04-24T01:27:48.888539+0000","last_peered":"2024-04-24T01:27:48.888539+0000","last_clean":"2024-04-24T01:27:48.888539+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:48.888539+0000","last_undegraded":"2024-04-24T01:27:48.888539+0000","last_fullsized":"2024-04-24T01:27:48.888539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.888453+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:06.782682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.070100+0000","last_change":"2024-04-24T01:27:21.070118+0000","last_active":"2024-04-24T01:27:21.070100+0000","last_peered":"2024-04-24T01:27:21.070100+0000","last_clean":"2024-04-24T01:27:21.070100+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:27:21.070100+0000","last_undegraded":"2024-04-24T01:27:21.070100+0000","last_fullsized":"2024-04-24T01:27:21.070100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.070033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:24.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.438803+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.438803+0000","last_peered":"2024-04-24T01:27:10.438803+0000","last_clean":"2024-04-24T01:27:10.438803+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.438803+0000","last_undegraded":"2024-04-24T01:27:10.438803+0000","last_fullsized":"2024-04-24T01:27:10.438803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046489+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.046489+0000","last_peered":"2024-04-24T01:27:10.046489+0000","last_clean":"2024-04-24T01:27:10.046489+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.046489+0000","last_undegraded":"2024-04-24T01:27:10.046489+0000","last_fullsized":"2024-04-24T01:27:10.046489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.330030+0000","last_change":"2024-04-24T01:27:54.330094+0000","last_active":"2024-04-24T01:27:54.330030+0000","last_peered":"2024-04-24T01:27:54.330030+0000","last_clean":"2024-04-24T01:27:54.330030+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:27:54.330030+0000","last_undegraded":"2024-04-24T01:27:54.330030+0000","last_fullsized":"2024-04-24T01:27:54.330030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.329915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:09.474046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.022814+0000","last_change":"2024-04-24T01:27:39.022839+0000","last_active":"2024-04-24T01:27:39.022814+0000","last_peered":"2024-04-24T01:27:39.022814+0000","last_clean":"2024-04-24T01:27:39.022814+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:27:39.022814+0000","last_undegraded":"2024-04-24T01:27:39.022814+0000","last_fullsized":"2024-04-24T01:27:39.022814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.022713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:44.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.795231+0000","last_change":"2024-04-24T01:27:26.795265+0000","last_active":"2024-04-24T01:27:26.795231+0000","last_peered":"2024-04-24T01:27:26.795231+0000","last_clean":"2024-04-24T01:27:26.795231+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:26.795231+0000","last_undegraded":"2024-04-24T01:27:26.795231+0000","last_fullsized":"2024-04-24T01:27:26.795231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.795151+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:53.921283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.990239+0000","last_change":"2024-04-24T01:27:40.990277+0000","last_active":"2024-04-24T01:27:40.990239+0000","last_peered":"2024-04-24T01:27:40.990239+0000","last_clean":"2024-04-24T01:27:40.990239+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:27:40.990239+0000","last_undegraded":"2024-04-24T01:27:40.990239+0000","last_fullsized":"2024-04-24T01:27:40.990239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.990117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:52.892751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'11","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.398022+0000","last_change":"2024-04-24T01:24:08.772993+0000","last_active":"2024-04-24T01:27:10.398022+0000","last_peered":"2024-04-24T01:27:10.398022+0000","last_clean":"2024-04-24T01:27:10.398022+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:27:10.398022+0000","last_undegraded":"2024-04-24T01:27:10.398022+0000","last_fullsized":"2024-04-24T01:27:10.398022+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:53.989481+0000","last_change":"2024-04-24T01:24:39.805084+0000","last_active":"2024-04-24T01:26:53.989481+0000","last_peered":"2024-04-24T01:26:53.989481+0000","last_clean":"2024-04-24T01:26:53.989481+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:26:53.989481+0000","last_undegraded":"2024-04-24T01:26:53.989481+0000","last_fullsized":"2024-04-24T01:26:53.989481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982856+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:26:08.982856+0000","last_peered":"2024-04-24T01:26:08.982856+0000","last_clean":"2024-04-24T01:26:08.982856+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:26:08.982856+0000","last_undegraded":"2024-04-24T01:26:08.982856+0000","last_fullsized":"2024-04-24T01:26:08.982856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.249356+0000","last_change":"2024-04-24T01:27:38.249380+0000","last_active":"2024-04-24T01:27:38.249356+0000","last_peered":"2024-04-24T01:27:38.249356+0000","last_clean":"2024-04-24T01:27:38.249356+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:27:38.249356+0000","last_undegraded":"2024-04-24T01:27:38.249356+0000","last_fullsized":"2024-04-24T01:27:38.249356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.249265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:20.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.930905+0000","last_change":"2024-04-24T01:27:31.930974+0000","last_active":"2024-04-24T01:27:31.930905+0000","last_peered":"2024-04-24T01:27:31.930905+0000","last_clean":"2024-04-24T01:27:31.930905+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:31.930905+0000","last_undegraded":"2024-04-24T01:27:31.930905+0000","last_fullsized":"2024-04-24T01:27:31.930905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.930805+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:07.030096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.862402+0000","last_change":"2024-04-24T01:27:25.862447+0000","last_active":"2024-04-24T01:27:25.862402+0000","last_peered":"2024-04-24T01:27:25.862402+0000","last_clean":"2024-04-24T01:27:25.862402+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:25.862402+0000","last_undegraded":"2024-04-24T01:27:25.862402+0000","last_fullsized":"2024-04-24T01:27:25.862402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.862292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:06.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.291402+0000","last_change":"2024-04-24T01:27:49.291445+0000","last_active":"2024-04-24T01:27:49.291402+0000","last_peered":"2024-04-24T01:27:49.291402+0000","last_clean":"2024-04-24T01:27:49.291402+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:27:49.291402+0000","last_undegraded":"2024-04-24T01:27:49.291402+0000","last_fullsized":"2024-04-24T01:27:49.291402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.291293+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:16.626192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.091307+0000","last_change":"2024-04-24T01:27:58.091349+0000","last_active":"2024-04-24T01:27:58.091307+0000","last_peered":"2024-04-24T01:27:58.091307+0000","last_clean":"2024-04-24T01:27:58.091307+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:58.091307+0000","last_undegraded":"2024-04-24T01:27:58.091307+0000","last_fullsized":"2024-04-24T01:27:58.091307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.091198+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:10.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982814+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:26:08.982814+0000","last_peered":"2024-04-24T01:26:08.982814+0000","last_clean":"2024-04-24T01:26:08.982814+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:26:08.982814+0000","last_undegraded":"2024-04-24T01:26:08.982814+0000","last_fullsized":"2024-04-24T01:26:08.982814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.716636+0000","last_change":"2024-04-24T01:27:35.716690+0000","last_active":"2024-04-24T01:27:35.716636+0000","last_peered":"2024-04-24T01:27:35.716636+0000","last_clean":"2024-04-24T01:27:35.716636+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:35.716636+0000","last_undegraded":"2024-04-24T01:27:35.716636+0000","last_fullsized":"2024-04-24T01:27:35.716636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.716538+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:45.474001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.061371+0000","last_change":"2024-04-24T01:27:39.061416+0000","last_active":"2024-04-24T01:27:39.061371+0000","last_peered":"2024-04-24T01:27:39.061371+0000","last_clean":"2024-04-24T01:27:39.061371+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:27:39.061371+0000","last_undegraded":"2024-04-24T01:27:39.061371+0000","last_fullsized":"2024-04-24T01:27:39.061371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.061278+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:42.587769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.819819+0000","last_change":"2024-04-24T01:27:21.819879+0000","last_active":"2024-04-24T01:27:21.819819+0000","last_peered":"2024-04-24T01:27:21.819819+0000","last_clean":"2024-04-24T01:27:21.819819+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:21.819819+0000","last_undegraded":"2024-04-24T01:27:21.819819+0000","last_fullsized":"2024-04-24T01:27:21.819819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.819685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:51.931578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.009990+0000","last_change":"2024-04-24T01:27:42.010031+0000","last_active":"2024-04-24T01:27:42.009990+0000","last_peered":"2024-04-24T01:27:42.009990+0000","last_clean":"2024-04-24T01:27:42.009990+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:27:42.009990+0000","last_undegraded":"2024-04-24T01:27:42.009990+0000","last_fullsized":"2024-04-24T01:27:42.009990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.009873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:39.421872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.131655+0000","last_change":"2024-04-24T01:24:00.743011+0000","last_active":"2024-04-24T01:27:10.131655+0000","last_peered":"2024-04-24T01:27:10.131655+0000","last_clean":"2024-04-24T01:27:10.131655+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:27:10.131655+0000","last_undegraded":"2024-04-24T01:27:10.131655+0000","last_fullsized":"2024-04-24T01:27:10.131655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982774+0000","last_change":"2024-04-24T01:23:58.760103+0000","last_active":"2024-04-24T01:26:08.982774+0000","last_peered":"2024-04-24T01:26:08.982774+0000","last_clean":"2024-04-24T01:26:08.982774+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:26:08.982774+0000","last_undegraded":"2024-04-24T01:26:08.982774+0000","last_fullsized":"2024-04-24T01:26:08.982774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.040401+0000","last_change":"2024-04-24T01:27:32.040427+0000","last_active":"2024-04-24T01:27:32.040401+0000","last_peered":"2024-04-24T01:27:32.040401+0000","last_clean":"2024-04-24T01:27:32.040401+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:27:32.040401+0000","last_undegraded":"2024-04-24T01:27:32.040401+0000","last_fullsized":"2024-04-24T01:27:32.040401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.040303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:24.647469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.833944+0000","last_change":"2024-04-24T01:27:27.834021+0000","last_active":"2024-04-24T01:27:27.833944+0000","last_peered":"2024-04-24T01:27:27.833944+0000","last_clean":"2024-04-24T01:27:27.833944+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:27.833944+0000","last_undegraded":"2024-04-24T01:27:27.833944+0000","last_fullsized":"2024-04-24T01:27:27.833944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.833839+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:51:49.939141+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.839877+0000","last_change":"2024-04-24T01:27:21.839921+0000","last_active":"2024-04-24T01:27:21.839877+0000","last_peered":"2024-04-24T01:27:21.839877+0000","last_clean":"2024-04-24T01:27:21.839877+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:27:21.839877+0000","last_undegraded":"2024-04-24T01:27:21.839877+0000","last_fullsized":"2024-04-24T01:27:21.839877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:25.887464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.781084+0000","last_change":"2024-04-24T01:27:41.781113+0000","last_active":"2024-04-24T01:27:41.781084+0000","last_peered":"2024-04-24T01:27:41.781084+0000","last_clean":"2024-04-24T01:27:41.781084+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:41.781084+0000","last_undegraded":"2024-04-24T01:27:41.781084+0000","last_fullsized":"2024-04-24T01:27:41.781084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.781002+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:01.531853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.009823+0000","last_change":"2024-04-24T01:27:38.009852+0000","last_active":"2024-04-24T01:27:38.009823+0000","last_peered":"2024-04-24T01:27:38.009823+0000","last_clean":"2024-04-24T01:27:38.009823+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:38.009823+0000","last_undegraded":"2024-04-24T01:27:38.009823+0000","last_fullsized":"2024-04-24T01:27:38.009823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.009727+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:13.773436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"13'117","reported_seq":204,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.237424+0000","last_change":"2024-04-24T01:23:45.965869+0000","last_active":"2024-04-24T01:27:20.237424+0000","last_peered":"2024-04-24T01:27:20.237424+0000","last_clean":"2024-04-24T01:27:20.237424+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:27:20.237424+0000","last_undegraded":"2024-04-24T01:27:20.237424+0000","last_fullsized":"2024-04-24T01:27:20.237424+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:44.656300+0000","last_clean_scrub_stamp":"2024-04-24T01:23:44.656300+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981411+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:25:58.981411+0000","last_peered":"2024-04-24T01:25:58.981411+0000","last_clean":"2024-04-24T01:25:58.981411+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:25:58.981411+0000","last_undegraded":"2024-04-24T01:25:58.981411+0000","last_fullsized":"2024-04-24T01:25:58.981411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982127+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:26:03.982127+0000","last_peered":"2024-04-24T01:26:03.982127+0000","last_clean":"2024-04-24T01:26:03.982127+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:26:03.982127+0000","last_undegraded":"2024-04-24T01:26:03.982127+0000","last_fullsized":"2024-04-24T01:26:03.982127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982209+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:26:08.982209+0000","last_peered":"2024-04-24T01:26:08.982209+0000","last_clean":"2024-04-24T01:26:08.982209+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:26:08.982209+0000","last_undegraded":"2024-04-24T01:26:08.982209+0000","last_fullsized":"2024-04-24T01:26:08.982209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.123880+0000","last_change":"2024-04-24T01:27:27.123918+0000","last_active":"2024-04-24T01:27:27.123880+0000","last_peered":"2024-04-24T01:27:27.123880+0000","last_clean":"2024-04-24T01:27:27.123880+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:27.123880+0000","last_undegraded":"2024-04-24T01:27:27.123880+0000","last_fullsized":"2024-04-24T01:27:27.123880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.123786+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:04.256795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.112064+0000","last_change":"2024-04-24T01:27:29.112111+0000","last_active":"2024-04-24T01:27:29.112064+0000","last_peered":"2024-04-24T01:27:29.112064+0000","last_clean":"2024-04-24T01:27:29.112064+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:27:29.112064+0000","last_undegraded":"2024-04-24T01:27:29.112064+0000","last_fullsized":"2024-04-24T01:27:29.112064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.111929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:30.720342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.978903+0000","last_change":"2024-04-24T01:27:37.978931+0000","last_active":"2024-04-24T01:27:37.978903+0000","last_peered":"2024-04-24T01:27:37.978903+0000","last_clean":"2024-04-24T01:27:37.978903+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:37.978903+0000","last_undegraded":"2024-04-24T01:27:37.978903+0000","last_fullsized":"2024-04-24T01:27:37.978903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.978807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:55.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.938237+0000","last_change":"2024-04-24T01:27:56.938286+0000","last_active":"2024-04-24T01:27:56.938237+0000","last_peered":"2024-04-24T01:27:56.938237+0000","last_clean":"2024-04-24T01:27:56.938237+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:27:56.938237+0000","last_undegraded":"2024-04-24T01:27:56.938237+0000","last_fullsized":"2024-04-24T01:27:56.938237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.938134+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:59.400837+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087960+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:27:21.087960+0000","last_peered":"2024-04-24T01:27:21.087960+0000","last_clean":"2024-04-24T01:27:21.087960+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:27:21.087960+0000","last_undegraded":"2024-04-24T01:27:21.087960+0000","last_fullsized":"2024-04-24T01:27:21.087960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.015048+0000","last_change":"2024-04-24T01:23:58.743429+0000","last_active":"2024-04-24T01:27:17.015048+0000","last_peered":"2024-04-24T01:27:17.015048+0000","last_clean":"2024-04-24T01:27:17.015048+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:27:17.015048+0000","last_undegraded":"2024-04-24T01:27:17.015048+0000","last_fullsized":"2024-04-24T01:27:17.015048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.112830+0000","last_change":"2024-04-24T01:27:24.112872+0000","last_active":"2024-04-24T01:27:24.112830+0000","last_peered":"2024-04-24T01:27:24.112830+0000","last_clean":"2024-04-24T01:27:24.112830+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:27:24.112830+0000","last_undegraded":"2024-04-24T01:27:24.112830+0000","last_fullsized":"2024-04-24T01:27:24.112830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.112716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:45.026444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":528,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.829554+0000","last_change":"2024-04-24T01:27:23.829636+0000","last_active":"2024-04-24T01:27:23.829554+0000","last_peered":"2024-04-24T01:27:23.829554+0000","last_clean":"2024-04-24T01:27:23.829554+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:23.829554+0000","last_undegraded":"2024-04-24T01:27:23.829554+0000","last_fullsized":"2024-04-24T01:27:23.829554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.829451+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:41.027361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.953198+0000","last_change":"2024-04-24T01:27:41.953224+0000","last_active":"2024-04-24T01:27:41.953198+0000","last_peered":"2024-04-24T01:27:41.953198+0000","last_clean":"2024-04-24T01:27:41.953198+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:27:41.953198+0000","last_undegraded":"2024-04-24T01:27:41.953198+0000","last_fullsized":"2024-04-24T01:27:41.953198+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.953108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:10.618830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.753024+0000","last_change":"2024-04-24T01:27:49.753087+0000","last_active":"2024-04-24T01:27:49.753024+0000","last_peered":"2024-04-24T01:27:49.753024+0000","last_clean":"2024-04-24T01:27:49.753024+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:27:49.753024+0000","last_undegraded":"2024-04-24T01:27:49.753024+0000","last_fullsized":"2024-04-24T01:27:49.753024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.752922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.966181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.285820+0000","last_change":"2024-04-24T01:27:47.285843+0000","last_active":"2024-04-24T01:27:47.285820+0000","last_peered":"2024-04-24T01:27:47.285820+0000","last_clean":"2024-04-24T01:27:47.285820+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:47.285820+0000","last_undegraded":"2024-04-24T01:27:47.285820+0000","last_fullsized":"2024-04-24T01:27:47.285820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.285734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:56.799840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.660827+0000","last_change":"2024-04-24T01:23:50.688428+0000","last_active":"2024-04-24T01:27:20.660827+0000","last_peered":"2024-04-24T01:27:20.660827+0000","last_clean":"2024-04-24T01:27:20.660827+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:27:20.660827+0000","last_undegraded":"2024-04-24T01:27:20.660827+0000","last_fullsized":"2024-04-24T01:27:20.660827+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.971927+0000","last_change":"2024-04-24T01:23:58.743937+0000","last_active":"2024-04-24T01:26:01.971927+0000","last_peered":"2024-04-24T01:26:01.971927+0000","last_clean":"2024-04-24T01:26:01.971927+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:26:01.971927+0000","last_undegraded":"2024-04-24T01:26:01.971927+0000","last_fullsized":"2024-04-24T01:26:01.971927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'4","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.917102+0000","last_change":"2024-04-24T01:27:35.917133+0000","last_active":"2024-04-24T01:27:35.917102+0000","last_peered":"2024-04-24T01:27:35.917102+0000","last_clean":"2024-04-24T01:27:35.917102+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:35.917102+0000","last_undegraded":"2024-04-24T01:27:35.917102+0000","last_fullsized":"2024-04-24T01:27:35.917102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.916997+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:07.090816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":100,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.905563+0000","last_change":"2024-04-24T01:27:27.905612+0000","last_active":"2024-04-24T01:27:27.905563+0000","last_peered":"2024-04-24T01:27:27.905563+0000","last_clean":"2024-04-24T01:27:27.905563+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:27.905563+0000","last_undegraded":"2024-04-24T01:27:27.905563+0000","last_fullsized":"2024-04-24T01:27:27.905563+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.905478+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:29.454916+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.318280+0000","last_change":"2024-04-24T01:27:41.318338+0000","last_active":"2024-04-24T01:27:41.318280+0000","last_peered":"2024-04-24T01:27:41.318280+0000","last_clean":"2024-04-24T01:27:41.318280+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:27:41.318280+0000","last_undegraded":"2024-04-24T01:27:41.318280+0000","last_fullsized":"2024-04-24T01:27:41.318280+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.318182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:55:53.255679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985117+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:26:23.985117+0000","last_peered":"2024-04-24T01:26:23.985117+0000","last_clean":"2024-04-24T01:26:23.985117+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:26:23.985117+0000","last_undegraded":"2024-04-24T01:26:23.985117+0000","last_fullsized":"2024-04-24T01:26:23.985117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.266038+0000","last_change":"2024-04-24T01:27:51.266085+0000","last_active":"2024-04-24T01:27:51.266038+0000","last_peered":"2024-04-24T01:27:51.266038+0000","last_clean":"2024-04-24T01:27:51.266038+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:51.266038+0000","last_undegraded":"2024-04-24T01:27:51.266038+0000","last_fullsized":"2024-04-24T01:27:51.266038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.265934+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:09:26.486398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087999+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:27:21.087999+0000","last_peered":"2024-04-24T01:27:21.087999+0000","last_clean":"2024-04-24T01:27:21.087999+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:27:21.087999+0000","last_undegraded":"2024-04-24T01:27:21.087999+0000","last_fullsized":"2024-04-24T01:27:21.087999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.620927+0000","last_change":"2024-04-24T01:23:58.739690+0000","last_active":"2024-04-24T01:26:09.620927+0000","last_peered":"2024-04-24T01:26:09.620927+0000","last_clean":"2024-04-24T01:26:09.620927+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:26:09.620927+0000","last_undegraded":"2024-04-24T01:26:09.620927+0000","last_fullsized":"2024-04-24T01:26:09.620927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.359480+0000","last_change":"2024-04-24T01:27:43.359505+0000","last_active":"2024-04-24T01:27:43.359480+0000","last_peered":"2024-04-24T01:27:43.359480+0000","last_clean":"2024-04-24T01:27:43.359480+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:27:43.359480+0000","last_undegraded":"2024-04-24T01:27:43.359480+0000","last_fullsized":"2024-04-24T01:27:43.359480+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.359390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:55.127868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.923552+0000","last_change":"2024-04-24T01:27:49.923613+0000","last_active":"2024-04-24T01:27:49.923552+0000","last_peered":"2024-04-24T01:27:49.923552+0000","last_clean":"2024-04-24T01:27:49.923552+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:49.923552+0000","last_undegraded":"2024-04-24T01:27:49.923552+0000","last_fullsized":"2024-04-24T01:27:49.923552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.923469+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:10.601774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.002121+0000","last_change":"2024-04-24T01:27:44.002143+0000","last_active":"2024-04-24T01:27:44.002121+0000","last_peered":"2024-04-24T01:27:44.002121+0000","last_clean":"2024-04-24T01:27:44.002121+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:27:44.002121+0000","last_undegraded":"2024-04-24T01:27:44.002121+0000","last_fullsized":"2024-04-24T01:27:44.002121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.001993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:46.800003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983635+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:18.983635+0000","last_peered":"2024-04-24T01:26:18.983635+0000","last_clean":"2024-04-24T01:26:18.983635+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:18.983635+0000","last_undegraded":"2024-04-24T01:26:18.983635+0000","last_fullsized":"2024-04-24T01:26:18.983635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.764509+0000","last_change":"2024-04-24T01:27:57.764536+0000","last_active":"2024-04-24T01:27:57.764509+0000","last_peered":"2024-04-24T01:27:57.764509+0000","last_clean":"2024-04-24T01:27:57.764509+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:57.764509+0000","last_undegraded":"2024-04-24T01:27:57.764509+0000","last_fullsized":"2024-04-24T01:27:57.764509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.764420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:01.699221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.042721+0000","last_change":"2024-04-24T01:27:55.042782+0000","last_active":"2024-04-24T01:27:55.042721+0000","last_peered":"2024-04-24T01:27:55.042721+0000","last_clean":"2024-04-24T01:27:55.042721+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:55.042721+0000","last_undegraded":"2024-04-24T01:27:55.042721+0000","last_fullsized":"2024-04-24T01:27:55.042721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.042621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:01:44.687742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:56.971200+0000","last_change":"2024-04-24T01:23:50.690717+0000","last_active":"2024-04-24T01:25:56.971200+0000","last_peered":"2024-04-24T01:25:56.971200+0000","last_clean":"2024-04-24T01:25:56.971200+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:25:56.971200+0000","last_undegraded":"2024-04-24T01:25:56.971200+0000","last_fullsized":"2024-04-24T01:25:56.971200+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.316792+0000","last_change":"2024-04-24T01:27:44.316856+0000","last_active":"2024-04-24T01:27:44.316792+0000","last_peered":"2024-04-24T01:27:44.316792+0000","last_clean":"2024-04-24T01:27:44.316792+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:44.316792+0000","last_undegraded":"2024-04-24T01:27:44.316792+0000","last_fullsized":"2024-04-24T01:27:44.316792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.316675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:19.698338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'88","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.086818+0000","last_change":"2024-04-24T01:27:27.086861+0000","last_active":"2024-04-24T01:27:27.086818+0000","last_peered":"2024-04-24T01:27:27.086818+0000","last_clean":"2024-04-24T01:27:27.086818+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:27.086818+0000","last_undegraded":"2024-04-24T01:27:27.086818+0000","last_fullsized":"2024-04-24T01:27:27.086818+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'88","last_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_deep_scrub":"34'88","last_deep_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.086724+0000","objects_scrubbed":11,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:32.526409+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.902314+0000","last_change":"2024-04-24T01:27:29.902351+0000","last_active":"2024-04-24T01:27:29.902314+0000","last_peered":"2024-04-24T01:27:29.902314+0000","last_clean":"2024-04-24T01:27:29.902314+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:27:29.902314+0000","last_undegraded":"2024-04-24T01:27:29.902314+0000","last_fullsized":"2024-04-24T01:27:29.902314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.902169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:02.390606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975643+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:26.975643+0000","last_peered":"2024-04-24T01:26:26.975643+0000","last_clean":"2024-04-24T01:26:26.975643+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:26.975643+0000","last_undegraded":"2024-04-24T01:26:26.975643+0000","last_fullsized":"2024-04-24T01:26:26.975643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":76,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.768534+0000","last_change":"2024-04-24T01:27:55.768560+0000","last_active":"2024-04-24T01:27:55.768534+0000","last_peered":"2024-04-24T01:27:55.768534+0000","last_clean":"2024-04-24T01:27:55.768534+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:55.768534+0000","last_undegraded":"2024-04-24T01:27:55.768534+0000","last_fullsized":"2024-04-24T01:27:55.768534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.768450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:38.395793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972707+0000","last_change":"2024-04-24T01:23:58.743148+0000","last_active":"2024-04-24T01:26:06.972707+0000","last_peered":"2024-04-24T01:26:06.972707+0000","last_clean":"2024-04-24T01:26:06.972707+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:26:06.972707+0000","last_undegraded":"2024-04-24T01:26:06.972707+0000","last_fullsized":"2024-04-24T01:26:06.972707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981455+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:25:58.981455+0000","last_peered":"2024-04-24T01:25:58.981455+0000","last_clean":"2024-04-24T01:25:58.981455+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:25:58.981455+0000","last_undegraded":"2024-04-24T01:25:58.981455+0000","last_fullsized":"2024-04-24T01:25:58.981455+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.079185+0000","last_change":"2024-04-24T01:27:26.079211+0000","last_active":"2024-04-24T01:27:26.079185+0000","last_peered":"2024-04-24T01:27:26.079185+0000","last_clean":"2024-04-24T01:27:26.079185+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:27:26.079185+0000","last_undegraded":"2024-04-24T01:27:26.079185+0000","last_fullsized":"2024-04-24T01:27:26.079185+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.079098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:16:40.353572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.825386+0000","last_change":"2024-04-24T01:27:24.825422+0000","last_active":"2024-04-24T01:27:24.825386+0000","last_peered":"2024-04-24T01:27:24.825386+0000","last_clean":"2024-04-24T01:27:24.825386+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:27:24.825386+0000","last_undegraded":"2024-04-24T01:27:24.825386+0000","last_fullsized":"2024-04-24T01:27:24.825386+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.825285+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:34.030557+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":368,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.840941+0000","last_change":"2024-04-24T01:27:25.840969+0000","last_active":"2024-04-24T01:27:25.840941+0000","last_peered":"2024-04-24T01:27:25.840941+0000","last_clean":"2024-04-24T01:27:25.840941+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:25.840941+0000","last_undegraded":"2024-04-24T01:27:25.840941+0000","last_fullsized":"2024-04-24T01:27:25.840941+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.840846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:46:26.499751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985221+0000","last_change":"2024-04-24T01:24:08.770343+0000","last_active":"2024-04-24T01:26:23.985221+0000","last_peered":"2024-04-24T01:26:23.985221+0000","last_clean":"2024-04-24T01:26:23.985221+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:26:23.985221+0000","last_undegraded":"2024-04-24T01:26:23.985221+0000","last_fullsized":"2024-04-24T01:26:23.985221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.981788+0000","last_change":"2024-04-24T01:27:36.981815+0000","last_active":"2024-04-24T01:27:36.981788+0000","last_peered":"2024-04-24T01:27:36.981788+0000","last_clean":"2024-04-24T01:27:36.981788+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:27:36.981788+0000","last_undegraded":"2024-04-24T01:27:36.981788+0000","last_fullsized":"2024-04-24T01:27:36.981788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.981689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:02.218699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982949+0000","last_change":"2024-04-24T01:23:58.764623+0000","last_active":"2024-04-24T01:26:08.982949+0000","last_peered":"2024-04-24T01:26:08.982949+0000","last_clean":"2024-04-24T01:26:08.982949+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:26:08.982949+0000","last_undegraded":"2024-04-24T01:26:08.982949+0000","last_fullsized":"2024-04-24T01:26:08.982949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.972093+0000","last_change":"2024-04-24T01:23:50.690641+0000","last_active":"2024-04-24T01:26:01.972093+0000","last_peered":"2024-04-24T01:26:01.972093+0000","last_clean":"2024-04-24T01:26:01.972093+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:26:01.972093+0000","last_undegraded":"2024-04-24T01:26:01.972093+0000","last_fullsized":"2024-04-24T01:26:01.972093+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982795+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:26:08.982795+0000","last_peered":"2024-04-24T01:26:08.982795+0000","last_clean":"2024-04-24T01:26:08.982795+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:26:08.982795+0000","last_undegraded":"2024-04-24T01:26:08.982795+0000","last_fullsized":"2024-04-24T01:26:08.982795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.936643+0000","last_change":"2024-04-24T01:27:45.936683+0000","last_active":"2024-04-24T01:27:45.936643+0000","last_peered":"2024-04-24T01:27:45.936643+0000","last_clean":"2024-04-24T01:27:45.936643+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:27:45.936643+0000","last_undegraded":"2024-04-24T01:27:45.936643+0000","last_fullsized":"2024-04-24T01:27:45.936643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.936543+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:45.566244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":424,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.031895+0000","last_change":"2024-04-24T01:27:26.031922+0000","last_active":"2024-04-24T01:27:26.031895+0000","last_peered":"2024-04-24T01:27:26.031895+0000","last_clean":"2024-04-24T01:27:26.031895+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:26.031895+0000","last_undegraded":"2024-04-24T01:27:26.031895+0000","last_fullsized":"2024-04-24T01:27:26.031895+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.031809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:08.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984605+0000","last_change":"2024-04-24T01:24:08.778968+0000","last_active":"2024-04-24T01:26:23.984605+0000","last_peered":"2024-04-24T01:26:23.984605+0000","last_clean":"2024-04-24T01:26:23.984605+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:26:23.984605+0000","last_undegraded":"2024-04-24T01:26:23.984605+0000","last_fullsized":"2024-04-24T01:26:23.984605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.047151+0000","last_change":"2024-04-24T01:24:00.740835+0000","last_active":"2024-04-24T01:27:10.047151+0000","last_peered":"2024-04-24T01:27:10.047151+0000","last_clean":"2024-04-24T01:27:10.047151+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:27:10.047151+0000","last_undegraded":"2024-04-24T01:27:10.047151+0000","last_fullsized":"2024-04-24T01:27:10.047151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982263+0000","last_change":"2024-04-24T01:23:58.752490+0000","last_active":"2024-04-24T01:26:08.982263+0000","last_peered":"2024-04-24T01:26:08.982263+0000","last_clean":"2024-04-24T01:26:08.982263+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:26:08.982263+0000","last_undegraded":"2024-04-24T01:26:08.982263+0000","last_fullsized":"2024-04-24T01:26:08.982263+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:25:58.981505+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:25:58.981505+0000","last_peered":"2024-04-24T01:25:58.981505+0000","last_clean":"2024-04-24T01:25:58.981505+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:25:58.981505+0000","last_undegraded":"2024-04-24T01:25:58.981505+0000","last_fullsized":"2024-04-24T01:25:58.981505+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.157265+0000","last_change":"2024-04-24T01:27:21.157304+0000","last_active":"2024-04-24T01:27:21.157265+0000","last_peered":"2024-04-24T01:27:21.157265+0000","last_clean":"2024-04-24T01:27:21.157265+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:27:21.157265+0000","last_undegraded":"2024-04-24T01:27:21.157265+0000","last_fullsized":"2024-04-24T01:27:21.157265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.157174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:08.856778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":205,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.850671+0000","last_change":"2024-04-24T01:27:24.850725+0000","last_active":"2024-04-24T01:27:24.850671+0000","last_peered":"2024-04-24T01:27:24.850671+0000","last_clean":"2024-04-24T01:27:24.850671+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:24.850671+0000","last_undegraded":"2024-04-24T01:27:24.850671+0000","last_fullsized":"2024-04-24T01:27:24.850671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.850572+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:25.939996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.111901+0000","last_change":"2024-04-24T01:27:20.111936+0000","last_active":"2024-04-24T01:27:20.111901+0000","last_peered":"2024-04-24T01:27:20.111901+0000","last_clean":"2024-04-24T01:27:20.111901+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:27:20.111901+0000","last_undegraded":"2024-04-24T01:27:20.111901+0000","last_fullsized":"2024-04-24T01:27:20.111901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.111793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:00.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.136819+0000","last_change":"2024-04-24T01:24:08.771385+0000","last_active":"2024-04-24T01:27:10.136819+0000","last_peered":"2024-04-24T01:27:10.136819+0000","last_clean":"2024-04-24T01:27:10.136819+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:27:10.136819+0000","last_undegraded":"2024-04-24T01:27:10.136819+0000","last_fullsized":"2024-04-24T01:27:10.136819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983103+0000","last_change":"2024-04-24T01:24:08.773058+0000","last_active":"2024-04-24T01:26:13.983103+0000","last_peered":"2024-04-24T01:26:13.983103+0000","last_clean":"2024-04-24T01:26:13.983103+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:26:13.983103+0000","last_undegraded":"2024-04-24T01:26:13.983103+0000","last_fullsized":"2024-04-24T01:26:13.983103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.103039+0000","last_change":"2024-04-24T01:27:50.103068+0000","last_active":"2024-04-24T01:27:50.103039+0000","last_peered":"2024-04-24T01:27:50.103039+0000","last_clean":"2024-04-24T01:27:50.103039+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:27:50.103039+0000","last_undegraded":"2024-04-24T01:27:50.103039+0000","last_fullsized":"2024-04-24T01:27:50.103039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.102944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:05.909709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984372+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:26:18.984372+0000","last_peered":"2024-04-24T01:26:18.984372+0000","last_clean":"2024-04-24T01:26:18.984372+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:26:18.984372+0000","last_undegraded":"2024-04-24T01:26:18.984372+0000","last_fullsized":"2024-04-24T01:26:18.984372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.764420+0000","last_change":"2024-04-24T01:27:38.764441+0000","last_active":"2024-04-24T01:27:38.764420+0000","last_peered":"2024-04-24T01:27:38.764420+0000","last_clean":"2024-04-24T01:27:38.764420+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:27:38.764420+0000","last_undegraded":"2024-04-24T01:27:38.764420+0000","last_fullsized":"2024-04-24T01:27:38.764420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.764324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:54.262419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.087710+0000","last_change":"2024-04-24T01:27:31.087751+0000","last_active":"2024-04-24T01:27:31.087710+0000","last_peered":"2024-04-24T01:27:31.087710+0000","last_clean":"2024-04-24T01:27:31.087710+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:31.087710+0000","last_undegraded":"2024-04-24T01:27:31.087710+0000","last_fullsized":"2024-04-24T01:27:31.087710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.087607+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:17.401970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.881538+0000","last_change":"2024-04-24T01:27:50.881559+0000","last_active":"2024-04-24T01:27:50.881538+0000","last_peered":"2024-04-24T01:27:50.881538+0000","last_clean":"2024-04-24T01:27:50.881538+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:27:50.881538+0000","last_undegraded":"2024-04-24T01:27:50.881538+0000","last_fullsized":"2024-04-24T01:27:50.881538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.881443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:57.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.043852+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:10.043852+0000","last_peered":"2024-04-24T01:27:10.043852+0000","last_clean":"2024-04-24T01:27:10.043852+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:10.043852+0000","last_undegraded":"2024-04-24T01:27:10.043852+0000","last_fullsized":"2024-04-24T01:27:10.043852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320685+0000","last_change":"2024-04-24T01:24:00.743196+0000","last_active":"2024-04-24T01:27:10.320685+0000","last_peered":"2024-04-24T01:27:10.320685+0000","last_clean":"2024-04-24T01:27:10.320685+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:27:10.320685+0000","last_undegraded":"2024-04-24T01:27:10.320685+0000","last_fullsized":"2024-04-24T01:27:10.320685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.044213+0000","last_change":"2024-04-24T01:27:57.044241+0000","last_active":"2024-04-24T01:27:57.044213+0000","last_peered":"2024-04-24T01:27:57.044213+0000","last_clean":"2024-04-24T01:27:57.044213+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:57.044213+0000","last_undegraded":"2024-04-24T01:27:57.044213+0000","last_fullsized":"2024-04-24T01:27:57.044213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.044128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:43.358491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.142890+0000","last_change":"2024-04-24T01:27:29.142915+0000","last_active":"2024-04-24T01:27:29.142890+0000","last_peered":"2024-04-24T01:27:29.142890+0000","last_clean":"2024-04-24T01:27:29.142890+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:27:29.142890+0000","last_undegraded":"2024-04-24T01:27:29.142890+0000","last_fullsized":"2024-04-24T01:27:29.142890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.142798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:45.905908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.183889+0000","last_change":"2024-04-24T01:27:34.183920+0000","last_active":"2024-04-24T01:27:34.183889+0000","last_peered":"2024-04-24T01:27:34.183889+0000","last_clean":"2024-04-24T01:27:34.183889+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:34.183889+0000","last_undegraded":"2024-04-24T01:27:34.183889+0000","last_fullsized":"2024-04-24T01:27:34.183889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.183806+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:12.698513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.807860+0000","last_change":"2024-04-24T01:27:23.807924+0000","last_active":"2024-04-24T01:27:23.807860+0000","last_peered":"2024-04-24T01:27:23.807860+0000","last_clean":"2024-04-24T01:27:23.807860+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:27:23.807860+0000","last_undegraded":"2024-04-24T01:27:23.807860+0000","last_fullsized":"2024-04-24T01:27:23.807860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.807746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:16.346274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977765+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:41.977765+0000","last_peered":"2024-04-24T01:26:41.977765+0000","last_clean":"2024-04-24T01:26:41.977765+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:41.977765+0000","last_undegraded":"2024-04-24T01:26:41.977765+0000","last_fullsized":"2024-04-24T01:26:41.977765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'5","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.395049+0000","last_change":"2024-04-24T01:24:00.738348+0000","last_active":"2024-04-24T01:27:10.395049+0000","last_peered":"2024-04-24T01:27:10.395049+0000","last_clean":"2024-04-24T01:27:10.395049+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:27:10.395049+0000","last_undegraded":"2024-04-24T01:27:10.395049+0000","last_fullsized":"2024-04-24T01:27:10.395049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984600+0000","last_change":"2024-04-24T01:23:58.737688+0000","last_active":"2024-04-24T01:26:23.984600+0000","last_peered":"2024-04-24T01:26:23.984600+0000","last_clean":"2024-04-24T01:26:23.984600+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:26:23.984600+0000","last_undegraded":"2024-04-24T01:26:23.984600+0000","last_fullsized":"2024-04-24T01:26:23.984600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.931167+0000","last_change":"2024-04-24T01:27:36.931202+0000","last_active":"2024-04-24T01:27:36.931167+0000","last_peered":"2024-04-24T01:27:36.931167+0000","last_clean":"2024-04-24T01:27:36.931167+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:27:36.931167+0000","last_undegraded":"2024-04-24T01:27:36.931167+0000","last_fullsized":"2024-04-24T01:27:36.931167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.931078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:03.648188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.196789+0000","last_change":"2024-04-24T01:27:31.196826+0000","last_active":"2024-04-24T01:27:31.196789+0000","last_peered":"2024-04-24T01:27:31.196789+0000","last_clean":"2024-04-24T01:27:31.196789+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:31.196789+0000","last_undegraded":"2024-04-24T01:27:31.196789+0000","last_fullsized":"2024-04-24T01:27:31.196789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.196709+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:14:11.522611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.807230+0000","last_change":"2024-04-24T01:27:20.807267+0000","last_active":"2024-04-24T01:27:20.807230+0000","last_peered":"2024-04-24T01:27:20.807230+0000","last_clean":"2024-04-24T01:27:20.807230+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:27:20.807230+0000","last_undegraded":"2024-04-24T01:27:20.807230+0000","last_fullsized":"2024-04-24T01:27:20.807230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.807118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:36.350177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:38.987613+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:26:38.987613+0000","last_peered":"2024-04-24T01:26:38.987613+0000","last_clean":"2024-04-24T01:26:38.987613+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:26:38.987613+0000","last_undegraded":"2024-04-24T01:26:38.987613+0000","last_fullsized":"2024-04-24T01:26:38.987613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.969576+0000","last_change":"2024-04-24T01:27:35.969607+0000","last_active":"2024-04-24T01:27:35.969576+0000","last_peered":"2024-04-24T01:27:35.969576+0000","last_clean":"2024-04-24T01:27:35.969576+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:35.969576+0000","last_undegraded":"2024-04-24T01:27:35.969576+0000","last_fullsized":"2024-04-24T01:27:35.969576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.969453+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:40.292715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.984717+0000","last_change":"2024-04-24T01:23:58.752672+0000","last_active":"2024-04-24T01:26:23.984717+0000","last_peered":"2024-04-24T01:26:23.984717+0000","last_clean":"2024-04-24T01:26:23.984717+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:26:23.984717+0000","last_undegraded":"2024-04-24T01:26:23.984717+0000","last_fullsized":"2024-04-24T01:26:23.984717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.118350+0000","last_change":"2024-04-24T01:27:30.118393+0000","last_active":"2024-04-24T01:27:30.118350+0000","last_peered":"2024-04-24T01:27:30.118350+0000","last_clean":"2024-04-24T01:27:30.118350+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:27:30.118350+0000","last_undegraded":"2024-04-24T01:27:30.118350+0000","last_fullsized":"2024-04-24T01:27:30.118350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.118234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:34.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.933092+0000","last_change":"2024-04-24T01:27:32.933125+0000","last_active":"2024-04-24T01:27:32.933092+0000","last_peered":"2024-04-24T01:27:32.933092+0000","last_clean":"2024-04-24T01:27:32.933092+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:32.933092+0000","last_undegraded":"2024-04-24T01:27:32.933092+0000","last_fullsized":"2024-04-24T01:27:32.933092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.933012+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:06:06.750907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.831039+0000","last_change":"2024-04-24T01:27:20.831064+0000","last_active":"2024-04-24T01:27:20.831039+0000","last_peered":"2024-04-24T01:27:20.831039+0000","last_clean":"2024-04-24T01:27:20.831039+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:27:20.831039+0000","last_undegraded":"2024-04-24T01:27:20.831039+0000","last_fullsized":"2024-04-24T01:27:20.831039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.830957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:31.945556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.917560+0000","last_change":"2024-04-24T01:27:55.917603+0000","last_active":"2024-04-24T01:27:55.917560+0000","last_peered":"2024-04-24T01:27:55.917560+0000","last_clean":"2024-04-24T01:27:55.917560+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:27:55.917560+0000","last_undegraded":"2024-04-24T01:27:55.917560+0000","last_fullsized":"2024-04-24T01:27:55.917560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.917438+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:55.797725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985004+0000","last_change":"2024-04-24T01:23:58.759047+0000","last_active":"2024-04-24T01:26:23.985004+0000","last_peered":"2024-04-24T01:26:23.985004+0000","last_clean":"2024-04-24T01:26:23.985004+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:26:23.985004+0000","last_undegraded":"2024-04-24T01:26:23.985004+0000","last_fullsized":"2024-04-24T01:26:23.985004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.353236+0000","last_change":"2024-04-24T01:27:42.353257+0000","last_active":"2024-04-24T01:27:42.353236+0000","last_peered":"2024-04-24T01:27:42.353236+0000","last_clean":"2024-04-24T01:27:42.353236+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:27:42.353236+0000","last_undegraded":"2024-04-24T01:27:42.353236+0000","last_fullsized":"2024-04-24T01:27:42.353236+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.353157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:02.089872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.233047+0000","last_change":"2024-04-24T01:27:32.233080+0000","last_active":"2024-04-24T01:27:32.233047+0000","last_peered":"2024-04-24T01:27:32.233047+0000","last_clean":"2024-04-24T01:27:32.233047+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:32.233047+0000","last_undegraded":"2024-04-24T01:27:32.233047+0000","last_fullsized":"2024-04-24T01:27:32.233047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.232954+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:33.771403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.841600+0000","last_change":"2024-04-24T01:27:22.841624+0000","last_active":"2024-04-24T01:27:22.841600+0000","last_peered":"2024-04-24T01:27:22.841600+0000","last_clean":"2024-04-24T01:27:22.841600+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:27:22.841600+0000","last_undegraded":"2024-04-24T01:27:22.841600+0000","last_fullsized":"2024-04-24T01:27:22.841600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.841514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:44.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448352+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.448352+0000","last_peered":"2024-04-24T01:27:10.448352+0000","last_clean":"2024-04-24T01:27:10.448352+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.448352+0000","last_undegraded":"2024-04-24T01:27:10.448352+0000","last_fullsized":"2024-04-24T01:27:10.448352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.296621+0000","last_change":"2024-04-24T01:27:48.296646+0000","last_active":"2024-04-24T01:27:48.296621+0000","last_peered":"2024-04-24T01:27:48.296621+0000","last_clean":"2024-04-24T01:27:48.296621+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:48.296621+0000","last_undegraded":"2024-04-24T01:27:48.296621+0000","last_fullsized":"2024-04-24T01:27:48.296621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.296518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:09.220285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.016819+0000","last_change":"2024-04-24T01:23:58.752621+0000","last_active":"2024-04-24T01:27:17.016819+0000","last_peered":"2024-04-24T01:27:17.016819+0000","last_clean":"2024-04-24T01:27:17.016819+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:27:17.016819+0000","last_undegraded":"2024-04-24T01:27:17.016819+0000","last_fullsized":"2024-04-24T01:27:17.016819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.045977+0000","last_change":"2024-04-24T01:27:41.046002+0000","last_active":"2024-04-24T01:27:41.045977+0000","last_peered":"2024-04-24T01:27:41.045977+0000","last_clean":"2024-04-24T01:27:41.045977+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:27:41.045977+0000","last_undegraded":"2024-04-24T01:27:41.045977+0000","last_fullsized":"2024-04-24T01:27:41.045977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.045887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:22.914827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.087296+0000","last_change":"2024-04-24T01:27:25.087358+0000","last_active":"2024-04-24T01:27:25.087296+0000","last_peered":"2024-04-24T01:27:25.087296+0000","last_clean":"2024-04-24T01:27:25.087296+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:25.087296+0000","last_undegraded":"2024-04-24T01:27:25.087296+0000","last_fullsized":"2024-04-24T01:27:25.087296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.087202+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:18.223546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.735703+0000","last_change":"2024-04-24T01:27:33.735761+0000","last_active":"2024-04-24T01:27:33.735703+0000","last_peered":"2024-04-24T01:27:33.735703+0000","last_clean":"2024-04-24T01:27:33.735703+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:27:33.735703+0000","last_undegraded":"2024-04-24T01:27:33.735703+0000","last_fullsized":"2024-04-24T01:27:33.735703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.735599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:44.989596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985964+0000","last_change":"2024-04-24T01:24:08.771793+0000","last_active":"2024-04-24T01:26:28.985964+0000","last_peered":"2024-04-24T01:26:28.985964+0000","last_clean":"2024-04-24T01:26:28.985964+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:26:28.985964+0000","last_undegraded":"2024-04-24T01:26:28.985964+0000","last_fullsized":"2024-04-24T01:26:28.985964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.973256+0000","last_change":"2024-04-24T01:27:33.973301+0000","last_active":"2024-04-24T01:27:33.973256+0000","last_peered":"2024-04-24T01:27:33.973256+0000","last_clean":"2024-04-24T01:27:33.973256+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:27:33.973256+0000","last_undegraded":"2024-04-24T01:27:33.973256+0000","last_fullsized":"2024-04-24T01:27:33.973256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.973155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:28.429349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985527+0000","last_change":"2024-04-24T01:23:58.752298+0000","last_active":"2024-04-24T01:26:28.985527+0000","last_peered":"2024-04-24T01:26:28.985527+0000","last_clean":"2024-04-24T01:26:28.985527+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:26:28.985527+0000","last_undegraded":"2024-04-24T01:26:28.985527+0000","last_fullsized":"2024-04-24T01:26:28.985527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.059784+0000","last_change":"2024-04-24T01:27:40.059810+0000","last_active":"2024-04-24T01:27:40.059784+0000","last_peered":"2024-04-24T01:27:40.059784+0000","last_clean":"2024-04-24T01:27:40.059784+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:27:40.059784+0000","last_undegraded":"2024-04-24T01:27:40.059784+0000","last_fullsized":"2024-04-24T01:27:40.059784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.059684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:04.176354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":108,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.098321+0000","last_change":"2024-04-24T01:27:28.098384+0000","last_active":"2024-04-24T01:27:28.098321+0000","last_peered":"2024-04-24T01:27:28.098321+0000","last_clean":"2024-04-24T01:27:28.098321+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:28.098321+0000","last_undegraded":"2024-04-24T01:27:28.098321+0000","last_fullsized":"2024-04-24T01:27:28.098321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.098205+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:13.672642+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.091400+0000","last_change":"2024-04-24T01:27:22.091423+0000","last_active":"2024-04-24T01:27:22.091400+0000","last_peered":"2024-04-24T01:27:22.091400+0000","last_clean":"2024-04-24T01:27:22.091400+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:27:22.091400+0000","last_undegraded":"2024-04-24T01:27:22.091400+0000","last_fullsized":"2024-04-24T01:27:22.091400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.091312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:42.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985951+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:28.985951+0000","last_peered":"2024-04-24T01:26:28.985951+0000","last_clean":"2024-04-24T01:26:28.985951+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:28.985951+0000","last_undegraded":"2024-04-24T01:26:28.985951+0000","last_fullsized":"2024-04-24T01:26:28.985951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.329918+0000","last_change":"2024-04-24T01:27:55.329959+0000","last_active":"2024-04-24T01:27:55.329918+0000","last_peered":"2024-04-24T01:27:55.329918+0000","last_clean":"2024-04-24T01:27:55.329918+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:27:55.329918+0000","last_undegraded":"2024-04-24T01:27:55.329918+0000","last_fullsized":"2024-04-24T01:27:55.329918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.329792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:04:03.792768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986002+0000","last_change":"2024-04-24T01:23:58.758937+0000","last_active":"2024-04-24T01:26:28.986002+0000","last_peered":"2024-04-24T01:26:28.986002+0000","last_clean":"2024-04-24T01:26:28.986002+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:26:28.986002+0000","last_undegraded":"2024-04-24T01:26:28.986002+0000","last_fullsized":"2024-04-24T01:26:28.986002+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.749135+0000","last_change":"2024-04-24T01:27:39.749158+0000","last_active":"2024-04-24T01:27:39.749135+0000","last_peered":"2024-04-24T01:27:39.749135+0000","last_clean":"2024-04-24T01:27:39.749135+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:27:39.749135+0000","last_undegraded":"2024-04-24T01:27:39.749135+0000","last_fullsized":"2024-04-24T01:27:39.749135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.749046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:27.448650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.983543+0000","last_change":"2024-04-24T01:27:34.983586+0000","last_active":"2024-04-24T01:27:34.983543+0000","last_peered":"2024-04-24T01:27:34.983543+0000","last_clean":"2024-04-24T01:27:34.983543+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:27:34.983543+0000","last_undegraded":"2024-04-24T01:27:34.983543+0000","last_fullsized":"2024-04-24T01:27:34.983543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.983448+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:01.670877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":387,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.929151+0000","last_change":"2024-04-24T01:27:33.929176+0000","last_active":"2024-04-24T01:27:33.929151+0000","last_peered":"2024-04-24T01:27:33.929151+0000","last_clean":"2024-04-24T01:27:33.929151+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:33.929151+0000","last_undegraded":"2024-04-24T01:27:33.929151+0000","last_fullsized":"2024-04-24T01:27:33.929151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.929072+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:18.783745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985841+0000","last_change":"2024-04-24T01:24:08.773245+0000","last_active":"2024-04-24T01:26:28.985841+0000","last_peered":"2024-04-24T01:26:28.985841+0000","last_clean":"2024-04-24T01:26:28.985841+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:26:28.985841+0000","last_undegraded":"2024-04-24T01:26:28.985841+0000","last_fullsized":"2024-04-24T01:26:28.985841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.079919+0000","last_change":"2024-04-24T01:27:48.079950+0000","last_active":"2024-04-24T01:27:48.079919+0000","last_peered":"2024-04-24T01:27:48.079919+0000","last_clean":"2024-04-24T01:27:48.079919+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:48.079919+0000","last_undegraded":"2024-04-24T01:27:48.079919+0000","last_fullsized":"2024-04-24T01:27:48.079919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.079833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:52:03.610383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985561+0000","last_change":"2024-04-24T01:23:58.753123+0000","last_active":"2024-04-24T01:26:28.985561+0000","last_peered":"2024-04-24T01:26:28.985561+0000","last_clean":"2024-04-24T01:26:28.985561+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:26:28.985561+0000","last_undegraded":"2024-04-24T01:26:28.985561+0000","last_fullsized":"2024-04-24T01:26:28.985561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.756543+0000","last_change":"2024-04-24T01:27:36.756588+0000","last_active":"2024-04-24T01:27:36.756543+0000","last_peered":"2024-04-24T01:27:36.756543+0000","last_clean":"2024-04-24T01:27:36.756543+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:27:36.756543+0000","last_undegraded":"2024-04-24T01:27:36.756543+0000","last_fullsized":"2024-04-24T01:27:36.756543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.756455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:22.449180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.761744+0000","last_change":"2024-04-24T01:27:30.761800+0000","last_active":"2024-04-24T01:27:30.761744+0000","last_peered":"2024-04-24T01:27:30.761744+0000","last_clean":"2024-04-24T01:27:30.761744+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:30.761744+0000","last_undegraded":"2024-04-24T01:27:30.761744+0000","last_fullsized":"2024-04-24T01:27:30.761744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.761661+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:48.545704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.337069+0000","last_change":"2024-04-24T01:27:45.337095+0000","last_active":"2024-04-24T01:27:45.337069+0000","last_peered":"2024-04-24T01:27:45.337069+0000","last_clean":"2024-04-24T01:27:45.337069+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:27:45.337069+0000","last_undegraded":"2024-04-24T01:27:45.337069+0000","last_fullsized":"2024-04-24T01:27:45.337069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.336963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:37.290165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.739909+0000","last_change":"2024-04-24T01:27:37.739935+0000","last_active":"2024-04-24T01:27:37.739909+0000","last_peered":"2024-04-24T01:27:37.739909+0000","last_clean":"2024-04-24T01:27:37.739909+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:27:37.739909+0000","last_undegraded":"2024-04-24T01:27:37.739909+0000","last_fullsized":"2024-04-24T01:27:37.739909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.739820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:34.597803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.075139+0000","last_change":"2024-04-24T01:27:45.075163+0000","last_active":"2024-04-24T01:27:45.075139+0000","last_peered":"2024-04-24T01:27:45.075139+0000","last_clean":"2024-04-24T01:27:45.075139+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:45.075139+0000","last_undegraded":"2024-04-24T01:27:45.075139+0000","last_fullsized":"2024-04-24T01:27:45.075139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.075019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:51.367822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986062+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:26:28.986062+0000","last_peered":"2024-04-24T01:26:28.986062+0000","last_clean":"2024-04-24T01:26:28.986062+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:26:28.986062+0000","last_undegraded":"2024-04-24T01:26:28.986062+0000","last_fullsized":"2024-04-24T01:26:28.986062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.913584+0000","last_change":"2024-04-24T01:27:34.913612+0000","last_active":"2024-04-24T01:27:34.913584+0000","last_peered":"2024-04-24T01:27:34.913584+0000","last_clean":"2024-04-24T01:27:34.913584+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:27:34.913584+0000","last_undegraded":"2024-04-24T01:27:34.913584+0000","last_fullsized":"2024-04-24T01:27:34.913584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.913487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:18.229615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.156326+0000","last_change":"2024-04-24T01:27:30.156369+0000","last_active":"2024-04-24T01:27:30.156326+0000","last_peered":"2024-04-24T01:27:30.156326+0000","last_clean":"2024-04-24T01:27:30.156326+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:30.156326+0000","last_undegraded":"2024-04-24T01:27:30.156326+0000","last_fullsized":"2024-04-24T01:27:30.156326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.156230+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:37.955468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.987140+0000","last_change":"2024-04-24T01:27:42.987190+0000","last_active":"2024-04-24T01:27:42.987140+0000","last_peered":"2024-04-24T01:27:42.987140+0000","last_clean":"2024-04-24T01:27:42.987140+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:27:42.987140+0000","last_undegraded":"2024-04-24T01:27:42.987140+0000","last_fullsized":"2024-04-24T01:27:42.987140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.987041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:18.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986980+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:26:33.986980+0000","last_peered":"2024-04-24T01:26:33.986980+0000","last_clean":"2024-04-24T01:26:33.986980+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:26:33.986980+0000","last_undegraded":"2024-04-24T01:26:33.986980+0000","last_fullsized":"2024-04-24T01:26:33.986980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'11","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.394981+0000","last_change":"2024-04-24T01:24:00.731136+0000","last_active":"2024-04-24T01:27:10.394981+0000","last_peered":"2024-04-24T01:27:10.394981+0000","last_clean":"2024-04-24T01:27:10.394981+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:27:10.394981+0000","last_undegraded":"2024-04-24T01:27:10.394981+0000","last_fullsized":"2024-04-24T01:27:10.394981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:01.972102+0000","last_change":"2024-04-24T01:23:58.743560+0000","last_active":"2024-04-24T01:26:01.972102+0000","last_peered":"2024-04-24T01:26:01.972102+0000","last_clean":"2024-04-24T01:26:01.972102+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:26:01.972102+0000","last_undegraded":"2024-04-24T01:26:01.972102+0000","last_fullsized":"2024-04-24T01:26:01.972102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.755391+0000","last_change":"2024-04-24T01:27:34.755417+0000","last_active":"2024-04-24T01:27:34.755391+0000","last_peered":"2024-04-24T01:27:34.755391+0000","last_clean":"2024-04-24T01:27:34.755391+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:27:34.755391+0000","last_undegraded":"2024-04-24T01:27:34.755391+0000","last_fullsized":"2024-04-24T01:27:34.755391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.755296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:32.167294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.873513+0000","last_change":"2024-04-24T01:27:47.873544+0000","last_active":"2024-04-24T01:27:47.873513+0000","last_peered":"2024-04-24T01:27:47.873513+0000","last_clean":"2024-04-24T01:27:47.873513+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:47.873513+0000","last_undegraded":"2024-04-24T01:27:47.873513+0000","last_fullsized":"2024-04-24T01:27:47.873513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.873413+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:12:47.188719+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.891422+0000","last_change":"2024-04-24T01:27:54.891469+0000","last_active":"2024-04-24T01:27:54.891422+0000","last_peered":"2024-04-24T01:27:54.891422+0000","last_clean":"2024-04-24T01:27:54.891422+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:27:54.891422+0000","last_undegraded":"2024-04-24T01:27:54.891422+0000","last_fullsized":"2024-04-24T01:27:54.891422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.891327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:46.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986917+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:33.986917+0000","last_peered":"2024-04-24T01:26:33.986917+0000","last_clean":"2024-04-24T01:26:33.986917+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:33.986917+0000","last_undegraded":"2024-04-24T01:26:33.986917+0000","last_fullsized":"2024-04-24T01:26:33.986917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.065454+0000","last_change":"2024-04-24T01:27:44.065481+0000","last_active":"2024-04-24T01:27:44.065454+0000","last_peered":"2024-04-24T01:27:44.065454+0000","last_clean":"2024-04-24T01:27:44.065454+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:27:44.065454+0000","last_undegraded":"2024-04-24T01:27:44.065454+0000","last_fullsized":"2024-04-24T01:27:44.065454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.065351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:23.725424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.981615+0000","last_change":"2024-04-24T01:23:58.754305+0000","last_active":"2024-04-24T01:26:03.981615+0000","last_peered":"2024-04-24T01:26:03.981615+0000","last_clean":"2024-04-24T01:26:03.981615+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:26:03.981615+0000","last_undegraded":"2024-04-24T01:26:03.981615+0000","last_fullsized":"2024-04-24T01:26:03.981615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.719484+0000","last_change":"2024-04-24T01:27:32.719516+0000","last_active":"2024-04-24T01:27:32.719484+0000","last_peered":"2024-04-24T01:27:32.719484+0000","last_clean":"2024-04-24T01:27:32.719484+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:27:32.719484+0000","last_undegraded":"2024-04-24T01:27:32.719484+0000","last_fullsized":"2024-04-24T01:27:32.719484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.719397+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:10.815530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.973007+0000","last_change":"2024-04-24T01:27:44.973079+0000","last_active":"2024-04-24T01:27:44.973007+0000","last_peered":"2024-04-24T01:27:44.973007+0000","last_clean":"2024-04-24T01:27:44.973007+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:44.973007+0000","last_undegraded":"2024-04-24T01:27:44.973007+0000","last_fullsized":"2024-04-24T01:27:44.973007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.972905+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:58:52.372440+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.200708+0000","last_change":"2024-04-24T01:27:37.200734+0000","last_active":"2024-04-24T01:27:37.200708+0000","last_peered":"2024-04-24T01:27:37.200708+0000","last_clean":"2024-04-24T01:27:37.200708+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:27:37.200708+0000","last_undegraded":"2024-04-24T01:27:37.200708+0000","last_fullsized":"2024-04-24T01:27:37.200708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.200577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:30.452220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986026+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:28.986026+0000","last_peered":"2024-04-24T01:26:28.986026+0000","last_clean":"2024-04-24T01:26:28.986026+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:28.986026+0000","last_undegraded":"2024-04-24T01:26:28.986026+0000","last_fullsized":"2024-04-24T01:26:28.986026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983091+0000","last_change":"2024-04-24T01:24:00.743591+0000","last_active":"2024-04-24T01:26:13.983091+0000","last_peered":"2024-04-24T01:26:13.983091+0000","last_clean":"2024-04-24T01:26:13.983091+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:26:13.983091+0000","last_undegraded":"2024-04-24T01:26:13.983091+0000","last_fullsized":"2024-04-24T01:26:13.983091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.098701+0000","last_change":"2024-04-24T01:27:47.098736+0000","last_active":"2024-04-24T01:27:47.098701+0000","last_peered":"2024-04-24T01:27:47.098701+0000","last_clean":"2024-04-24T01:27:47.098701+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:47.098701+0000","last_undegraded":"2024-04-24T01:27:47.098701+0000","last_fullsized":"2024-04-24T01:27:47.098701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.098613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:08.549533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.326561+0000","last_change":"2024-04-24T01:27:53.326589+0000","last_active":"2024-04-24T01:27:53.326561+0000","last_peered":"2024-04-24T01:27:53.326561+0000","last_clean":"2024-04-24T01:27:53.326561+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:27:53.326561+0000","last_undegraded":"2024-04-24T01:27:53.326561+0000","last_fullsized":"2024-04-24T01:27:53.326561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.326480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:56.533113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972607+0000","last_change":"2024-04-24T01:23:58.734945+0000","last_active":"2024-04-24T01:26:06.972607+0000","last_peered":"2024-04-24T01:26:06.972607+0000","last_clean":"2024-04-24T01:26:06.972607+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:26:06.972607+0000","last_undegraded":"2024-04-24T01:26:06.972607+0000","last_fullsized":"2024-04-24T01:26:06.972607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.133042+0000","last_change":"2024-04-24T01:24:00.729688+0000","last_active":"2024-04-24T01:27:10.133042+0000","last_peered":"2024-04-24T01:27:10.133042+0000","last_clean":"2024-04-24T01:27:10.133042+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:27:10.133042+0000","last_undegraded":"2024-04-24T01:27:10.133042+0000","last_fullsized":"2024-04-24T01:27:10.133042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:03.982114+0000","last_change":"2024-04-24T01:23:58.760076+0000","last_active":"2024-04-24T01:26:03.982114+0000","last_peered":"2024-04-24T01:26:03.982114+0000","last_clean":"2024-04-24T01:26:03.982114+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:26:03.982114+0000","last_undegraded":"2024-04-24T01:26:03.982114+0000","last_fullsized":"2024-04-24T01:26:03.982114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.132527+0000","last_change":"2024-04-24T01:24:00.733253+0000","last_active":"2024-04-24T01:27:10.132527+0000","last_peered":"2024-04-24T01:27:10.132527+0000","last_clean":"2024-04-24T01:27:10.132527+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:10.132527+0000","last_undegraded":"2024-04-24T01:27:10.132527+0000","last_fullsized":"2024-04-24T01:27:10.132527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.302350+0000","last_change":"2024-04-24T01:27:56.302374+0000","last_active":"2024-04-24T01:27:56.302350+0000","last_peered":"2024-04-24T01:27:56.302350+0000","last_clean":"2024-04-24T01:27:56.302350+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:27:56.302350+0000","last_undegraded":"2024-04-24T01:27:56.302350+0000","last_fullsized":"2024-04-24T01:27:56.302350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.302255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:55.783843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.320624+0000","last_change":"2024-04-24T01:24:00.735530+0000","last_active":"2024-04-24T01:27:10.320624+0000","last_peered":"2024-04-24T01:27:10.320624+0000","last_clean":"2024-04-24T01:27:10.320624+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:27:10.320624+0000","last_undegraded":"2024-04-24T01:27:10.320624+0000","last_fullsized":"2024-04-24T01:27:10.320624+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973452+0000","last_change":"2024-04-24T01:23:58.742681+0000","last_active":"2024-04-24T01:26:11.973452+0000","last_peered":"2024-04-24T01:26:11.973452+0000","last_clean":"2024-04-24T01:26:11.973452+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:26:11.973452+0000","last_undegraded":"2024-04-24T01:26:11.973452+0000","last_fullsized":"2024-04-24T01:26:11.973452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.269069+0000","last_change":"2024-04-24T01:24:00.742772+0000","last_active":"2024-04-24T01:27:10.269069+0000","last_peered":"2024-04-24T01:27:10.269069+0000","last_clean":"2024-04-24T01:27:10.269069+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:10.269069+0000","last_undegraded":"2024-04-24T01:27:10.269069+0000","last_fullsized":"2024-04-24T01:27:10.269069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:09.543852+0000","last_change":"2024-04-24T01:23:58.753098+0000","last_active":"2024-04-24T01:26:09.543852+0000","last_peered":"2024-04-24T01:26:09.543852+0000","last_clean":"2024-04-24T01:26:09.543852+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:26:09.543852+0000","last_undegraded":"2024-04-24T01:26:09.543852+0000","last_fullsized":"2024-04-24T01:26:09.543852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:06.972634+0000","last_change":"2024-04-24T01:24:00.733748+0000","last_active":"2024-04-24T01:26:06.972634+0000","last_peered":"2024-04-24T01:26:06.972634+0000","last_clean":"2024-04-24T01:26:06.972634+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:26:06.972634+0000","last_undegraded":"2024-04-24T01:26:06.972634+0000","last_fullsized":"2024-04-24T01:26:06.972634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.341095+0000","last_change":"2024-04-24T01:23:58.734823+0000","last_active":"2024-04-24T01:27:10.341095+0000","last_peered":"2024-04-24T01:27:10.341095+0000","last_clean":"2024-04-24T01:27:10.341095+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:27:10.341095+0000","last_undegraded":"2024-04-24T01:27:10.341095+0000","last_fullsized":"2024-04-24T01:27:10.341095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.790274+0000","last_change":"2024-04-24T01:27:48.790317+0000","last_active":"2024-04-24T01:27:48.790274+0000","last_peered":"2024-04-24T01:27:48.790274+0000","last_clean":"2024-04-24T01:27:48.790274+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:48.790274+0000","last_undegraded":"2024-04-24T01:27:48.790274+0000","last_fullsized":"2024-04-24T01:27:48.790274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.790131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:15.310685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:11.973534+0000","last_change":"2024-04-24T01:23:58.742401+0000","last_active":"2024-04-24T01:26:11.973534+0000","last_peered":"2024-04-24T01:26:11.973534+0000","last_clean":"2024-04-24T01:26:11.973534+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:26:11.973534+0000","last_undegraded":"2024-04-24T01:26:11.973534+0000","last_fullsized":"2024-04-24T01:26:11.973534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.824638+0000","last_change":"2024-04-24T01:27:42.824684+0000","last_active":"2024-04-24T01:27:42.824638+0000","last_peered":"2024-04-24T01:27:42.824638+0000","last_clean":"2024-04-24T01:27:42.824638+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:42.824638+0000","last_undegraded":"2024-04-24T01:27:42.824638+0000","last_fullsized":"2024-04-24T01:27:42.824638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.824525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:03.738253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:08.982757+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:26:08.982757+0000","last_peered":"2024-04-24T01:26:08.982757+0000","last_clean":"2024-04-24T01:26:08.982757+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:26:08.982757+0000","last_undegraded":"2024-04-24T01:26:08.982757+0000","last_fullsized":"2024-04-24T01:26:08.982757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.013260+0000","last_change":"2024-04-24T01:27:40.013289+0000","last_active":"2024-04-24T01:27:40.013260+0000","last_peered":"2024-04-24T01:27:40.013260+0000","last_clean":"2024-04-24T01:27:40.013260+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:40.013260+0000","last_undegraded":"2024-04-24T01:27:40.013260+0000","last_fullsized":"2024-04-24T01:27:40.013260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.013169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:21.080960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:16.974123+0000","last_change":"2024-04-24T01:23:58.742778+0000","last_active":"2024-04-24T01:26:16.974123+0000","last_peered":"2024-04-24T01:26:16.974123+0000","last_clean":"2024-04-24T01:26:16.974123+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:26:16.974123+0000","last_undegraded":"2024-04-24T01:26:16.974123+0000","last_fullsized":"2024-04-24T01:26:16.974123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.131621+0000","last_change":"2024-04-24T01:24:00.738060+0000","last_active":"2024-04-24T01:27:10.131621+0000","last_peered":"2024-04-24T01:27:10.131621+0000","last_clean":"2024-04-24T01:27:10.131621+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:27:10.131621+0000","last_undegraded":"2024-04-24T01:27:10.131621+0000","last_fullsized":"2024-04-24T01:27:10.131621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.255364+0000","last_change":"2024-04-24T01:23:58.754863+0000","last_active":"2024-04-24T01:27:10.255364+0000","last_peered":"2024-04-24T01:27:10.255364+0000","last_clean":"2024-04-24T01:27:10.255364+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:27:10.255364+0000","last_undegraded":"2024-04-24T01:27:10.255364+0000","last_fullsized":"2024-04-24T01:27:10.255364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.721972+0000","last_change":"2024-04-24T01:27:54.721998+0000","last_active":"2024-04-24T01:27:54.721972+0000","last_peered":"2024-04-24T01:27:54.721972+0000","last_clean":"2024-04-24T01:27:54.721972+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:54.721972+0000","last_undegraded":"2024-04-24T01:27:54.721972+0000","last_fullsized":"2024-04-24T01:27:54.721972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.721886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:21.542465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.982977+0000","last_change":"2024-04-24T01:23:58.752203+0000","last_active":"2024-04-24T01:26:13.982977+0000","last_peered":"2024-04-24T01:26:13.982977+0000","last_clean":"2024-04-24T01:26:13.982977+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:26:13.982977+0000","last_undegraded":"2024-04-24T01:26:13.982977+0000","last_fullsized":"2024-04-24T01:26:13.982977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983775+0000","last_change":"2024-04-24T01:24:00.743296+0000","last_active":"2024-04-24T01:26:18.983775+0000","last_peered":"2024-04-24T01:26:18.983775+0000","last_clean":"2024-04-24T01:26:18.983775+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:26:18.983775+0000","last_undegraded":"2024-04-24T01:26:18.983775+0000","last_fullsized":"2024-04-24T01:26:18.983775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983594+0000","last_change":"2024-04-24T01:23:58.760986+0000","last_active":"2024-04-24T01:26:13.983594+0000","last_peered":"2024-04-24T01:26:13.983594+0000","last_clean":"2024-04-24T01:26:13.983594+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:26:13.983594+0000","last_undegraded":"2024-04-24T01:26:13.983594+0000","last_fullsized":"2024-04-24T01:26:13.983594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.742303+0000","last_change":"2024-04-24T01:27:40.742337+0000","last_active":"2024-04-24T01:27:40.742303+0000","last_peered":"2024-04-24T01:27:40.742303+0000","last_clean":"2024-04-24T01:27:40.742303+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:27:40.742303+0000","last_undegraded":"2024-04-24T01:27:40.742303+0000","last_fullsized":"2024-04-24T01:27:40.742303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.742220+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:29.319272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983635+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:26:13.983635+0000","last_peered":"2024-04-24T01:26:13.983635+0000","last_clean":"2024-04-24T01:26:13.983635+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:26:13.983635+0000","last_undegraded":"2024-04-24T01:26:13.983635+0000","last_fullsized":"2024-04-24T01:26:13.983635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.350890+0000","last_change":"2024-04-24T01:24:39.803587+0000","last_active":"2024-04-24T01:27:10.350890+0000","last_peered":"2024-04-24T01:27:10.350890+0000","last_clean":"2024-04-24T01:27:10.350890+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:27:10.350890+0000","last_undegraded":"2024-04-24T01:27:10.350890+0000","last_fullsized":"2024-04-24T01:27:10.350890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983882+0000","last_change":"2024-04-24T01:23:58.739937+0000","last_active":"2024-04-24T01:26:18.983882+0000","last_peered":"2024-04-24T01:26:18.983882+0000","last_clean":"2024-04-24T01:26:18.983882+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:26:18.983882+0000","last_undegraded":"2024-04-24T01:26:18.983882+0000","last_fullsized":"2024-04-24T01:26:18.983882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.768162+0000","last_change":"2024-04-24T01:27:53.768193+0000","last_active":"2024-04-24T01:27:53.768162+0000","last_peered":"2024-04-24T01:27:53.768162+0000","last_clean":"2024-04-24T01:27:53.768162+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:53.768162+0000","last_undegraded":"2024-04-24T01:27:53.768162+0000","last_fullsized":"2024-04-24T01:27:53.768162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.768072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:20.455501+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984456+0000","last_change":"2024-04-24T01:23:58.765191+0000","last_active":"2024-04-24T01:26:18.984456+0000","last_peered":"2024-04-24T01:26:18.984456+0000","last_clean":"2024-04-24T01:26:18.984456+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:26:18.984456+0000","last_undegraded":"2024-04-24T01:26:18.984456+0000","last_fullsized":"2024-04-24T01:26:18.984456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984249+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:26:18.984249+0000","last_peered":"2024-04-24T01:26:18.984249+0000","last_clean":"2024-04-24T01:26:18.984249+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:26:18.984249+0000","last_undegraded":"2024-04-24T01:26:18.984249+0000","last_fullsized":"2024-04-24T01:26:18.984249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.290295+0000","last_change":"2024-04-24T01:27:46.290325+0000","last_active":"2024-04-24T01:27:46.290295+0000","last_peered":"2024-04-24T01:27:46.290295+0000","last_clean":"2024-04-24T01:27:46.290295+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:46.290295+0000","last_undegraded":"2024-04-24T01:27:46.290295+0000","last_fullsized":"2024-04-24T01:27:46.290295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.290152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:57.436026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:21.974849+0000","last_change":"2024-04-24T01:23:58.743918+0000","last_active":"2024-04-24T01:26:21.974849+0000","last_peered":"2024-04-24T01:26:21.974849+0000","last_clean":"2024-04-24T01:26:21.974849+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:26:21.974849+0000","last_undegraded":"2024-04-24T01:26:21.974849+0000","last_fullsized":"2024-04-24T01:26:21.974849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.704447+0000","last_change":"2024-04-24T01:27:50.704477+0000","last_active":"2024-04-24T01:27:50.704447+0000","last_peered":"2024-04-24T01:27:50.704447+0000","last_clean":"2024-04-24T01:27:50.704447+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:27:50.704447+0000","last_undegraded":"2024-04-24T01:27:50.704447+0000","last_fullsized":"2024-04-24T01:27:50.704447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.704360+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:31.185382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1755,"ondisk_log_size":1755,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":479,"ondisk_log_size":479,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640312,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640310,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39940,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331900,"statfs":{"total":96636764160,"available":96595865600,"internally_reserved":0,"allocated":454656,"data_stored":150586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:28:02.221 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.221 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.222 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.223 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.223 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.223 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.223 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.223 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.224 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.225 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.226 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:23:44.656300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=44, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.227 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.228 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.229 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.230 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.231 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.232 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.233 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.234 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.235 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:02.236 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:28:22.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:28:22.347 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.346+0000 7fd09759d640 1 Processor -- start 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.346+0000 7fd09759d640 1 -- start start 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09759d640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd09012b5e0 0x7fd09012b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09759d640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd090073370 con 0x7fd09006d210 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09759d640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fd09012bf00 con 0x7fd09012b5e0 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd095d9a640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fd09006d210 0x7fd09006d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:41738/0 (socket says 172.21.15.142:41738) 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd095d9a640 1 -- 172.21.15.142:0/3838531806 learned_addr learned my addr 172.21.15.142:0/3838531806 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09659b640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fd09012b5e0 0x7fd09012b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09659b640 1 -- 172.21.15.142:0/3838531806 >> v1:172.21.15.142:6789/0 conn(0x7fd09006d210 legacy=0x7fd09006d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:22.348 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd09659b640 1 -- 172.21.15.142:0/3838531806 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd09012b190 con 0x7fd09012b5e0 2024-04-24T01:28:22.349 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.347+0000 7fd095599640 1 -- 172.21.15.142:0/3838531806 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793368239 0 0) 0x7fd090073370 con 0x7fd09006d210 2024-04-24T01:28:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd09659b640 1 --2- 172.21.15.142:0/3838531806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09012b5e0 0x7fd09012b9c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009720 tx=0x7fd08c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad51f8e90c13ed53 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd095599640 1 -- 172.21.15.142:0/3838531806 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c0316d0 con 0x7fd09012b5e0 2024-04-24T01:28:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd095599640 1 -- 172.21.15.142:0/3838531806 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08c037070 con 0x7fd09012b5e0 2024-04-24T01:28:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd095599640 1 -- 172.21.15.142:0/3838531806 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c0319c0 con 0x7fd09012b5e0 2024-04-24T01:28:22.351 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd09759d640 1 -- 172.21.15.142:0/3838531806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09012b5e0 msgr2=0x7fd09012b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.348+0000 7fd09759d640 1 --2- 172.21.15.142:0/3838531806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09012b5e0 0x7fd09012b9c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009720 tx=0x7fd08c02b840 comp rx=0 tx=0).stop 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 -- 172.21.15.142:0/3838531806 shutdown_connections 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 --2- 172.21.15.142:0/3838531806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09012b5e0 0x7fd09012b9c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 -- 172.21.15.142:0/3838531806 >> 172.21.15.142:0/3838531806 conn(0x7fd09009ab10 msgr2=0x7fd09009af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 -- 172.21.15.142:0/3838531806 shutdown_connections 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 -- 172.21.15.142:0/3838531806 wait complete. 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 Processor -- start 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.349+0000 7fd09759d640 1 -- start start 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09759d640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09759d640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fd09006e350 con 0x7fd09006d210 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09659b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09659b640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53656/0 (socket says 172.21.15.142:53656) 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09659b640 1 -- 172.21.15.142:0/3210232182 learned_addr learned my addr 172.21.15.142:0/3210232182 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09659b640 1 -- 172.21.15.142:0/3210232182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd090070650 con 0x7fd09006d210 2024-04-24T01:28:22.352 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09659b640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009840 tx=0x7fd08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:22.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c032770 con 0x7fd09006d210 2024-04-24T01:28:22.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd08c032910 con 0x7fd09006d210 2024-04-24T01:28:22.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd09006fa20 con 0x7fd09006d210 2024-04-24T01:28:22.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd08c032c30 con 0x7fd09006d210 2024-04-24T01:28:22.353 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.350+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd090123e20 con 0x7fd09006d210 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.351+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd08c04c060 con 0x7fd09006d210 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.351+0000 7fd086ffd640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 0x7fd07403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.351+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fd08c02f050 con 0x7fd09006d210 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.351+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd090125290 con 0x7fd09006d210 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.352+0000 7fd095d9a640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 0x7fd07403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:22.354 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.352+0000 7fd095d9a640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 0x7fd07403a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd080000c00 tx=0x7fd080007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:22.357 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.356+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fd08c040070 con 0x7fd09006d210 2024-04-24T01:28:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.526+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd090062da0 con 0x7fd074038060 2024-04-24T01:28:22.542 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.542+0000 7fd086ffd640 1 -- 172.21.15.142:0/3210232182 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665008 (secure 0 0 0) 0x7fd090062da0 con 0x7fd074038060 2024-04-24T01:28:22.550 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:28:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 msgr2=0x7fd07403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 0x7fd07403a520 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd080000c00 tx=0x7fd080007910 comp rx=0 tx=0).stop 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 msgr2=0x7fd0901238e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009840 tx=0x7fd08c0046c0 comp rx=0 tx=0).stop 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 shutdown_connections 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fd074038060 0x7fd07403a520 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 --2- 172.21.15.142:0/3210232182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd09006d210 0x7fd0901238e0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 >> 172.21.15.142:0/3210232182 conn(0x7fd09009ab10 msgr2=0x7fd0901b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 shutdown_connections 2024-04-24T01:28:22.558 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:22.547+0000 7fd09759d640 1 -- 172.21.15.142:0/3210232182 wait complete. 2024-04-24T01:28:22.559 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-04-24T01:28:21.983365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5377,"num_read_kb":4926,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5012,"ondisk_log_size":5012,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1778210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003994"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.115018+0000","last_change":"2024-04-24T01:27:51.115018+0000","last_active":"2024-04-24T01:27:51.115018+0000","last_peered":"2024-04-24T01:27:51.115018+0000","last_clean":"2024-04-24T01:27:51.115018+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:27:51.115018+0000","last_undegraded":"2024-04-24T01:27:51.115018+0000","last_fullsized":"2024-04-24T01:27:51.115018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.114886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:37.582826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.756639+0000","last_change":"2024-04-24T01:27:44.756666+0000","last_active":"2024-04-24T01:27:44.756639+0000","last_peered":"2024-04-24T01:27:44.756639+0000","last_clean":"2024-04-24T01:27:44.756639+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:44.756639+0000","last_undegraded":"2024-04-24T01:27:44.756639+0000","last_fullsized":"2024-04-24T01:27:44.756639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.756553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:43.777959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.223065+0000","last_change":"2024-04-24T01:28:02.223065+0000","last_active":"2024-04-24T01:28:02.223065+0000","last_peered":"2024-04-24T01:28:02.223065+0000","last_clean":"2024-04-24T01:28:02.223065+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:28:02.223065+0000","last_undegraded":"2024-04-24T01:28:02.223065+0000","last_fullsized":"2024-04-24T01:28:02.223065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.222955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:22.111184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.052111+0000","last_change":"2024-04-24T01:28:00.052138+0000","last_active":"2024-04-24T01:28:00.052111+0000","last_peered":"2024-04-24T01:28:00.052111+0000","last_clean":"2024-04-24T01:28:00.052111+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:28:00.052111+0000","last_undegraded":"2024-04-24T01:28:00.052111+0000","last_fullsized":"2024-04-24T01:28:00.052111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.052021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:32.079724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088430+0000","last_change":"2024-04-24T01:23:58.757257+0000","last_active":"2024-04-24T01:27:21.088430+0000","last_peered":"2024-04-24T01:27:21.088430+0000","last_clean":"2024-04-24T01:27:21.088430+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:27:21.088430+0000","last_undegraded":"2024-04-24T01:27:21.088430+0000","last_fullsized":"2024-04-24T01:27:21.088430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.070669+0000","last_change":"2024-04-24T01:28:01.070736+0000","last_active":"2024-04-24T01:28:01.070669+0000","last_peered":"2024-04-24T01:28:01.070669+0000","last_clean":"2024-04-24T01:28:01.070669+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:28:01.070669+0000","last_undegraded":"2024-04-24T01:28:01.070669+0000","last_fullsized":"2024-04-24T01:28:01.070669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.070556+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:10.689727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.090880+0000","last_change":"2024-04-24T01:28:02.090907+0000","last_active":"2024-04-24T01:28:02.090880+0000","last_peered":"2024-04-24T01:28:02.090880+0000","last_clean":"2024-04-24T01:28:02.090880+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:28:02.090880+0000","last_undegraded":"2024-04-24T01:28:02.090880+0000","last_fullsized":"2024-04-24T01:28:02.090880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.090787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:45.124033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.013113+0000","last_change":"2024-04-24T01:28:04.013177+0000","last_active":"2024-04-24T01:28:04.013113+0000","last_peered":"2024-04-24T01:28:04.013113+0000","last_clean":"2024-04-24T01:28:04.013113+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:28:04.013113+0000","last_undegraded":"2024-04-24T01:28:04.013113+0000","last_fullsized":"2024-04-24T01:28:04.013113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.012979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:48.531163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986012+0000","last_change":"2024-04-24T01:23:58.757089+0000","last_active":"2024-04-24T01:26:28.986012+0000","last_peered":"2024-04-24T01:26:28.986012+0000","last_clean":"2024-04-24T01:26:28.986012+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:26:28.986012+0000","last_undegraded":"2024-04-24T01:26:28.986012+0000","last_fullsized":"2024-04-24T01:26:28.986012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.722184+0000","last_change":"2024-04-24T01:27:52.722184+0000","last_active":"2024-04-24T01:27:52.722184+0000","last_peered":"2024-04-24T01:27:52.722184+0000","last_clean":"2024-04-24T01:27:52.722184+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:52.722184+0000","last_undegraded":"2024-04-24T01:27:52.722184+0000","last_fullsized":"2024-04-24T01:27:52.722184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.722064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.178258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.076443+0000","last_change":"2024-04-24T01:28:07.076470+0000","last_active":"2024-04-24T01:28:07.076443+0000","last_peered":"2024-04-24T01:28:07.076443+0000","last_clean":"2024-04-24T01:28:07.076443+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:28:07.076443+0000","last_undegraded":"2024-04-24T01:28:07.076443+0000","last_fullsized":"2024-04-24T01:28:07.076443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.076348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:48.144139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.126491+0000","last_change":"2024-04-24T01:28:13.126524+0000","last_active":"2024-04-24T01:28:13.126491+0000","last_peered":"2024-04-24T01:28:13.126491+0000","last_clean":"2024-04-24T01:28:13.126491+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:28:13.126491+0000","last_undegraded":"2024-04-24T01:28:13.126491+0000","last_fullsized":"2024-04-24T01:28:13.126491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.126407+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:16.636846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.252437+0000","last_change":"2024-04-24T01:23:58.758245+0000","last_active":"2024-04-24T01:27:10.252437+0000","last_peered":"2024-04-24T01:27:10.252437+0000","last_clean":"2024-04-24T01:27:10.252437+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:27:10.252437+0000","last_undegraded":"2024-04-24T01:27:10.252437+0000","last_fullsized":"2024-04-24T01:27:10.252437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.056694+0000","last_change":"2024-04-24T01:27:43.056694+0000","last_active":"2024-04-24T01:27:43.056694+0000","last_peered":"2024-04-24T01:27:43.056694+0000","last_clean":"2024-04-24T01:27:43.056694+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:27:43.056694+0000","last_undegraded":"2024-04-24T01:27:43.056694+0000","last_fullsized":"2024-04-24T01:27:43.056694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.056528+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:52.813992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.096615+0000","last_change":"2024-04-24T01:28:14.096641+0000","last_active":"2024-04-24T01:28:14.096615+0000","last_peered":"2024-04-24T01:28:14.096615+0000","last_clean":"2024-04-24T01:28:14.096615+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:28:14.096615+0000","last_undegraded":"2024-04-24T01:28:14.096615+0000","last_fullsized":"2024-04-24T01:28:14.096615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.096486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.442284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.084049+0000","last_change":"2024-04-24T01:27:52.084049+0000","last_active":"2024-04-24T01:27:52.084049+0000","last_peered":"2024-04-24T01:27:52.084049+0000","last_clean":"2024-04-24T01:27:52.084049+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:52.084049+0000","last_undegraded":"2024-04-24T01:27:52.084049+0000","last_fullsized":"2024-04-24T01:27:52.084049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.083901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:30.781693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.864119+0000","last_change":"2024-04-24T01:27:52.864145+0000","last_active":"2024-04-24T01:27:52.864119+0000","last_peered":"2024-04-24T01:27:52.864119+0000","last_clean":"2024-04-24T01:27:52.864119+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:52.864119+0000","last_undegraded":"2024-04-24T01:27:52.864119+0000","last_fullsized":"2024-04-24T01:27:52.864119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.864012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:12.175983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.808596+0000","last_change":"2024-04-24T01:27:58.808645+0000","last_active":"2024-04-24T01:27:58.808596+0000","last_peered":"2024-04-24T01:27:58.808596+0000","last_clean":"2024-04-24T01:27:58.808596+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:27:58.808596+0000","last_undegraded":"2024-04-24T01:27:58.808596+0000","last_fullsized":"2024-04-24T01:27:58.808596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.808475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:39.876266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.733646+0000","last_change":"2024-04-24T01:27:46.733689+0000","last_active":"2024-04-24T01:27:46.733646+0000","last_peered":"2024-04-24T01:27:46.733646+0000","last_clean":"2024-04-24T01:27:46.733646+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:46.733646+0000","last_undegraded":"2024-04-24T01:27:46.733646+0000","last_fullsized":"2024-04-24T01:27:46.733646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.733535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:05.735464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.150626+0000","last_change":"2024-04-24T01:28:04.150662+0000","last_active":"2024-04-24T01:28:04.150626+0000","last_peered":"2024-04-24T01:28:04.150626+0000","last_clean":"2024-04-24T01:28:04.150626+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:28:04.150626+0000","last_undegraded":"2024-04-24T01:28:04.150626+0000","last_fullsized":"2024-04-24T01:28:04.150626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.150539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:29.387549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.777724+0000","last_change":"2024-04-24T01:27:43.777752+0000","last_active":"2024-04-24T01:27:43.777724+0000","last_peered":"2024-04-24T01:27:43.777724+0000","last_clean":"2024-04-24T01:27:43.777724+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:27:43.777724+0000","last_undegraded":"2024-04-24T01:27:43.777724+0000","last_fullsized":"2024-04-24T01:27:43.777724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.777633+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:36.913978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.842760+0000","last_change":"2024-04-24T01:28:14.842797+0000","last_active":"2024-04-24T01:28:14.842760+0000","last_peered":"2024-04-24T01:28:14.842760+0000","last_clean":"2024-04-24T01:28:14.842760+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:28:14.842760+0000","last_undegraded":"2024-04-24T01:28:14.842760+0000","last_fullsized":"2024-04-24T01:28:14.842760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.842663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:14.722950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.108294+0000","last_change":"2024-04-24T01:28:15.108364+0000","last_active":"2024-04-24T01:28:15.108294+0000","last_peered":"2024-04-24T01:28:15.108294+0000","last_clean":"2024-04-24T01:28:15.108294+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:28:15.108294+0000","last_undegraded":"2024-04-24T01:28:15.108294+0000","last_fullsized":"2024-04-24T01:28:15.108294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.108195+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:19:14.900595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.786257+0000","last_change":"2024-04-24T01:28:10.786303+0000","last_active":"2024-04-24T01:28:10.786257+0000","last_peered":"2024-04-24T01:28:10.786257+0000","last_clean":"2024-04-24T01:28:10.786257+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:28:10.786257+0000","last_undegraded":"2024-04-24T01:28:10.786257+0000","last_fullsized":"2024-04-24T01:28:10.786257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.786147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:55.313023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.040944+0000","last_change":"2024-04-24T01:27:56.040969+0000","last_active":"2024-04-24T01:27:56.040944+0000","last_peered":"2024-04-24T01:27:56.040944+0000","last_clean":"2024-04-24T01:27:56.040944+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:56.040944+0000","last_undegraded":"2024-04-24T01:27:56.040944+0000","last_fullsized":"2024-04-24T01:27:56.040944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.040837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:12.454785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.307397+0000","last_change":"2024-04-24T01:27:52.307427+0000","last_active":"2024-04-24T01:27:52.307397+0000","last_peered":"2024-04-24T01:27:52.307397+0000","last_clean":"2024-04-24T01:27:52.307397+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:27:52.307397+0000","last_undegraded":"2024-04-24T01:27:52.307397+0000","last_fullsized":"2024-04-24T01:27:52.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.307307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:07.610661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.760656+0000","last_change":"2024-04-24T01:27:47.760706+0000","last_active":"2024-04-24T01:27:47.760656+0000","last_peered":"2024-04-24T01:27:47.760656+0000","last_clean":"2024-04-24T01:27:47.760656+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:47.760656+0000","last_undegraded":"2024-04-24T01:27:47.760656+0000","last_fullsized":"2024-04-24T01:27:47.760656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.760550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:24:04.523660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.036808+0000","last_change":"2024-04-24T01:28:15.036833+0000","last_active":"2024-04-24T01:28:15.036808+0000","last_peered":"2024-04-24T01:28:15.036808+0000","last_clean":"2024-04-24T01:28:15.036808+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:28:15.036808+0000","last_undegraded":"2024-04-24T01:28:15.036808+0000","last_fullsized":"2024-04-24T01:28:15.036808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.036696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:23.884209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.929573+0000","last_change":"2024-04-24T01:28:18.929635+0000","last_active":"2024-04-24T01:28:18.929573+0000","last_peered":"2024-04-24T01:28:18.929573+0000","last_clean":"2024-04-24T01:28:18.929573+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:28:18.929573+0000","last_undegraded":"2024-04-24T01:28:18.929573+0000","last_fullsized":"2024-04-24T01:28:18.929573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.929470+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:29.233355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.982618+0000","last_change":"2024-04-24T01:28:04.982647+0000","last_active":"2024-04-24T01:28:04.982618+0000","last_peered":"2024-04-24T01:28:04.982618+0000","last_clean":"2024-04-24T01:28:04.982618+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:28:04.982618+0000","last_undegraded":"2024-04-24T01:28:04.982618+0000","last_fullsized":"2024-04-24T01:28:04.982618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.982533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:34.027613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.973617+0000","last_change":"2024-04-24T01:28:18.973646+0000","last_active":"2024-04-24T01:28:18.973617+0000","last_peered":"2024-04-24T01:28:18.973617+0000","last_clean":"2024-04-24T01:28:18.973617+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:28:18.973617+0000","last_undegraded":"2024-04-24T01:28:18.973617+0000","last_fullsized":"2024-04-24T01:28:18.973617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.973529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:48.432455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.182402+0000","last_change":"2024-04-24T01:27:22.182426+0000","last_active":"2024-04-24T01:27:22.182402+0000","last_peered":"2024-04-24T01:27:22.182402+0000","last_clean":"2024-04-24T01:27:22.182402+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:27:22.182402+0000","last_undegraded":"2024-04-24T01:27:22.182402+0000","last_fullsized":"2024-04-24T01:27:22.182402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.182314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:53.198026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.018890+0000","last_change":"2024-04-24T01:27:33.018949+0000","last_active":"2024-04-24T01:27:33.018890+0000","last_peered":"2024-04-24T01:27:33.018890+0000","last_clean":"2024-04-24T01:27:33.018890+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:33.018890+0000","last_undegraded":"2024-04-24T01:27:33.018890+0000","last_fullsized":"2024-04-24T01:27:33.018890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.018804+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:06.024098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.763614+0000","last_change":"2024-04-24T01:27:29.763639+0000","last_active":"2024-04-24T01:27:29.763614+0000","last_peered":"2024-04-24T01:27:29.763614+0000","last_clean":"2024-04-24T01:27:29.763614+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:27:29.763614+0000","last_undegraded":"2024-04-24T01:27:29.763614+0000","last_fullsized":"2024-04-24T01:27:29.763614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.763505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:56.480614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.855129+0000","last_change":"2024-04-24T01:28:16.855160+0000","last_active":"2024-04-24T01:28:16.855129+0000","last_peered":"2024-04-24T01:28:16.855129+0000","last_clean":"2024-04-24T01:28:16.855129+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:28:16.855129+0000","last_undegraded":"2024-04-24T01:28:16.855129+0000","last_fullsized":"2024-04-24T01:28:16.855129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.855041+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:38.466443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.040893+0000","last_change":"2024-04-24T01:28:02.040917+0000","last_active":"2024-04-24T01:28:02.040893+0000","last_peered":"2024-04-24T01:28:02.040893+0000","last_clean":"2024-04-24T01:28:02.040893+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:28:02.040893+0000","last_undegraded":"2024-04-24T01:28:02.040893+0000","last_fullsized":"2024-04-24T01:28:02.040893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.040760+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:37.666837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.092632+0000","last_change":"2024-04-24T01:27:59.092679+0000","last_active":"2024-04-24T01:27:59.092632+0000","last_peered":"2024-04-24T01:27:59.092632+0000","last_clean":"2024-04-24T01:27:59.092632+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:27:59.092632+0000","last_undegraded":"2024-04-24T01:27:59.092632+0000","last_fullsized":"2024-04-24T01:27:59.092632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.092526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.097820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:58.990047+0000","last_change":"2024-04-24T01:24:39.799381+0000","last_active":"2024-04-24T01:26:58.990047+0000","last_peered":"2024-04-24T01:26:58.990047+0000","last_clean":"2024-04-24T01:26:58.990047+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:26:58.990047+0000","last_undegraded":"2024-04-24T01:26:58.990047+0000","last_fullsized":"2024-04-24T01:26:58.990047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'17","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.795733+0000","last_change":"2024-04-24T01:27:28.795795+0000","last_active":"2024-04-24T01:27:28.795733+0000","last_peered":"2024-04-24T01:27:28.795733+0000","last_clean":"2024-04-24T01:27:28.795733+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:27:28.795733+0000","last_undegraded":"2024-04-24T01:27:28.795733+0000","last_fullsized":"2024-04-24T01:27:28.795733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.795617+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:13.586689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.807223+0000","last_change":"2024-04-24T01:27:22.807246+0000","last_active":"2024-04-24T01:27:22.807223+0000","last_peered":"2024-04-24T01:27:22.807223+0000","last_clean":"2024-04-24T01:27:22.807223+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:27:22.807223+0000","last_undegraded":"2024-04-24T01:27:22.807223+0000","last_fullsized":"2024-04-24T01:27:22.807223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.807114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:58.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977684+0000","last_change":"2024-04-24T01:24:08.768642+0000","last_active":"2024-04-24T01:26:41.977684+0000","last_peered":"2024-04-24T01:26:41.977684+0000","last_clean":"2024-04-24T01:26:41.977684+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:26:41.977684+0000","last_undegraded":"2024-04-24T01:26:41.977684+0000","last_fullsized":"2024-04-24T01:26:41.977684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.977361+0000","last_change":"2024-04-24T01:27:57.977385+0000","last_active":"2024-04-24T01:27:57.977361+0000","last_peered":"2024-04-24T01:27:57.977361+0000","last_clean":"2024-04-24T01:27:57.977361+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:57.977361+0000","last_undegraded":"2024-04-24T01:27:57.977361+0000","last_fullsized":"2024-04-24T01:27:57.977361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.977272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:19.588675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984281+0000","last_change":"2024-04-24T01:23:58.757950+0000","last_active":"2024-04-24T01:26:18.984281+0000","last_peered":"2024-04-24T01:26:18.984281+0000","last_clean":"2024-04-24T01:26:18.984281+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:26:18.984281+0000","last_undegraded":"2024-04-24T01:26:18.984281+0000","last_fullsized":"2024-04-24T01:26:18.984281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.283661+0000","last_change":"2024-04-24T01:27:39.283686+0000","last_active":"2024-04-24T01:27:39.283661+0000","last_peered":"2024-04-24T01:27:39.283661+0000","last_clean":"2024-04-24T01:27:39.283661+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:27:39.283661+0000","last_undegraded":"2024-04-24T01:27:39.283661+0000","last_fullsized":"2024-04-24T01:27:39.283661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.283571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:27.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.914958+0000","last_change":"2024-04-24T01:27:28.914998+0000","last_active":"2024-04-24T01:27:28.914958+0000","last_peered":"2024-04-24T01:27:28.914958+0000","last_clean":"2024-04-24T01:27:28.914958+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:27:28.914958+0000","last_undegraded":"2024-04-24T01:27:28.914958+0000","last_fullsized":"2024-04-24T01:27:28.914958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.914874+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:31.978701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.904111+0000","last_change":"2024-04-24T01:27:46.904142+0000","last_active":"2024-04-24T01:27:46.904111+0000","last_peered":"2024-04-24T01:27:46.904111+0000","last_clean":"2024-04-24T01:27:46.904111+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:46.904111+0000","last_undegraded":"2024-04-24T01:27:46.904111+0000","last_fullsized":"2024-04-24T01:27:46.904111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.904020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:50.414459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.135360+0000","last_change":"2024-04-24T01:28:10.135388+0000","last_active":"2024-04-24T01:28:10.135360+0000","last_peered":"2024-04-24T01:28:10.135360+0000","last_clean":"2024-04-24T01:28:10.135360+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:28:10.135360+0000","last_undegraded":"2024-04-24T01:28:10.135360+0000","last_fullsized":"2024-04-24T01:28:10.135360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.135272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.660932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.273861+0000","last_change":"2024-04-24T01:27:50.273889+0000","last_active":"2024-04-24T01:27:50.273861+0000","last_peered":"2024-04-24T01:27:50.273861+0000","last_clean":"2024-04-24T01:27:50.273861+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:27:50.273861+0000","last_undegraded":"2024-04-24T01:27:50.273861+0000","last_fullsized":"2024-04-24T01:27:50.273861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.273766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:54:42.265021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.812203+0000","last_change":"2024-04-24T01:27:56.812248+0000","last_active":"2024-04-24T01:27:56.812203+0000","last_peered":"2024-04-24T01:27:56.812203+0000","last_clean":"2024-04-24T01:27:56.812203+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:27:56.812203+0000","last_undegraded":"2024-04-24T01:27:56.812203+0000","last_fullsized":"2024-04-24T01:27:56.812203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.812089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:46.064127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.157564+0000","last_change":"2024-04-24T01:27:28.157587+0000","last_active":"2024-04-24T01:27:28.157564+0000","last_peered":"2024-04-24T01:27:28.157564+0000","last_clean":"2024-04-24T01:27:28.157564+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:27:28.157564+0000","last_undegraded":"2024-04-24T01:27:28.157564+0000","last_fullsized":"2024-04-24T01:27:28.157564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.157467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:47.159396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.890012+0000","last_change":"2024-04-24T01:27:26.890053+0000","last_active":"2024-04-24T01:27:26.890012+0000","last_peered":"2024-04-24T01:27:26.890012+0000","last_clean":"2024-04-24T01:27:26.890012+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:26.890012+0000","last_undegraded":"2024-04-24T01:27:26.890012+0000","last_fullsized":"2024-04-24T01:27:26.890012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.889929+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:10.323651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.070103+0000","last_change":"2024-04-24T01:27:24.070163+0000","last_active":"2024-04-24T01:27:24.070103+0000","last_peered":"2024-04-24T01:27:24.070103+0000","last_clean":"2024-04-24T01:27:24.070103+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:24.070103+0000","last_undegraded":"2024-04-24T01:27:24.070103+0000","last_fullsized":"2024-04-24T01:27:24.070103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.069989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:46.537881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.899015+0000","last_change":"2024-04-24T01:27:53.899047+0000","last_active":"2024-04-24T01:27:53.899015+0000","last_peered":"2024-04-24T01:27:53.899015+0000","last_clean":"2024-04-24T01:27:53.899015+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:27:53.899015+0000","last_undegraded":"2024-04-24T01:27:53.899015+0000","last_fullsized":"2024-04-24T01:27:53.899015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.898918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:49.273306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.068824+0000","last_change":"2024-04-24T01:27:53.068848+0000","last_active":"2024-04-24T01:27:53.068824+0000","last_peered":"2024-04-24T01:27:53.068824+0000","last_clean":"2024-04-24T01:27:53.068824+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:27:53.068824+0000","last_undegraded":"2024-04-24T01:27:53.068824+0000","last_fullsized":"2024-04-24T01:27:53.068824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.068721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:30.201730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.724484+0000","last_change":"2024-04-24T01:27:31.724506+0000","last_active":"2024-04-24T01:27:31.724484+0000","last_peered":"2024-04-24T01:27:31.724484+0000","last_clean":"2024-04-24T01:27:31.724484+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:27:31.724484+0000","last_undegraded":"2024-04-24T01:27:31.724484+0000","last_fullsized":"2024-04-24T01:27:31.724484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.724380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:37.609422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":124,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.950424+0000","last_change":"2024-04-24T01:27:30.950474+0000","last_active":"2024-04-24T01:27:30.950424+0000","last_peered":"2024-04-24T01:27:30.950424+0000","last_clean":"2024-04-24T01:27:30.950424+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:30.950424+0000","last_undegraded":"2024-04-24T01:27:30.950424+0000","last_fullsized":"2024-04-24T01:27:30.950424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.950337+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:06.885598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.107865+0000","last_change":"2024-04-24T01:27:23.107889+0000","last_active":"2024-04-24T01:27:23.107865+0000","last_peered":"2024-04-24T01:27:23.107865+0000","last_clean":"2024-04-24T01:27:23.107865+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:27:23.107865+0000","last_undegraded":"2024-04-24T01:27:23.107865+0000","last_fullsized":"2024-04-24T01:27:23.107865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.107773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:16.379160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.138383+0000","last_change":"2024-04-24T01:28:12.138383+0000","last_active":"2024-04-24T01:28:12.138383+0000","last_peered":"2024-04-24T01:28:12.138383+0000","last_clean":"2024-04-24T01:28:12.138383+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:28:12.138383+0000","last_undegraded":"2024-04-24T01:28:12.138383+0000","last_fullsized":"2024-04-24T01:28:12.138383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.138254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:11.767955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.703758+0000","last_change":"2024-04-24T01:27:51.703790+0000","last_active":"2024-04-24T01:27:51.703758+0000","last_peered":"2024-04-24T01:27:51.703758+0000","last_clean":"2024-04-24T01:27:51.703758+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:27:51.703758+0000","last_undegraded":"2024-04-24T01:27:51.703758+0000","last_fullsized":"2024-04-24T01:27:51.703758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.703677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:59.808919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.113009+0000","last_change":"2024-04-24T01:27:49.113076+0000","last_active":"2024-04-24T01:27:49.113009+0000","last_peered":"2024-04-24T01:27:49.113009+0000","last_clean":"2024-04-24T01:27:49.113009+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:49.113009+0000","last_undegraded":"2024-04-24T01:27:49.113009+0000","last_fullsized":"2024-04-24T01:27:49.113009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.112893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:26.748726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'5","reported_seq":238,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.312333+0000","last_change":"2024-04-24T01:27:40.312374+0000","last_active":"2024-04-24T01:27:40.312333+0000","last_peered":"2024-04-24T01:27:40.312333+0000","last_clean":"2024-04-24T01:27:40.312333+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:40.312333+0000","last_undegraded":"2024-04-24T01:27:40.312333+0000","last_fullsized":"2024-04-24T01:27:40.312333+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.312210+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:26.075351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.146590+0000","last_change":"2024-04-24T01:27:23.146630+0000","last_active":"2024-04-24T01:27:23.146590+0000","last_peered":"2024-04-24T01:27:23.146590+0000","last_clean":"2024-04-24T01:27:23.146590+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:23.146590+0000","last_undegraded":"2024-04-24T01:27:23.146590+0000","last_fullsized":"2024-04-24T01:27:23.146590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.146508+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:42.897359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.041435+0000","last_change":"2024-04-24T01:27:25.041459+0000","last_active":"2024-04-24T01:27:25.041435+0000","last_peered":"2024-04-24T01:27:25.041435+0000","last_clean":"2024-04-24T01:27:25.041435+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:27:25.041435+0000","last_undegraded":"2024-04-24T01:27:25.041435+0000","last_fullsized":"2024-04-24T01:27:25.041435+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.041335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.527549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.764060+0000","last_change":"2024-04-24T01:27:45.764060+0000","last_active":"2024-04-24T01:27:45.764060+0000","last_peered":"2024-04-24T01:27:45.764060+0000","last_clean":"2024-04-24T01:27:45.764060+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:27:45.764060+0000","last_undegraded":"2024-04-24T01:27:45.764060+0000","last_fullsized":"2024-04-24T01:27:45.764060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.763949+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:24.155072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.048341+0000","last_change":"2024-04-24T01:27:54.048365+0000","last_active":"2024-04-24T01:27:54.048341+0000","last_peered":"2024-04-24T01:27:54.048341+0000","last_clean":"2024-04-24T01:27:54.048341+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:27:54.048341+0000","last_undegraded":"2024-04-24T01:27:54.048341+0000","last_fullsized":"2024-04-24T01:27:54.048341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.048229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:34:31.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:17.015141+0000","last_change":"2024-04-24T01:23:58.764399+0000","last_active":"2024-04-24T01:27:17.015141+0000","last_peered":"2024-04-24T01:27:17.015141+0000","last_clean":"2024-04-24T01:27:17.015141+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:27:17.015141+0000","last_undegraded":"2024-04-24T01:27:17.015141+0000","last_fullsized":"2024-04-24T01:27:17.015141+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.208929+0000","last_change":"2024-04-24T01:27:35.208971+0000","last_active":"2024-04-24T01:27:35.208929+0000","last_peered":"2024-04-24T01:27:35.208929+0000","last_clean":"2024-04-24T01:27:35.208929+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:27:35.208929+0000","last_undegraded":"2024-04-24T01:27:35.208929+0000","last_fullsized":"2024-04-24T01:27:35.208929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:53.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.868537+0000","last_change":"2024-04-24T01:27:51.868587+0000","last_active":"2024-04-24T01:27:51.868537+0000","last_peered":"2024-04-24T01:27:51.868537+0000","last_clean":"2024-04-24T01:27:51.868537+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:51.868537+0000","last_undegraded":"2024-04-24T01:27:51.868537+0000","last_fullsized":"2024-04-24T01:27:51.868537+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.868449+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:02.837512+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.193180+0000","last_change":"2024-04-24T01:27:33.193209+0000","last_active":"2024-04-24T01:27:33.193180+0000","last_peered":"2024-04-24T01:27:33.193180+0000","last_clean":"2024-04-24T01:27:33.193180+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:33.193180+0000","last_undegraded":"2024-04-24T01:27:33.193180+0000","last_fullsized":"2024-04-24T01:27:33.193180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.193083+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:14.827477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.116488+0000","last_change":"2024-04-24T01:28:16.116526+0000","last_active":"2024-04-24T01:28:16.116488+0000","last_peered":"2024-04-24T01:28:16.116488+0000","last_clean":"2024-04-24T01:28:16.116488+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:28:16.116488+0000","last_undegraded":"2024-04-24T01:28:16.116488+0000","last_fullsized":"2024-04-24T01:28:16.116488+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.116365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:36.662647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.095920+0000","last_change":"2024-04-24T01:27:46.095967+0000","last_active":"2024-04-24T01:27:46.095920+0000","last_peered":"2024-04-24T01:27:46.095920+0000","last_clean":"2024-04-24T01:27:46.095920+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:27:46.095920+0000","last_undegraded":"2024-04-24T01:27:46.095920+0000","last_fullsized":"2024-04-24T01:27:46.095920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.095813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:43:01.593908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.047129+0000","last_change":"2024-04-24T01:28:12.047166+0000","last_active":"2024-04-24T01:28:12.047129+0000","last_peered":"2024-04-24T01:28:12.047129+0000","last_clean":"2024-04-24T01:28:12.047129+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:28:12.047129+0000","last_undegraded":"2024-04-24T01:28:12.047129+0000","last_fullsized":"2024-04-24T01:28:12.047129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.047037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:46:29.031559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.200419+0000","last_change":"2024-04-24T01:27:36.200442+0000","last_active":"2024-04-24T01:27:36.200419+0000","last_peered":"2024-04-24T01:27:36.200419+0000","last_clean":"2024-04-24T01:27:36.200419+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:27:36.200419+0000","last_undegraded":"2024-04-24T01:27:36.200419+0000","last_fullsized":"2024-04-24T01:27:36.200419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.200293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.864662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":164,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.888539+0000","last_change":"2024-04-24T01:27:48.888578+0000","last_active":"2024-04-24T01:27:48.888539+0000","last_peered":"2024-04-24T01:27:48.888539+0000","last_clean":"2024-04-24T01:27:48.888539+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:48.888539+0000","last_undegraded":"2024-04-24T01:27:48.888539+0000","last_fullsized":"2024-04-24T01:27:48.888539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.888453+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:06.782682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.070100+0000","last_change":"2024-04-24T01:27:21.070118+0000","last_active":"2024-04-24T01:27:21.070100+0000","last_peered":"2024-04-24T01:27:21.070100+0000","last_clean":"2024-04-24T01:27:21.070100+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:27:21.070100+0000","last_undegraded":"2024-04-24T01:27:21.070100+0000","last_fullsized":"2024-04-24T01:27:21.070100+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.070033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:24.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'20","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.438803+0000","last_change":"2024-04-24T01:24:08.775403+0000","last_active":"2024-04-24T01:27:10.438803+0000","last_peered":"2024-04-24T01:27:10.438803+0000","last_clean":"2024-04-24T01:27:10.438803+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:27:10.438803+0000","last_undegraded":"2024-04-24T01:27:10.438803+0000","last_fullsized":"2024-04-24T01:27:10.438803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.046489+0000","last_change":"2024-04-24T01:24:39.842385+0000","last_active":"2024-04-24T01:27:10.046489+0000","last_peered":"2024-04-24T01:27:10.046489+0000","last_clean":"2024-04-24T01:27:10.046489+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:27:10.046489+0000","last_undegraded":"2024-04-24T01:27:10.046489+0000","last_fullsized":"2024-04-24T01:27:10.046489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:59.712192+0000","last_clean_scrub_stamp":"2024-04-24T01:23:59.712192+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.330030+0000","last_change":"2024-04-24T01:27:54.330094+0000","last_active":"2024-04-24T01:27:54.330030+0000","last_peered":"2024-04-24T01:27:54.330030+0000","last_clean":"2024-04-24T01:27:54.330030+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:27:54.330030+0000","last_undegraded":"2024-04-24T01:27:54.330030+0000","last_fullsized":"2024-04-24T01:27:54.330030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.329915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:09.474046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.022814+0000","last_change":"2024-04-24T01:27:39.022839+0000","last_active":"2024-04-24T01:27:39.022814+0000","last_peered":"2024-04-24T01:27:39.022814+0000","last_clean":"2024-04-24T01:27:39.022814+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:27:39.022814+0000","last_undegraded":"2024-04-24T01:27:39.022814+0000","last_fullsized":"2024-04-24T01:27:39.022814+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.022713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:44.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.795231+0000","last_change":"2024-04-24T01:27:26.795265+0000","last_active":"2024-04-24T01:27:26.795231+0000","last_peered":"2024-04-24T01:27:26.795231+0000","last_clean":"2024-04-24T01:27:26.795231+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:26.795231+0000","last_undegraded":"2024-04-24T01:27:26.795231+0000","last_fullsized":"2024-04-24T01:27:26.795231+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.795151+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:53.921283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.990239+0000","last_change":"2024-04-24T01:27:40.990277+0000","last_active":"2024-04-24T01:27:40.990239+0000","last_peered":"2024-04-24T01:27:40.990239+0000","last_clean":"2024-04-24T01:27:40.990239+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:27:40.990239+0000","last_undegraded":"2024-04-24T01:27:40.990239+0000","last_fullsized":"2024-04-24T01:27:40.990239+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.990117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:52.892751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'12","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.974834+0000","last_change":"2024-04-24T01:28:06.974834+0000","last_active":"2024-04-24T01:28:06.974834+0000","last_peered":"2024-04-24T01:28:06.974834+0000","last_clean":"2024-04-24T01:28:06.974834+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:28:06.974834+0000","last_undegraded":"2024-04-24T01:28:06.974834+0000","last_fullsized":"2024-04-24T01:28:06.974834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.974708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:08.313889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.077121+0000","last_change":"2024-04-24T01:28:15.077149+0000","last_active":"2024-04-24T01:28:15.077121+0000","last_peered":"2024-04-24T01:28:15.077121+0000","last_clean":"2024-04-24T01:28:15.077121+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:28:15.077121+0000","last_undegraded":"2024-04-24T01:28:15.077121+0000","last_fullsized":"2024-04-24T01:28:15.077121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.077031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:52.551061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088121+0000","last_change":"2024-04-24T01:23:58.758536+0000","last_active":"2024-04-24T01:27:21.088121+0000","last_peered":"2024-04-24T01:27:21.088121+0000","last_clean":"2024-04-24T01:27:21.088121+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:27:21.088121+0000","last_undegraded":"2024-04-24T01:27:21.088121+0000","last_fullsized":"2024-04-24T01:27:21.088121+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.249356+0000","last_change":"2024-04-24T01:27:38.249380+0000","last_active":"2024-04-24T01:27:38.249356+0000","last_peered":"2024-04-24T01:27:38.249356+0000","last_clean":"2024-04-24T01:27:38.249356+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:27:38.249356+0000","last_undegraded":"2024-04-24T01:27:38.249356+0000","last_fullsized":"2024-04-24T01:27:38.249356+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.249265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:20.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.930905+0000","last_change":"2024-04-24T01:27:31.930974+0000","last_active":"2024-04-24T01:27:31.930905+0000","last_peered":"2024-04-24T01:27:31.930905+0000","last_clean":"2024-04-24T01:27:31.930905+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:31.930905+0000","last_undegraded":"2024-04-24T01:27:31.930905+0000","last_fullsized":"2024-04-24T01:27:31.930905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.930805+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:07.030096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":415,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.862402+0000","last_change":"2024-04-24T01:27:25.862447+0000","last_active":"2024-04-24T01:27:25.862402+0000","last_peered":"2024-04-24T01:27:25.862402+0000","last_clean":"2024-04-24T01:27:25.862402+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:25.862402+0000","last_undegraded":"2024-04-24T01:27:25.862402+0000","last_fullsized":"2024-04-24T01:27:25.862402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.862292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:06.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.291402+0000","last_change":"2024-04-24T01:27:49.291445+0000","last_active":"2024-04-24T01:27:49.291402+0000","last_peered":"2024-04-24T01:27:49.291402+0000","last_clean":"2024-04-24T01:27:49.291402+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:27:49.291402+0000","last_undegraded":"2024-04-24T01:27:49.291402+0000","last_fullsized":"2024-04-24T01:27:49.291402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.291293+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:16.626192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.091307+0000","last_change":"2024-04-24T01:27:58.091349+0000","last_active":"2024-04-24T01:27:58.091307+0000","last_peered":"2024-04-24T01:27:58.091307+0000","last_clean":"2024-04-24T01:27:58.091307+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:58.091307+0000","last_undegraded":"2024-04-24T01:27:58.091307+0000","last_fullsized":"2024-04-24T01:27:58.091307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.091198+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:10.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088189+0000","last_change":"2024-04-24T01:23:58.758587+0000","last_active":"2024-04-24T01:27:21.088189+0000","last_peered":"2024-04-24T01:27:21.088189+0000","last_clean":"2024-04-24T01:27:21.088189+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:27:21.088189+0000","last_undegraded":"2024-04-24T01:27:21.088189+0000","last_fullsized":"2024-04-24T01:27:21.088189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":428,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.716636+0000","last_change":"2024-04-24T01:27:35.716690+0000","last_active":"2024-04-24T01:27:35.716636+0000","last_peered":"2024-04-24T01:27:35.716636+0000","last_clean":"2024-04-24T01:27:35.716636+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:35.716636+0000","last_undegraded":"2024-04-24T01:27:35.716636+0000","last_fullsized":"2024-04-24T01:27:35.716636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.716538+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:45.474001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.061371+0000","last_change":"2024-04-24T01:27:39.061416+0000","last_active":"2024-04-24T01:27:39.061371+0000","last_peered":"2024-04-24T01:27:39.061371+0000","last_clean":"2024-04-24T01:27:39.061371+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:27:39.061371+0000","last_undegraded":"2024-04-24T01:27:39.061371+0000","last_fullsized":"2024-04-24T01:27:39.061371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.061278+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:42.587769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":471,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.819819+0000","last_change":"2024-04-24T01:27:21.819879+0000","last_active":"2024-04-24T01:27:21.819819+0000","last_peered":"2024-04-24T01:27:21.819819+0000","last_clean":"2024-04-24T01:27:21.819819+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:21.819819+0000","last_undegraded":"2024-04-24T01:27:21.819819+0000","last_fullsized":"2024-04-24T01:27:21.819819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.819685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:51.931578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.010031+0000","last_change":"2024-04-24T01:27:42.010031+0000","last_active":"2024-04-24T01:27:42.010031+0000","last_peered":"2024-04-24T01:27:42.010031+0000","last_clean":"2024-04-24T01:27:42.010031+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:27:42.010031+0000","last_undegraded":"2024-04-24T01:27:42.010031+0000","last_fullsized":"2024-04-24T01:27:42.010031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.009873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:39.421872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.891592+0000","last_change":"2024-04-24T01:28:01.891623+0000","last_active":"2024-04-24T01:28:01.891592+0000","last_peered":"2024-04-24T01:28:01.891592+0000","last_clean":"2024-04-24T01:28:01.891592+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:28:01.891592+0000","last_undegraded":"2024-04-24T01:28:01.891592+0000","last_fullsized":"2024-04-24T01:28:01.891592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.891503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:18.375150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.053931+0000","last_change":"2024-04-24T01:28:14.053931+0000","last_active":"2024-04-24T01:28:14.053931+0000","last_peered":"2024-04-24T01:28:14.053931+0000","last_clean":"2024-04-24T01:28:14.053931+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:28:14.053931+0000","last_undegraded":"2024-04-24T01:28:14.053931+0000","last_fullsized":"2024-04-24T01:28:14.053931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.053794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:31.641010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.040401+0000","last_change":"2024-04-24T01:27:32.040427+0000","last_active":"2024-04-24T01:27:32.040401+0000","last_peered":"2024-04-24T01:27:32.040401+0000","last_clean":"2024-04-24T01:27:32.040401+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:27:32.040401+0000","last_undegraded":"2024-04-24T01:27:32.040401+0000","last_fullsized":"2024-04-24T01:27:32.040401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.040303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:24.647469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.833944+0000","last_change":"2024-04-24T01:27:27.834021+0000","last_active":"2024-04-24T01:27:27.833944+0000","last_peered":"2024-04-24T01:27:27.833944+0000","last_clean":"2024-04-24T01:27:27.833944+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:27.833944+0000","last_undegraded":"2024-04-24T01:27:27.833944+0000","last_fullsized":"2024-04-24T01:27:27.833944+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.833839+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:51:49.939141+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.839877+0000","last_change":"2024-04-24T01:27:21.839921+0000","last_active":"2024-04-24T01:27:21.839877+0000","last_peered":"2024-04-24T01:27:21.839877+0000","last_clean":"2024-04-24T01:27:21.839877+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:27:21.839877+0000","last_undegraded":"2024-04-24T01:27:21.839877+0000","last_fullsized":"2024-04-24T01:27:21.839877+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:25.887464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.781113+0000","last_change":"2024-04-24T01:27:41.781113+0000","last_active":"2024-04-24T01:27:41.781113+0000","last_peered":"2024-04-24T01:27:41.781113+0000","last_clean":"2024-04-24T01:27:41.781113+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:41.781113+0000","last_undegraded":"2024-04-24T01:27:41.781113+0000","last_fullsized":"2024-04-24T01:27:41.781113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.781002+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:01.531853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.009852+0000","last_change":"2024-04-24T01:27:38.009852+0000","last_active":"2024-04-24T01:27:38.009852+0000","last_peered":"2024-04-24T01:27:38.009852+0000","last_clean":"2024-04-24T01:27:38.009852+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:38.009852+0000","last_undegraded":"2024-04-24T01:27:38.009852+0000","last_fullsized":"2024-04-24T01:27:38.009852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.009727+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:13.773436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.840720+0000","last_change":"2024-04-24T01:28:07.840757+0000","last_active":"2024-04-24T01:28:07.840720+0000","last_peered":"2024-04-24T01:28:07.840720+0000","last_clean":"2024-04-24T01:28:07.840720+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:28:07.840720+0000","last_undegraded":"2024-04-24T01:28:07.840720+0000","last_fullsized":"2024-04-24T01:28:07.840720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.840634+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:16:33.976498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087991+0000","last_change":"2024-04-24T01:23:50.692975+0000","last_active":"2024-04-24T01:27:21.087991+0000","last_peered":"2024-04-24T01:27:21.087991+0000","last_clean":"2024-04-24T01:27:21.087991+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:27:21.087991+0000","last_undegraded":"2024-04-24T01:27:21.087991+0000","last_fullsized":"2024-04-24T01:27:21.087991+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088050+0000","last_change":"2024-04-24T01:23:58.764406+0000","last_active":"2024-04-24T01:27:21.088050+0000","last_peered":"2024-04-24T01:27:21.088050+0000","last_clean":"2024-04-24T01:27:21.088050+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:27:21.088050+0000","last_undegraded":"2024-04-24T01:27:21.088050+0000","last_fullsized":"2024-04-24T01:27:21.088050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.238048+0000","last_change":"2024-04-24T01:24:39.801359+0000","last_active":"2024-04-24T01:27:20.238048+0000","last_peered":"2024-04-24T01:27:20.238048+0000","last_clean":"2024-04-24T01:27:20.238048+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:27:20.238048+0000","last_undegraded":"2024-04-24T01:27:20.238048+0000","last_fullsized":"2024-04-24T01:27:20.238048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":190,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.123880+0000","last_change":"2024-04-24T01:27:27.123918+0000","last_active":"2024-04-24T01:27:27.123880+0000","last_peered":"2024-04-24T01:27:27.123880+0000","last_clean":"2024-04-24T01:27:27.123880+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:27.123880+0000","last_undegraded":"2024-04-24T01:27:27.123880+0000","last_fullsized":"2024-04-24T01:27:27.123880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.123786+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:04.256795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.112064+0000","last_change":"2024-04-24T01:27:29.112111+0000","last_active":"2024-04-24T01:27:29.112064+0000","last_peered":"2024-04-24T01:27:29.112064+0000","last_clean":"2024-04-24T01:27:29.112064+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:27:29.112064+0000","last_undegraded":"2024-04-24T01:27:29.112064+0000","last_fullsized":"2024-04-24T01:27:29.112064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.111929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:30.720342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":172,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.978903+0000","last_change":"2024-04-24T01:27:37.978931+0000","last_active":"2024-04-24T01:27:37.978903+0000","last_peered":"2024-04-24T01:27:37.978903+0000","last_clean":"2024-04-24T01:27:37.978903+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:37.978903+0000","last_undegraded":"2024-04-24T01:27:37.978903+0000","last_fullsized":"2024-04-24T01:27:37.978903+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.978807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:55.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.938237+0000","last_change":"2024-04-24T01:27:56.938286+0000","last_active":"2024-04-24T01:27:56.938237+0000","last_peered":"2024-04-24T01:27:56.938237+0000","last_clean":"2024-04-24T01:27:56.938237+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:27:56.938237+0000","last_undegraded":"2024-04-24T01:27:56.938237+0000","last_fullsized":"2024-04-24T01:27:56.938237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.938134+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:59.400837+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087960+0000","last_change":"2024-04-24T01:23:50.690161+0000","last_active":"2024-04-24T01:27:21.087960+0000","last_peered":"2024-04-24T01:27:21.087960+0000","last_clean":"2024-04-24T01:27:21.087960+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:27:21.087960+0000","last_undegraded":"2024-04-24T01:27:21.087960+0000","last_fullsized":"2024-04-24T01:27:21.087960+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.180653+0000","last_change":"2024-04-24T01:28:06.180653+0000","last_active":"2024-04-24T01:28:06.180653+0000","last_peered":"2024-04-24T01:28:06.180653+0000","last_clean":"2024-04-24T01:28:06.180653+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:28:06.180653+0000","last_undegraded":"2024-04-24T01:28:06.180653+0000","last_fullsized":"2024-04-24T01:28:06.180653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.180538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:45.452260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.112830+0000","last_change":"2024-04-24T01:27:24.112872+0000","last_active":"2024-04-24T01:27:24.112830+0000","last_peered":"2024-04-24T01:27:24.112830+0000","last_clean":"2024-04-24T01:27:24.112830+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:27:24.112830+0000","last_undegraded":"2024-04-24T01:27:24.112830+0000","last_fullsized":"2024-04-24T01:27:24.112830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.112716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:45.026444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.829636+0000","last_change":"2024-04-24T01:27:23.829636+0000","last_active":"2024-04-24T01:27:23.829636+0000","last_peered":"2024-04-24T01:27:23.829636+0000","last_clean":"2024-04-24T01:27:23.829636+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:23.829636+0000","last_undegraded":"2024-04-24T01:27:23.829636+0000","last_fullsized":"2024-04-24T01:27:23.829636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.829451+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:41.027361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.953224+0000","last_change":"2024-04-24T01:27:41.953224+0000","last_active":"2024-04-24T01:27:41.953224+0000","last_peered":"2024-04-24T01:27:41.953224+0000","last_clean":"2024-04-24T01:27:41.953224+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:27:41.953224+0000","last_undegraded":"2024-04-24T01:27:41.953224+0000","last_fullsized":"2024-04-24T01:27:41.953224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.953108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:10.618830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.753024+0000","last_change":"2024-04-24T01:27:49.753087+0000","last_active":"2024-04-24T01:27:49.753024+0000","last_peered":"2024-04-24T01:27:49.753024+0000","last_clean":"2024-04-24T01:27:49.753024+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:27:49.753024+0000","last_undegraded":"2024-04-24T01:27:49.753024+0000","last_fullsized":"2024-04-24T01:27:49.753024+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.752922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.966181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.285820+0000","last_change":"2024-04-24T01:27:47.285843+0000","last_active":"2024-04-24T01:27:47.285820+0000","last_peered":"2024-04-24T01:27:47.285820+0000","last_clean":"2024-04-24T01:27:47.285820+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:47.285820+0000","last_undegraded":"2024-04-24T01:27:47.285820+0000","last_fullsized":"2024-04-24T01:27:47.285820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.285734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:56.799840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.112054+0000","last_change":"2024-04-24T01:28:00.112079+0000","last_active":"2024-04-24T01:28:00.112054+0000","last_peered":"2024-04-24T01:28:00.112054+0000","last_clean":"2024-04-24T01:28:00.112054+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:28:00.112054+0000","last_undegraded":"2024-04-24T01:28:00.112054+0000","last_fullsized":"2024-04-24T01:28:00.112054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.111972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:11.268871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.234409+0000","last_change":"2024-04-24T01:27:58.234409+0000","last_active":"2024-04-24T01:27:58.234409+0000","last_peered":"2024-04-24T01:27:58.234409+0000","last_clean":"2024-04-24T01:27:58.234409+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:27:58.234409+0000","last_undegraded":"2024-04-24T01:27:58.234409+0000","last_fullsized":"2024-04-24T01:27:58.234409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.234292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:31.772695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'4","reported_seq":232,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.917102+0000","last_change":"2024-04-24T01:27:35.917133+0000","last_active":"2024-04-24T01:27:35.917102+0000","last_peered":"2024-04-24T01:27:35.917102+0000","last_clean":"2024-04-24T01:27:35.917102+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:35.917102+0000","last_undegraded":"2024-04-24T01:27:35.917102+0000","last_fullsized":"2024-04-24T01:27:35.917102+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.916997+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:07.090816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.905612+0000","last_change":"2024-04-24T01:27:27.905612+0000","last_active":"2024-04-24T01:27:27.905612+0000","last_peered":"2024-04-24T01:27:27.905612+0000","last_clean":"2024-04-24T01:27:27.905612+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:27.905612+0000","last_undegraded":"2024-04-24T01:27:27.905612+0000","last_fullsized":"2024-04-24T01:27:27.905612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.905478+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:29.454916+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.318338+0000","last_change":"2024-04-24T01:27:41.318338+0000","last_active":"2024-04-24T01:27:41.318338+0000","last_peered":"2024-04-24T01:27:41.318338+0000","last_clean":"2024-04-24T01:27:41.318338+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:27:41.318338+0000","last_undegraded":"2024-04-24T01:27:41.318338+0000","last_fullsized":"2024-04-24T01:27:41.318338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.318182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:55:53.255679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:23.985117+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:26:23.985117+0000","last_peered":"2024-04-24T01:26:23.985117+0000","last_clean":"2024-04-24T01:26:23.985117+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:26:23.985117+0000","last_undegraded":"2024-04-24T01:26:23.985117+0000","last_fullsized":"2024-04-24T01:26:23.985117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.266085+0000","last_change":"2024-04-24T01:27:51.266085+0000","last_active":"2024-04-24T01:27:51.266085+0000","last_peered":"2024-04-24T01:27:51.266085+0000","last_clean":"2024-04-24T01:27:51.266085+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:51.266085+0000","last_undegraded":"2024-04-24T01:27:51.266085+0000","last_fullsized":"2024-04-24T01:27:51.266085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.265934+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:09:26.486398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087999+0000","last_change":"2024-04-24T01:23:50.690218+0000","last_active":"2024-04-24T01:27:21.087999+0000","last_peered":"2024-04-24T01:27:21.087999+0000","last_clean":"2024-04-24T01:27:21.087999+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:27:21.087999+0000","last_undegraded":"2024-04-24T01:27:21.087999+0000","last_fullsized":"2024-04-24T01:27:21.087999+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.125139+0000","last_change":"2024-04-24T01:28:05.125139+0000","last_active":"2024-04-24T01:28:05.125139+0000","last_peered":"2024-04-24T01:28:05.125139+0000","last_clean":"2024-04-24T01:28:05.125139+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:28:05.125139+0000","last_undegraded":"2024-04-24T01:28:05.125139+0000","last_fullsized":"2024-04-24T01:28:05.125139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.125023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:40.888731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.359505+0000","last_change":"2024-04-24T01:27:43.359505+0000","last_active":"2024-04-24T01:27:43.359505+0000","last_peered":"2024-04-24T01:27:43.359505+0000","last_clean":"2024-04-24T01:27:43.359505+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:27:43.359505+0000","last_undegraded":"2024-04-24T01:27:43.359505+0000","last_fullsized":"2024-04-24T01:27:43.359505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.359390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:55.127868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.923552+0000","last_change":"2024-04-24T01:27:49.923613+0000","last_active":"2024-04-24T01:27:49.923552+0000","last_peered":"2024-04-24T01:27:49.923552+0000","last_clean":"2024-04-24T01:27:49.923552+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:49.923552+0000","last_undegraded":"2024-04-24T01:27:49.923552+0000","last_fullsized":"2024-04-24T01:27:49.923552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.923469+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:10.601774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.002121+0000","last_change":"2024-04-24T01:27:44.002143+0000","last_active":"2024-04-24T01:27:44.002121+0000","last_peered":"2024-04-24T01:27:44.002121+0000","last_clean":"2024-04-24T01:27:44.002121+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:27:44.002121+0000","last_undegraded":"2024-04-24T01:27:44.002121+0000","last_fullsized":"2024-04-24T01:27:44.002121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.001993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:46.800003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.983635+0000","last_change":"2024-04-24T01:24:08.779082+0000","last_active":"2024-04-24T01:26:18.983635+0000","last_peered":"2024-04-24T01:26:18.983635+0000","last_clean":"2024-04-24T01:26:18.983635+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:26:18.983635+0000","last_undegraded":"2024-04-24T01:26:18.983635+0000","last_fullsized":"2024-04-24T01:26:18.983635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.764536+0000","last_change":"2024-04-24T01:27:57.764536+0000","last_active":"2024-04-24T01:27:57.764536+0000","last_peered":"2024-04-24T01:27:57.764536+0000","last_clean":"2024-04-24T01:27:57.764536+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:57.764536+0000","last_undegraded":"2024-04-24T01:27:57.764536+0000","last_fullsized":"2024-04-24T01:27:57.764536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.764420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:01.699221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.042782+0000","last_change":"2024-04-24T01:27:55.042782+0000","last_active":"2024-04-24T01:27:55.042782+0000","last_peered":"2024-04-24T01:27:55.042782+0000","last_clean":"2024-04-24T01:27:55.042782+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:55.042782+0000","last_undegraded":"2024-04-24T01:27:55.042782+0000","last_fullsized":"2024-04-24T01:27:55.042782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.042621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:01:44.687742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.174050+0000","last_change":"2024-04-24T01:28:08.174089+0000","last_active":"2024-04-24T01:28:08.174050+0000","last_peered":"2024-04-24T01:28:08.174050+0000","last_clean":"2024-04-24T01:28:08.174050+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:28:08.174050+0000","last_undegraded":"2024-04-24T01:28:08.174050+0000","last_fullsized":"2024-04-24T01:28:08.174050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.173899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:18.830246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.316856+0000","last_change":"2024-04-24T01:27:44.316856+0000","last_active":"2024-04-24T01:27:44.316856+0000","last_peered":"2024-04-24T01:27:44.316856+0000","last_clean":"2024-04-24T01:27:44.316856+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:44.316856+0000","last_undegraded":"2024-04-24T01:27:44.316856+0000","last_fullsized":"2024-04-24T01:27:44.316856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.316675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:19.698338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'88","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.086861+0000","last_change":"2024-04-24T01:27:27.086861+0000","last_active":"2024-04-24T01:27:27.086861+0000","last_peered":"2024-04-24T01:27:27.086861+0000","last_clean":"2024-04-24T01:27:27.086861+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:27.086861+0000","last_undegraded":"2024-04-24T01:27:27.086861+0000","last_fullsized":"2024-04-24T01:27:27.086861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'88","last_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_deep_scrub":"34'88","last_deep_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.086724+0000","objects_scrubbed":11,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:32.526409+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.902351+0000","last_change":"2024-04-24T01:27:29.902351+0000","last_active":"2024-04-24T01:27:29.902351+0000","last_peered":"2024-04-24T01:27:29.902351+0000","last_clean":"2024-04-24T01:27:29.902351+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:27:29.902351+0000","last_undegraded":"2024-04-24T01:27:29.902351+0000","last_fullsized":"2024-04-24T01:27:29.902351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.902169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:02.390606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:26.975643+0000","last_change":"2024-04-24T01:24:08.771796+0000","last_active":"2024-04-24T01:26:26.975643+0000","last_peered":"2024-04-24T01:26:26.975643+0000","last_clean":"2024-04-24T01:26:26.975643+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:26:26.975643+0000","last_undegraded":"2024-04-24T01:26:26.975643+0000","last_fullsized":"2024-04-24T01:26:26.975643+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.768560+0000","last_change":"2024-04-24T01:27:55.768560+0000","last_active":"2024-04-24T01:27:55.768560+0000","last_peered":"2024-04-24T01:27:55.768560+0000","last_clean":"2024-04-24T01:27:55.768560+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:55.768560+0000","last_undegraded":"2024-04-24T01:27:55.768560+0000","last_fullsized":"2024-04-24T01:27:55.768560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.768450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:38.395793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.133523+0000","last_change":"2024-04-24T01:28:13.133547+0000","last_active":"2024-04-24T01:28:13.133523+0000","last_peered":"2024-04-24T01:28:13.133523+0000","last_clean":"2024-04-24T01:28:13.133523+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:28:13.133523+0000","last_undegraded":"2024-04-24T01:28:13.133523+0000","last_fullsized":"2024-04-24T01:28:13.133523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.133431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:35.842301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.087997+0000","last_change":"2024-04-24T01:23:50.690171+0000","last_active":"2024-04-24T01:27:21.087997+0000","last_peered":"2024-04-24T01:27:21.087997+0000","last_clean":"2024-04-24T01:27:21.087997+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:27:21.087997+0000","last_undegraded":"2024-04-24T01:27:21.087997+0000","last_fullsized":"2024-04-24T01:27:21.087997+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.079211+0000","last_change":"2024-04-24T01:27:26.079211+0000","last_active":"2024-04-24T01:27:26.079211+0000","last_peered":"2024-04-24T01:27:26.079211+0000","last_clean":"2024-04-24T01:27:26.079211+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:27:26.079211+0000","last_undegraded":"2024-04-24T01:27:26.079211+0000","last_fullsized":"2024-04-24T01:27:26.079211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.079098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:16:40.353572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.825422+0000","last_change":"2024-04-24T01:27:24.825422+0000","last_active":"2024-04-24T01:27:24.825422+0000","last_peered":"2024-04-24T01:27:24.825422+0000","last_clean":"2024-04-24T01:27:24.825422+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:27:24.825422+0000","last_undegraded":"2024-04-24T01:27:24.825422+0000","last_fullsized":"2024-04-24T01:27:24.825422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.825285+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:34.030557+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.840969+0000","last_change":"2024-04-24T01:27:25.840969+0000","last_active":"2024-04-24T01:27:25.840969+0000","last_peered":"2024-04-24T01:27:25.840969+0000","last_clean":"2024-04-24T01:27:25.840969+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:25.840969+0000","last_undegraded":"2024-04-24T01:27:25.840969+0000","last_fullsized":"2024-04-24T01:27:25.840969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.840846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:46:26.499751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.017110+0000","last_change":"2024-04-24T01:27:59.017138+0000","last_active":"2024-04-24T01:27:59.017110+0000","last_peered":"2024-04-24T01:27:59.017110+0000","last_clean":"2024-04-24T01:27:59.017110+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:27:59.017110+0000","last_undegraded":"2024-04-24T01:27:59.017110+0000","last_fullsized":"2024-04-24T01:27:59.017110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.017023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:20.258126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.981815+0000","last_change":"2024-04-24T01:27:36.981815+0000","last_active":"2024-04-24T01:27:36.981815+0000","last_peered":"2024-04-24T01:27:36.981815+0000","last_clean":"2024-04-24T01:27:36.981815+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:27:36.981815+0000","last_undegraded":"2024-04-24T01:27:36.981815+0000","last_fullsized":"2024-04-24T01:27:36.981815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.981689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:02.218699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.976878+0000","last_change":"2024-04-24T01:28:09.976878+0000","last_active":"2024-04-24T01:28:09.976878+0000","last_peered":"2024-04-24T01:28:09.976878+0000","last_clean":"2024-04-24T01:28:09.976878+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:28:09.976878+0000","last_undegraded":"2024-04-24T01:28:09.976878+0000","last_fullsized":"2024-04-24T01:28:09.976878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.976742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:54.442355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.223313+0000","last_change":"2024-04-24T01:28:07.223313+0000","last_active":"2024-04-24T01:28:07.223313+0000","last_peered":"2024-04-24T01:28:07.223313+0000","last_clean":"2024-04-24T01:28:07.223313+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:28:07.223313+0000","last_undegraded":"2024-04-24T01:28:07.223313+0000","last_fullsized":"2024-04-24T01:28:07.223313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.223157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.453523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088814+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:27:21.088814+0000","last_peered":"2024-04-24T01:27:21.088814+0000","last_clean":"2024-04-24T01:27:21.088814+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:27:21.088814+0000","last_undegraded":"2024-04-24T01:27:21.088814+0000","last_fullsized":"2024-04-24T01:27:21.088814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.936683+0000","last_change":"2024-04-24T01:27:45.936683+0000","last_active":"2024-04-24T01:27:45.936683+0000","last_peered":"2024-04-24T01:27:45.936683+0000","last_clean":"2024-04-24T01:27:45.936683+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:27:45.936683+0000","last_undegraded":"2024-04-24T01:27:45.936683+0000","last_fullsized":"2024-04-24T01:27:45.936683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.936543+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:45.566244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.031922+0000","last_change":"2024-04-24T01:27:26.031922+0000","last_active":"2024-04-24T01:27:26.031922+0000","last_peered":"2024-04-24T01:27:26.031922+0000","last_clean":"2024-04-24T01:27:26.031922+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:26.031922+0000","last_undegraded":"2024-04-24T01:27:26.031922+0000","last_fullsized":"2024-04-24T01:27:26.031922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.031809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:08.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.899519+0000","last_change":"2024-04-24T01:28:17.899565+0000","last_active":"2024-04-24T01:28:17.899519+0000","last_peered":"2024-04-24T01:28:17.899519+0000","last_clean":"2024-04-24T01:28:17.899519+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:28:17.899519+0000","last_undegraded":"2024-04-24T01:28:17.899519+0000","last_fullsized":"2024-04-24T01:28:17.899519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.899414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:39.140517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.099400+0000","last_change":"2024-04-24T01:28:08.099400+0000","last_active":"2024-04-24T01:28:08.099400+0000","last_peered":"2024-04-24T01:28:08.099400+0000","last_clean":"2024-04-24T01:28:08.099400+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:28:08.099400+0000","last_undegraded":"2024-04-24T01:28:08.099400+0000","last_fullsized":"2024-04-24T01:28:08.099400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.099278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:59:08.168998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.836355+0000","last_change":"2024-04-24T01:28:11.836355+0000","last_active":"2024-04-24T01:28:11.836355+0000","last_peered":"2024-04-24T01:28:11.836355+0000","last_clean":"2024-04-24T01:28:11.836355+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:28:11.836355+0000","last_undegraded":"2024-04-24T01:28:11.836355+0000","last_fullsized":"2024-04-24T01:28:11.836355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.836242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:31.148213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088009+0000","last_change":"2024-04-24T01:23:50.777739+0000","last_active":"2024-04-24T01:27:21.088009+0000","last_peered":"2024-04-24T01:27:21.088009+0000","last_clean":"2024-04-24T01:27:21.088009+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:27:21.088009+0000","last_undegraded":"2024-04-24T01:27:21.088009+0000","last_fullsized":"2024-04-24T01:27:21.088009+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:49.675471+0000","last_clean_scrub_stamp":"2024-04-24T01:23:49.675471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.157304+0000","last_change":"2024-04-24T01:27:21.157304+0000","last_active":"2024-04-24T01:27:21.157304+0000","last_peered":"2024-04-24T01:27:21.157304+0000","last_clean":"2024-04-24T01:27:21.157304+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:27:21.157304+0000","last_undegraded":"2024-04-24T01:27:21.157304+0000","last_fullsized":"2024-04-24T01:27:21.157304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.157174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:08.856778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.850725+0000","last_change":"2024-04-24T01:27:24.850725+0000","last_active":"2024-04-24T01:27:24.850725+0000","last_peered":"2024-04-24T01:27:24.850725+0000","last_clean":"2024-04-24T01:27:24.850725+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:24.850725+0000","last_undegraded":"2024-04-24T01:27:24.850725+0000","last_fullsized":"2024-04-24T01:27:24.850725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.850572+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:25.939996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.111936+0000","last_change":"2024-04-24T01:27:20.111936+0000","last_active":"2024-04-24T01:27:20.111936+0000","last_peered":"2024-04-24T01:27:20.111936+0000","last_clean":"2024-04-24T01:27:20.111936+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:27:20.111936+0000","last_undegraded":"2024-04-24T01:27:20.111936+0000","last_fullsized":"2024-04-24T01:27:20.111936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.111793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:00.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.148792+0000","last_change":"2024-04-24T01:28:09.148836+0000","last_active":"2024-04-24T01:28:09.148792+0000","last_peered":"2024-04-24T01:28:09.148792+0000","last_clean":"2024-04-24T01:28:09.148792+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:28:09.148792+0000","last_undegraded":"2024-04-24T01:28:09.148792+0000","last_fullsized":"2024-04-24T01:28:09.148792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.148692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:37.814414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.170629+0000","last_change":"2024-04-24T01:28:11.170629+0000","last_active":"2024-04-24T01:28:11.170629+0000","last_peered":"2024-04-24T01:28:11.170629+0000","last_clean":"2024-04-24T01:28:11.170629+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:28:11.170629+0000","last_undegraded":"2024-04-24T01:28:11.170629+0000","last_fullsized":"2024-04-24T01:28:11.170629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.170504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:38:30.319203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.103039+0000","last_change":"2024-04-24T01:27:50.103068+0000","last_active":"2024-04-24T01:27:50.103039+0000","last_peered":"2024-04-24T01:27:50.103039+0000","last_clean":"2024-04-24T01:27:50.103039+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:27:50.103039+0000","last_undegraded":"2024-04-24T01:27:50.103039+0000","last_fullsized":"2024-04-24T01:27:50.103039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.102944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:05.909709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984372+0000","last_change":"2024-04-24T01:23:58.762365+0000","last_active":"2024-04-24T01:26:18.984372+0000","last_peered":"2024-04-24T01:26:18.984372+0000","last_clean":"2024-04-24T01:26:18.984372+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:26:18.984372+0000","last_undegraded":"2024-04-24T01:26:18.984372+0000","last_fullsized":"2024-04-24T01:26:18.984372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.764420+0000","last_change":"2024-04-24T01:27:38.764441+0000","last_active":"2024-04-24T01:27:38.764420+0000","last_peered":"2024-04-24T01:27:38.764420+0000","last_clean":"2024-04-24T01:27:38.764420+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:27:38.764420+0000","last_undegraded":"2024-04-24T01:27:38.764420+0000","last_fullsized":"2024-04-24T01:27:38.764420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.764324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:54.262419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.087710+0000","last_change":"2024-04-24T01:27:31.087751+0000","last_active":"2024-04-24T01:27:31.087710+0000","last_peered":"2024-04-24T01:27:31.087710+0000","last_clean":"2024-04-24T01:27:31.087710+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:31.087710+0000","last_undegraded":"2024-04-24T01:27:31.087710+0000","last_fullsized":"2024-04-24T01:27:31.087710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.087607+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:17.401970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.881538+0000","last_change":"2024-04-24T01:27:50.881559+0000","last_active":"2024-04-24T01:27:50.881538+0000","last_peered":"2024-04-24T01:27:50.881538+0000","last_clean":"2024-04-24T01:27:50.881538+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:27:50.881538+0000","last_undegraded":"2024-04-24T01:27:50.881538+0000","last_fullsized":"2024-04-24T01:27:50.881538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.881443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:57.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:19.813181+0000","last_change":"2024-04-24T01:24:08.778498+0000","last_active":"2024-04-24T01:27:19.813181+0000","last_peered":"2024-04-24T01:27:19.813181+0000","last_clean":"2024-04-24T01:27:19.813181+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:27:19.813181+0000","last_undegraded":"2024-04-24T01:27:19.813181+0000","last_fullsized":"2024-04-24T01:27:19.813181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.832739+0000","last_change":"2024-04-24T01:28:03.832778+0000","last_active":"2024-04-24T01:28:03.832739+0000","last_peered":"2024-04-24T01:28:03.832739+0000","last_clean":"2024-04-24T01:28:03.832739+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:28:03.832739+0000","last_undegraded":"2024-04-24T01:28:03.832739+0000","last_fullsized":"2024-04-24T01:28:03.832739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.832618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:59.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.044213+0000","last_change":"2024-04-24T01:27:57.044241+0000","last_active":"2024-04-24T01:27:57.044213+0000","last_peered":"2024-04-24T01:27:57.044213+0000","last_clean":"2024-04-24T01:27:57.044213+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:57.044213+0000","last_undegraded":"2024-04-24T01:27:57.044213+0000","last_fullsized":"2024-04-24T01:27:57.044213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.044128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:43.358491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.142890+0000","last_change":"2024-04-24T01:27:29.142915+0000","last_active":"2024-04-24T01:27:29.142890+0000","last_peered":"2024-04-24T01:27:29.142890+0000","last_clean":"2024-04-24T01:27:29.142890+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:27:29.142890+0000","last_undegraded":"2024-04-24T01:27:29.142890+0000","last_fullsized":"2024-04-24T01:27:29.142890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.142798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:45.905908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.183889+0000","last_change":"2024-04-24T01:27:34.183920+0000","last_active":"2024-04-24T01:27:34.183889+0000","last_peered":"2024-04-24T01:27:34.183889+0000","last_clean":"2024-04-24T01:27:34.183889+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:34.183889+0000","last_undegraded":"2024-04-24T01:27:34.183889+0000","last_fullsized":"2024-04-24T01:27:34.183889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.183806+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:12.698513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.807860+0000","last_change":"2024-04-24T01:27:23.807924+0000","last_active":"2024-04-24T01:27:23.807860+0000","last_peered":"2024-04-24T01:27:23.807860+0000","last_clean":"2024-04-24T01:27:23.807860+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:27:23.807860+0000","last_undegraded":"2024-04-24T01:27:23.807860+0000","last_fullsized":"2024-04-24T01:27:23.807860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.807746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:16.346274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:41.977765+0000","last_change":"2024-04-24T01:24:08.768836+0000","last_active":"2024-04-24T01:26:41.977765+0000","last_peered":"2024-04-24T01:26:41.977765+0000","last_clean":"2024-04-24T01:26:41.977765+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:26:41.977765+0000","last_undegraded":"2024-04-24T01:26:41.977765+0000","last_fullsized":"2024-04-24T01:26:41.977765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.205483+0000","last_change":"2024-04-24T01:28:05.205539+0000","last_active":"2024-04-24T01:28:05.205483+0000","last_peered":"2024-04-24T01:28:05.205483+0000","last_clean":"2024-04-24T01:28:05.205483+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:28:05.205483+0000","last_undegraded":"2024-04-24T01:28:05.205483+0000","last_fullsized":"2024-04-24T01:28:05.205483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.205385+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:24.593592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.105393+0000","last_change":"2024-04-24T01:28:03.105447+0000","last_active":"2024-04-24T01:28:03.105393+0000","last_peered":"2024-04-24T01:28:03.105393+0000","last_clean":"2024-04-24T01:28:03.105393+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:28:03.105393+0000","last_undegraded":"2024-04-24T01:28:03.105393+0000","last_fullsized":"2024-04-24T01:28:03.105393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.105283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:07.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.931167+0000","last_change":"2024-04-24T01:27:36.931202+0000","last_active":"2024-04-24T01:27:36.931167+0000","last_peered":"2024-04-24T01:27:36.931167+0000","last_clean":"2024-04-24T01:27:36.931167+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:27:36.931167+0000","last_undegraded":"2024-04-24T01:27:36.931167+0000","last_fullsized":"2024-04-24T01:27:36.931167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.931078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:03.648188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.196789+0000","last_change":"2024-04-24T01:27:31.196826+0000","last_active":"2024-04-24T01:27:31.196789+0000","last_peered":"2024-04-24T01:27:31.196789+0000","last_clean":"2024-04-24T01:27:31.196789+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:31.196789+0000","last_undegraded":"2024-04-24T01:27:31.196789+0000","last_fullsized":"2024-04-24T01:27:31.196789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.196709+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:14:11.522611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.807230+0000","last_change":"2024-04-24T01:27:20.807267+0000","last_active":"2024-04-24T01:27:20.807230+0000","last_peered":"2024-04-24T01:27:20.807230+0000","last_clean":"2024-04-24T01:27:20.807230+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:27:20.807230+0000","last_undegraded":"2024-04-24T01:27:20.807230+0000","last_fullsized":"2024-04-24T01:27:20.807230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.807118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:36.350177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:38.987613+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:26:38.987613+0000","last_peered":"2024-04-24T01:26:38.987613+0000","last_clean":"2024-04-24T01:26:38.987613+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:26:38.987613+0000","last_undegraded":"2024-04-24T01:26:38.987613+0000","last_fullsized":"2024-04-24T01:26:38.987613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.969576+0000","last_change":"2024-04-24T01:27:35.969607+0000","last_active":"2024-04-24T01:27:35.969576+0000","last_peered":"2024-04-24T01:27:35.969576+0000","last_clean":"2024-04-24T01:27:35.969576+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:35.969576+0000","last_undegraded":"2024-04-24T01:27:35.969576+0000","last_fullsized":"2024-04-24T01:27:35.969576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.969453+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:40.292715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.863774+0000","last_change":"2024-04-24T01:28:13.863808+0000","last_active":"2024-04-24T01:28:13.863774+0000","last_peered":"2024-04-24T01:28:13.863774+0000","last_clean":"2024-04-24T01:28:13.863774+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:28:13.863774+0000","last_undegraded":"2024-04-24T01:28:13.863774+0000","last_fullsized":"2024-04-24T01:28:13.863774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.863667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:05.970240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.118350+0000","last_change":"2024-04-24T01:27:30.118393+0000","last_active":"2024-04-24T01:27:30.118350+0000","last_peered":"2024-04-24T01:27:30.118350+0000","last_clean":"2024-04-24T01:27:30.118350+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:27:30.118350+0000","last_undegraded":"2024-04-24T01:27:30.118350+0000","last_fullsized":"2024-04-24T01:27:30.118350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.118234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:34.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.933092+0000","last_change":"2024-04-24T01:27:32.933125+0000","last_active":"2024-04-24T01:27:32.933092+0000","last_peered":"2024-04-24T01:27:32.933092+0000","last_clean":"2024-04-24T01:27:32.933092+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:32.933092+0000","last_undegraded":"2024-04-24T01:27:32.933092+0000","last_fullsized":"2024-04-24T01:27:32.933092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.933012+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:06:06.750907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.831039+0000","last_change":"2024-04-24T01:27:20.831064+0000","last_active":"2024-04-24T01:27:20.831039+0000","last_peered":"2024-04-24T01:27:20.831039+0000","last_clean":"2024-04-24T01:27:20.831039+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:27:20.831039+0000","last_undegraded":"2024-04-24T01:27:20.831039+0000","last_fullsized":"2024-04-24T01:27:20.831039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.830957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:31.945556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.917603+0000","last_change":"2024-04-24T01:27:55.917603+0000","last_active":"2024-04-24T01:27:55.917603+0000","last_peered":"2024-04-24T01:27:55.917603+0000","last_clean":"2024-04-24T01:27:55.917603+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:27:55.917603+0000","last_undegraded":"2024-04-24T01:27:55.917603+0000","last_fullsized":"2024-04-24T01:27:55.917603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.917438+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:55.797725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.091073+0000","last_change":"2024-04-24T01:28:13.091102+0000","last_active":"2024-04-24T01:28:13.091073+0000","last_peered":"2024-04-24T01:28:13.091073+0000","last_clean":"2024-04-24T01:28:13.091073+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:28:13.091073+0000","last_undegraded":"2024-04-24T01:28:13.091073+0000","last_fullsized":"2024-04-24T01:28:13.091073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.090980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:40.409078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.353257+0000","last_change":"2024-04-24T01:27:42.353257+0000","last_active":"2024-04-24T01:27:42.353257+0000","last_peered":"2024-04-24T01:27:42.353257+0000","last_clean":"2024-04-24T01:27:42.353257+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:27:42.353257+0000","last_undegraded":"2024-04-24T01:27:42.353257+0000","last_fullsized":"2024-04-24T01:27:42.353257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.353157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:02.089872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.233047+0000","last_change":"2024-04-24T01:27:32.233080+0000","last_active":"2024-04-24T01:27:32.233047+0000","last_peered":"2024-04-24T01:27:32.233047+0000","last_clean":"2024-04-24T01:27:32.233047+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:32.233047+0000","last_undegraded":"2024-04-24T01:27:32.233047+0000","last_fullsized":"2024-04-24T01:27:32.233047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.232954+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:33.771403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.841600+0000","last_change":"2024-04-24T01:27:22.841624+0000","last_active":"2024-04-24T01:27:22.841600+0000","last_peered":"2024-04-24T01:27:22.841600+0000","last_clean":"2024-04-24T01:27:22.841600+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:27:22.841600+0000","last_undegraded":"2024-04-24T01:27:22.841600+0000","last_fullsized":"2024-04-24T01:27:22.841600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.841514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:44.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'18","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:10.448352+0000","last_change":"2024-04-24T01:24:08.768920+0000","last_active":"2024-04-24T01:27:10.448352+0000","last_peered":"2024-04-24T01:27:10.448352+0000","last_clean":"2024-04-24T01:27:10.448352+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:27:10.448352+0000","last_undegraded":"2024-04-24T01:27:10.448352+0000","last_fullsized":"2024-04-24T01:27:10.448352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.296646+0000","last_change":"2024-04-24T01:27:48.296646+0000","last_active":"2024-04-24T01:27:48.296646+0000","last_peered":"2024-04-24T01:27:48.296646+0000","last_clean":"2024-04-24T01:27:48.296646+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:48.296646+0000","last_undegraded":"2024-04-24T01:27:48.296646+0000","last_fullsized":"2024-04-24T01:27:48.296646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.296518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:09.220285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.859584+0000","last_change":"2024-04-24T01:28:12.859610+0000","last_active":"2024-04-24T01:28:12.859584+0000","last_peered":"2024-04-24T01:28:12.859584+0000","last_clean":"2024-04-24T01:28:12.859584+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:28:12.859584+0000","last_undegraded":"2024-04-24T01:28:12.859584+0000","last_fullsized":"2024-04-24T01:28:12.859584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.859483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:08.233871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.046002+0000","last_change":"2024-04-24T01:27:41.046002+0000","last_active":"2024-04-24T01:27:41.046002+0000","last_peered":"2024-04-24T01:27:41.046002+0000","last_clean":"2024-04-24T01:27:41.046002+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:27:41.046002+0000","last_undegraded":"2024-04-24T01:27:41.046002+0000","last_fullsized":"2024-04-24T01:27:41.046002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.045887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:22.914827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.087296+0000","last_change":"2024-04-24T01:27:25.087358+0000","last_active":"2024-04-24T01:27:25.087296+0000","last_peered":"2024-04-24T01:27:25.087296+0000","last_clean":"2024-04-24T01:27:25.087296+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:25.087296+0000","last_undegraded":"2024-04-24T01:27:25.087296+0000","last_fullsized":"2024-04-24T01:27:25.087296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.087202+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:18.223546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.735703+0000","last_change":"2024-04-24T01:27:33.735761+0000","last_active":"2024-04-24T01:27:33.735703+0000","last_peered":"2024-04-24T01:27:33.735703+0000","last_clean":"2024-04-24T01:27:33.735703+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:27:33.735703+0000","last_undegraded":"2024-04-24T01:27:33.735703+0000","last_fullsized":"2024-04-24T01:27:33.735703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.735599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:44.989596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.044635+0000","last_change":"2024-04-24T01:28:03.044679+0000","last_active":"2024-04-24T01:28:03.044635+0000","last_peered":"2024-04-24T01:28:03.044635+0000","last_clean":"2024-04-24T01:28:03.044635+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:28:03.044635+0000","last_undegraded":"2024-04-24T01:28:03.044635+0000","last_fullsized":"2024-04-24T01:28:03.044635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.044539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:54.343523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.973256+0000","last_change":"2024-04-24T01:27:33.973301+0000","last_active":"2024-04-24T01:27:33.973256+0000","last_peered":"2024-04-24T01:27:33.973256+0000","last_clean":"2024-04-24T01:27:33.973256+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:27:33.973256+0000","last_undegraded":"2024-04-24T01:27:33.973256+0000","last_fullsized":"2024-04-24T01:27:33.973256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.973155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:28.429349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.825703+0000","last_change":"2024-04-24T01:28:09.825748+0000","last_active":"2024-04-24T01:28:09.825703+0000","last_peered":"2024-04-24T01:28:09.825703+0000","last_clean":"2024-04-24T01:28:09.825703+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:28:09.825703+0000","last_undegraded":"2024-04-24T01:28:09.825703+0000","last_fullsized":"2024-04-24T01:28:09.825703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.825585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:16.859867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.059784+0000","last_change":"2024-04-24T01:27:40.059810+0000","last_active":"2024-04-24T01:27:40.059784+0000","last_peered":"2024-04-24T01:27:40.059784+0000","last_clean":"2024-04-24T01:27:40.059784+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:27:40.059784+0000","last_undegraded":"2024-04-24T01:27:40.059784+0000","last_fullsized":"2024-04-24T01:27:40.059784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.059684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:04.176354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.098384+0000","last_change":"2024-04-24T01:27:28.098384+0000","last_active":"2024-04-24T01:27:28.098384+0000","last_peered":"2024-04-24T01:27:28.098384+0000","last_clean":"2024-04-24T01:27:28.098384+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:28.098384+0000","last_undegraded":"2024-04-24T01:27:28.098384+0000","last_fullsized":"2024-04-24T01:27:28.098384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.098205+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:13.672642+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.091423+0000","last_change":"2024-04-24T01:27:22.091423+0000","last_active":"2024-04-24T01:27:22.091423+0000","last_peered":"2024-04-24T01:27:22.091423+0000","last_clean":"2024-04-24T01:27:22.091423+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:27:22.091423+0000","last_undegraded":"2024-04-24T01:27:22.091423+0000","last_fullsized":"2024-04-24T01:27:22.091423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.091312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:42.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.985951+0000","last_change":"2024-04-24T01:24:08.773739+0000","last_active":"2024-04-24T01:26:28.985951+0000","last_peered":"2024-04-24T01:26:28.985951+0000","last_clean":"2024-04-24T01:26:28.985951+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:26:28.985951+0000","last_undegraded":"2024-04-24T01:26:28.985951+0000","last_fullsized":"2024-04-24T01:26:28.985951+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.329918+0000","last_change":"2024-04-24T01:27:55.329959+0000","last_active":"2024-04-24T01:27:55.329918+0000","last_peered":"2024-04-24T01:27:55.329918+0000","last_clean":"2024-04-24T01:27:55.329918+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:27:55.329918+0000","last_undegraded":"2024-04-24T01:27:55.329918+0000","last_fullsized":"2024-04-24T01:27:55.329918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.329792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:04:03.792768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.960404+0000","last_change":"2024-04-24T01:28:17.960427+0000","last_active":"2024-04-24T01:28:17.960404+0000","last_peered":"2024-04-24T01:28:17.960404+0000","last_clean":"2024-04-24T01:28:17.960404+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:28:17.960404+0000","last_undegraded":"2024-04-24T01:28:17.960404+0000","last_fullsized":"2024-04-24T01:28:17.960404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.960318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:16.440099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.749135+0000","last_change":"2024-04-24T01:27:39.749158+0000","last_active":"2024-04-24T01:27:39.749135+0000","last_peered":"2024-04-24T01:27:39.749135+0000","last_clean":"2024-04-24T01:27:39.749135+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:27:39.749135+0000","last_undegraded":"2024-04-24T01:27:39.749135+0000","last_fullsized":"2024-04-24T01:27:39.749135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.749046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:27.448650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.983586+0000","last_change":"2024-04-24T01:27:34.983586+0000","last_active":"2024-04-24T01:27:34.983586+0000","last_peered":"2024-04-24T01:27:34.983586+0000","last_clean":"2024-04-24T01:27:34.983586+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:27:34.983586+0000","last_undegraded":"2024-04-24T01:27:34.983586+0000","last_fullsized":"2024-04-24T01:27:34.983586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.983448+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:01.670877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.929176+0000","last_change":"2024-04-24T01:27:33.929176+0000","last_active":"2024-04-24T01:27:33.929176+0000","last_peered":"2024-04-24T01:27:33.929176+0000","last_clean":"2024-04-24T01:27:33.929176+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:33.929176+0000","last_undegraded":"2024-04-24T01:27:33.929176+0000","last_fullsized":"2024-04-24T01:27:33.929176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.929072+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:18.783745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.001548+0000","last_change":"2024-04-24T01:28:11.001570+0000","last_active":"2024-04-24T01:28:11.001548+0000","last_peered":"2024-04-24T01:28:11.001548+0000","last_clean":"2024-04-24T01:28:11.001548+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:28:11.001548+0000","last_undegraded":"2024-04-24T01:28:11.001548+0000","last_fullsized":"2024-04-24T01:28:11.001548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.001466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:24.425690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.079919+0000","last_change":"2024-04-24T01:27:48.079950+0000","last_active":"2024-04-24T01:27:48.079919+0000","last_peered":"2024-04-24T01:27:48.079919+0000","last_clean":"2024-04-24T01:27:48.079919+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:48.079919+0000","last_undegraded":"2024-04-24T01:27:48.079919+0000","last_fullsized":"2024-04-24T01:27:48.079919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.079833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:52:03.610383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.861473+0000","last_change":"2024-04-24T01:28:04.861517+0000","last_active":"2024-04-24T01:28:04.861473+0000","last_peered":"2024-04-24T01:28:04.861473+0000","last_clean":"2024-04-24T01:28:04.861473+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:28:04.861473+0000","last_undegraded":"2024-04-24T01:28:04.861473+0000","last_fullsized":"2024-04-24T01:28:04.861473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.861352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.266160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.756543+0000","last_change":"2024-04-24T01:27:36.756588+0000","last_active":"2024-04-24T01:27:36.756543+0000","last_peered":"2024-04-24T01:27:36.756543+0000","last_clean":"2024-04-24T01:27:36.756543+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:27:36.756543+0000","last_undegraded":"2024-04-24T01:27:36.756543+0000","last_fullsized":"2024-04-24T01:27:36.756543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.756455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:22.449180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.761744+0000","last_change":"2024-04-24T01:27:30.761800+0000","last_active":"2024-04-24T01:27:30.761744+0000","last_peered":"2024-04-24T01:27:30.761744+0000","last_clean":"2024-04-24T01:27:30.761744+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:30.761744+0000","last_undegraded":"2024-04-24T01:27:30.761744+0000","last_fullsized":"2024-04-24T01:27:30.761744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.761661+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:48.545704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.337069+0000","last_change":"2024-04-24T01:27:45.337095+0000","last_active":"2024-04-24T01:27:45.337069+0000","last_peered":"2024-04-24T01:27:45.337069+0000","last_clean":"2024-04-24T01:27:45.337069+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:27:45.337069+0000","last_undegraded":"2024-04-24T01:27:45.337069+0000","last_fullsized":"2024-04-24T01:27:45.337069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.336963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:37.290165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.739909+0000","last_change":"2024-04-24T01:27:37.739935+0000","last_active":"2024-04-24T01:27:37.739909+0000","last_peered":"2024-04-24T01:27:37.739909+0000","last_clean":"2024-04-24T01:27:37.739909+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:27:37.739909+0000","last_undegraded":"2024-04-24T01:27:37.739909+0000","last_fullsized":"2024-04-24T01:27:37.739909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.739820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:34.597803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.075139+0000","last_change":"2024-04-24T01:27:45.075163+0000","last_active":"2024-04-24T01:27:45.075139+0000","last_peered":"2024-04-24T01:27:45.075139+0000","last_clean":"2024-04-24T01:27:45.075139+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:45.075139+0000","last_undegraded":"2024-04-24T01:27:45.075139+0000","last_fullsized":"2024-04-24T01:27:45.075139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.075019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:51.367822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986062+0000","last_change":"2024-04-24T01:23:58.763317+0000","last_active":"2024-04-24T01:26:28.986062+0000","last_peered":"2024-04-24T01:26:28.986062+0000","last_clean":"2024-04-24T01:26:28.986062+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:26:28.986062+0000","last_undegraded":"2024-04-24T01:26:28.986062+0000","last_fullsized":"2024-04-24T01:26:28.986062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.913584+0000","last_change":"2024-04-24T01:27:34.913612+0000","last_active":"2024-04-24T01:27:34.913584+0000","last_peered":"2024-04-24T01:27:34.913584+0000","last_clean":"2024-04-24T01:27:34.913584+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:27:34.913584+0000","last_undegraded":"2024-04-24T01:27:34.913584+0000","last_fullsized":"2024-04-24T01:27:34.913584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.913487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:18.229615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.156326+0000","last_change":"2024-04-24T01:27:30.156369+0000","last_active":"2024-04-24T01:27:30.156326+0000","last_peered":"2024-04-24T01:27:30.156326+0000","last_clean":"2024-04-24T01:27:30.156326+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:30.156326+0000","last_undegraded":"2024-04-24T01:27:30.156326+0000","last_fullsized":"2024-04-24T01:27:30.156326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.156230+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:37.955468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.987140+0000","last_change":"2024-04-24T01:27:42.987190+0000","last_active":"2024-04-24T01:27:42.987140+0000","last_peered":"2024-04-24T01:27:42.987140+0000","last_clean":"2024-04-24T01:27:42.987140+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:27:42.987140+0000","last_undegraded":"2024-04-24T01:27:42.987140+0000","last_fullsized":"2024-04-24T01:27:42.987140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.987041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:18.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986980+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:26:33.986980+0000","last_peered":"2024-04-24T01:26:33.986980+0000","last_clean":"2024-04-24T01:26:33.986980+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:26:33.986980+0000","last_undegraded":"2024-04-24T01:26:33.986980+0000","last_fullsized":"2024-04-24T01:26:33.986980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.994045+0000","last_change":"2024-04-24T01:28:05.994109+0000","last_active":"2024-04-24T01:28:05.994045+0000","last_peered":"2024-04-24T01:28:05.994045+0000","last_clean":"2024-04-24T01:28:05.994045+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:28:05.994045+0000","last_undegraded":"2024-04-24T01:28:05.994045+0000","last_fullsized":"2024-04-24T01:28:05.994045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.993947+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:25.685425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.244737+0000","last_change":"2024-04-24T01:28:04.244763+0000","last_active":"2024-04-24T01:28:04.244737+0000","last_peered":"2024-04-24T01:28:04.244737+0000","last_clean":"2024-04-24T01:28:04.244737+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:28:04.244737+0000","last_undegraded":"2024-04-24T01:28:04.244737+0000","last_fullsized":"2024-04-24T01:28:04.244737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.244647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:25.006383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.755391+0000","last_change":"2024-04-24T01:27:34.755417+0000","last_active":"2024-04-24T01:27:34.755391+0000","last_peered":"2024-04-24T01:27:34.755391+0000","last_clean":"2024-04-24T01:27:34.755391+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:27:34.755391+0000","last_undegraded":"2024-04-24T01:27:34.755391+0000","last_fullsized":"2024-04-24T01:27:34.755391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.755296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:32.167294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.873513+0000","last_change":"2024-04-24T01:27:47.873544+0000","last_active":"2024-04-24T01:27:47.873513+0000","last_peered":"2024-04-24T01:27:47.873513+0000","last_clean":"2024-04-24T01:27:47.873513+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:47.873513+0000","last_undegraded":"2024-04-24T01:27:47.873513+0000","last_fullsized":"2024-04-24T01:27:47.873513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.873413+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:12:47.188719+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.891422+0000","last_change":"2024-04-24T01:27:54.891469+0000","last_active":"2024-04-24T01:27:54.891422+0000","last_peered":"2024-04-24T01:27:54.891422+0000","last_clean":"2024-04-24T01:27:54.891422+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:27:54.891422+0000","last_undegraded":"2024-04-24T01:27:54.891422+0000","last_fullsized":"2024-04-24T01:27:54.891422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.891327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:46.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986917+0000","last_change":"2024-04-24T01:24:08.773727+0000","last_active":"2024-04-24T01:26:33.986917+0000","last_peered":"2024-04-24T01:26:33.986917+0000","last_clean":"2024-04-24T01:26:33.986917+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:26:33.986917+0000","last_undegraded":"2024-04-24T01:26:33.986917+0000","last_fullsized":"2024-04-24T01:26:33.986917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.065454+0000","last_change":"2024-04-24T01:27:44.065481+0000","last_active":"2024-04-24T01:27:44.065454+0000","last_peered":"2024-04-24T01:27:44.065454+0000","last_clean":"2024-04-24T01:27:44.065454+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:27:44.065454+0000","last_undegraded":"2024-04-24T01:27:44.065454+0000","last_fullsized":"2024-04-24T01:27:44.065454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.065351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:23.725424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.876743+0000","last_change":"2024-04-24T01:28:02.876743+0000","last_active":"2024-04-24T01:28:02.876743+0000","last_peered":"2024-04-24T01:28:02.876743+0000","last_clean":"2024-04-24T01:28:02.876743+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:28:02.876743+0000","last_undegraded":"2024-04-24T01:28:02.876743+0000","last_fullsized":"2024-04-24T01:28:02.876743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.876585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:05.674595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.719484+0000","last_change":"2024-04-24T01:27:32.719516+0000","last_active":"2024-04-24T01:27:32.719484+0000","last_peered":"2024-04-24T01:27:32.719484+0000","last_clean":"2024-04-24T01:27:32.719484+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:27:32.719484+0000","last_undegraded":"2024-04-24T01:27:32.719484+0000","last_fullsized":"2024-04-24T01:27:32.719484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.719397+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:10.815530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.973007+0000","last_change":"2024-04-24T01:27:44.973079+0000","last_active":"2024-04-24T01:27:44.973007+0000","last_peered":"2024-04-24T01:27:44.973007+0000","last_clean":"2024-04-24T01:27:44.973007+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:44.973007+0000","last_undegraded":"2024-04-24T01:27:44.973007+0000","last_fullsized":"2024-04-24T01:27:44.973007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.972905+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:58:52.372440+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.200708+0000","last_change":"2024-04-24T01:27:37.200734+0000","last_active":"2024-04-24T01:27:37.200708+0000","last_peered":"2024-04-24T01:27:37.200708+0000","last_clean":"2024-04-24T01:27:37.200708+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:27:37.200708+0000","last_undegraded":"2024-04-24T01:27:37.200708+0000","last_fullsized":"2024-04-24T01:27:37.200708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.200577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:30.452220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986026+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:28.986026+0000","last_peered":"2024-04-24T01:26:28.986026+0000","last_clean":"2024-04-24T01:26:28.986026+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:28.986026+0000","last_undegraded":"2024-04-24T01:26:28.986026+0000","last_fullsized":"2024-04-24T01:26:28.986026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.821917+0000","last_change":"2024-04-24T01:28:15.821958+0000","last_active":"2024-04-24T01:28:15.821917+0000","last_peered":"2024-04-24T01:28:15.821917+0000","last_clean":"2024-04-24T01:28:15.821917+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:28:15.821917+0000","last_undegraded":"2024-04-24T01:28:15.821917+0000","last_fullsized":"2024-04-24T01:28:15.821917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.821799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:18.284502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.098736+0000","last_change":"2024-04-24T01:27:47.098736+0000","last_active":"2024-04-24T01:27:47.098736+0000","last_peered":"2024-04-24T01:27:47.098736+0000","last_clean":"2024-04-24T01:27:47.098736+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:47.098736+0000","last_undegraded":"2024-04-24T01:27:47.098736+0000","last_fullsized":"2024-04-24T01:27:47.098736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.098613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:08.549533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.326561+0000","last_change":"2024-04-24T01:27:53.326589+0000","last_active":"2024-04-24T01:27:53.326561+0000","last_peered":"2024-04-24T01:27:53.326561+0000","last_clean":"2024-04-24T01:27:53.326561+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:27:53.326561+0000","last_undegraded":"2024-04-24T01:27:53.326561+0000","last_fullsized":"2024-04-24T01:27:53.326561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.326480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:56.533113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.154672+0000","last_change":"2024-04-24T01:28:09.154672+0000","last_active":"2024-04-24T01:28:09.154672+0000","last_peered":"2024-04-24T01:28:09.154672+0000","last_clean":"2024-04-24T01:28:09.154672+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:28:09.154672+0000","last_undegraded":"2024-04-24T01:28:09.154672+0000","last_fullsized":"2024-04-24T01:28:09.154672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.154557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:38.451216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.943522+0000","last_change":"2024-04-24T01:28:07.943548+0000","last_active":"2024-04-24T01:28:07.943522+0000","last_peered":"2024-04-24T01:28:07.943522+0000","last_clean":"2024-04-24T01:28:07.943522+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:28:07.943522+0000","last_undegraded":"2024-04-24T01:28:07.943522+0000","last_fullsized":"2024-04-24T01:28:07.943522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.943435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:27.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.003080+0000","last_change":"2024-04-24T01:28:16.003105+0000","last_active":"2024-04-24T01:28:16.003080+0000","last_peered":"2024-04-24T01:28:16.003080+0000","last_clean":"2024-04-24T01:28:16.003080+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:28:16.003080+0000","last_undegraded":"2024-04-24T01:28:16.003080+0000","last_fullsized":"2024-04-24T01:28:16.003080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.002980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:31.898663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.270189+0000","last_change":"2024-04-24T01:27:57.270216+0000","last_active":"2024-04-24T01:27:57.270189+0000","last_peered":"2024-04-24T01:27:57.270189+0000","last_clean":"2024-04-24T01:27:57.270189+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:57.270189+0000","last_undegraded":"2024-04-24T01:27:57.270189+0000","last_fullsized":"2024-04-24T01:27:57.270189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.270099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:32.213542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.302374+0000","last_change":"2024-04-24T01:27:56.302374+0000","last_active":"2024-04-24T01:27:56.302374+0000","last_peered":"2024-04-24T01:27:56.302374+0000","last_clean":"2024-04-24T01:27:56.302374+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:27:56.302374+0000","last_undegraded":"2024-04-24T01:27:56.302374+0000","last_fullsized":"2024-04-24T01:27:56.302374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.302255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:55.783843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.195571+0000","last_change":"2024-04-24T01:28:01.195571+0000","last_active":"2024-04-24T01:28:01.195571+0000","last_peered":"2024-04-24T01:28:01.195571+0000","last_clean":"2024-04-24T01:28:01.195571+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:28:01.195571+0000","last_undegraded":"2024-04-24T01:28:01.195571+0000","last_fullsized":"2024-04-24T01:28:01.195571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.195431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:09.529251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.140062+0000","last_change":"2024-04-24T01:28:11.140087+0000","last_active":"2024-04-24T01:28:11.140062+0000","last_peered":"2024-04-24T01:28:11.140062+0000","last_clean":"2024-04-24T01:28:11.140062+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:28:11.140062+0000","last_undegraded":"2024-04-24T01:28:11.140062+0000","last_fullsized":"2024-04-24T01:28:11.140062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.139969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:09.603168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.819728+0000","last_change":"2024-04-24T01:27:59.819728+0000","last_active":"2024-04-24T01:27:59.819728+0000","last_peered":"2024-04-24T01:27:59.819728+0000","last_clean":"2024-04-24T01:27:59.819728+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:59.819728+0000","last_undegraded":"2024-04-24T01:27:59.819728+0000","last_fullsized":"2024-04-24T01:27:59.819728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.819607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:11.722240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.856063+0000","last_change":"2024-04-24T01:28:06.856063+0000","last_active":"2024-04-24T01:28:06.856063+0000","last_peered":"2024-04-24T01:28:06.856063+0000","last_clean":"2024-04-24T01:28:06.856063+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:28:06.856063+0000","last_undegraded":"2024-04-24T01:28:06.856063+0000","last_fullsized":"2024-04-24T01:28:06.856063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.855938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:44.329967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.195318+0000","last_change":"2024-04-24T01:27:59.195318+0000","last_active":"2024-04-24T01:27:59.195318+0000","last_peered":"2024-04-24T01:27:59.195318+0000","last_clean":"2024-04-24T01:27:59.195318+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:27:59.195318+0000","last_undegraded":"2024-04-24T01:27:59.195318+0000","last_fullsized":"2024-04-24T01:27:59.195318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.195149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:51.074457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.122928+0000","last_change":"2024-04-24T01:28:01.122928+0000","last_active":"2024-04-24T01:28:01.122928+0000","last_peered":"2024-04-24T01:28:01.122928+0000","last_clean":"2024-04-24T01:28:01.122928+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:28:01.122928+0000","last_undegraded":"2024-04-24T01:28:01.122928+0000","last_fullsized":"2024-04-24T01:28:01.122928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.122753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:31:56.927600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.790317+0000","last_change":"2024-04-24T01:27:48.790317+0000","last_active":"2024-04-24T01:27:48.790317+0000","last_peered":"2024-04-24T01:27:48.790317+0000","last_clean":"2024-04-24T01:27:48.790317+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:48.790317+0000","last_undegraded":"2024-04-24T01:27:48.790317+0000","last_fullsized":"2024-04-24T01:27:48.790317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.790131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:15.310685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.150955+0000","last_change":"2024-04-24T01:28:10.150980+0000","last_active":"2024-04-24T01:28:10.150955+0000","last_peered":"2024-04-24T01:28:10.150955+0000","last_clean":"2024-04-24T01:28:10.150955+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:28:10.150955+0000","last_undegraded":"2024-04-24T01:28:10.150955+0000","last_fullsized":"2024-04-24T01:28:10.150955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.150848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:35.075645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.824638+0000","last_change":"2024-04-24T01:27:42.824684+0000","last_active":"2024-04-24T01:27:42.824638+0000","last_peered":"2024-04-24T01:27:42.824638+0000","last_clean":"2024-04-24T01:27:42.824638+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:42.824638+0000","last_undegraded":"2024-04-24T01:27:42.824638+0000","last_fullsized":"2024-04-24T01:27:42.824638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.824525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:03.738253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088301+0000","last_change":"2024-04-24T01:23:58.758422+0000","last_active":"2024-04-24T01:27:21.088301+0000","last_peered":"2024-04-24T01:27:21.088301+0000","last_clean":"2024-04-24T01:27:21.088301+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:27:21.088301+0000","last_undegraded":"2024-04-24T01:27:21.088301+0000","last_fullsized":"2024-04-24T01:27:21.088301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.013260+0000","last_change":"2024-04-24T01:27:40.013289+0000","last_active":"2024-04-24T01:27:40.013260+0000","last_peered":"2024-04-24T01:27:40.013260+0000","last_clean":"2024-04-24T01:27:40.013260+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:40.013260+0000","last_undegraded":"2024-04-24T01:27:40.013260+0000","last_fullsized":"2024-04-24T01:27:40.013260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.013169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:21.080960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.109713+0000","last_change":"2024-04-24T01:28:12.109769+0000","last_active":"2024-04-24T01:28:12.109713+0000","last_peered":"2024-04-24T01:28:12.109713+0000","last_clean":"2024-04-24T01:28:12.109713+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:28:12.109713+0000","last_undegraded":"2024-04-24T01:28:12.109713+0000","last_fullsized":"2024-04-24T01:28:12.109713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.109616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:48.990071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.238623+0000","last_change":"2024-04-24T01:28:03.238648+0000","last_active":"2024-04-24T01:28:03.238623+0000","last_peered":"2024-04-24T01:28:03.238623+0000","last_clean":"2024-04-24T01:28:03.238623+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:28:03.238623+0000","last_undegraded":"2024-04-24T01:28:03.238623+0000","last_fullsized":"2024-04-24T01:28:03.238623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.238536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:17.676354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.851682+0000","last_change":"2024-04-24T01:28:00.851711+0000","last_active":"2024-04-24T01:28:00.851682+0000","last_peered":"2024-04-24T01:28:00.851682+0000","last_clean":"2024-04-24T01:28:00.851682+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:28:00.851682+0000","last_undegraded":"2024-04-24T01:28:00.851682+0000","last_fullsized":"2024-04-24T01:28:00.851682+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.851583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:32.414278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.721972+0000","last_change":"2024-04-24T01:27:54.721998+0000","last_active":"2024-04-24T01:27:54.721972+0000","last_peered":"2024-04-24T01:27:54.721972+0000","last_clean":"2024-04-24T01:27:54.721972+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:54.721972+0000","last_undegraded":"2024-04-24T01:27:54.721972+0000","last_fullsized":"2024-04-24T01:27:54.721972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.721886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:21.542465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.829199+0000","last_change":"2024-04-24T01:28:08.829238+0000","last_active":"2024-04-24T01:28:08.829199+0000","last_peered":"2024-04-24T01:28:08.829199+0000","last_clean":"2024-04-24T01:28:08.829199+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:28:08.829199+0000","last_undegraded":"2024-04-24T01:28:08.829199+0000","last_fullsized":"2024-04-24T01:28:08.829199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.829110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:29.507416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.859510+0000","last_change":"2024-04-24T01:28:05.859558+0000","last_active":"2024-04-24T01:28:05.859510+0000","last_peered":"2024-04-24T01:28:05.859510+0000","last_clean":"2024-04-24T01:28:05.859510+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:28:05.859510+0000","last_undegraded":"2024-04-24T01:28:05.859510+0000","last_fullsized":"2024-04-24T01:28:05.859510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.859401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:16.646001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.995218+0000","last_change":"2024-04-24T01:28:16.995244+0000","last_active":"2024-04-24T01:28:16.995218+0000","last_peered":"2024-04-24T01:28:16.995218+0000","last_clean":"2024-04-24T01:28:16.995218+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:28:16.995218+0000","last_undegraded":"2024-04-24T01:28:16.995218+0000","last_fullsized":"2024-04-24T01:28:16.995218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.995125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:06.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.742303+0000","last_change":"2024-04-24T01:27:40.742337+0000","last_active":"2024-04-24T01:27:40.742303+0000","last_peered":"2024-04-24T01:27:40.742303+0000","last_clean":"2024-04-24T01:27:40.742303+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:27:40.742303+0000","last_undegraded":"2024-04-24T01:27:40.742303+0000","last_fullsized":"2024-04-24T01:27:40.742303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.742220+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:29.319272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:13.983635+0000","last_change":"2024-04-24T01:23:58.762085+0000","last_active":"2024-04-24T01:26:13.983635+0000","last_peered":"2024-04-24T01:26:13.983635+0000","last_clean":"2024-04-24T01:26:13.983635+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:26:13.983635+0000","last_undegraded":"2024-04-24T01:26:13.983635+0000","last_fullsized":"2024-04-24T01:26:13.983635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.099525+0000","last_change":"2024-04-24T01:28:14.099552+0000","last_active":"2024-04-24T01:28:14.099525+0000","last_peered":"2024-04-24T01:28:14.099525+0000","last_clean":"2024-04-24T01:28:14.099525+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:28:14.099525+0000","last_undegraded":"2024-04-24T01:28:14.099525+0000","last_fullsized":"2024-04-24T01:28:14.099525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.099430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:48.960432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.112301+0000","last_change":"2024-04-24T01:28:06.112328+0000","last_active":"2024-04-24T01:28:06.112301+0000","last_peered":"2024-04-24T01:28:06.112301+0000","last_clean":"2024-04-24T01:28:06.112301+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:28:06.112301+0000","last_undegraded":"2024-04-24T01:28:06.112301+0000","last_fullsized":"2024-04-24T01:28:06.112301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.112211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:09.638702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'12","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.768162+0000","last_change":"2024-04-24T01:27:53.768193+0000","last_active":"2024-04-24T01:27:53.768162+0000","last_peered":"2024-04-24T01:27:53.768162+0000","last_clean":"2024-04-24T01:27:53.768162+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:53.768162+0000","last_undegraded":"2024-04-24T01:27:53.768162+0000","last_fullsized":"2024-04-24T01:27:53.768162+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.768072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:20.455501+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.993616+0000","last_change":"2024-04-24T01:28:08.993658+0000","last_active":"2024-04-24T01:28:08.993616+0000","last_peered":"2024-04-24T01:28:08.993616+0000","last_clean":"2024-04-24T01:28:08.993616+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:28:08.993616+0000","last_undegraded":"2024-04-24T01:28:08.993616+0000","last_fullsized":"2024-04-24T01:28:08.993616+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.993523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:50.996413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:18.984249+0000","last_change":"2024-04-24T01:23:58.757806+0000","last_active":"2024-04-24T01:26:18.984249+0000","last_peered":"2024-04-24T01:26:18.984249+0000","last_clean":"2024-04-24T01:26:18.984249+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:26:18.984249+0000","last_undegraded":"2024-04-24T01:26:18.984249+0000","last_fullsized":"2024-04-24T01:26:18.984249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:23:57.704698+0000","last_clean_scrub_stamp":"2024-04-24T01:23:57.704698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.290295+0000","last_change":"2024-04-24T01:27:46.290325+0000","last_active":"2024-04-24T01:27:46.290295+0000","last_peered":"2024-04-24T01:27:46.290295+0000","last_clean":"2024-04-24T01:27:46.290295+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:46.290295+0000","last_undegraded":"2024-04-24T01:27:46.290295+0000","last_fullsized":"2024-04-24T01:27:46.290295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.290152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:57.436026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.151350+0000","last_change":"2024-04-24T01:28:00.151375+0000","last_active":"2024-04-24T01:28:00.151350+0000","last_peered":"2024-04-24T01:28:00.151350+0000","last_clean":"2024-04-24T01:28:00.151350+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:28:00.151350+0000","last_undegraded":"2024-04-24T01:28:00.151350+0000","last_fullsized":"2024-04-24T01:28:00.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.151264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:54.349626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.704447+0000","last_change":"2024-04-24T01:27:50.704477+0000","last_active":"2024-04-24T01:27:50.704447+0000","last_peered":"2024-04-24T01:27:50.704447+0000","last_clean":"2024-04-24T01:27:50.704447+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:27:50.704447+0000","last_undegraded":"2024-04-24T01:27:50.704447+0000","last_fullsized":"2024-04-24T01:27:50.704447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.704360+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:31.185382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1755,"ondisk_log_size":1755,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640316,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640314,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":454656,"data_stored":150586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:28:22.569 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.569 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.569 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.569 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.569 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.570 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.570 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.570 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.570 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T01:23:59.712192+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.570 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.571 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.572 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.572 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.572 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.572 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.572 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:23:49.675471+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.573 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.573 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.573 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.573 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.573 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.574 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.574 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.574 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.574 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.574 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.575 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.575 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.575 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T01:23:57.704698+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=23, tm_sec=57, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:22.575 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:28:42.576 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:28:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b612d2640 1 Processor -- start 2024-04-24T01:28:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b612d2640 1 -- start start 2024-04-24T01:28:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b612d2640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b5c1287d0 0x7f8b5c130360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b612d2640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5c127b00 con 0x7f8b5c127ce0 2024-04-24T01:28:42.684 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b612d2640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f8b5c0708e0 con 0x7f8b5c1287d0 2024-04-24T01:28:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b5a7fc640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f8b5c1287d0 0x7f8b5c130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b5affd640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f8b5c127ce0 0x7f8b5c1280c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:34442/0 (socket says 172.21.15.142:34442) 2024-04-24T01:28:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b5affd640 1 -- 172.21.15.142:0/3375969027 learned_addr learned my addr 172.21.15.142:0/3375969027 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:28:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b5a7fc640 1 -- 172.21.15.142:0/3375969027 >> v1:172.21.15.142:6789/0 conn(0x7f8b5c127ce0 legacy=0x7f8b5c1280c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:42.685 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.683+0000 7f8b5a7fc640 1 -- 172.21.15.142:0/3375969027 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c098800 con 0x7f8b5c1287d0 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.684+0000 7f8b5a7fc640 1 --2- 172.21.15.142:0/3375969027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c1287d0 0x7f8b5c130360 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009750 tx=0x7f8b4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f1000ab6b00ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.684+0000 7f8b59ffb640 1 -- 172.21.15.142:0/3375969027 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b4c0316d0 con 0x7f8b5c1287d0 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.684+0000 7f8b59ffb640 1 -- 172.21.15.142:0/3375969027 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c037070 con 0x7f8b5c1287d0 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.684+0000 7f8b59ffb640 1 -- 172.21.15.142:0/3375969027 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b4c0319c0 con 0x7f8b5c1287d0 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 -- 172.21.15.142:0/3375969027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c1287d0 msgr2=0x7f8b5c130360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 --2- 172.21.15.142:0/3375969027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c1287d0 0x7f8b5c130360 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009750 tx=0x7f8b4c02b840 comp rx=0 tx=0).stop 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 -- 172.21.15.142:0/3375969027 shutdown_connections 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 --2- 172.21.15.142:0/3375969027 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c1287d0 0x7f8b5c130360 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 -- 172.21.15.142:0/3375969027 >> 172.21.15.142:0/3375969027 conn(0x7f8b5c099680 msgr2=0x7f8b5c099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 -- 172.21.15.142:0/3375969027 shutdown_connections 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.685+0000 7f8b612d2640 1 -- 172.21.15.142:0/3375969027 wait complete. 2024-04-24T01:28:42.688 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b612d2640 1 Processor -- start 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b612d2640 1 -- start start 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b612d2640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b612d2640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5c06faa0 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b5affd640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57316/0 (socket says 172.21.15.142:57316) 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.686+0000 7f8b5affd640 1 -- 172.21.15.142:0/1837338018 learned_addr learned my addr 172.21.15.142:0/1837338018 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b5affd640 1 -- 172.21.15.142:0/1837338018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5c123560 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b5affd640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c4a0 tx=0x7f8b4400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b44017070 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b44005c10 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b5c06dea0 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b44007070 con 0x7f8b5c127ce0 2024-04-24T01:28:42.689 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.687+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5c123150 con 0x7f8b5c127ce0 2024-04-24T01:28:42.690 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.688+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b4401a070 con 0x7f8b5c127ce0 2024-04-24T01:28:42.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.688+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5c062da0 con 0x7f8b5c127ce0 2024-04-24T01:28:42.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.688+0000 7f8b537fe640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 0x7f8b3c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:28:42.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.688+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f8b4404ad00 con 0x7f8b5c127ce0 2024-04-24T01:28:42.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.688+0000 7f8b5a7fc640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 0x7f8b3c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:28:42.691 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.689+0000 7f8b5a7fc640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 0x7f8b3c03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c036000 tx=0x7f8b4c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:28:42.693 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.693+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f8b5c127b00 con 0x7f8b5c127ce0 2024-04-24T01:28:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.864+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b5c1240b0 con 0x7f8b3c038060 2024-04-24T01:28:42.880 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.880+0000 7f8b537fe640 1 -- 172.21.15.142:0/1837338018 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666160 (secure 0 0 0) 0x7f8b5c1240b0 con 0x7f8b3c038060 2024-04-24T01:28:42.888 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:28:42.893 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:28:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 msgr2=0x7f8b3c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 0x7f8b3c03a520 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c036000 tx=0x7f8b4c008030 comp rx=0 tx=0).stop 2024-04-24T01:28:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 msgr2=0x7f8b5c121df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:28:42.896 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400c4a0 tx=0x7f8b4400c960 comp rx=0 tx=0).stop 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 shutdown_connections 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f8b3c038060 0x7f8b3c03a520 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 --2- 172.21.15.142:0/1837338018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b5c127ce0 0x7f8b5c121df0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 >> 172.21.15.142:0/1837338018 conn(0x7f8b5c099680 msgr2=0x7f8b5c12ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 shutdown_connections 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:28:42.884+0000 7f8b612d2640 1 -- 172.21.15.142:0/1837338018 wait complete. 2024-04-24T01:28:42.897 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-04-24T01:28:41.989662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5377,"num_read_kb":4926,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5016,"ondisk_log_size":5016,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1778210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003939"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.115018+0000","last_change":"2024-04-24T01:27:51.115018+0000","last_active":"2024-04-24T01:27:51.115018+0000","last_peered":"2024-04-24T01:27:51.115018+0000","last_clean":"2024-04-24T01:27:51.115018+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:27:51.115018+0000","last_undegraded":"2024-04-24T01:27:51.115018+0000","last_fullsized":"2024-04-24T01:27:51.115018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.114886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:37.582826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.756639+0000","last_change":"2024-04-24T01:27:44.756666+0000","last_active":"2024-04-24T01:27:44.756639+0000","last_peered":"2024-04-24T01:27:44.756639+0000","last_clean":"2024-04-24T01:27:44.756639+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:44.756639+0000","last_undegraded":"2024-04-24T01:27:44.756639+0000","last_fullsized":"2024-04-24T01:27:44.756639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.756553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:43.777959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.223065+0000","last_change":"2024-04-24T01:28:02.223065+0000","last_active":"2024-04-24T01:28:02.223065+0000","last_peered":"2024-04-24T01:28:02.223065+0000","last_clean":"2024-04-24T01:28:02.223065+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:28:02.223065+0000","last_undegraded":"2024-04-24T01:28:02.223065+0000","last_fullsized":"2024-04-24T01:28:02.223065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.222955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:22.111184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.052111+0000","last_change":"2024-04-24T01:28:00.052138+0000","last_active":"2024-04-24T01:28:00.052111+0000","last_peered":"2024-04-24T01:28:00.052111+0000","last_clean":"2024-04-24T01:28:00.052111+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:28:00.052111+0000","last_undegraded":"2024-04-24T01:28:00.052111+0000","last_fullsized":"2024-04-24T01:28:00.052111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.052021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:32.079724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:34.909849+0000","last_change":"2024-04-24T01:28:34.909901+0000","last_active":"2024-04-24T01:28:34.909849+0000","last_peered":"2024-04-24T01:28:34.909849+0000","last_clean":"2024-04-24T01:28:34.909849+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:28:34.909849+0000","last_undegraded":"2024-04-24T01:28:34.909849+0000","last_fullsized":"2024-04-24T01:28:34.909849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:34.909706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:34.909706+0000","last_clean_scrub_stamp":"2024-04-24T01:28:34.909706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:45.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.070669+0000","last_change":"2024-04-24T01:28:01.070736+0000","last_active":"2024-04-24T01:28:01.070669+0000","last_peered":"2024-04-24T01:28:01.070669+0000","last_clean":"2024-04-24T01:28:01.070669+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:28:01.070669+0000","last_undegraded":"2024-04-24T01:28:01.070669+0000","last_fullsized":"2024-04-24T01:28:01.070669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.070556+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:10.689727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.090880+0000","last_change":"2024-04-24T01:28:02.090907+0000","last_active":"2024-04-24T01:28:02.090880+0000","last_peered":"2024-04-24T01:28:02.090880+0000","last_clean":"2024-04-24T01:28:02.090880+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:28:02.090880+0000","last_undegraded":"2024-04-24T01:28:02.090880+0000","last_fullsized":"2024-04-24T01:28:02.090880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.090787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:45.124033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.013113+0000","last_change":"2024-04-24T01:28:04.013177+0000","last_active":"2024-04-24T01:28:04.013113+0000","last_peered":"2024-04-24T01:28:04.013113+0000","last_clean":"2024-04-24T01:28:04.013113+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:28:04.013113+0000","last_undegraded":"2024-04-24T01:28:04.013113+0000","last_fullsized":"2024-04-24T01:28:04.013113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.012979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:48.531163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:33.863618+0000","last_change":"2024-04-24T01:28:33.863646+0000","last_active":"2024-04-24T01:28:33.863618+0000","last_peered":"2024-04-24T01:28:33.863618+0000","last_clean":"2024-04-24T01:28:33.863618+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:28:33.863618+0000","last_undegraded":"2024-04-24T01:28:33.863618+0000","last_fullsized":"2024-04-24T01:28:33.863618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:33.863531+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:33.863531+0000","last_clean_scrub_stamp":"2024-04-24T01:28:33.863531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:37:26.355037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.722184+0000","last_change":"2024-04-24T01:27:52.722184+0000","last_active":"2024-04-24T01:27:52.722184+0000","last_peered":"2024-04-24T01:27:52.722184+0000","last_clean":"2024-04-24T01:27:52.722184+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:52.722184+0000","last_undegraded":"2024-04-24T01:27:52.722184+0000","last_fullsized":"2024-04-24T01:27:52.722184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.722064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.178258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.076443+0000","last_change":"2024-04-24T01:28:07.076470+0000","last_active":"2024-04-24T01:28:07.076443+0000","last_peered":"2024-04-24T01:28:07.076443+0000","last_clean":"2024-04-24T01:28:07.076443+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:28:07.076443+0000","last_undegraded":"2024-04-24T01:28:07.076443+0000","last_fullsized":"2024-04-24T01:28:07.076443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.076348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:48.144139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'4","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.126491+0000","last_change":"2024-04-24T01:28:13.126524+0000","last_active":"2024-04-24T01:28:13.126491+0000","last_peered":"2024-04-24T01:28:13.126491+0000","last_clean":"2024-04-24T01:28:13.126491+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:28:13.126491+0000","last_undegraded":"2024-04-24T01:28:13.126491+0000","last_fullsized":"2024-04-24T01:28:13.126491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.126407+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:16.636846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:25.991135+0000","last_change":"2024-04-24T01:28:25.991185+0000","last_active":"2024-04-24T01:28:25.991135+0000","last_peered":"2024-04-24T01:28:25.991135+0000","last_clean":"2024-04-24T01:28:25.991135+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:28:25.991135+0000","last_undegraded":"2024-04-24T01:28:25.991135+0000","last_fullsized":"2024-04-24T01:28:25.991135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:25.991030+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:25.991030+0000","last_clean_scrub_stamp":"2024-04-24T01:28:25.991030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:04.235902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.056694+0000","last_change":"2024-04-24T01:27:43.056694+0000","last_active":"2024-04-24T01:27:43.056694+0000","last_peered":"2024-04-24T01:27:43.056694+0000","last_clean":"2024-04-24T01:27:43.056694+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:27:43.056694+0000","last_undegraded":"2024-04-24T01:27:43.056694+0000","last_fullsized":"2024-04-24T01:27:43.056694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.056528+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:52.813992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.096615+0000","last_change":"2024-04-24T01:28:14.096641+0000","last_active":"2024-04-24T01:28:14.096615+0000","last_peered":"2024-04-24T01:28:14.096615+0000","last_clean":"2024-04-24T01:28:14.096615+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:28:14.096615+0000","last_undegraded":"2024-04-24T01:28:14.096615+0000","last_fullsized":"2024-04-24T01:28:14.096615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.096486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.442284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.084049+0000","last_change":"2024-04-24T01:27:52.084049+0000","last_active":"2024-04-24T01:27:52.084049+0000","last_peered":"2024-04-24T01:27:52.084049+0000","last_clean":"2024-04-24T01:27:52.084049+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:52.084049+0000","last_undegraded":"2024-04-24T01:27:52.084049+0000","last_fullsized":"2024-04-24T01:27:52.084049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.083901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:30.781693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.864119+0000","last_change":"2024-04-24T01:27:52.864145+0000","last_active":"2024-04-24T01:27:52.864119+0000","last_peered":"2024-04-24T01:27:52.864119+0000","last_clean":"2024-04-24T01:27:52.864119+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:52.864119+0000","last_undegraded":"2024-04-24T01:27:52.864119+0000","last_fullsized":"2024-04-24T01:27:52.864119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.864012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:12.175983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.808596+0000","last_change":"2024-04-24T01:27:58.808645+0000","last_active":"2024-04-24T01:27:58.808596+0000","last_peered":"2024-04-24T01:27:58.808596+0000","last_clean":"2024-04-24T01:27:58.808596+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:27:58.808596+0000","last_undegraded":"2024-04-24T01:27:58.808596+0000","last_fullsized":"2024-04-24T01:27:58.808596+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.808475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:39.876266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.733646+0000","last_change":"2024-04-24T01:27:46.733689+0000","last_active":"2024-04-24T01:27:46.733646+0000","last_peered":"2024-04-24T01:27:46.733646+0000","last_clean":"2024-04-24T01:27:46.733646+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:46.733646+0000","last_undegraded":"2024-04-24T01:27:46.733646+0000","last_fullsized":"2024-04-24T01:27:46.733646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.733535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:05.735464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.150626+0000","last_change":"2024-04-24T01:28:04.150662+0000","last_active":"2024-04-24T01:28:04.150626+0000","last_peered":"2024-04-24T01:28:04.150626+0000","last_clean":"2024-04-24T01:28:04.150626+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:28:04.150626+0000","last_undegraded":"2024-04-24T01:28:04.150626+0000","last_fullsized":"2024-04-24T01:28:04.150626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.150539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:29.387549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.777724+0000","last_change":"2024-04-24T01:27:43.777752+0000","last_active":"2024-04-24T01:27:43.777724+0000","last_peered":"2024-04-24T01:27:43.777724+0000","last_clean":"2024-04-24T01:27:43.777724+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:27:43.777724+0000","last_undegraded":"2024-04-24T01:27:43.777724+0000","last_fullsized":"2024-04-24T01:27:43.777724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.777633+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:36.913978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.842760+0000","last_change":"2024-04-24T01:28:14.842797+0000","last_active":"2024-04-24T01:28:14.842760+0000","last_peered":"2024-04-24T01:28:14.842760+0000","last_clean":"2024-04-24T01:28:14.842760+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:28:14.842760+0000","last_undegraded":"2024-04-24T01:28:14.842760+0000","last_fullsized":"2024-04-24T01:28:14.842760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.842663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:14.722950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'12","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.108294+0000","last_change":"2024-04-24T01:28:15.108364+0000","last_active":"2024-04-24T01:28:15.108294+0000","last_peered":"2024-04-24T01:28:15.108294+0000","last_clean":"2024-04-24T01:28:15.108294+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:28:15.108294+0000","last_undegraded":"2024-04-24T01:28:15.108294+0000","last_fullsized":"2024-04-24T01:28:15.108294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.108195+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:19:14.900595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.786257+0000","last_change":"2024-04-24T01:28:10.786303+0000","last_active":"2024-04-24T01:28:10.786257+0000","last_peered":"2024-04-24T01:28:10.786257+0000","last_clean":"2024-04-24T01:28:10.786257+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:28:10.786257+0000","last_undegraded":"2024-04-24T01:28:10.786257+0000","last_fullsized":"2024-04-24T01:28:10.786257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.786147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:55.313023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":87,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.040944+0000","last_change":"2024-04-24T01:27:56.040969+0000","last_active":"2024-04-24T01:27:56.040944+0000","last_peered":"2024-04-24T01:27:56.040944+0000","last_clean":"2024-04-24T01:27:56.040944+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:56.040944+0000","last_undegraded":"2024-04-24T01:27:56.040944+0000","last_fullsized":"2024-04-24T01:27:56.040944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.040837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:12.454785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.307397+0000","last_change":"2024-04-24T01:27:52.307427+0000","last_active":"2024-04-24T01:27:52.307397+0000","last_peered":"2024-04-24T01:27:52.307397+0000","last_clean":"2024-04-24T01:27:52.307397+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:27:52.307397+0000","last_undegraded":"2024-04-24T01:27:52.307397+0000","last_fullsized":"2024-04-24T01:27:52.307397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.307307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:07.610661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.760656+0000","last_change":"2024-04-24T01:27:47.760706+0000","last_active":"2024-04-24T01:27:47.760656+0000","last_peered":"2024-04-24T01:27:47.760656+0000","last_clean":"2024-04-24T01:27:47.760656+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:47.760656+0000","last_undegraded":"2024-04-24T01:27:47.760656+0000","last_fullsized":"2024-04-24T01:27:47.760656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.760550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:24:04.523660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.036833+0000","last_change":"2024-04-24T01:28:15.036833+0000","last_active":"2024-04-24T01:28:15.036833+0000","last_peered":"2024-04-24T01:28:15.036833+0000","last_clean":"2024-04-24T01:28:15.036833+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:28:15.036833+0000","last_undegraded":"2024-04-24T01:28:15.036833+0000","last_fullsized":"2024-04-24T01:28:15.036833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.036696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:23.884209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.929573+0000","last_change":"2024-04-24T01:28:18.929635+0000","last_active":"2024-04-24T01:28:18.929573+0000","last_peered":"2024-04-24T01:28:18.929573+0000","last_clean":"2024-04-24T01:28:18.929573+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:28:18.929573+0000","last_undegraded":"2024-04-24T01:28:18.929573+0000","last_fullsized":"2024-04-24T01:28:18.929573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.929470+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:29.233355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.982618+0000","last_change":"2024-04-24T01:28:04.982647+0000","last_active":"2024-04-24T01:28:04.982618+0000","last_peered":"2024-04-24T01:28:04.982618+0000","last_clean":"2024-04-24T01:28:04.982618+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:28:04.982618+0000","last_undegraded":"2024-04-24T01:28:04.982618+0000","last_fullsized":"2024-04-24T01:28:04.982618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.982533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:34.027613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.973646+0000","last_change":"2024-04-24T01:28:18.973646+0000","last_active":"2024-04-24T01:28:18.973646+0000","last_peered":"2024-04-24T01:28:18.973646+0000","last_clean":"2024-04-24T01:28:18.973646+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:28:18.973646+0000","last_undegraded":"2024-04-24T01:28:18.973646+0000","last_fullsized":"2024-04-24T01:28:18.973646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.973529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:48.432455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.182402+0000","last_change":"2024-04-24T01:27:22.182426+0000","last_active":"2024-04-24T01:27:22.182402+0000","last_peered":"2024-04-24T01:27:22.182402+0000","last_clean":"2024-04-24T01:27:22.182402+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:27:22.182402+0000","last_undegraded":"2024-04-24T01:27:22.182402+0000","last_fullsized":"2024-04-24T01:27:22.182402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.182314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:53.198026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":117,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.018890+0000","last_change":"2024-04-24T01:27:33.018949+0000","last_active":"2024-04-24T01:27:33.018890+0000","last_peered":"2024-04-24T01:27:33.018890+0000","last_clean":"2024-04-24T01:27:33.018890+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:33.018890+0000","last_undegraded":"2024-04-24T01:27:33.018890+0000","last_fullsized":"2024-04-24T01:27:33.018890+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.018804+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:06.024098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.763614+0000","last_change":"2024-04-24T01:27:29.763639+0000","last_active":"2024-04-24T01:27:29.763614+0000","last_peered":"2024-04-24T01:27:29.763614+0000","last_clean":"2024-04-24T01:27:29.763614+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:27:29.763614+0000","last_undegraded":"2024-04-24T01:27:29.763614+0000","last_fullsized":"2024-04-24T01:27:29.763614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.763505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:56.480614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.855129+0000","last_change":"2024-04-24T01:28:16.855160+0000","last_active":"2024-04-24T01:28:16.855129+0000","last_peered":"2024-04-24T01:28:16.855129+0000","last_clean":"2024-04-24T01:28:16.855129+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:28:16.855129+0000","last_undegraded":"2024-04-24T01:28:16.855129+0000","last_fullsized":"2024-04-24T01:28:16.855129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.855041+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:38.466443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.040893+0000","last_change":"2024-04-24T01:28:02.040917+0000","last_active":"2024-04-24T01:28:02.040893+0000","last_peered":"2024-04-24T01:28:02.040893+0000","last_clean":"2024-04-24T01:28:02.040893+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:28:02.040893+0000","last_undegraded":"2024-04-24T01:28:02.040893+0000","last_fullsized":"2024-04-24T01:28:02.040893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.040760+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:37.666837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.092679+0000","last_change":"2024-04-24T01:27:59.092679+0000","last_active":"2024-04-24T01:27:59.092679+0000","last_peered":"2024-04-24T01:27:59.092679+0000","last_clean":"2024-04-24T01:27:59.092679+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:27:59.092679+0000","last_undegraded":"2024-04-24T01:27:59.092679+0000","last_fullsized":"2024-04-24T01:27:59.092679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.092526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.097820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.909563+0000","last_change":"2024-04-24T01:28:20.909587+0000","last_active":"2024-04-24T01:28:20.909563+0000","last_peered":"2024-04-24T01:28:20.909563+0000","last_clean":"2024-04-24T01:28:20.909563+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:28:20.909563+0000","last_undegraded":"2024-04-24T01:28:20.909563+0000","last_fullsized":"2024-04-24T01:28:20.909563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:20.909463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:20.909463+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.909463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:56.535540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'17","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.795733+0000","last_change":"2024-04-24T01:27:28.795795+0000","last_active":"2024-04-24T01:27:28.795733+0000","last_peered":"2024-04-24T01:27:28.795733+0000","last_clean":"2024-04-24T01:27:28.795733+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:27:28.795733+0000","last_undegraded":"2024-04-24T01:27:28.795733+0000","last_fullsized":"2024-04-24T01:27:28.795733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.795617+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:13.586689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.807223+0000","last_change":"2024-04-24T01:27:22.807246+0000","last_active":"2024-04-24T01:27:22.807223+0000","last_peered":"2024-04-24T01:27:22.807223+0000","last_clean":"2024-04-24T01:27:22.807223+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:27:22.807223+0000","last_undegraded":"2024-04-24T01:27:22.807223+0000","last_fullsized":"2024-04-24T01:27:22.807223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.807114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:58.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.082598+0000","last_change":"2024-04-24T01:28:17.082633+0000","last_active":"2024-04-24T01:28:17.082598+0000","last_peered":"2024-04-24T01:28:17.082598+0000","last_clean":"2024-04-24T01:28:17.082598+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:28:17.082598+0000","last_undegraded":"2024-04-24T01:28:17.082598+0000","last_fullsized":"2024-04-24T01:28:17.082598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:17.082496+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:17.082496+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.082496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:32:28.277615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.977361+0000","last_change":"2024-04-24T01:27:57.977385+0000","last_active":"2024-04-24T01:27:57.977361+0000","last_peered":"2024-04-24T01:27:57.977361+0000","last_clean":"2024-04-24T01:27:57.977361+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:57.977361+0000","last_undegraded":"2024-04-24T01:27:57.977361+0000","last_fullsized":"2024-04-24T01:27:57.977361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.977272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:19.588675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:27.947305+0000","last_change":"2024-04-24T01:28:27.947305+0000","last_active":"2024-04-24T01:28:27.947305+0000","last_peered":"2024-04-24T01:28:27.947305+0000","last_clean":"2024-04-24T01:28:27.947305+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:28:27.947305+0000","last_undegraded":"2024-04-24T01:28:27.947305+0000","last_fullsized":"2024-04-24T01:28:27.947305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:27.947163+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:27.947163+0000","last_clean_scrub_stamp":"2024-04-24T01:28:27.947163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:13.732224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.283661+0000","last_change":"2024-04-24T01:27:39.283686+0000","last_active":"2024-04-24T01:27:39.283661+0000","last_peered":"2024-04-24T01:27:39.283661+0000","last_clean":"2024-04-24T01:27:39.283661+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:27:39.283661+0000","last_undegraded":"2024-04-24T01:27:39.283661+0000","last_fullsized":"2024-04-24T01:27:39.283661+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.283571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:27.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":81,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.914958+0000","last_change":"2024-04-24T01:27:28.914998+0000","last_active":"2024-04-24T01:27:28.914958+0000","last_peered":"2024-04-24T01:27:28.914958+0000","last_clean":"2024-04-24T01:27:28.914958+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:27:28.914958+0000","last_undegraded":"2024-04-24T01:27:28.914958+0000","last_fullsized":"2024-04-24T01:27:28.914958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.914874+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:31.978701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":433,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.904111+0000","last_change":"2024-04-24T01:27:46.904142+0000","last_active":"2024-04-24T01:27:46.904111+0000","last_peered":"2024-04-24T01:27:46.904111+0000","last_clean":"2024-04-24T01:27:46.904111+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:46.904111+0000","last_undegraded":"2024-04-24T01:27:46.904111+0000","last_fullsized":"2024-04-24T01:27:46.904111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.904020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:50.414459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.135360+0000","last_change":"2024-04-24T01:28:10.135388+0000","last_active":"2024-04-24T01:28:10.135360+0000","last_peered":"2024-04-24T01:28:10.135360+0000","last_clean":"2024-04-24T01:28:10.135360+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:28:10.135360+0000","last_undegraded":"2024-04-24T01:28:10.135360+0000","last_fullsized":"2024-04-24T01:28:10.135360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.135272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.660932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.273861+0000","last_change":"2024-04-24T01:27:50.273889+0000","last_active":"2024-04-24T01:27:50.273861+0000","last_peered":"2024-04-24T01:27:50.273861+0000","last_clean":"2024-04-24T01:27:50.273861+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:27:50.273861+0000","last_undegraded":"2024-04-24T01:27:50.273861+0000","last_fullsized":"2024-04-24T01:27:50.273861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.273766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:54:42.265021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.812248+0000","last_change":"2024-04-24T01:27:56.812248+0000","last_active":"2024-04-24T01:27:56.812248+0000","last_peered":"2024-04-24T01:27:56.812248+0000","last_clean":"2024-04-24T01:27:56.812248+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:27:56.812248+0000","last_undegraded":"2024-04-24T01:27:56.812248+0000","last_fullsized":"2024-04-24T01:27:56.812248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.812089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:46.064127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.157564+0000","last_change":"2024-04-24T01:27:28.157587+0000","last_active":"2024-04-24T01:27:28.157564+0000","last_peered":"2024-04-24T01:27:28.157564+0000","last_clean":"2024-04-24T01:27:28.157564+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:27:28.157564+0000","last_undegraded":"2024-04-24T01:27:28.157564+0000","last_fullsized":"2024-04-24T01:27:28.157564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.157467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:47.159396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.890012+0000","last_change":"2024-04-24T01:27:26.890053+0000","last_active":"2024-04-24T01:27:26.890012+0000","last_peered":"2024-04-24T01:27:26.890012+0000","last_clean":"2024-04-24T01:27:26.890012+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:26.890012+0000","last_undegraded":"2024-04-24T01:27:26.890012+0000","last_fullsized":"2024-04-24T01:27:26.890012+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.889929+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:10.323651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":413,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.070103+0000","last_change":"2024-04-24T01:27:24.070163+0000","last_active":"2024-04-24T01:27:24.070103+0000","last_peered":"2024-04-24T01:27:24.070103+0000","last_clean":"2024-04-24T01:27:24.070103+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:24.070103+0000","last_undegraded":"2024-04-24T01:27:24.070103+0000","last_fullsized":"2024-04-24T01:27:24.070103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.069989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:46.537881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.899047+0000","last_change":"2024-04-24T01:27:53.899047+0000","last_active":"2024-04-24T01:27:53.899047+0000","last_peered":"2024-04-24T01:27:53.899047+0000","last_clean":"2024-04-24T01:27:53.899047+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:27:53.899047+0000","last_undegraded":"2024-04-24T01:27:53.899047+0000","last_fullsized":"2024-04-24T01:27:53.899047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.898918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:49.273306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.068848+0000","last_change":"2024-04-24T01:27:53.068848+0000","last_active":"2024-04-24T01:27:53.068848+0000","last_peered":"2024-04-24T01:27:53.068848+0000","last_clean":"2024-04-24T01:27:53.068848+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:27:53.068848+0000","last_undegraded":"2024-04-24T01:27:53.068848+0000","last_fullsized":"2024-04-24T01:27:53.068848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.068721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:30.201730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.724506+0000","last_change":"2024-04-24T01:27:31.724506+0000","last_active":"2024-04-24T01:27:31.724506+0000","last_peered":"2024-04-24T01:27:31.724506+0000","last_clean":"2024-04-24T01:27:31.724506+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:27:31.724506+0000","last_undegraded":"2024-04-24T01:27:31.724506+0000","last_fullsized":"2024-04-24T01:27:31.724506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.724380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:37.609422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.950474+0000","last_change":"2024-04-24T01:27:30.950474+0000","last_active":"2024-04-24T01:27:30.950474+0000","last_peered":"2024-04-24T01:27:30.950474+0000","last_clean":"2024-04-24T01:27:30.950474+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:30.950474+0000","last_undegraded":"2024-04-24T01:27:30.950474+0000","last_fullsized":"2024-04-24T01:27:30.950474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.950337+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:06.885598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.107889+0000","last_change":"2024-04-24T01:27:23.107889+0000","last_active":"2024-04-24T01:27:23.107889+0000","last_peered":"2024-04-24T01:27:23.107889+0000","last_clean":"2024-04-24T01:27:23.107889+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:27:23.107889+0000","last_undegraded":"2024-04-24T01:27:23.107889+0000","last_fullsized":"2024-04-24T01:27:23.107889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.107773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:16.379160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.138383+0000","last_change":"2024-04-24T01:28:12.138383+0000","last_active":"2024-04-24T01:28:12.138383+0000","last_peered":"2024-04-24T01:28:12.138383+0000","last_clean":"2024-04-24T01:28:12.138383+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:28:12.138383+0000","last_undegraded":"2024-04-24T01:28:12.138383+0000","last_fullsized":"2024-04-24T01:28:12.138383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.138254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:11.767955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.703790+0000","last_change":"2024-04-24T01:27:51.703790+0000","last_active":"2024-04-24T01:27:51.703790+0000","last_peered":"2024-04-24T01:27:51.703790+0000","last_clean":"2024-04-24T01:27:51.703790+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:27:51.703790+0000","last_undegraded":"2024-04-24T01:27:51.703790+0000","last_fullsized":"2024-04-24T01:27:51.703790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.703677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:59.808919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.113076+0000","last_change":"2024-04-24T01:27:49.113076+0000","last_active":"2024-04-24T01:27:49.113076+0000","last_peered":"2024-04-24T01:27:49.113076+0000","last_clean":"2024-04-24T01:27:49.113076+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:49.113076+0000","last_undegraded":"2024-04-24T01:27:49.113076+0000","last_fullsized":"2024-04-24T01:27:49.113076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.112893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:26.748726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.312374+0000","last_change":"2024-04-24T01:27:40.312374+0000","last_active":"2024-04-24T01:27:40.312374+0000","last_peered":"2024-04-24T01:27:40.312374+0000","last_clean":"2024-04-24T01:27:40.312374+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:40.312374+0000","last_undegraded":"2024-04-24T01:27:40.312374+0000","last_fullsized":"2024-04-24T01:27:40.312374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.312210+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:26.075351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'43","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.146630+0000","last_change":"2024-04-24T01:27:23.146630+0000","last_active":"2024-04-24T01:27:23.146630+0000","last_peered":"2024-04-24T01:27:23.146630+0000","last_clean":"2024-04-24T01:27:23.146630+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:23.146630+0000","last_undegraded":"2024-04-24T01:27:23.146630+0000","last_fullsized":"2024-04-24T01:27:23.146630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.146508+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:42.897359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.041459+0000","last_change":"2024-04-24T01:27:25.041459+0000","last_active":"2024-04-24T01:27:25.041459+0000","last_peered":"2024-04-24T01:27:25.041459+0000","last_clean":"2024-04-24T01:27:25.041459+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:27:25.041459+0000","last_undegraded":"2024-04-24T01:27:25.041459+0000","last_fullsized":"2024-04-24T01:27:25.041459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.041335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.527549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.764060+0000","last_change":"2024-04-24T01:27:45.764060+0000","last_active":"2024-04-24T01:27:45.764060+0000","last_peered":"2024-04-24T01:27:45.764060+0000","last_clean":"2024-04-24T01:27:45.764060+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:27:45.764060+0000","last_undegraded":"2024-04-24T01:27:45.764060+0000","last_fullsized":"2024-04-24T01:27:45.764060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.763949+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:24.155072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.048365+0000","last_change":"2024-04-24T01:27:54.048365+0000","last_active":"2024-04-24T01:27:54.048365+0000","last_peered":"2024-04-24T01:27:54.048365+0000","last_clean":"2024-04-24T01:27:54.048365+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:27:54.048365+0000","last_undegraded":"2024-04-24T01:27:54.048365+0000","last_fullsized":"2024-04-24T01:27:54.048365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.048229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:34:31.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:26.961654+0000","last_change":"2024-04-24T01:28:26.961654+0000","last_active":"2024-04-24T01:28:26.961654+0000","last_peered":"2024-04-24T01:28:26.961654+0000","last_clean":"2024-04-24T01:28:26.961654+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:28:26.961654+0000","last_undegraded":"2024-04-24T01:28:26.961654+0000","last_fullsized":"2024-04-24T01:28:26.961654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:26.961535+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:26.961535+0000","last_clean_scrub_stamp":"2024-04-24T01:28:26.961535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:30:55.159380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.208971+0000","last_change":"2024-04-24T01:27:35.208971+0000","last_active":"2024-04-24T01:27:35.208971+0000","last_peered":"2024-04-24T01:27:35.208971+0000","last_clean":"2024-04-24T01:27:35.208971+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:27:35.208971+0000","last_undegraded":"2024-04-24T01:27:35.208971+0000","last_fullsized":"2024-04-24T01:27:35.208971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:53.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.868587+0000","last_change":"2024-04-24T01:27:51.868587+0000","last_active":"2024-04-24T01:27:51.868587+0000","last_peered":"2024-04-24T01:27:51.868587+0000","last_clean":"2024-04-24T01:27:51.868587+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:51.868587+0000","last_undegraded":"2024-04-24T01:27:51.868587+0000","last_fullsized":"2024-04-24T01:27:51.868587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.868449+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:02.837512+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":389,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.193209+0000","last_change":"2024-04-24T01:27:33.193209+0000","last_active":"2024-04-24T01:27:33.193209+0000","last_peered":"2024-04-24T01:27:33.193209+0000","last_clean":"2024-04-24T01:27:33.193209+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:33.193209+0000","last_undegraded":"2024-04-24T01:27:33.193209+0000","last_fullsized":"2024-04-24T01:27:33.193209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.193083+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:14.827477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.116526+0000","last_change":"2024-04-24T01:28:16.116526+0000","last_active":"2024-04-24T01:28:16.116526+0000","last_peered":"2024-04-24T01:28:16.116526+0000","last_clean":"2024-04-24T01:28:16.116526+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:28:16.116526+0000","last_undegraded":"2024-04-24T01:28:16.116526+0000","last_fullsized":"2024-04-24T01:28:16.116526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.116365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:36.662647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.095967+0000","last_change":"2024-04-24T01:27:46.095967+0000","last_active":"2024-04-24T01:27:46.095967+0000","last_peered":"2024-04-24T01:27:46.095967+0000","last_clean":"2024-04-24T01:27:46.095967+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:27:46.095967+0000","last_undegraded":"2024-04-24T01:27:46.095967+0000","last_fullsized":"2024-04-24T01:27:46.095967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.095813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:43:01.593908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.047166+0000","last_change":"2024-04-24T01:28:12.047166+0000","last_active":"2024-04-24T01:28:12.047166+0000","last_peered":"2024-04-24T01:28:12.047166+0000","last_clean":"2024-04-24T01:28:12.047166+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:28:12.047166+0000","last_undegraded":"2024-04-24T01:28:12.047166+0000","last_fullsized":"2024-04-24T01:28:12.047166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.047037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:46:29.031559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.200442+0000","last_change":"2024-04-24T01:27:36.200442+0000","last_active":"2024-04-24T01:27:36.200442+0000","last_peered":"2024-04-24T01:27:36.200442+0000","last_clean":"2024-04-24T01:27:36.200442+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:27:36.200442+0000","last_undegraded":"2024-04-24T01:27:36.200442+0000","last_fullsized":"2024-04-24T01:27:36.200442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.200293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.864662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.888578+0000","last_change":"2024-04-24T01:27:48.888578+0000","last_active":"2024-04-24T01:27:48.888578+0000","last_peered":"2024-04-24T01:27:48.888578+0000","last_clean":"2024-04-24T01:27:48.888578+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:48.888578+0000","last_undegraded":"2024-04-24T01:27:48.888578+0000","last_fullsized":"2024-04-24T01:27:48.888578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.888453+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:06.782682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.070118+0000","last_change":"2024-04-24T01:27:21.070118+0000","last_active":"2024-04-24T01:27:21.070118+0000","last_peered":"2024-04-24T01:27:21.070118+0000","last_clean":"2024-04-24T01:27:21.070118+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:27:21.070118+0000","last_undegraded":"2024-04-24T01:27:21.070118+0000","last_fullsized":"2024-04-24T01:27:21.070118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.070033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:24.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:21.171607+0000","last_change":"2024-04-24T01:28:21.171607+0000","last_active":"2024-04-24T01:28:21.171607+0000","last_peered":"2024-04-24T01:28:21.171607+0000","last_clean":"2024-04-24T01:28:21.171607+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:28:21.171607+0000","last_undegraded":"2024-04-24T01:28:21.171607+0000","last_fullsized":"2024-04-24T01:28:21.171607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:28:21.171436+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:28:21.171436+0000","last_clean_scrub_stamp":"2024-04-24T01:28:21.171436+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:38.910435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.963948+0000","last_change":"2024-04-24T01:28:22.963948+0000","last_active":"2024-04-24T01:28:22.963948+0000","last_peered":"2024-04-24T01:28:22.963948+0000","last_clean":"2024-04-24T01:28:22.963948+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:28:22.963948+0000","last_undegraded":"2024-04-24T01:28:22.963948+0000","last_fullsized":"2024-04-24T01:28:22.963948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:22.963758+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:22.963758+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.963758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:07.481942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.330094+0000","last_change":"2024-04-24T01:27:54.330094+0000","last_active":"2024-04-24T01:27:54.330094+0000","last_peered":"2024-04-24T01:27:54.330094+0000","last_clean":"2024-04-24T01:27:54.330094+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:27:54.330094+0000","last_undegraded":"2024-04-24T01:27:54.330094+0000","last_fullsized":"2024-04-24T01:27:54.330094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.329915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:09.474046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.022839+0000","last_change":"2024-04-24T01:27:39.022839+0000","last_active":"2024-04-24T01:27:39.022839+0000","last_peered":"2024-04-24T01:27:39.022839+0000","last_clean":"2024-04-24T01:27:39.022839+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:27:39.022839+0000","last_undegraded":"2024-04-24T01:27:39.022839+0000","last_fullsized":"2024-04-24T01:27:39.022839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.022713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:44.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.795265+0000","last_change":"2024-04-24T01:27:26.795265+0000","last_active":"2024-04-24T01:27:26.795265+0000","last_peered":"2024-04-24T01:27:26.795265+0000","last_clean":"2024-04-24T01:27:26.795265+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:26.795265+0000","last_undegraded":"2024-04-24T01:27:26.795265+0000","last_fullsized":"2024-04-24T01:27:26.795265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.795151+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:53.921283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.990277+0000","last_change":"2024-04-24T01:27:40.990277+0000","last_active":"2024-04-24T01:27:40.990277+0000","last_peered":"2024-04-24T01:27:40.990277+0000","last_clean":"2024-04-24T01:27:40.990277+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:27:40.990277+0000","last_undegraded":"2024-04-24T01:27:40.990277+0000","last_fullsized":"2024-04-24T01:27:40.990277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.990117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:52.892751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'12","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.974834+0000","last_change":"2024-04-24T01:28:06.974834+0000","last_active":"2024-04-24T01:28:06.974834+0000","last_peered":"2024-04-24T01:28:06.974834+0000","last_clean":"2024-04-24T01:28:06.974834+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:28:06.974834+0000","last_undegraded":"2024-04-24T01:28:06.974834+0000","last_fullsized":"2024-04-24T01:28:06.974834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.974708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:08.313889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.077121+0000","last_change":"2024-04-24T01:28:15.077149+0000","last_active":"2024-04-24T01:28:15.077121+0000","last_peered":"2024-04-24T01:28:15.077121+0000","last_clean":"2024-04-24T01:28:15.077121+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:28:15.077121+0000","last_undegraded":"2024-04-24T01:28:15.077121+0000","last_fullsized":"2024-04-24T01:28:15.077121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.077031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:52.551061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.011324+0000","last_change":"2024-04-24T01:28:22.011382+0000","last_active":"2024-04-24T01:28:22.011324+0000","last_peered":"2024-04-24T01:28:22.011324+0000","last_clean":"2024-04-24T01:28:22.011324+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:28:22.011324+0000","last_undegraded":"2024-04-24T01:28:22.011324+0000","last_fullsized":"2024-04-24T01:28:22.011324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:22.011213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:22.011213+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.011213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:24.578256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.249380+0000","last_change":"2024-04-24T01:27:38.249380+0000","last_active":"2024-04-24T01:27:38.249380+0000","last_peered":"2024-04-24T01:27:38.249380+0000","last_clean":"2024-04-24T01:27:38.249380+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:27:38.249380+0000","last_undegraded":"2024-04-24T01:27:38.249380+0000","last_fullsized":"2024-04-24T01:27:38.249380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.249265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:20.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.930974+0000","last_change":"2024-04-24T01:27:31.930974+0000","last_active":"2024-04-24T01:27:31.930974+0000","last_peered":"2024-04-24T01:27:31.930974+0000","last_clean":"2024-04-24T01:27:31.930974+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:31.930974+0000","last_undegraded":"2024-04-24T01:27:31.930974+0000","last_fullsized":"2024-04-24T01:27:31.930974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.930805+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:07.030096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.862447+0000","last_change":"2024-04-24T01:27:25.862447+0000","last_active":"2024-04-24T01:27:25.862447+0000","last_peered":"2024-04-24T01:27:25.862447+0000","last_clean":"2024-04-24T01:27:25.862447+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:25.862447+0000","last_undegraded":"2024-04-24T01:27:25.862447+0000","last_fullsized":"2024-04-24T01:27:25.862447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.862292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:06.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.291445+0000","last_change":"2024-04-24T01:27:49.291445+0000","last_active":"2024-04-24T01:27:49.291445+0000","last_peered":"2024-04-24T01:27:49.291445+0000","last_clean":"2024-04-24T01:27:49.291445+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:27:49.291445+0000","last_undegraded":"2024-04-24T01:27:49.291445+0000","last_fullsized":"2024-04-24T01:27:49.291445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.291293+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:16.626192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.091349+0000","last_change":"2024-04-24T01:27:58.091349+0000","last_active":"2024-04-24T01:27:58.091349+0000","last_peered":"2024-04-24T01:27:58.091349+0000","last_clean":"2024-04-24T01:27:58.091349+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:58.091349+0000","last_undegraded":"2024-04-24T01:27:58.091349+0000","last_fullsized":"2024-04-24T01:27:58.091349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.091198+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:10.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.001582+0000","last_change":"2024-04-24T01:28:20.001609+0000","last_active":"2024-04-24T01:28:20.001582+0000","last_peered":"2024-04-24T01:28:20.001582+0000","last_clean":"2024-04-24T01:28:20.001582+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:28:20.001582+0000","last_undegraded":"2024-04-24T01:28:20.001582+0000","last_fullsized":"2024-04-24T01:28:20.001582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:20.001483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:20.001483+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.001483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:37.817459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.716690+0000","last_change":"2024-04-24T01:27:35.716690+0000","last_active":"2024-04-24T01:27:35.716690+0000","last_peered":"2024-04-24T01:27:35.716690+0000","last_clean":"2024-04-24T01:27:35.716690+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:35.716690+0000","last_undegraded":"2024-04-24T01:27:35.716690+0000","last_fullsized":"2024-04-24T01:27:35.716690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.716538+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:45.474001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.061416+0000","last_change":"2024-04-24T01:27:39.061416+0000","last_active":"2024-04-24T01:27:39.061416+0000","last_peered":"2024-04-24T01:27:39.061416+0000","last_clean":"2024-04-24T01:27:39.061416+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:27:39.061416+0000","last_undegraded":"2024-04-24T01:27:39.061416+0000","last_fullsized":"2024-04-24T01:27:39.061416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.061278+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:42.587769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":472,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.819879+0000","last_change":"2024-04-24T01:27:21.819879+0000","last_active":"2024-04-24T01:27:21.819879+0000","last_peered":"2024-04-24T01:27:21.819879+0000","last_clean":"2024-04-24T01:27:21.819879+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:21.819879+0000","last_undegraded":"2024-04-24T01:27:21.819879+0000","last_fullsized":"2024-04-24T01:27:21.819879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.819685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:51.931578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.010031+0000","last_change":"2024-04-24T01:27:42.010031+0000","last_active":"2024-04-24T01:27:42.010031+0000","last_peered":"2024-04-24T01:27:42.010031+0000","last_clean":"2024-04-24T01:27:42.010031+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:27:42.010031+0000","last_undegraded":"2024-04-24T01:27:42.010031+0000","last_fullsized":"2024-04-24T01:27:42.010031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.009873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:39.421872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.891623+0000","last_change":"2024-04-24T01:28:01.891623+0000","last_active":"2024-04-24T01:28:01.891623+0000","last_peered":"2024-04-24T01:28:01.891623+0000","last_clean":"2024-04-24T01:28:01.891623+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:28:01.891623+0000","last_undegraded":"2024-04-24T01:28:01.891623+0000","last_fullsized":"2024-04-24T01:28:01.891623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.891503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:18.375150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.053931+0000","last_change":"2024-04-24T01:28:14.053931+0000","last_active":"2024-04-24T01:28:14.053931+0000","last_peered":"2024-04-24T01:28:14.053931+0000","last_clean":"2024-04-24T01:28:14.053931+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:28:14.053931+0000","last_undegraded":"2024-04-24T01:28:14.053931+0000","last_fullsized":"2024-04-24T01:28:14.053931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.053794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:31.641010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.040427+0000","last_change":"2024-04-24T01:27:32.040427+0000","last_active":"2024-04-24T01:27:32.040427+0000","last_peered":"2024-04-24T01:27:32.040427+0000","last_clean":"2024-04-24T01:27:32.040427+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:27:32.040427+0000","last_undegraded":"2024-04-24T01:27:32.040427+0000","last_fullsized":"2024-04-24T01:27:32.040427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.040303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:24.647469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.834021+0000","last_change":"2024-04-24T01:27:27.834021+0000","last_active":"2024-04-24T01:27:27.834021+0000","last_peered":"2024-04-24T01:27:27.834021+0000","last_clean":"2024-04-24T01:27:27.834021+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:27.834021+0000","last_undegraded":"2024-04-24T01:27:27.834021+0000","last_fullsized":"2024-04-24T01:27:27.834021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.833839+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:51:49.939141+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.839921+0000","last_change":"2024-04-24T01:27:21.839921+0000","last_active":"2024-04-24T01:27:21.839921+0000","last_peered":"2024-04-24T01:27:21.839921+0000","last_clean":"2024-04-24T01:27:21.839921+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:27:21.839921+0000","last_undegraded":"2024-04-24T01:27:21.839921+0000","last_fullsized":"2024-04-24T01:27:21.839921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:25.887464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.781113+0000","last_change":"2024-04-24T01:27:41.781113+0000","last_active":"2024-04-24T01:27:41.781113+0000","last_peered":"2024-04-24T01:27:41.781113+0000","last_clean":"2024-04-24T01:27:41.781113+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:41.781113+0000","last_undegraded":"2024-04-24T01:27:41.781113+0000","last_fullsized":"2024-04-24T01:27:41.781113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.781002+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:01.531853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.009852+0000","last_change":"2024-04-24T01:27:38.009852+0000","last_active":"2024-04-24T01:27:38.009852+0000","last_peered":"2024-04-24T01:27:38.009852+0000","last_clean":"2024-04-24T01:27:38.009852+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:38.009852+0000","last_undegraded":"2024-04-24T01:27:38.009852+0000","last_fullsized":"2024-04-24T01:27:38.009852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.009727+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:13.773436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.840720+0000","last_change":"2024-04-24T01:28:07.840757+0000","last_active":"2024-04-24T01:28:07.840720+0000","last_peered":"2024-04-24T01:28:07.840720+0000","last_clean":"2024-04-24T01:28:07.840720+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:28:07.840720+0000","last_undegraded":"2024-04-24T01:28:07.840720+0000","last_fullsized":"2024-04-24T01:28:07.840720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.840634+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:16:33.976498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:31.868412+0000","last_change":"2024-04-24T01:28:31.868436+0000","last_active":"2024-04-24T01:28:31.868412+0000","last_peered":"2024-04-24T01:28:31.868412+0000","last_clean":"2024-04-24T01:28:31.868412+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:28:31.868412+0000","last_undegraded":"2024-04-24T01:28:31.868412+0000","last_fullsized":"2024-04-24T01:28:31.868412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:31.868324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:31.868324+0000","last_clean_scrub_stamp":"2024-04-24T01:28:31.868324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:56.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:36.856060+0000","last_change":"2024-04-24T01:28:36.856087+0000","last_active":"2024-04-24T01:28:36.856060+0000","last_peered":"2024-04-24T01:28:36.856060+0000","last_clean":"2024-04-24T01:28:36.856060+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:28:36.856060+0000","last_undegraded":"2024-04-24T01:28:36.856060+0000","last_fullsized":"2024-04-24T01:28:36.856060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:36.855956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:36.855956+0000","last_clean_scrub_stamp":"2024-04-24T01:28:36.855956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:38.122105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:21.919820+0000","last_change":"2024-04-24T01:28:21.919843+0000","last_active":"2024-04-24T01:28:21.919820+0000","last_peered":"2024-04-24T01:28:21.919820+0000","last_clean":"2024-04-24T01:28:21.919820+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:28:21.919820+0000","last_undegraded":"2024-04-24T01:28:21.919820+0000","last_fullsized":"2024-04-24T01:28:21.919820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:21.919728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:21.919728+0000","last_clean_scrub_stamp":"2024-04-24T01:28:21.919728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:13.218711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.123918+0000","last_change":"2024-04-24T01:27:27.123918+0000","last_active":"2024-04-24T01:27:27.123918+0000","last_peered":"2024-04-24T01:27:27.123918+0000","last_clean":"2024-04-24T01:27:27.123918+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:27.123918+0000","last_undegraded":"2024-04-24T01:27:27.123918+0000","last_fullsized":"2024-04-24T01:27:27.123918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.123786+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:04.256795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.112111+0000","last_change":"2024-04-24T01:27:29.112111+0000","last_active":"2024-04-24T01:27:29.112111+0000","last_peered":"2024-04-24T01:27:29.112111+0000","last_clean":"2024-04-24T01:27:29.112111+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:27:29.112111+0000","last_undegraded":"2024-04-24T01:27:29.112111+0000","last_fullsized":"2024-04-24T01:27:29.112111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.111929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:30.720342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.978931+0000","last_change":"2024-04-24T01:27:37.978931+0000","last_active":"2024-04-24T01:27:37.978931+0000","last_peered":"2024-04-24T01:27:37.978931+0000","last_clean":"2024-04-24T01:27:37.978931+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:37.978931+0000","last_undegraded":"2024-04-24T01:27:37.978931+0000","last_fullsized":"2024-04-24T01:27:37.978931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.978807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:55.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.938286+0000","last_change":"2024-04-24T01:27:56.938286+0000","last_active":"2024-04-24T01:27:56.938286+0000","last_peered":"2024-04-24T01:27:56.938286+0000","last_clean":"2024-04-24T01:27:56.938286+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:27:56.938286+0000","last_undegraded":"2024-04-24T01:27:56.938286+0000","last_fullsized":"2024-04-24T01:27:56.938286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.938134+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:59.400837+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:29.892015+0000","last_change":"2024-04-24T01:28:29.892039+0000","last_active":"2024-04-24T01:28:29.892015+0000","last_peered":"2024-04-24T01:28:29.892015+0000","last_clean":"2024-04-24T01:28:29.892015+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:28:29.892015+0000","last_undegraded":"2024-04-24T01:28:29.892015+0000","last_fullsized":"2024-04-24T01:28:29.892015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:29.891923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:29.891923+0000","last_clean_scrub_stamp":"2024-04-24T01:28:29.891923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:00:34.694662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.180653+0000","last_change":"2024-04-24T01:28:06.180653+0000","last_active":"2024-04-24T01:28:06.180653+0000","last_peered":"2024-04-24T01:28:06.180653+0000","last_clean":"2024-04-24T01:28:06.180653+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:28:06.180653+0000","last_undegraded":"2024-04-24T01:28:06.180653+0000","last_fullsized":"2024-04-24T01:28:06.180653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.180538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:45.452260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.112872+0000","last_change":"2024-04-24T01:27:24.112872+0000","last_active":"2024-04-24T01:27:24.112872+0000","last_peered":"2024-04-24T01:27:24.112872+0000","last_clean":"2024-04-24T01:27:24.112872+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:27:24.112872+0000","last_undegraded":"2024-04-24T01:27:24.112872+0000","last_fullsized":"2024-04-24T01:27:24.112872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.112716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:45.026444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.829636+0000","last_change":"2024-04-24T01:27:23.829636+0000","last_active":"2024-04-24T01:27:23.829636+0000","last_peered":"2024-04-24T01:27:23.829636+0000","last_clean":"2024-04-24T01:27:23.829636+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:23.829636+0000","last_undegraded":"2024-04-24T01:27:23.829636+0000","last_fullsized":"2024-04-24T01:27:23.829636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.829451+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:41.027361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.953224+0000","last_change":"2024-04-24T01:27:41.953224+0000","last_active":"2024-04-24T01:27:41.953224+0000","last_peered":"2024-04-24T01:27:41.953224+0000","last_clean":"2024-04-24T01:27:41.953224+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:27:41.953224+0000","last_undegraded":"2024-04-24T01:27:41.953224+0000","last_fullsized":"2024-04-24T01:27:41.953224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.953108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:10.618830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.753087+0000","last_change":"2024-04-24T01:27:49.753087+0000","last_active":"2024-04-24T01:27:49.753087+0000","last_peered":"2024-04-24T01:27:49.753087+0000","last_clean":"2024-04-24T01:27:49.753087+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:27:49.753087+0000","last_undegraded":"2024-04-24T01:27:49.753087+0000","last_fullsized":"2024-04-24T01:27:49.753087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.752922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.966181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.285843+0000","last_change":"2024-04-24T01:27:47.285843+0000","last_active":"2024-04-24T01:27:47.285843+0000","last_peered":"2024-04-24T01:27:47.285843+0000","last_clean":"2024-04-24T01:27:47.285843+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:47.285843+0000","last_undegraded":"2024-04-24T01:27:47.285843+0000","last_fullsized":"2024-04-24T01:27:47.285843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.285734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:56.799840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.112054+0000","last_change":"2024-04-24T01:28:00.112079+0000","last_active":"2024-04-24T01:28:00.112054+0000","last_peered":"2024-04-24T01:28:00.112054+0000","last_clean":"2024-04-24T01:28:00.112054+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:28:00.112054+0000","last_undegraded":"2024-04-24T01:28:00.112054+0000","last_fullsized":"2024-04-24T01:28:00.112054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.111972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:11.268871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.234409+0000","last_change":"2024-04-24T01:27:58.234409+0000","last_active":"2024-04-24T01:27:58.234409+0000","last_peered":"2024-04-24T01:27:58.234409+0000","last_clean":"2024-04-24T01:27:58.234409+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:27:58.234409+0000","last_undegraded":"2024-04-24T01:27:58.234409+0000","last_fullsized":"2024-04-24T01:27:58.234409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.234292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:31.772695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'4","reported_seq":233,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.917133+0000","last_change":"2024-04-24T01:27:35.917133+0000","last_active":"2024-04-24T01:27:35.917133+0000","last_peered":"2024-04-24T01:27:35.917133+0000","last_clean":"2024-04-24T01:27:35.917133+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:35.917133+0000","last_undegraded":"2024-04-24T01:27:35.917133+0000","last_fullsized":"2024-04-24T01:27:35.917133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.916997+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:07.090816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.905612+0000","last_change":"2024-04-24T01:27:27.905612+0000","last_active":"2024-04-24T01:27:27.905612+0000","last_peered":"2024-04-24T01:27:27.905612+0000","last_clean":"2024-04-24T01:27:27.905612+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:27.905612+0000","last_undegraded":"2024-04-24T01:27:27.905612+0000","last_fullsized":"2024-04-24T01:27:27.905612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.905478+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:29.454916+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.318338+0000","last_change":"2024-04-24T01:27:41.318338+0000","last_active":"2024-04-24T01:27:41.318338+0000","last_peered":"2024-04-24T01:27:41.318338+0000","last_clean":"2024-04-24T01:27:41.318338+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:27:41.318338+0000","last_undegraded":"2024-04-24T01:27:41.318338+0000","last_fullsized":"2024-04-24T01:27:41.318338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.318182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:55:53.255679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.089414+0000","last_change":"2024-04-24T01:24:08.775874+0000","last_active":"2024-04-24T01:27:21.089414+0000","last_peered":"2024-04-24T01:27:21.089414+0000","last_clean":"2024-04-24T01:27:21.089414+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:27:21.089414+0000","last_undegraded":"2024-04-24T01:27:21.089414+0000","last_fullsized":"2024-04-24T01:27:21.089414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.266085+0000","last_change":"2024-04-24T01:27:51.266085+0000","last_active":"2024-04-24T01:27:51.266085+0000","last_peered":"2024-04-24T01:27:51.266085+0000","last_clean":"2024-04-24T01:27:51.266085+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:51.266085+0000","last_undegraded":"2024-04-24T01:27:51.266085+0000","last_fullsized":"2024-04-24T01:27:51.266085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.265934+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:09:26.486398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:30.878943+0000","last_change":"2024-04-24T01:28:30.878968+0000","last_active":"2024-04-24T01:28:30.878943+0000","last_peered":"2024-04-24T01:28:30.878943+0000","last_clean":"2024-04-24T01:28:30.878943+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:28:30.878943+0000","last_undegraded":"2024-04-24T01:28:30.878943+0000","last_fullsized":"2024-04-24T01:28:30.878943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:30.878842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:30.878842+0000","last_clean_scrub_stamp":"2024-04-24T01:28:30.878842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:59.394810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.125139+0000","last_change":"2024-04-24T01:28:05.125139+0000","last_active":"2024-04-24T01:28:05.125139+0000","last_peered":"2024-04-24T01:28:05.125139+0000","last_clean":"2024-04-24T01:28:05.125139+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:28:05.125139+0000","last_undegraded":"2024-04-24T01:28:05.125139+0000","last_fullsized":"2024-04-24T01:28:05.125139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.125023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:40.888731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.359505+0000","last_change":"2024-04-24T01:27:43.359505+0000","last_active":"2024-04-24T01:27:43.359505+0000","last_peered":"2024-04-24T01:27:43.359505+0000","last_clean":"2024-04-24T01:27:43.359505+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:27:43.359505+0000","last_undegraded":"2024-04-24T01:27:43.359505+0000","last_fullsized":"2024-04-24T01:27:43.359505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.359390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:55.127868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.923613+0000","last_change":"2024-04-24T01:27:49.923613+0000","last_active":"2024-04-24T01:27:49.923613+0000","last_peered":"2024-04-24T01:27:49.923613+0000","last_clean":"2024-04-24T01:27:49.923613+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:49.923613+0000","last_undegraded":"2024-04-24T01:27:49.923613+0000","last_fullsized":"2024-04-24T01:27:49.923613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.923469+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:10.601774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.002143+0000","last_change":"2024-04-24T01:27:44.002143+0000","last_active":"2024-04-24T01:27:44.002143+0000","last_peered":"2024-04-24T01:27:44.002143+0000","last_clean":"2024-04-24T01:27:44.002143+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:27:44.002143+0000","last_undegraded":"2024-04-24T01:27:44.002143+0000","last_fullsized":"2024-04-24T01:27:44.002143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.001993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:46.800003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:19.951190+0000","last_change":"2024-04-24T01:28:19.951190+0000","last_active":"2024-04-24T01:28:19.951190+0000","last_peered":"2024-04-24T01:28:19.951190+0000","last_clean":"2024-04-24T01:28:19.951190+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:28:19.951190+0000","last_undegraded":"2024-04-24T01:28:19.951190+0000","last_fullsized":"2024-04-24T01:28:19.951190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:19.951073+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:19.951073+0000","last_clean_scrub_stamp":"2024-04-24T01:28:19.951073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:29.570244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.764536+0000","last_change":"2024-04-24T01:27:57.764536+0000","last_active":"2024-04-24T01:27:57.764536+0000","last_peered":"2024-04-24T01:27:57.764536+0000","last_clean":"2024-04-24T01:27:57.764536+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:57.764536+0000","last_undegraded":"2024-04-24T01:27:57.764536+0000","last_fullsized":"2024-04-24T01:27:57.764536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.764420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:01.699221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.042782+0000","last_change":"2024-04-24T01:27:55.042782+0000","last_active":"2024-04-24T01:27:55.042782+0000","last_peered":"2024-04-24T01:27:55.042782+0000","last_clean":"2024-04-24T01:27:55.042782+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:55.042782+0000","last_undegraded":"2024-04-24T01:27:55.042782+0000","last_fullsized":"2024-04-24T01:27:55.042782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.042621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:01:44.687742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.174050+0000","last_change":"2024-04-24T01:28:08.174089+0000","last_active":"2024-04-24T01:28:08.174050+0000","last_peered":"2024-04-24T01:28:08.174050+0000","last_clean":"2024-04-24T01:28:08.174050+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:28:08.174050+0000","last_undegraded":"2024-04-24T01:28:08.174050+0000","last_fullsized":"2024-04-24T01:28:08.174050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.173899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:18.830246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.316856+0000","last_change":"2024-04-24T01:27:44.316856+0000","last_active":"2024-04-24T01:27:44.316856+0000","last_peered":"2024-04-24T01:27:44.316856+0000","last_clean":"2024-04-24T01:27:44.316856+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:44.316856+0000","last_undegraded":"2024-04-24T01:27:44.316856+0000","last_fullsized":"2024-04-24T01:27:44.316856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.316675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:19.698338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'88","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.086861+0000","last_change":"2024-04-24T01:27:27.086861+0000","last_active":"2024-04-24T01:27:27.086861+0000","last_peered":"2024-04-24T01:27:27.086861+0000","last_clean":"2024-04-24T01:27:27.086861+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:27.086861+0000","last_undegraded":"2024-04-24T01:27:27.086861+0000","last_fullsized":"2024-04-24T01:27:27.086861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'88","last_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_deep_scrub":"34'88","last_deep_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.086724+0000","objects_scrubbed":11,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:32.526409+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.902351+0000","last_change":"2024-04-24T01:27:29.902351+0000","last_active":"2024-04-24T01:27:29.902351+0000","last_peered":"2024-04-24T01:27:29.902351+0000","last_clean":"2024-04-24T01:27:29.902351+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:27:29.902351+0000","last_undegraded":"2024-04-24T01:27:29.902351+0000","last_fullsized":"2024-04-24T01:27:29.902351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.902169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:02.390606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.131261+0000","last_change":"2024-04-24T01:28:20.131290+0000","last_active":"2024-04-24T01:28:20.131261+0000","last_peered":"2024-04-24T01:28:20.131261+0000","last_clean":"2024-04-24T01:28:20.131261+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:28:20.131261+0000","last_undegraded":"2024-04-24T01:28:20.131261+0000","last_fullsized":"2024-04-24T01:28:20.131261+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-24T01:28:20.131163+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-24T01:28:20.131163+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.131163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:16.775973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.768560+0000","last_change":"2024-04-24T01:27:55.768560+0000","last_active":"2024-04-24T01:27:55.768560+0000","last_peered":"2024-04-24T01:27:55.768560+0000","last_clean":"2024-04-24T01:27:55.768560+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:55.768560+0000","last_undegraded":"2024-04-24T01:27:55.768560+0000","last_fullsized":"2024-04-24T01:27:55.768560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.768450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:38.395793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.133523+0000","last_change":"2024-04-24T01:28:13.133547+0000","last_active":"2024-04-24T01:28:13.133523+0000","last_peered":"2024-04-24T01:28:13.133523+0000","last_clean":"2024-04-24T01:28:13.133523+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:28:13.133523+0000","last_undegraded":"2024-04-24T01:28:13.133523+0000","last_fullsized":"2024-04-24T01:28:13.133523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.133431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:35.842301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:28.908528+0000","last_change":"2024-04-24T01:28:28.908552+0000","last_active":"2024-04-24T01:28:28.908528+0000","last_peered":"2024-04-24T01:28:28.908528+0000","last_clean":"2024-04-24T01:28:28.908528+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:28:28.908528+0000","last_undegraded":"2024-04-24T01:28:28.908528+0000","last_fullsized":"2024-04-24T01:28:28.908528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:28.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:28.908436+0000","last_clean_scrub_stamp":"2024-04-24T01:28:28.908436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:20:07.474910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.079211+0000","last_change":"2024-04-24T01:27:26.079211+0000","last_active":"2024-04-24T01:27:26.079211+0000","last_peered":"2024-04-24T01:27:26.079211+0000","last_clean":"2024-04-24T01:27:26.079211+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:27:26.079211+0000","last_undegraded":"2024-04-24T01:27:26.079211+0000","last_fullsized":"2024-04-24T01:27:26.079211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.079098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:16:40.353572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.825422+0000","last_change":"2024-04-24T01:27:24.825422+0000","last_active":"2024-04-24T01:27:24.825422+0000","last_peered":"2024-04-24T01:27:24.825422+0000","last_clean":"2024-04-24T01:27:24.825422+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:27:24.825422+0000","last_undegraded":"2024-04-24T01:27:24.825422+0000","last_fullsized":"2024-04-24T01:27:24.825422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.825285+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:34.030557+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.840969+0000","last_change":"2024-04-24T01:27:25.840969+0000","last_active":"2024-04-24T01:27:25.840969+0000","last_peered":"2024-04-24T01:27:25.840969+0000","last_clean":"2024-04-24T01:27:25.840969+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:25.840969+0000","last_undegraded":"2024-04-24T01:27:25.840969+0000","last_fullsized":"2024-04-24T01:27:25.840969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.840846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:46:26.499751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.017138+0000","last_change":"2024-04-24T01:27:59.017138+0000","last_active":"2024-04-24T01:27:59.017138+0000","last_peered":"2024-04-24T01:27:59.017138+0000","last_clean":"2024-04-24T01:27:59.017138+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:27:59.017138+0000","last_undegraded":"2024-04-24T01:27:59.017138+0000","last_fullsized":"2024-04-24T01:27:59.017138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.017023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:20.258126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.981815+0000","last_change":"2024-04-24T01:27:36.981815+0000","last_active":"2024-04-24T01:27:36.981815+0000","last_peered":"2024-04-24T01:27:36.981815+0000","last_clean":"2024-04-24T01:27:36.981815+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:27:36.981815+0000","last_undegraded":"2024-04-24T01:27:36.981815+0000","last_fullsized":"2024-04-24T01:27:36.981815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.981689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:02.218699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.976878+0000","last_change":"2024-04-24T01:28:09.976878+0000","last_active":"2024-04-24T01:28:09.976878+0000","last_peered":"2024-04-24T01:28:09.976878+0000","last_clean":"2024-04-24T01:28:09.976878+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:28:09.976878+0000","last_undegraded":"2024-04-24T01:28:09.976878+0000","last_fullsized":"2024-04-24T01:28:09.976878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.976742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:54.442355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.223313+0000","last_change":"2024-04-24T01:28:07.223313+0000","last_active":"2024-04-24T01:28:07.223313+0000","last_peered":"2024-04-24T01:28:07.223313+0000","last_clean":"2024-04-24T01:28:07.223313+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:28:07.223313+0000","last_undegraded":"2024-04-24T01:28:07.223313+0000","last_fullsized":"2024-04-24T01:28:07.223313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.223157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.453523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.088814+0000","last_change":"2024-04-24T01:24:39.799418+0000","last_active":"2024-04-24T01:27:21.088814+0000","last_peered":"2024-04-24T01:27:21.088814+0000","last_clean":"2024-04-24T01:27:21.088814+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:27:21.088814+0000","last_undegraded":"2024-04-24T01:27:21.088814+0000","last_fullsized":"2024-04-24T01:27:21.088814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:01.719664+0000","last_clean_scrub_stamp":"2024-04-24T01:24:01.719664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.936683+0000","last_change":"2024-04-24T01:27:45.936683+0000","last_active":"2024-04-24T01:27:45.936683+0000","last_peered":"2024-04-24T01:27:45.936683+0000","last_clean":"2024-04-24T01:27:45.936683+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:27:45.936683+0000","last_undegraded":"2024-04-24T01:27:45.936683+0000","last_fullsized":"2024-04-24T01:27:45.936683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.936543+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:45.566244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.031922+0000","last_change":"2024-04-24T01:27:26.031922+0000","last_active":"2024-04-24T01:27:26.031922+0000","last_peered":"2024-04-24T01:27:26.031922+0000","last_clean":"2024-04-24T01:27:26.031922+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:26.031922+0000","last_undegraded":"2024-04-24T01:27:26.031922+0000","last_fullsized":"2024-04-24T01:27:26.031922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.031809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:08.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.899565+0000","last_change":"2024-04-24T01:28:17.899565+0000","last_active":"2024-04-24T01:28:17.899565+0000","last_peered":"2024-04-24T01:28:17.899565+0000","last_clean":"2024-04-24T01:28:17.899565+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:28:17.899565+0000","last_undegraded":"2024-04-24T01:28:17.899565+0000","last_fullsized":"2024-04-24T01:28:17.899565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.899414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:39.140517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.099400+0000","last_change":"2024-04-24T01:28:08.099400+0000","last_active":"2024-04-24T01:28:08.099400+0000","last_peered":"2024-04-24T01:28:08.099400+0000","last_clean":"2024-04-24T01:28:08.099400+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:28:08.099400+0000","last_undegraded":"2024-04-24T01:28:08.099400+0000","last_fullsized":"2024-04-24T01:28:08.099400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.099278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:59:08.168998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.836355+0000","last_change":"2024-04-24T01:28:11.836355+0000","last_active":"2024-04-24T01:28:11.836355+0000","last_peered":"2024-04-24T01:28:11.836355+0000","last_clean":"2024-04-24T01:28:11.836355+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:28:11.836355+0000","last_undegraded":"2024-04-24T01:28:11.836355+0000","last_fullsized":"2024-04-24T01:28:11.836355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.836242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:31.148213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:32.826110+0000","last_change":"2024-04-24T01:28:32.826134+0000","last_active":"2024-04-24T01:28:32.826110+0000","last_peered":"2024-04-24T01:28:32.826110+0000","last_clean":"2024-04-24T01:28:32.826110+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:28:32.826110+0000","last_undegraded":"2024-04-24T01:28:32.826110+0000","last_fullsized":"2024-04-24T01:28:32.826110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:32.826015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:32.826015+0000","last_clean_scrub_stamp":"2024-04-24T01:28:32.826015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:17.800836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.157304+0000","last_change":"2024-04-24T01:27:21.157304+0000","last_active":"2024-04-24T01:27:21.157304+0000","last_peered":"2024-04-24T01:27:21.157304+0000","last_clean":"2024-04-24T01:27:21.157304+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:27:21.157304+0000","last_undegraded":"2024-04-24T01:27:21.157304+0000","last_fullsized":"2024-04-24T01:27:21.157304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.157174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:08.856778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.850725+0000","last_change":"2024-04-24T01:27:24.850725+0000","last_active":"2024-04-24T01:27:24.850725+0000","last_peered":"2024-04-24T01:27:24.850725+0000","last_clean":"2024-04-24T01:27:24.850725+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:24.850725+0000","last_undegraded":"2024-04-24T01:27:24.850725+0000","last_fullsized":"2024-04-24T01:27:24.850725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.850572+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:25.939996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.111936+0000","last_change":"2024-04-24T01:27:20.111936+0000","last_active":"2024-04-24T01:27:20.111936+0000","last_peered":"2024-04-24T01:27:20.111936+0000","last_clean":"2024-04-24T01:27:20.111936+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:27:20.111936+0000","last_undegraded":"2024-04-24T01:27:20.111936+0000","last_fullsized":"2024-04-24T01:27:20.111936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.111793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:00.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.148836+0000","last_change":"2024-04-24T01:28:09.148836+0000","last_active":"2024-04-24T01:28:09.148836+0000","last_peered":"2024-04-24T01:28:09.148836+0000","last_clean":"2024-04-24T01:28:09.148836+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:28:09.148836+0000","last_undegraded":"2024-04-24T01:28:09.148836+0000","last_fullsized":"2024-04-24T01:28:09.148836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.148692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:37.814414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.170629+0000","last_change":"2024-04-24T01:28:11.170629+0000","last_active":"2024-04-24T01:28:11.170629+0000","last_peered":"2024-04-24T01:28:11.170629+0000","last_clean":"2024-04-24T01:28:11.170629+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:28:11.170629+0000","last_undegraded":"2024-04-24T01:28:11.170629+0000","last_fullsized":"2024-04-24T01:28:11.170629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.170504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:38:30.319203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.103039+0000","last_change":"2024-04-24T01:27:50.103068+0000","last_active":"2024-04-24T01:27:50.103039+0000","last_peered":"2024-04-24T01:27:50.103039+0000","last_clean":"2024-04-24T01:27:50.103039+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:27:50.103039+0000","last_undegraded":"2024-04-24T01:27:50.103039+0000","last_fullsized":"2024-04-24T01:27:50.103039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.102944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:05.909709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:23.032609+0000","last_change":"2024-04-24T01:28:23.032609+0000","last_active":"2024-04-24T01:28:23.032609+0000","last_peered":"2024-04-24T01:28:23.032609+0000","last_clean":"2024-04-24T01:28:23.032609+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:28:23.032609+0000","last_undegraded":"2024-04-24T01:28:23.032609+0000","last_fullsized":"2024-04-24T01:28:23.032609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:23.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:23.032499+0000","last_clean_scrub_stamp":"2024-04-24T01:28:23.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:19.871990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.764420+0000","last_change":"2024-04-24T01:27:38.764441+0000","last_active":"2024-04-24T01:27:38.764420+0000","last_peered":"2024-04-24T01:27:38.764420+0000","last_clean":"2024-04-24T01:27:38.764420+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:27:38.764420+0000","last_undegraded":"2024-04-24T01:27:38.764420+0000","last_fullsized":"2024-04-24T01:27:38.764420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.764324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:54.262419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.087710+0000","last_change":"2024-04-24T01:27:31.087751+0000","last_active":"2024-04-24T01:27:31.087710+0000","last_peered":"2024-04-24T01:27:31.087710+0000","last_clean":"2024-04-24T01:27:31.087710+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:31.087710+0000","last_undegraded":"2024-04-24T01:27:31.087710+0000","last_fullsized":"2024-04-24T01:27:31.087710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.087607+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:17.401970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.881538+0000","last_change":"2024-04-24T01:27:50.881559+0000","last_active":"2024-04-24T01:27:50.881538+0000","last_peered":"2024-04-24T01:27:50.881538+0000","last_clean":"2024-04-24T01:27:50.881538+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:27:50.881538+0000","last_undegraded":"2024-04-24T01:27:50.881538+0000","last_fullsized":"2024-04-24T01:27:50.881538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.881443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:57.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.205265+0000","last_change":"2024-04-24T01:28:22.205292+0000","last_active":"2024-04-24T01:28:22.205265+0000","last_peered":"2024-04-24T01:28:22.205265+0000","last_clean":"2024-04-24T01:28:22.205265+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:28:22.205265+0000","last_undegraded":"2024-04-24T01:28:22.205265+0000","last_fullsized":"2024-04-24T01:28:22.205265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-04-24T01:28:22.205176+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-04-24T01:28:22.205176+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.205176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:03.929937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.832739+0000","last_change":"2024-04-24T01:28:03.832778+0000","last_active":"2024-04-24T01:28:03.832739+0000","last_peered":"2024-04-24T01:28:03.832739+0000","last_clean":"2024-04-24T01:28:03.832739+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:28:03.832739+0000","last_undegraded":"2024-04-24T01:28:03.832739+0000","last_fullsized":"2024-04-24T01:28:03.832739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.832618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:59.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.044213+0000","last_change":"2024-04-24T01:27:57.044241+0000","last_active":"2024-04-24T01:27:57.044213+0000","last_peered":"2024-04-24T01:27:57.044213+0000","last_clean":"2024-04-24T01:27:57.044213+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:57.044213+0000","last_undegraded":"2024-04-24T01:27:57.044213+0000","last_fullsized":"2024-04-24T01:27:57.044213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.044128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:43.358491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.142890+0000","last_change":"2024-04-24T01:27:29.142915+0000","last_active":"2024-04-24T01:27:29.142890+0000","last_peered":"2024-04-24T01:27:29.142890+0000","last_clean":"2024-04-24T01:27:29.142890+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:27:29.142890+0000","last_undegraded":"2024-04-24T01:27:29.142890+0000","last_fullsized":"2024-04-24T01:27:29.142890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.142798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:45.905908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.183889+0000","last_change":"2024-04-24T01:27:34.183920+0000","last_active":"2024-04-24T01:27:34.183889+0000","last_peered":"2024-04-24T01:27:34.183889+0000","last_clean":"2024-04-24T01:27:34.183889+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:34.183889+0000","last_undegraded":"2024-04-24T01:27:34.183889+0000","last_fullsized":"2024-04-24T01:27:34.183889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.183806+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:12.698513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.807860+0000","last_change":"2024-04-24T01:27:23.807924+0000","last_active":"2024-04-24T01:27:23.807860+0000","last_peered":"2024-04-24T01:27:23.807860+0000","last_clean":"2024-04-24T01:27:23.807860+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:27:23.807860+0000","last_undegraded":"2024-04-24T01:27:23.807860+0000","last_fullsized":"2024-04-24T01:27:23.807860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.807746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:16.346274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.094421+0000","last_change":"2024-04-24T01:28:18.094448+0000","last_active":"2024-04-24T01:28:18.094421+0000","last_peered":"2024-04-24T01:28:18.094421+0000","last_clean":"2024-04-24T01:28:18.094421+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:28:18.094421+0000","last_undegraded":"2024-04-24T01:28:18.094421+0000","last_fullsized":"2024-04-24T01:28:18.094421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:18.094335+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:18.094335+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.094335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:21.982836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.205483+0000","last_change":"2024-04-24T01:28:05.205539+0000","last_active":"2024-04-24T01:28:05.205483+0000","last_peered":"2024-04-24T01:28:05.205483+0000","last_clean":"2024-04-24T01:28:05.205483+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:28:05.205483+0000","last_undegraded":"2024-04-24T01:28:05.205483+0000","last_fullsized":"2024-04-24T01:28:05.205483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.205385+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:24.593592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.105393+0000","last_change":"2024-04-24T01:28:03.105447+0000","last_active":"2024-04-24T01:28:03.105393+0000","last_peered":"2024-04-24T01:28:03.105393+0000","last_clean":"2024-04-24T01:28:03.105393+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:28:03.105393+0000","last_undegraded":"2024-04-24T01:28:03.105393+0000","last_fullsized":"2024-04-24T01:28:03.105393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.105283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:07.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.931167+0000","last_change":"2024-04-24T01:27:36.931202+0000","last_active":"2024-04-24T01:27:36.931167+0000","last_peered":"2024-04-24T01:27:36.931167+0000","last_clean":"2024-04-24T01:27:36.931167+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:27:36.931167+0000","last_undegraded":"2024-04-24T01:27:36.931167+0000","last_fullsized":"2024-04-24T01:27:36.931167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.931078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:03.648188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":122,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.196789+0000","last_change":"2024-04-24T01:27:31.196826+0000","last_active":"2024-04-24T01:27:31.196789+0000","last_peered":"2024-04-24T01:27:31.196789+0000","last_clean":"2024-04-24T01:27:31.196789+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:31.196789+0000","last_undegraded":"2024-04-24T01:27:31.196789+0000","last_fullsized":"2024-04-24T01:27:31.196789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.196709+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:14:11.522611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.807230+0000","last_change":"2024-04-24T01:27:20.807267+0000","last_active":"2024-04-24T01:27:20.807230+0000","last_peered":"2024-04-24T01:27:20.807230+0000","last_clean":"2024-04-24T01:27:20.807230+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:27:20.807230+0000","last_undegraded":"2024-04-24T01:27:20.807230+0000","last_fullsized":"2024-04-24T01:27:20.807230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.807118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:36.350177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:38.987613+0000","last_change":"2024-04-24T01:24:08.774693+0000","last_active":"2024-04-24T01:26:38.987613+0000","last_peered":"2024-04-24T01:26:38.987613+0000","last_clean":"2024-04-24T01:26:38.987613+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:26:38.987613+0000","last_undegraded":"2024-04-24T01:26:38.987613+0000","last_fullsized":"2024-04-24T01:26:38.987613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.969576+0000","last_change":"2024-04-24T01:27:35.969607+0000","last_active":"2024-04-24T01:27:35.969576+0000","last_peered":"2024-04-24T01:27:35.969576+0000","last_clean":"2024-04-24T01:27:35.969576+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:35.969576+0000","last_undegraded":"2024-04-24T01:27:35.969576+0000","last_fullsized":"2024-04-24T01:27:35.969576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.969453+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:40.292715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.863774+0000","last_change":"2024-04-24T01:28:13.863808+0000","last_active":"2024-04-24T01:28:13.863774+0000","last_peered":"2024-04-24T01:28:13.863774+0000","last_clean":"2024-04-24T01:28:13.863774+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:28:13.863774+0000","last_undegraded":"2024-04-24T01:28:13.863774+0000","last_fullsized":"2024-04-24T01:28:13.863774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.863667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:05.970240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.118350+0000","last_change":"2024-04-24T01:27:30.118393+0000","last_active":"2024-04-24T01:27:30.118350+0000","last_peered":"2024-04-24T01:27:30.118350+0000","last_clean":"2024-04-24T01:27:30.118350+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:27:30.118350+0000","last_undegraded":"2024-04-24T01:27:30.118350+0000","last_fullsized":"2024-04-24T01:27:30.118350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.118234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:34.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":91,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.933092+0000","last_change":"2024-04-24T01:27:32.933125+0000","last_active":"2024-04-24T01:27:32.933092+0000","last_peered":"2024-04-24T01:27:32.933092+0000","last_clean":"2024-04-24T01:27:32.933092+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:32.933092+0000","last_undegraded":"2024-04-24T01:27:32.933092+0000","last_fullsized":"2024-04-24T01:27:32.933092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.933012+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:06:06.750907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.831039+0000","last_change":"2024-04-24T01:27:20.831064+0000","last_active":"2024-04-24T01:27:20.831039+0000","last_peered":"2024-04-24T01:27:20.831039+0000","last_clean":"2024-04-24T01:27:20.831039+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:27:20.831039+0000","last_undegraded":"2024-04-24T01:27:20.831039+0000","last_fullsized":"2024-04-24T01:27:20.831039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.830957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:31.945556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.917603+0000","last_change":"2024-04-24T01:27:55.917603+0000","last_active":"2024-04-24T01:27:55.917603+0000","last_peered":"2024-04-24T01:27:55.917603+0000","last_clean":"2024-04-24T01:27:55.917603+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:27:55.917603+0000","last_undegraded":"2024-04-24T01:27:55.917603+0000","last_fullsized":"2024-04-24T01:27:55.917603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.917438+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:55.797725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.091073+0000","last_change":"2024-04-24T01:28:13.091102+0000","last_active":"2024-04-24T01:28:13.091073+0000","last_peered":"2024-04-24T01:28:13.091073+0000","last_clean":"2024-04-24T01:28:13.091073+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:28:13.091073+0000","last_undegraded":"2024-04-24T01:28:13.091073+0000","last_fullsized":"2024-04-24T01:28:13.091073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.090980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:40.409078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.353257+0000","last_change":"2024-04-24T01:27:42.353257+0000","last_active":"2024-04-24T01:27:42.353257+0000","last_peered":"2024-04-24T01:27:42.353257+0000","last_clean":"2024-04-24T01:27:42.353257+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:27:42.353257+0000","last_undegraded":"2024-04-24T01:27:42.353257+0000","last_fullsized":"2024-04-24T01:27:42.353257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.353157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:02.089872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.233047+0000","last_change":"2024-04-24T01:27:32.233080+0000","last_active":"2024-04-24T01:27:32.233047+0000","last_peered":"2024-04-24T01:27:32.233047+0000","last_clean":"2024-04-24T01:27:32.233047+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:32.233047+0000","last_undegraded":"2024-04-24T01:27:32.233047+0000","last_fullsized":"2024-04-24T01:27:32.233047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.232954+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:33.771403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.841600+0000","last_change":"2024-04-24T01:27:22.841624+0000","last_active":"2024-04-24T01:27:22.841600+0000","last_peered":"2024-04-24T01:27:22.841600+0000","last_clean":"2024-04-24T01:27:22.841600+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:27:22.841600+0000","last_undegraded":"2024-04-24T01:27:22.841600+0000","last_fullsized":"2024-04-24T01:27:22.841600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.841514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:44.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'19","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:19.132883+0000","last_change":"2024-04-24T01:28:19.132938+0000","last_active":"2024-04-24T01:28:19.132883+0000","last_peered":"2024-04-24T01:28:19.132883+0000","last_clean":"2024-04-24T01:28:19.132883+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:28:19.132883+0000","last_undegraded":"2024-04-24T01:28:19.132883+0000","last_fullsized":"2024-04-24T01:28:19.132883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'19","last_scrub_stamp":"2024-04-24T01:28:19.132780+0000","last_deep_scrub":"34'19","last_deep_scrub_stamp":"2024-04-24T01:28:19.132780+0000","last_clean_scrub_stamp":"2024-04-24T01:28:19.132780+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:36.505868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.296646+0000","last_change":"2024-04-24T01:27:48.296646+0000","last_active":"2024-04-24T01:27:48.296646+0000","last_peered":"2024-04-24T01:27:48.296646+0000","last_clean":"2024-04-24T01:27:48.296646+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:48.296646+0000","last_undegraded":"2024-04-24T01:27:48.296646+0000","last_fullsized":"2024-04-24T01:27:48.296646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.296518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:09.220285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.859584+0000","last_change":"2024-04-24T01:28:12.859610+0000","last_active":"2024-04-24T01:28:12.859584+0000","last_peered":"2024-04-24T01:28:12.859584+0000","last_clean":"2024-04-24T01:28:12.859584+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:28:12.859584+0000","last_undegraded":"2024-04-24T01:28:12.859584+0000","last_fullsized":"2024-04-24T01:28:12.859584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.859483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:08.233871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.046002+0000","last_change":"2024-04-24T01:27:41.046002+0000","last_active":"2024-04-24T01:27:41.046002+0000","last_peered":"2024-04-24T01:27:41.046002+0000","last_clean":"2024-04-24T01:27:41.046002+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:27:41.046002+0000","last_undegraded":"2024-04-24T01:27:41.046002+0000","last_fullsized":"2024-04-24T01:27:41.046002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.045887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:22.914827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.087296+0000","last_change":"2024-04-24T01:27:25.087358+0000","last_active":"2024-04-24T01:27:25.087296+0000","last_peered":"2024-04-24T01:27:25.087296+0000","last_clean":"2024-04-24T01:27:25.087296+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:25.087296+0000","last_undegraded":"2024-04-24T01:27:25.087296+0000","last_fullsized":"2024-04-24T01:27:25.087296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.087202+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:18.223546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.735703+0000","last_change":"2024-04-24T01:27:33.735761+0000","last_active":"2024-04-24T01:27:33.735703+0000","last_peered":"2024-04-24T01:27:33.735703+0000","last_clean":"2024-04-24T01:27:33.735703+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:27:33.735703+0000","last_undegraded":"2024-04-24T01:27:33.735703+0000","last_fullsized":"2024-04-24T01:27:33.735703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.735599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:44.989596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.044635+0000","last_change":"2024-04-24T01:28:03.044679+0000","last_active":"2024-04-24T01:28:03.044635+0000","last_peered":"2024-04-24T01:28:03.044635+0000","last_clean":"2024-04-24T01:28:03.044635+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:28:03.044635+0000","last_undegraded":"2024-04-24T01:28:03.044635+0000","last_fullsized":"2024-04-24T01:28:03.044635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.044539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:54.343523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.973256+0000","last_change":"2024-04-24T01:27:33.973301+0000","last_active":"2024-04-24T01:27:33.973256+0000","last_peered":"2024-04-24T01:27:33.973256+0000","last_clean":"2024-04-24T01:27:33.973256+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:27:33.973256+0000","last_undegraded":"2024-04-24T01:27:33.973256+0000","last_fullsized":"2024-04-24T01:27:33.973256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.973155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:28.429349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.825703+0000","last_change":"2024-04-24T01:28:09.825748+0000","last_active":"2024-04-24T01:28:09.825703+0000","last_peered":"2024-04-24T01:28:09.825703+0000","last_clean":"2024-04-24T01:28:09.825703+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:28:09.825703+0000","last_undegraded":"2024-04-24T01:28:09.825703+0000","last_fullsized":"2024-04-24T01:28:09.825703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.825585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:16.859867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.059784+0000","last_change":"2024-04-24T01:27:40.059810+0000","last_active":"2024-04-24T01:27:40.059784+0000","last_peered":"2024-04-24T01:27:40.059784+0000","last_clean":"2024-04-24T01:27:40.059784+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:27:40.059784+0000","last_undegraded":"2024-04-24T01:27:40.059784+0000","last_fullsized":"2024-04-24T01:27:40.059784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.059684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:04.176354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.098384+0000","last_change":"2024-04-24T01:27:28.098384+0000","last_active":"2024-04-24T01:27:28.098384+0000","last_peered":"2024-04-24T01:27:28.098384+0000","last_clean":"2024-04-24T01:27:28.098384+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:28.098384+0000","last_undegraded":"2024-04-24T01:27:28.098384+0000","last_fullsized":"2024-04-24T01:27:28.098384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.098205+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:13.672642+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.091423+0000","last_change":"2024-04-24T01:27:22.091423+0000","last_active":"2024-04-24T01:27:22.091423+0000","last_peered":"2024-04-24T01:27:22.091423+0000","last_clean":"2024-04-24T01:27:22.091423+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:27:22.091423+0000","last_undegraded":"2024-04-24T01:27:22.091423+0000","last_fullsized":"2024-04-24T01:27:22.091423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.091312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:42.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:38.803612+0000","last_change":"2024-04-24T01:28:38.803638+0000","last_active":"2024-04-24T01:28:38.803612+0000","last_peered":"2024-04-24T01:28:38.803612+0000","last_clean":"2024-04-24T01:28:38.803612+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:28:38.803612+0000","last_undegraded":"2024-04-24T01:28:38.803612+0000","last_fullsized":"2024-04-24T01:28:38.803612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:38.803505+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:38.803505+0000","last_clean_scrub_stamp":"2024-04-24T01:28:38.803505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:01.570836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.329918+0000","last_change":"2024-04-24T01:27:55.329959+0000","last_active":"2024-04-24T01:27:55.329918+0000","last_peered":"2024-04-24T01:27:55.329918+0000","last_clean":"2024-04-24T01:27:55.329918+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:27:55.329918+0000","last_undegraded":"2024-04-24T01:27:55.329918+0000","last_fullsized":"2024-04-24T01:27:55.329918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.329792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:04:03.792768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.960404+0000","last_change":"2024-04-24T01:28:17.960427+0000","last_active":"2024-04-24T01:28:17.960404+0000","last_peered":"2024-04-24T01:28:17.960404+0000","last_clean":"2024-04-24T01:28:17.960404+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:28:17.960404+0000","last_undegraded":"2024-04-24T01:28:17.960404+0000","last_fullsized":"2024-04-24T01:28:17.960404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.960318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:16.440099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.749135+0000","last_change":"2024-04-24T01:27:39.749158+0000","last_active":"2024-04-24T01:27:39.749135+0000","last_peered":"2024-04-24T01:27:39.749135+0000","last_clean":"2024-04-24T01:27:39.749135+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:27:39.749135+0000","last_undegraded":"2024-04-24T01:27:39.749135+0000","last_fullsized":"2024-04-24T01:27:39.749135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.749046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:27.448650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.983586+0000","last_change":"2024-04-24T01:27:34.983586+0000","last_active":"2024-04-24T01:27:34.983586+0000","last_peered":"2024-04-24T01:27:34.983586+0000","last_clean":"2024-04-24T01:27:34.983586+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:27:34.983586+0000","last_undegraded":"2024-04-24T01:27:34.983586+0000","last_fullsized":"2024-04-24T01:27:34.983586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.983448+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:01.670877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.929176+0000","last_change":"2024-04-24T01:27:33.929176+0000","last_active":"2024-04-24T01:27:33.929176+0000","last_peered":"2024-04-24T01:27:33.929176+0000","last_clean":"2024-04-24T01:27:33.929176+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:33.929176+0000","last_undegraded":"2024-04-24T01:27:33.929176+0000","last_fullsized":"2024-04-24T01:27:33.929176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.929072+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:18.783745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.001548+0000","last_change":"2024-04-24T01:28:11.001570+0000","last_active":"2024-04-24T01:28:11.001548+0000","last_peered":"2024-04-24T01:28:11.001548+0000","last_clean":"2024-04-24T01:28:11.001548+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:28:11.001548+0000","last_undegraded":"2024-04-24T01:28:11.001548+0000","last_fullsized":"2024-04-24T01:28:11.001548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.001466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:24.425690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.079919+0000","last_change":"2024-04-24T01:27:48.079950+0000","last_active":"2024-04-24T01:27:48.079919+0000","last_peered":"2024-04-24T01:27:48.079919+0000","last_clean":"2024-04-24T01:27:48.079919+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:48.079919+0000","last_undegraded":"2024-04-24T01:27:48.079919+0000","last_fullsized":"2024-04-24T01:27:48.079919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.079833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:52:03.610383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.861473+0000","last_change":"2024-04-24T01:28:04.861517+0000","last_active":"2024-04-24T01:28:04.861473+0000","last_peered":"2024-04-24T01:28:04.861473+0000","last_clean":"2024-04-24T01:28:04.861473+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:28:04.861473+0000","last_undegraded":"2024-04-24T01:28:04.861473+0000","last_fullsized":"2024-04-24T01:28:04.861473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.861352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.266160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.756543+0000","last_change":"2024-04-24T01:27:36.756588+0000","last_active":"2024-04-24T01:27:36.756543+0000","last_peered":"2024-04-24T01:27:36.756543+0000","last_clean":"2024-04-24T01:27:36.756543+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:27:36.756543+0000","last_undegraded":"2024-04-24T01:27:36.756543+0000","last_fullsized":"2024-04-24T01:27:36.756543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.756455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:22.449180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":157,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.761744+0000","last_change":"2024-04-24T01:27:30.761800+0000","last_active":"2024-04-24T01:27:30.761744+0000","last_peered":"2024-04-24T01:27:30.761744+0000","last_clean":"2024-04-24T01:27:30.761744+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:30.761744+0000","last_undegraded":"2024-04-24T01:27:30.761744+0000","last_fullsized":"2024-04-24T01:27:30.761744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.761661+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:48.545704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.337069+0000","last_change":"2024-04-24T01:27:45.337095+0000","last_active":"2024-04-24T01:27:45.337069+0000","last_peered":"2024-04-24T01:27:45.337069+0000","last_clean":"2024-04-24T01:27:45.337069+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:27:45.337069+0000","last_undegraded":"2024-04-24T01:27:45.337069+0000","last_fullsized":"2024-04-24T01:27:45.337069+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.336963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:37.290165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.739909+0000","last_change":"2024-04-24T01:27:37.739935+0000","last_active":"2024-04-24T01:27:37.739909+0000","last_peered":"2024-04-24T01:27:37.739909+0000","last_clean":"2024-04-24T01:27:37.739909+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:27:37.739909+0000","last_undegraded":"2024-04-24T01:27:37.739909+0000","last_fullsized":"2024-04-24T01:27:37.739909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.739820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:34.597803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.075139+0000","last_change":"2024-04-24T01:27:45.075163+0000","last_active":"2024-04-24T01:27:45.075139+0000","last_peered":"2024-04-24T01:27:45.075139+0000","last_clean":"2024-04-24T01:27:45.075139+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:45.075139+0000","last_undegraded":"2024-04-24T01:27:45.075139+0000","last_fullsized":"2024-04-24T01:27:45.075139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.075019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:51.367822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:24.976719+0000","last_change":"2024-04-24T01:28:24.976757+0000","last_active":"2024-04-24T01:28:24.976719+0000","last_peered":"2024-04-24T01:28:24.976719+0000","last_clean":"2024-04-24T01:28:24.976719+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:28:24.976719+0000","last_undegraded":"2024-04-24T01:28:24.976719+0000","last_fullsized":"2024-04-24T01:28:24.976719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:24.976622+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:24.976622+0000","last_clean_scrub_stamp":"2024-04-24T01:28:24.976622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:28.031723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.913584+0000","last_change":"2024-04-24T01:27:34.913612+0000","last_active":"2024-04-24T01:27:34.913584+0000","last_peered":"2024-04-24T01:27:34.913584+0000","last_clean":"2024-04-24T01:27:34.913584+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:27:34.913584+0000","last_undegraded":"2024-04-24T01:27:34.913584+0000","last_fullsized":"2024-04-24T01:27:34.913584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.913487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:18.229615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.156326+0000","last_change":"2024-04-24T01:27:30.156369+0000","last_active":"2024-04-24T01:27:30.156326+0000","last_peered":"2024-04-24T01:27:30.156326+0000","last_clean":"2024-04-24T01:27:30.156326+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:30.156326+0000","last_undegraded":"2024-04-24T01:27:30.156326+0000","last_fullsized":"2024-04-24T01:27:30.156326+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.156230+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:37.955468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.987140+0000","last_change":"2024-04-24T01:27:42.987190+0000","last_active":"2024-04-24T01:27:42.987140+0000","last_peered":"2024-04-24T01:27:42.987140+0000","last_clean":"2024-04-24T01:27:42.987140+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:27:42.987140+0000","last_undegraded":"2024-04-24T01:27:42.987140+0000","last_fullsized":"2024-04-24T01:27:42.987140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.987041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:18.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:33.986980+0000","last_change":"2024-04-24T01:24:08.776581+0000","last_active":"2024-04-24T01:26:33.986980+0000","last_peered":"2024-04-24T01:26:33.986980+0000","last_clean":"2024-04-24T01:26:33.986980+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:26:33.986980+0000","last_undegraded":"2024-04-24T01:26:33.986980+0000","last_fullsized":"2024-04-24T01:26:33.986980+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'12","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.994045+0000","last_change":"2024-04-24T01:28:05.994109+0000","last_active":"2024-04-24T01:28:05.994045+0000","last_peered":"2024-04-24T01:28:05.994045+0000","last_clean":"2024-04-24T01:28:05.994045+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:28:05.994045+0000","last_undegraded":"2024-04-24T01:28:05.994045+0000","last_fullsized":"2024-04-24T01:28:05.994045+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.993947+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:25.685425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.244737+0000","last_change":"2024-04-24T01:28:04.244763+0000","last_active":"2024-04-24T01:28:04.244737+0000","last_peered":"2024-04-24T01:28:04.244737+0000","last_clean":"2024-04-24T01:28:04.244737+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:28:04.244737+0000","last_undegraded":"2024-04-24T01:28:04.244737+0000","last_fullsized":"2024-04-24T01:28:04.244737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.244647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:25.006383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.755391+0000","last_change":"2024-04-24T01:27:34.755417+0000","last_active":"2024-04-24T01:27:34.755391+0000","last_peered":"2024-04-24T01:27:34.755391+0000","last_clean":"2024-04-24T01:27:34.755391+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:27:34.755391+0000","last_undegraded":"2024-04-24T01:27:34.755391+0000","last_fullsized":"2024-04-24T01:27:34.755391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.755296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:32.167294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.873513+0000","last_change":"2024-04-24T01:27:47.873544+0000","last_active":"2024-04-24T01:27:47.873513+0000","last_peered":"2024-04-24T01:27:47.873513+0000","last_clean":"2024-04-24T01:27:47.873513+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:47.873513+0000","last_undegraded":"2024-04-24T01:27:47.873513+0000","last_fullsized":"2024-04-24T01:27:47.873513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.873413+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:12:47.188719+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.891422+0000","last_change":"2024-04-24T01:27:54.891469+0000","last_active":"2024-04-24T01:27:54.891422+0000","last_peered":"2024-04-24T01:27:54.891422+0000","last_clean":"2024-04-24T01:27:54.891422+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:27:54.891422+0000","last_undegraded":"2024-04-24T01:27:54.891422+0000","last_fullsized":"2024-04-24T01:27:54.891422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.891327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:46.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:37.823656+0000","last_change":"2024-04-24T01:28:37.823684+0000","last_active":"2024-04-24T01:28:37.823656+0000","last_peered":"2024-04-24T01:28:37.823656+0000","last_clean":"2024-04-24T01:28:37.823656+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:28:37.823656+0000","last_undegraded":"2024-04-24T01:28:37.823656+0000","last_fullsized":"2024-04-24T01:28:37.823656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:37.823558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:37.823558+0000","last_clean_scrub_stamp":"2024-04-24T01:28:37.823558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:15.900101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":72,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.065454+0000","last_change":"2024-04-24T01:27:44.065481+0000","last_active":"2024-04-24T01:27:44.065454+0000","last_peered":"2024-04-24T01:27:44.065454+0000","last_clean":"2024-04-24T01:27:44.065454+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:27:44.065454+0000","last_undegraded":"2024-04-24T01:27:44.065454+0000","last_fullsized":"2024-04-24T01:27:44.065454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.065351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:23.725424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.876743+0000","last_change":"2024-04-24T01:28:02.876743+0000","last_active":"2024-04-24T01:28:02.876743+0000","last_peered":"2024-04-24T01:28:02.876743+0000","last_clean":"2024-04-24T01:28:02.876743+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:28:02.876743+0000","last_undegraded":"2024-04-24T01:28:02.876743+0000","last_fullsized":"2024-04-24T01:28:02.876743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.876585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:05.674595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":41,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.719484+0000","last_change":"2024-04-24T01:27:32.719516+0000","last_active":"2024-04-24T01:27:32.719484+0000","last_peered":"2024-04-24T01:27:32.719484+0000","last_clean":"2024-04-24T01:27:32.719484+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:27:32.719484+0000","last_undegraded":"2024-04-24T01:27:32.719484+0000","last_fullsized":"2024-04-24T01:27:32.719484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.719397+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:10.815530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.973007+0000","last_change":"2024-04-24T01:27:44.973079+0000","last_active":"2024-04-24T01:27:44.973007+0000","last_peered":"2024-04-24T01:27:44.973007+0000","last_clean":"2024-04-24T01:27:44.973007+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:44.973007+0000","last_undegraded":"2024-04-24T01:27:44.973007+0000","last_fullsized":"2024-04-24T01:27:44.973007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.972905+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:58:52.372440+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.200708+0000","last_change":"2024-04-24T01:27:37.200734+0000","last_active":"2024-04-24T01:27:37.200708+0000","last_peered":"2024-04-24T01:27:37.200708+0000","last_clean":"2024-04-24T01:27:37.200708+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:27:37.200708+0000","last_undegraded":"2024-04-24T01:27:37.200708+0000","last_fullsized":"2024-04-24T01:27:37.200708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.200577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:30.452220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:26:28.986026+0000","last_change":"2024-04-24T01:24:08.774968+0000","last_active":"2024-04-24T01:26:28.986026+0000","last_peered":"2024-04-24T01:26:28.986026+0000","last_clean":"2024-04-24T01:26:28.986026+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:26:28.986026+0000","last_undegraded":"2024-04-24T01:26:28.986026+0000","last_fullsized":"2024-04-24T01:26:28.986026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:24:07.746277+0000","last_clean_scrub_stamp":"2024-04-24T01:24:07.746277+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.821958+0000","last_change":"2024-04-24T01:28:15.821958+0000","last_active":"2024-04-24T01:28:15.821958+0000","last_peered":"2024-04-24T01:28:15.821958+0000","last_clean":"2024-04-24T01:28:15.821958+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:28:15.821958+0000","last_undegraded":"2024-04-24T01:28:15.821958+0000","last_fullsized":"2024-04-24T01:28:15.821958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.821799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:18.284502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.098736+0000","last_change":"2024-04-24T01:27:47.098736+0000","last_active":"2024-04-24T01:27:47.098736+0000","last_peered":"2024-04-24T01:27:47.098736+0000","last_clean":"2024-04-24T01:27:47.098736+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:47.098736+0000","last_undegraded":"2024-04-24T01:27:47.098736+0000","last_fullsized":"2024-04-24T01:27:47.098736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.098613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:08.549533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.326589+0000","last_change":"2024-04-24T01:27:53.326589+0000","last_active":"2024-04-24T01:27:53.326589+0000","last_peered":"2024-04-24T01:27:53.326589+0000","last_clean":"2024-04-24T01:27:53.326589+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:27:53.326589+0000","last_undegraded":"2024-04-24T01:27:53.326589+0000","last_fullsized":"2024-04-24T01:27:53.326589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.326480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:56.533113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.154672+0000","last_change":"2024-04-24T01:28:09.154672+0000","last_active":"2024-04-24T01:28:09.154672+0000","last_peered":"2024-04-24T01:28:09.154672+0000","last_clean":"2024-04-24T01:28:09.154672+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:28:09.154672+0000","last_undegraded":"2024-04-24T01:28:09.154672+0000","last_fullsized":"2024-04-24T01:28:09.154672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.154557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:38.451216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.943548+0000","last_change":"2024-04-24T01:28:07.943548+0000","last_active":"2024-04-24T01:28:07.943548+0000","last_peered":"2024-04-24T01:28:07.943548+0000","last_clean":"2024-04-24T01:28:07.943548+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:28:07.943548+0000","last_undegraded":"2024-04-24T01:28:07.943548+0000","last_fullsized":"2024-04-24T01:28:07.943548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.943435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:27.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.003080+0000","last_change":"2024-04-24T01:28:16.003105+0000","last_active":"2024-04-24T01:28:16.003080+0000","last_peered":"2024-04-24T01:28:16.003080+0000","last_clean":"2024-04-24T01:28:16.003080+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:28:16.003080+0000","last_undegraded":"2024-04-24T01:28:16.003080+0000","last_fullsized":"2024-04-24T01:28:16.003080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.002980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:31.898663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.270216+0000","last_change":"2024-04-24T01:27:57.270216+0000","last_active":"2024-04-24T01:27:57.270216+0000","last_peered":"2024-04-24T01:27:57.270216+0000","last_clean":"2024-04-24T01:27:57.270216+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:57.270216+0000","last_undegraded":"2024-04-24T01:27:57.270216+0000","last_fullsized":"2024-04-24T01:27:57.270216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.270099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:32.213542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.302374+0000","last_change":"2024-04-24T01:27:56.302374+0000","last_active":"2024-04-24T01:27:56.302374+0000","last_peered":"2024-04-24T01:27:56.302374+0000","last_clean":"2024-04-24T01:27:56.302374+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:27:56.302374+0000","last_undegraded":"2024-04-24T01:27:56.302374+0000","last_fullsized":"2024-04-24T01:27:56.302374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.302255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:55.783843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.195571+0000","last_change":"2024-04-24T01:28:01.195571+0000","last_active":"2024-04-24T01:28:01.195571+0000","last_peered":"2024-04-24T01:28:01.195571+0000","last_clean":"2024-04-24T01:28:01.195571+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:28:01.195571+0000","last_undegraded":"2024-04-24T01:28:01.195571+0000","last_fullsized":"2024-04-24T01:28:01.195571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.195431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:09.529251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.140087+0000","last_change":"2024-04-24T01:28:11.140087+0000","last_active":"2024-04-24T01:28:11.140087+0000","last_peered":"2024-04-24T01:28:11.140087+0000","last_clean":"2024-04-24T01:28:11.140087+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:28:11.140087+0000","last_undegraded":"2024-04-24T01:28:11.140087+0000","last_fullsized":"2024-04-24T01:28:11.140087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.139969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:09.603168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.819728+0000","last_change":"2024-04-24T01:27:59.819728+0000","last_active":"2024-04-24T01:27:59.819728+0000","last_peered":"2024-04-24T01:27:59.819728+0000","last_clean":"2024-04-24T01:27:59.819728+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:59.819728+0000","last_undegraded":"2024-04-24T01:27:59.819728+0000","last_fullsized":"2024-04-24T01:27:59.819728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.819607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:11.722240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.856063+0000","last_change":"2024-04-24T01:28:06.856063+0000","last_active":"2024-04-24T01:28:06.856063+0000","last_peered":"2024-04-24T01:28:06.856063+0000","last_clean":"2024-04-24T01:28:06.856063+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:28:06.856063+0000","last_undegraded":"2024-04-24T01:28:06.856063+0000","last_fullsized":"2024-04-24T01:28:06.856063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.855938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:44.329967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.195318+0000","last_change":"2024-04-24T01:27:59.195318+0000","last_active":"2024-04-24T01:27:59.195318+0000","last_peered":"2024-04-24T01:27:59.195318+0000","last_clean":"2024-04-24T01:27:59.195318+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:27:59.195318+0000","last_undegraded":"2024-04-24T01:27:59.195318+0000","last_fullsized":"2024-04-24T01:27:59.195318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.195149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:51.074457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.122928+0000","last_change":"2024-04-24T01:28:01.122928+0000","last_active":"2024-04-24T01:28:01.122928+0000","last_peered":"2024-04-24T01:28:01.122928+0000","last_clean":"2024-04-24T01:28:01.122928+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:28:01.122928+0000","last_undegraded":"2024-04-24T01:28:01.122928+0000","last_fullsized":"2024-04-24T01:28:01.122928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.122753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:31:56.927600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.790317+0000","last_change":"2024-04-24T01:27:48.790317+0000","last_active":"2024-04-24T01:27:48.790317+0000","last_peered":"2024-04-24T01:27:48.790317+0000","last_clean":"2024-04-24T01:27:48.790317+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:48.790317+0000","last_undegraded":"2024-04-24T01:27:48.790317+0000","last_fullsized":"2024-04-24T01:27:48.790317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.790131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:15.310685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.150980+0000","last_change":"2024-04-24T01:28:10.150980+0000","last_active":"2024-04-24T01:28:10.150980+0000","last_peered":"2024-04-24T01:28:10.150980+0000","last_clean":"2024-04-24T01:28:10.150980+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:28:10.150980+0000","last_undegraded":"2024-04-24T01:28:10.150980+0000","last_fullsized":"2024-04-24T01:28:10.150980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.150848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:35.075645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.824638+0000","last_change":"2024-04-24T01:27:42.824684+0000","last_active":"2024-04-24T01:27:42.824638+0000","last_peered":"2024-04-24T01:27:42.824638+0000","last_clean":"2024-04-24T01:27:42.824638+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:42.824638+0000","last_undegraded":"2024-04-24T01:27:42.824638+0000","last_fullsized":"2024-04-24T01:27:42.824638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.824525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:03.738253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:24.013981+0000","last_change":"2024-04-24T01:28:24.014012+0000","last_active":"2024-04-24T01:28:24.013981+0000","last_peered":"2024-04-24T01:28:24.013981+0000","last_clean":"2024-04-24T01:28:24.013981+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:28:24.013981+0000","last_undegraded":"2024-04-24T01:28:24.013981+0000","last_fullsized":"2024-04-24T01:28:24.013981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:24.013883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:24.013883+0000","last_clean_scrub_stamp":"2024-04-24T01:28:24.013883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:35.371838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":74,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.013260+0000","last_change":"2024-04-24T01:27:40.013289+0000","last_active":"2024-04-24T01:27:40.013260+0000","last_peered":"2024-04-24T01:27:40.013260+0000","last_clean":"2024-04-24T01:27:40.013260+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:40.013260+0000","last_undegraded":"2024-04-24T01:27:40.013260+0000","last_fullsized":"2024-04-24T01:27:40.013260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.013169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:21.080960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.109769+0000","last_change":"2024-04-24T01:28:12.109769+0000","last_active":"2024-04-24T01:28:12.109769+0000","last_peered":"2024-04-24T01:28:12.109769+0000","last_clean":"2024-04-24T01:28:12.109769+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:28:12.109769+0000","last_undegraded":"2024-04-24T01:28:12.109769+0000","last_fullsized":"2024-04-24T01:28:12.109769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.109616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:48.990071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.238648+0000","last_change":"2024-04-24T01:28:03.238648+0000","last_active":"2024-04-24T01:28:03.238648+0000","last_peered":"2024-04-24T01:28:03.238648+0000","last_clean":"2024-04-24T01:28:03.238648+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:28:03.238648+0000","last_undegraded":"2024-04-24T01:28:03.238648+0000","last_fullsized":"2024-04-24T01:28:03.238648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.238536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:17.676354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.851711+0000","last_change":"2024-04-24T01:28:00.851711+0000","last_active":"2024-04-24T01:28:00.851711+0000","last_peered":"2024-04-24T01:28:00.851711+0000","last_clean":"2024-04-24T01:28:00.851711+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:28:00.851711+0000","last_undegraded":"2024-04-24T01:28:00.851711+0000","last_fullsized":"2024-04-24T01:28:00.851711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.851583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:32.414278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.721998+0000","last_change":"2024-04-24T01:27:54.721998+0000","last_active":"2024-04-24T01:27:54.721998+0000","last_peered":"2024-04-24T01:27:54.721998+0000","last_clean":"2024-04-24T01:27:54.721998+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:54.721998+0000","last_undegraded":"2024-04-24T01:27:54.721998+0000","last_fullsized":"2024-04-24T01:27:54.721998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.721886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:21.542465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.829238+0000","last_change":"2024-04-24T01:28:08.829238+0000","last_active":"2024-04-24T01:28:08.829238+0000","last_peered":"2024-04-24T01:28:08.829238+0000","last_clean":"2024-04-24T01:28:08.829238+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:28:08.829238+0000","last_undegraded":"2024-04-24T01:28:08.829238+0000","last_fullsized":"2024-04-24T01:28:08.829238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.829110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:29.507416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.859558+0000","last_change":"2024-04-24T01:28:05.859558+0000","last_active":"2024-04-24T01:28:05.859558+0000","last_peered":"2024-04-24T01:28:05.859558+0000","last_clean":"2024-04-24T01:28:05.859558+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:28:05.859558+0000","last_undegraded":"2024-04-24T01:28:05.859558+0000","last_fullsized":"2024-04-24T01:28:05.859558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.859401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:16.646001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.995244+0000","last_change":"2024-04-24T01:28:16.995244+0000","last_active":"2024-04-24T01:28:16.995244+0000","last_peered":"2024-04-24T01:28:16.995244+0000","last_clean":"2024-04-24T01:28:16.995244+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:28:16.995244+0000","last_undegraded":"2024-04-24T01:28:16.995244+0000","last_fullsized":"2024-04-24T01:28:16.995244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.995125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:06.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.742337+0000","last_change":"2024-04-24T01:27:40.742337+0000","last_active":"2024-04-24T01:27:40.742337+0000","last_peered":"2024-04-24T01:27:40.742337+0000","last_clean":"2024-04-24T01:27:40.742337+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:27:40.742337+0000","last_undegraded":"2024-04-24T01:27:40.742337+0000","last_fullsized":"2024-04-24T01:27:40.742337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.742220+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:29.319272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.989162+0000","last_change":"2024-04-24T01:28:20.989162+0000","last_active":"2024-04-24T01:28:20.989162+0000","last_peered":"2024-04-24T01:28:20.989162+0000","last_clean":"2024-04-24T01:28:20.989162+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:28:20.989162+0000","last_undegraded":"2024-04-24T01:28:20.989162+0000","last_fullsized":"2024-04-24T01:28:20.989162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:20.989006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:20.989006+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.989006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:51.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.099525+0000","last_change":"2024-04-24T01:28:14.099552+0000","last_active":"2024-04-24T01:28:14.099525+0000","last_peered":"2024-04-24T01:28:14.099525+0000","last_clean":"2024-04-24T01:28:14.099525+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:28:14.099525+0000","last_undegraded":"2024-04-24T01:28:14.099525+0000","last_fullsized":"2024-04-24T01:28:14.099525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.099430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:48.960432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.112328+0000","last_change":"2024-04-24T01:28:06.112328+0000","last_active":"2024-04-24T01:28:06.112328+0000","last_peered":"2024-04-24T01:28:06.112328+0000","last_clean":"2024-04-24T01:28:06.112328+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:28:06.112328+0000","last_undegraded":"2024-04-24T01:28:06.112328+0000","last_fullsized":"2024-04-24T01:28:06.112328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.112211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:09.638702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.768193+0000","last_change":"2024-04-24T01:27:53.768193+0000","last_active":"2024-04-24T01:27:53.768193+0000","last_peered":"2024-04-24T01:27:53.768193+0000","last_clean":"2024-04-24T01:27:53.768193+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:53.768193+0000","last_undegraded":"2024-04-24T01:27:53.768193+0000","last_fullsized":"2024-04-24T01:27:53.768193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.768072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:20.455501+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.993658+0000","last_change":"2024-04-24T01:28:08.993658+0000","last_active":"2024-04-24T01:28:08.993658+0000","last_peered":"2024-04-24T01:28:08.993658+0000","last_clean":"2024-04-24T01:28:08.993658+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:28:08.993658+0000","last_undegraded":"2024-04-24T01:28:08.993658+0000","last_fullsized":"2024-04-24T01:28:08.993658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.993523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:50.996413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:35.896301+0000","last_change":"2024-04-24T01:28:35.896301+0000","last_active":"2024-04-24T01:28:35.896301+0000","last_peered":"2024-04-24T01:28:35.896301+0000","last_clean":"2024-04-24T01:28:35.896301+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:28:35.896301+0000","last_undegraded":"2024-04-24T01:28:35.896301+0000","last_fullsized":"2024-04-24T01:28:35.896301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:35.896182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:35.896182+0000","last_clean_scrub_stamp":"2024-04-24T01:28:35.896182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:58.630325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.290295+0000","last_change":"2024-04-24T01:27:46.290325+0000","last_active":"2024-04-24T01:27:46.290295+0000","last_peered":"2024-04-24T01:27:46.290295+0000","last_clean":"2024-04-24T01:27:46.290295+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:46.290295+0000","last_undegraded":"2024-04-24T01:27:46.290295+0000","last_fullsized":"2024-04-24T01:27:46.290295+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.290152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:57.436026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.151350+0000","last_change":"2024-04-24T01:28:00.151375+0000","last_active":"2024-04-24T01:28:00.151350+0000","last_peered":"2024-04-24T01:28:00.151350+0000","last_clean":"2024-04-24T01:28:00.151350+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:28:00.151350+0000","last_undegraded":"2024-04-24T01:28:00.151350+0000","last_fullsized":"2024-04-24T01:28:00.151350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.151264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:54.349626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.704447+0000","last_change":"2024-04-24T01:27:50.704477+0000","last_active":"2024-04-24T01:27:50.704447+0000","last_peered":"2024-04-24T01:27:50.704447+0000","last_clean":"2024-04-24T01:27:50.704447+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:27:50.704447+0000","last_undegraded":"2024-04-24T01:27:50.704447+0000","last_fullsized":"2024-04-24T01:27:50.704447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.704360+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:31.185382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1755,"ondisk_log_size":1755,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640320,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640318,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":454656,"data_stored":150586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:28:42.908 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:42.909 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T01:24:01.719664+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=1, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:42.909 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:42.910 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:42.910 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T01:24:07.746277+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=24, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=27, tm_sec=18, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T01:28:42.911 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T01:29:02.911 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:29:03.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.018+0000 7fcdc443e640 1 Processor -- start 2024-04-24T01:29:03.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.018+0000 7fcdc443e640 1 -- start start 2024-04-24T01:29:03.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.018+0000 7fcdc443e640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdbc071090 0x7fcdbc131430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.019 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.018+0000 7fcdc443e640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdbc098800 con 0x7fcdbc096430 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.018+0000 7fcdc443e640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7fcdbc071930 con 0x7fcdbc071090 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.019+0000 7fcdc19d9640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7fcdbc071090 0x7fcdbc131430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.019+0000 7fcdc21da640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7fcdbc096430 0x7fcdbc096810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43982/0 (socket says 172.21.15.142:43982) 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.019+0000 7fcdc21da640 1 -- 172.21.15.142:0/208716012 learned_addr learned my addr 172.21.15.142:0/208716012 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.019+0000 7fcdc19d9640 1 -- 172.21.15.142:0/208716012 >> v1:172.21.15.142:6789/0 conn(0x7fcdbc096430 legacy=0x7fcdbc096810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.020 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.019+0000 7fcdc19d9640 1 -- 172.21.15.142:0/208716012 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc071f50 con 0x7fcdbc071090 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc19d9640 1 --2- 172.21.15.142:0/208716012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc131430 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009720 tx=0x7fcdac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15f0dd5299165d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc11d8640 1 -- 172.21.15.142:0/208716012 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0316d0 con 0x7fcdbc071090 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc11d8640 1 -- 172.21.15.142:0/208716012 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac037070 con 0x7fcdbc071090 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc11d8640 1 -- 172.21.15.142:0/208716012 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdac0319c0 con 0x7fcdbc071090 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 -- 172.21.15.142:0/208716012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 msgr2=0x7fcdbc131430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 --2- 172.21.15.142:0/208716012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc131430 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009720 tx=0x7fcdac02b840 comp rx=0 tx=0).stop 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 -- 172.21.15.142:0/208716012 shutdown_connections 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 --2- 172.21.15.142:0/208716012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc131430 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.021 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 -- 172.21.15.142:0/208716012 >> 172.21.15.142:0/208716012 conn(0x7fcdbc099680 msgr2=0x7fcdbc099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:29:03.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 -- 172.21.15.142:0/208716012 shutdown_connections 2024-04-24T01:29:03.022 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.020+0000 7fcdc443e640 1 -- 172.21.15.142:0/208716012 wait complete. 2024-04-24T01:29:03.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.021+0000 7fcdc443e640 1 Processor -- start 2024-04-24T01:29:03.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.021+0000 7fcdc443e640 1 -- start start 2024-04-24T01:29:03.023 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc443e640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc443e640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7fcdbc131af0 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc21da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc21da640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48744/0 (socket says 172.21.15.142:48744) 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc21da640 1 -- 172.21.15.142:0/4114681559 learned_addr learned my addr 172.21.15.142:0/4114681559 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc21da640 1 -- 172.21.15.142:0/4114681559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdbc124580 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc21da640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c4a0 tx=0x7fcdb800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8017070 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb8005c10 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdbc1311c0 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcdb8007070 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.022+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdbc125630 con 0x7fcdbc071090 2024-04-24T01:29:03.024 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.023+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcdb801a070 con 0x7fcdbc071090 2024-04-24T01:29:03.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.023+0000 7fcdb2ffd640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 0x7fcda003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.023+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdbc062da0 con 0x7fcdbc071090 2024-04-24T01:29:03.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.023+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7fcdb804ad00 con 0x7fcdbc071090 2024-04-24T01:29:03.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.024+0000 7fcdc19d9640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 0x7fcda003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.025 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.024+0000 7fcdc19d9640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 0x7fcda003a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcdac036000 tx=0x7fcdac008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.029 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.028+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7fcdb8012400 con 0x7fcdbc071090 2024-04-24T01:29:03.197 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.197+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 --> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdbc06c170 con 0x7fcda0038060 2024-04-24T01:29:03.213 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.213+0000 7fcdb2ffd640 1 -- 172.21.15.142:0/4114681559 <== mgr.4102 v2:172.21.15.169:6824/3871964860 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666347 (secure 0 0 0) 0x7fcdbc06c170 con 0x7fcda0038060 2024-04-24T01:29:03.220 INFO:teuthology.orchestra.run.smithi142.stdout: 2024-04-24T01:29:03.225 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 msgr2=0x7fcda003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 0x7fcda003a520 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcdac036000 tx=0x7fcdac008030 comp rx=0 tx=0).stop 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 msgr2=0x7fcdbc1250f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800c4a0 tx=0x7fcdb800c960 comp rx=0 tx=0).stop 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 shutdown_connections 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7fcda0038060 0x7fcda003a520 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 --2- 172.21.15.142:0/4114681559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdbc071090 0x7fcdbc1250f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 >> 172.21.15.142:0/4114681559 conn(0x7fcdbc099680 msgr2=0x7fcdbc129ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 shutdown_connections 2024-04-24T01:29:03.227 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.217+0000 7fcdc443e640 1 -- 172.21.15.142:0/4114681559 wait complete. 2024-04-24T01:29:03.228 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-04-24T01:29:01.995800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":252,"num_object_clones":0,"num_object_copies":504,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":252,"num_whiteouts":0,"num_read":5377,"num_read_kb":4926,"num_write":2373,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5016,"ondisk_log_size":5016,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165048,"kb_used_data":2904,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322312,"statfs":{"total":386547056640,"available":386378047488,"internally_reserved":0,"allocated":2973696,"data_stored":1778210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003979"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.115018+0000","last_change":"2024-04-24T01:27:51.115018+0000","last_active":"2024-04-24T01:27:51.115018+0000","last_peered":"2024-04-24T01:27:51.115018+0000","last_clean":"2024-04-24T01:27:51.115018+0000","last_became_active":"2024-04-24T01:23:58.745631+0000","last_became_peered":"2024-04-24T01:23:58.745631+0000","last_unstale":"2024-04-24T01:27:51.115018+0000","last_undegraded":"2024-04-24T01:27:51.115018+0000","last_fullsized":"2024-04-24T01:27:51.115018+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:51.114886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.114886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:37.582826+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"34'4","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.756639+0000","last_change":"2024-04-24T01:27:44.756666+0000","last_active":"2024-04-24T01:27:44.756639+0000","last_peered":"2024-04-24T01:27:44.756639+0000","last_clean":"2024-04-24T01:27:44.756639+0000","last_became_active":"2024-04-24T01:24:00.744915+0000","last_became_peered":"2024-04-24T01:24:00.744915+0000","last_unstale":"2024-04-24T01:27:44.756639+0000","last_undegraded":"2024-04-24T01:27:44.756639+0000","last_fullsized":"2024-04-24T01:27:44.756639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:44.756553+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.756553+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:43.777959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.223065+0000","last_change":"2024-04-24T01:28:02.223065+0000","last_active":"2024-04-24T01:28:02.223065+0000","last_peered":"2024-04-24T01:28:02.223065+0000","last_clean":"2024-04-24T01:28:02.223065+0000","last_became_active":"2024-04-24T01:23:58.743109+0000","last_became_peered":"2024-04-24T01:23:58.743109+0000","last_unstale":"2024-04-24T01:28:02.223065+0000","last_undegraded":"2024-04-24T01:28:02.223065+0000","last_fullsized":"2024-04-24T01:28:02.223065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.222955+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.222955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:15:22.111184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"34'4","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.052111+0000","last_change":"2024-04-24T01:28:00.052138+0000","last_active":"2024-04-24T01:28:00.052111+0000","last_peered":"2024-04-24T01:28:00.052111+0000","last_clean":"2024-04-24T01:28:00.052111+0000","last_became_active":"2024-04-24T01:24:00.734506+0000","last_became_peered":"2024-04-24T01:24:00.734506+0000","last_unstale":"2024-04-24T01:28:00.052111+0000","last_undegraded":"2024-04-24T01:28:00.052111+0000","last_fullsized":"2024-04-24T01:28:00.052111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:00.052021+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.052021+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:11:32.079724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:34.909849+0000","last_change":"2024-04-24T01:28:34.909901+0000","last_active":"2024-04-24T01:28:34.909849+0000","last_peered":"2024-04-24T01:28:34.909849+0000","last_clean":"2024-04-24T01:28:34.909849+0000","last_became_active":"2024-04-24T01:23:58.756881+0000","last_became_peered":"2024-04-24T01:23:58.756881+0000","last_unstale":"2024-04-24T01:28:34.909849+0000","last_undegraded":"2024-04-24T01:28:34.909849+0000","last_fullsized":"2024-04-24T01:28:34.909849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:34.909706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:34.909706+0000","last_clean_scrub_stamp":"2024-04-24T01:28:34.909706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:45.131356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"34'10","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.070669+0000","last_change":"2024-04-24T01:28:01.070736+0000","last_active":"2024-04-24T01:28:01.070669+0000","last_peered":"2024-04-24T01:28:01.070669+0000","last_clean":"2024-04-24T01:28:01.070669+0000","last_became_active":"2024-04-24T01:24:00.734632+0000","last_became_peered":"2024-04-24T01:24:00.734632+0000","last_unstale":"2024-04-24T01:28:01.070669+0000","last_undegraded":"2024-04-24T01:28:01.070669+0000","last_fullsized":"2024-04-24T01:28:01.070669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:01.070556+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.070556+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:10.689727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.090880+0000","last_change":"2024-04-24T01:28:02.090907+0000","last_active":"2024-04-24T01:28:02.090880+0000","last_peered":"2024-04-24T01:28:02.090880+0000","last_clean":"2024-04-24T01:28:02.090880+0000","last_became_active":"2024-04-24T01:23:58.734438+0000","last_became_peered":"2024-04-24T01:23:58.734438+0000","last_unstale":"2024-04-24T01:28:02.090880+0000","last_undegraded":"2024-04-24T01:28:02.090880+0000","last_fullsized":"2024-04-24T01:28:02.090880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:02.090787+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.090787+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:45.124033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.013113+0000","last_change":"2024-04-24T01:28:04.013177+0000","last_active":"2024-04-24T01:28:04.013113+0000","last_peered":"2024-04-24T01:28:04.013113+0000","last_clean":"2024-04-24T01:28:04.013113+0000","last_became_active":"2024-04-24T01:24:00.732471+0000","last_became_peered":"2024-04-24T01:24:00.732471+0000","last_unstale":"2024-04-24T01:28:04.013113+0000","last_undegraded":"2024-04-24T01:28:04.013113+0000","last_fullsized":"2024-04-24T01:28:04.013113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.012979+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.012979+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:48.531163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:33.863646+0000","last_change":"2024-04-24T01:28:33.863646+0000","last_active":"2024-04-24T01:28:33.863646+0000","last_peered":"2024-04-24T01:28:33.863646+0000","last_clean":"2024-04-24T01:28:33.863646+0000","last_became_active":"2024-04-24T01:23:58.756659+0000","last_became_peered":"2024-04-24T01:23:58.756659+0000","last_unstale":"2024-04-24T01:28:33.863646+0000","last_undegraded":"2024-04-24T01:28:33.863646+0000","last_fullsized":"2024-04-24T01:28:33.863646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:33.863531+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:33.863531+0000","last_clean_scrub_stamp":"2024-04-24T01:28:33.863531+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:37:26.355037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"34'14","reported_seq":90,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.722184+0000","last_change":"2024-04-24T01:27:52.722184+0000","last_active":"2024-04-24T01:27:52.722184+0000","last_peered":"2024-04-24T01:27:52.722184+0000","last_clean":"2024-04-24T01:27:52.722184+0000","last_became_active":"2024-04-24T01:24:00.738847+0000","last_became_peered":"2024-04-24T01:24:00.738847+0000","last_unstale":"2024-04-24T01:27:52.722184+0000","last_undegraded":"2024-04-24T01:27:52.722184+0000","last_fullsized":"2024-04-24T01:27:52.722184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:52.722064+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.722064+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:47.178258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":58,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.076470+0000","last_change":"2024-04-24T01:28:07.076470+0000","last_active":"2024-04-24T01:28:07.076470+0000","last_peered":"2024-04-24T01:28:07.076470+0000","last_clean":"2024-04-24T01:28:07.076470+0000","last_became_active":"2024-04-24T01:23:58.740150+0000","last_became_peered":"2024-04-24T01:23:58.740150+0000","last_unstale":"2024-04-24T01:28:07.076470+0000","last_undegraded":"2024-04-24T01:28:07.076470+0000","last_fullsized":"2024-04-24T01:28:07.076470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.076348+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.076348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:48.144139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.126524+0000","last_change":"2024-04-24T01:28:13.126524+0000","last_active":"2024-04-24T01:28:13.126524+0000","last_peered":"2024-04-24T01:28:13.126524+0000","last_clean":"2024-04-24T01:28:13.126524+0000","last_became_active":"2024-04-24T01:24:39.795751+0000","last_became_peered":"2024-04-24T01:24:39.795751+0000","last_unstale":"2024-04-24T01:28:13.126524+0000","last_undegraded":"2024-04-24T01:28:13.126524+0000","last_fullsized":"2024-04-24T01:28:13.126524+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:13.126407+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.126407+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:09:16.636846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:25.991185+0000","last_change":"2024-04-24T01:28:25.991185+0000","last_active":"2024-04-24T01:28:25.991185+0000","last_peered":"2024-04-24T01:28:25.991185+0000","last_clean":"2024-04-24T01:28:25.991185+0000","last_became_active":"2024-04-24T01:23:58.757451+0000","last_became_peered":"2024-04-24T01:23:58.757451+0000","last_unstale":"2024-04-24T01:28:25.991185+0000","last_undegraded":"2024-04-24T01:28:25.991185+0000","last_fullsized":"2024-04-24T01:28:25.991185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:25.991030+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:25.991030+0000","last_clean_scrub_stamp":"2024-04-24T01:28:25.991030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:04.235902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.056694+0000","last_change":"2024-04-24T01:27:43.056694+0000","last_active":"2024-04-24T01:27:43.056694+0000","last_peered":"2024-04-24T01:27:43.056694+0000","last_clean":"2024-04-24T01:27:43.056694+0000","last_became_active":"2024-04-24T01:24:00.744807+0000","last_became_peered":"2024-04-24T01:24:00.744807+0000","last_unstale":"2024-04-24T01:27:43.056694+0000","last_undegraded":"2024-04-24T01:27:43.056694+0000","last_fullsized":"2024-04-24T01:27:43.056694+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:43.056528+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.056528+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:52.813992+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.096615+0000","last_change":"2024-04-24T01:28:14.096641+0000","last_active":"2024-04-24T01:28:14.096615+0000","last_peered":"2024-04-24T01:28:14.096615+0000","last_clean":"2024-04-24T01:28:14.096615+0000","last_became_active":"2024-04-24T01:23:58.742638+0000","last_became_peered":"2024-04-24T01:23:58.742638+0000","last_unstale":"2024-04-24T01:28:14.096615+0000","last_undegraded":"2024-04-24T01:28:14.096615+0000","last_fullsized":"2024-04-24T01:28:14.096615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.096486+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.096486+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:36:51.442284+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.084049+0000","last_change":"2024-04-24T01:27:52.084049+0000","last_active":"2024-04-24T01:27:52.084049+0000","last_peered":"2024-04-24T01:27:52.084049+0000","last_clean":"2024-04-24T01:27:52.084049+0000","last_became_active":"2024-04-24T01:24:00.739786+0000","last_became_peered":"2024-04-24T01:24:00.739786+0000","last_unstale":"2024-04-24T01:27:52.084049+0000","last_undegraded":"2024-04-24T01:27:52.084049+0000","last_fullsized":"2024-04-24T01:27:52.084049+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.083901+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.083901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:03:30.781693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"34'8","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.864145+0000","last_change":"2024-04-24T01:27:52.864145+0000","last_active":"2024-04-24T01:27:52.864145+0000","last_peered":"2024-04-24T01:27:52.864145+0000","last_clean":"2024-04-24T01:27:52.864145+0000","last_became_active":"2024-04-24T01:24:00.734780+0000","last_became_peered":"2024-04-24T01:24:00.734780+0000","last_unstale":"2024-04-24T01:27:52.864145+0000","last_undegraded":"2024-04-24T01:27:52.864145+0000","last_fullsized":"2024-04-24T01:27:52.864145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:52.864012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.864012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:12.175983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.808645+0000","last_change":"2024-04-24T01:27:58.808645+0000","last_active":"2024-04-24T01:27:58.808645+0000","last_peered":"2024-04-24T01:27:58.808645+0000","last_clean":"2024-04-24T01:27:58.808645+0000","last_became_active":"2024-04-24T01:23:58.755170+0000","last_became_peered":"2024-04-24T01:23:58.755170+0000","last_unstale":"2024-04-24T01:27:58.808645+0000","last_undegraded":"2024-04-24T01:27:58.808645+0000","last_fullsized":"2024-04-24T01:27:58.808645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.808475+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.808475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:39.876266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.733689+0000","last_change":"2024-04-24T01:27:46.733689+0000","last_active":"2024-04-24T01:27:46.733689+0000","last_peered":"2024-04-24T01:27:46.733689+0000","last_clean":"2024-04-24T01:27:46.733689+0000","last_became_active":"2024-04-24T01:24:00.744508+0000","last_became_peered":"2024-04-24T01:24:00.744508+0000","last_unstale":"2024-04-24T01:27:46.733689+0000","last_undegraded":"2024-04-24T01:27:46.733689+0000","last_fullsized":"2024-04-24T01:27:46.733689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:46.733535+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.733535+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:05.735464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.150662+0000","last_change":"2024-04-24T01:28:04.150662+0000","last_active":"2024-04-24T01:28:04.150662+0000","last_peered":"2024-04-24T01:28:04.150662+0000","last_clean":"2024-04-24T01:28:04.150662+0000","last_became_active":"2024-04-24T01:23:58.737335+0000","last_became_peered":"2024-04-24T01:23:58.737335+0000","last_unstale":"2024-04-24T01:28:04.150662+0000","last_undegraded":"2024-04-24T01:28:04.150662+0000","last_fullsized":"2024-04-24T01:28:04.150662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:04.150539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.150539+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:29.387549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'14","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.777752+0000","last_change":"2024-04-24T01:27:43.777752+0000","last_active":"2024-04-24T01:27:43.777752+0000","last_peered":"2024-04-24T01:27:43.777752+0000","last_clean":"2024-04-24T01:27:43.777752+0000","last_became_active":"2024-04-24T01:24:00.744677+0000","last_became_peered":"2024-04-24T01:24:00.744677+0000","last_unstale":"2024-04-24T01:27:43.777752+0000","last_undegraded":"2024-04-24T01:27:43.777752+0000","last_fullsized":"2024-04-24T01:27:43.777752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:43.777633+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.777633+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:36.913978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":35,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.842797+0000","last_change":"2024-04-24T01:28:14.842797+0000","last_active":"2024-04-24T01:28:14.842797+0000","last_peered":"2024-04-24T01:28:14.842797+0000","last_clean":"2024-04-24T01:28:14.842797+0000","last_became_active":"2024-04-24T01:23:58.752105+0000","last_became_peered":"2024-04-24T01:23:58.752105+0000","last_unstale":"2024-04-24T01:28:14.842797+0000","last_undegraded":"2024-04-24T01:28:14.842797+0000","last_fullsized":"2024-04-24T01:28:14.842797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:14.842663+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.842663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:14.722950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"34'12","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.108364+0000","last_change":"2024-04-24T01:28:15.108364+0000","last_active":"2024-04-24T01:28:15.108364+0000","last_peered":"2024-04-24T01:28:15.108364+0000","last_clean":"2024-04-24T01:28:15.108364+0000","last_became_active":"2024-04-24T01:24:00.738110+0000","last_became_peered":"2024-04-24T01:24:00.738110+0000","last_unstale":"2024-04-24T01:28:15.108364+0000","last_undegraded":"2024-04-24T01:28:15.108364+0000","last_fullsized":"2024-04-24T01:28:15.108364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:15.108195+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.108195+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:19:14.900595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.786303+0000","last_change":"2024-04-24T01:28:10.786303+0000","last_active":"2024-04-24T01:28:10.786303+0000","last_peered":"2024-04-24T01:28:10.786303+0000","last_clean":"2024-04-24T01:28:10.786303+0000","last_became_active":"2024-04-24T01:23:58.751295+0000","last_became_peered":"2024-04-24T01:23:58.751295+0000","last_unstale":"2024-04-24T01:28:10.786303+0000","last_undegraded":"2024-04-24T01:28:10.786303+0000","last_fullsized":"2024-04-24T01:28:10.786303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:10.786147+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.786147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:55.313023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":40,"num_write_kb":4094,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"34'14","reported_seq":88,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.040969+0000","last_change":"2024-04-24T01:27:56.040969+0000","last_active":"2024-04-24T01:27:56.040969+0000","last_peered":"2024-04-24T01:27:56.040969+0000","last_clean":"2024-04-24T01:27:56.040969+0000","last_became_active":"2024-04-24T01:24:00.740138+0000","last_became_peered":"2024-04-24T01:24:00.740138+0000","last_unstale":"2024-04-24T01:27:56.040969+0000","last_undegraded":"2024-04-24T01:27:56.040969+0000","last_fullsized":"2024-04-24T01:27:56.040969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:27:56.040837+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.040837+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:53:12.454785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:52.307427+0000","last_change":"2024-04-24T01:27:52.307427+0000","last_active":"2024-04-24T01:27:52.307427+0000","last_peered":"2024-04-24T01:27:52.307427+0000","last_clean":"2024-04-24T01:27:52.307427+0000","last_became_active":"2024-04-24T01:23:58.747303+0000","last_became_peered":"2024-04-24T01:23:58.747303+0000","last_unstale":"2024-04-24T01:27:52.307427+0000","last_undegraded":"2024-04-24T01:27:52.307427+0000","last_fullsized":"2024-04-24T01:27:52.307427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:52.307307+0000","last_clean_scrub_stamp":"2024-04-24T01:27:52.307307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:28:07.610661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.760706+0000","last_change":"2024-04-24T01:27:47.760706+0000","last_active":"2024-04-24T01:27:47.760706+0000","last_peered":"2024-04-24T01:27:47.760706+0000","last_clean":"2024-04-24T01:27:47.760706+0000","last_became_active":"2024-04-24T01:24:00.743891+0000","last_became_peered":"2024-04-24T01:24:00.743891+0000","last_unstale":"2024-04-24T01:27:47.760706+0000","last_undegraded":"2024-04-24T01:27:47.760706+0000","last_fullsized":"2024-04-24T01:27:47.760706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:47.760550+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.760550+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:24:04.523660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"34'4","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.036833+0000","last_change":"2024-04-24T01:28:15.036833+0000","last_active":"2024-04-24T01:28:15.036833+0000","last_peered":"2024-04-24T01:28:15.036833+0000","last_clean":"2024-04-24T01:28:15.036833+0000","last_became_active":"2024-04-24T01:23:58.758027+0000","last_became_peered":"2024-04-24T01:23:58.758027+0000","last_unstale":"2024-04-24T01:28:15.036833+0000","last_undegraded":"2024-04-24T01:28:15.036833+0000","last_fullsized":"2024-04-24T01:28:15.036833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:15.036696+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.036696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:23.884209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"34'36","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.929635+0000","last_change":"2024-04-24T01:28:18.929635+0000","last_active":"2024-04-24T01:28:18.929635+0000","last_peered":"2024-04-24T01:28:18.929635+0000","last_clean":"2024-04-24T01:28:18.929635+0000","last_became_active":"2024-04-24T01:24:08.778795+0000","last_became_peered":"2024-04-24T01:24:08.778795+0000","last_unstale":"2024-04-24T01:28:18.929635+0000","last_undegraded":"2024-04-24T01:28:18.929635+0000","last_fullsized":"2024-04-24T01:28:18.929635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:28:18.929470+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.929470+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:09:29.233355+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.982647+0000","last_change":"2024-04-24T01:28:04.982647+0000","last_active":"2024-04-24T01:28:04.982647+0000","last_peered":"2024-04-24T01:28:04.982647+0000","last_clean":"2024-04-24T01:28:04.982647+0000","last_became_active":"2024-04-24T01:24:00.732368+0000","last_became_peered":"2024-04-24T01:24:00.732368+0000","last_unstale":"2024-04-24T01:28:04.982647+0000","last_undegraded":"2024-04-24T01:28:04.982647+0000","last_fullsized":"2024-04-24T01:28:04.982647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:04.982533+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.982533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:29:34.027613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.973646+0000","last_change":"2024-04-24T01:28:18.973646+0000","last_active":"2024-04-24T01:28:18.973646+0000","last_peered":"2024-04-24T01:28:18.973646+0000","last_clean":"2024-04-24T01:28:18.973646+0000","last_became_active":"2024-04-24T01:23:58.761379+0000","last_became_peered":"2024-04-24T01:23:58.761379+0000","last_unstale":"2024-04-24T01:28:18.973646+0000","last_undegraded":"2024-04-24T01:28:18.973646+0000","last_fullsized":"2024-04-24T01:28:18.973646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:18.973529+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.973529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:48.432455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.182426+0000","last_change":"2024-04-24T01:27:22.182426+0000","last_active":"2024-04-24T01:27:22.182426+0000","last_peered":"2024-04-24T01:27:22.182426+0000","last_clean":"2024-04-24T01:27:22.182426+0000","last_became_active":"2024-04-24T01:24:02.754350+0000","last_became_peered":"2024-04-24T01:24:02.754350+0000","last_unstale":"2024-04-24T01:27:22.182426+0000","last_undegraded":"2024-04-24T01:27:22.182426+0000","last_fullsized":"2024-04-24T01:27:22.182426+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.182314+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.182314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:26:53.198026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"34'50","reported_seq":118,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.018949+0000","last_change":"2024-04-24T01:27:33.018949+0000","last_active":"2024-04-24T01:27:33.018949+0000","last_peered":"2024-04-24T01:27:33.018949+0000","last_clean":"2024-04-24T01:27:33.018949+0000","last_became_active":"2024-04-24T01:24:04.758870+0000","last_became_peered":"2024-04-24T01:24:04.758870+0000","last_unstale":"2024-04-24T01:27:33.018949+0000","last_undegraded":"2024-04-24T01:27:33.018949+0000","last_fullsized":"2024-04-24T01:27:33.018949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:33.018804+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.018804+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:06.024098+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.763639+0000","last_change":"2024-04-24T01:27:29.763639+0000","last_active":"2024-04-24T01:27:29.763639+0000","last_peered":"2024-04-24T01:27:29.763639+0000","last_clean":"2024-04-24T01:27:29.763639+0000","last_became_active":"2024-04-24T01:24:06.770920+0000","last_became_peered":"2024-04-24T01:24:06.770920+0000","last_unstale":"2024-04-24T01:27:29.763639+0000","last_undegraded":"2024-04-24T01:27:29.763639+0000","last_fullsized":"2024-04-24T01:27:29.763639+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.763505+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.763505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:32:56.480614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":35,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.855160+0000","last_change":"2024-04-24T01:28:16.855160+0000","last_active":"2024-04-24T01:28:16.855160+0000","last_peered":"2024-04-24T01:28:16.855160+0000","last_clean":"2024-04-24T01:28:16.855160+0000","last_became_active":"2024-04-24T01:24:08.778527+0000","last_became_peered":"2024-04-24T01:24:08.778527+0000","last_unstale":"2024-04-24T01:28:16.855160+0000","last_undegraded":"2024-04-24T01:28:16.855160+0000","last_fullsized":"2024-04-24T01:28:16.855160+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:28:16.855041+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.855041+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:38.466443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"34'10","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.040917+0000","last_change":"2024-04-24T01:28:02.040917+0000","last_active":"2024-04-24T01:28:02.040917+0000","last_peered":"2024-04-24T01:28:02.040917+0000","last_clean":"2024-04-24T01:28:02.040917+0000","last_became_active":"2024-04-24T01:24:00.732903+0000","last_became_peered":"2024-04-24T01:24:00.732903+0000","last_unstale":"2024-04-24T01:28:02.040917+0000","last_undegraded":"2024-04-24T01:28:02.040917+0000","last_fullsized":"2024-04-24T01:28:02.040917+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:02.040760+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.040760+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:37.666837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.092679+0000","last_change":"2024-04-24T01:27:59.092679+0000","last_active":"2024-04-24T01:27:59.092679+0000","last_peered":"2024-04-24T01:27:59.092679+0000","last_clean":"2024-04-24T01:27:59.092679+0000","last_became_active":"2024-04-24T01:23:58.740957+0000","last_became_peered":"2024-04-24T01:23:58.740957+0000","last_unstale":"2024-04-24T01:27:59.092679+0000","last_undegraded":"2024-04-24T01:27:59.092679+0000","last_fullsized":"2024-04-24T01:27:59.092679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:59.092526+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.092526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:22:32.097820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.909563+0000","last_change":"2024-04-24T01:28:20.909587+0000","last_active":"2024-04-24T01:28:20.909563+0000","last_peered":"2024-04-24T01:28:20.909563+0000","last_clean":"2024-04-24T01:28:20.909563+0000","last_became_active":"2024-04-24T01:24:39.799101+0000","last_became_peered":"2024-04-24T01:24:39.799101+0000","last_unstale":"2024-04-24T01:28:20.909563+0000","last_undegraded":"2024-04-24T01:28:20.909563+0000","last_fullsized":"2024-04-24T01:28:20.909563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:20.909463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:20.909463+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.909463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:15:56.535540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"34'17","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.795795+0000","last_change":"2024-04-24T01:27:28.795795+0000","last_active":"2024-04-24T01:27:28.795795+0000","last_peered":"2024-04-24T01:27:28.795795+0000","last_clean":"2024-04-24T01:27:28.795795+0000","last_became_active":"2024-04-24T01:24:04.754179+0000","last_became_peered":"2024-04-24T01:24:04.754179+0000","last_unstale":"2024-04-24T01:27:28.795795+0000","last_undegraded":"2024-04-24T01:27:28.795795+0000","last_fullsized":"2024-04-24T01:27:28.795795+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'17","last_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_deep_scrub":"34'17","last_deep_scrub_stamp":"2024-04-24T01:27:28.795617+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.795617+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:13.586689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.807246+0000","last_change":"2024-04-24T01:27:22.807246+0000","last_active":"2024-04-24T01:27:22.807246+0000","last_peered":"2024-04-24T01:27:22.807246+0000","last_clean":"2024-04-24T01:27:22.807246+0000","last_became_active":"2024-04-24T01:24:06.766828+0000","last_became_peered":"2024-04-24T01:24:06.766828+0000","last_unstale":"2024-04-24T01:27:22.807246+0000","last_undegraded":"2024-04-24T01:27:22.807246+0000","last_fullsized":"2024-04-24T01:27:22.807246+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.807114+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.807114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:58.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.082598+0000","last_change":"2024-04-24T01:28:17.082633+0000","last_active":"2024-04-24T01:28:17.082598+0000","last_peered":"2024-04-24T01:28:17.082598+0000","last_clean":"2024-04-24T01:28:17.082598+0000","last_became_active":"2024-04-24T01:24:08.768310+0000","last_became_peered":"2024-04-24T01:24:08.768310+0000","last_unstale":"2024-04-24T01:28:17.082598+0000","last_undegraded":"2024-04-24T01:28:17.082598+0000","last_fullsized":"2024-04-24T01:28:17.082598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:17.082496+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:17.082496+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.082496+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:32:28.277615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"34'6","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.977385+0000","last_change":"2024-04-24T01:27:57.977385+0000","last_active":"2024-04-24T01:27:57.977385+0000","last_peered":"2024-04-24T01:27:57.977385+0000","last_clean":"2024-04-24T01:27:57.977385+0000","last_became_active":"2024-04-24T01:24:00.734822+0000","last_became_peered":"2024-04-24T01:24:00.734822+0000","last_unstale":"2024-04-24T01:27:57.977385+0000","last_undegraded":"2024-04-24T01:27:57.977385+0000","last_fullsized":"2024-04-24T01:27:57.977385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:57.977272+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.977272+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:48:19.588675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:27.947305+0000","last_change":"2024-04-24T01:28:27.947305+0000","last_active":"2024-04-24T01:28:27.947305+0000","last_peered":"2024-04-24T01:28:27.947305+0000","last_clean":"2024-04-24T01:28:27.947305+0000","last_became_active":"2024-04-24T01:23:58.757156+0000","last_became_peered":"2024-04-24T01:23:58.757156+0000","last_unstale":"2024-04-24T01:28:27.947305+0000","last_undegraded":"2024-04-24T01:28:27.947305+0000","last_fullsized":"2024-04-24T01:28:27.947305+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:27.947163+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:27.947163+0000","last_clean_scrub_stamp":"2024-04-24T01:28:27.947163+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:05:13.732224+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.283686+0000","last_change":"2024-04-24T01:27:39.283686+0000","last_active":"2024-04-24T01:27:39.283686+0000","last_peered":"2024-04-24T01:27:39.283686+0000","last_clean":"2024-04-24T01:27:39.283686+0000","last_became_active":"2024-04-24T01:24:02.754185+0000","last_became_peered":"2024-04-24T01:24:02.754185+0000","last_unstale":"2024-04-24T01:27:39.283686+0000","last_undegraded":"2024-04-24T01:27:39.283686+0000","last_fullsized":"2024-04-24T01:27:39.283686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.283571+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.283571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:34:27.477155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"34'30","reported_seq":82,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.914998+0000","last_change":"2024-04-24T01:27:28.914998+0000","last_active":"2024-04-24T01:27:28.914998+0000","last_peered":"2024-04-24T01:27:28.914998+0000","last_clean":"2024-04-24T01:27:28.914998+0000","last_became_active":"2024-04-24T01:24:04.756690+0000","last_became_peered":"2024-04-24T01:24:04.756690+0000","last_unstale":"2024-04-24T01:27:28.914998+0000","last_undegraded":"2024-04-24T01:27:28.914998+0000","last_fullsized":"2024-04-24T01:27:28.914998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:28.914874+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.914874+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:54:31.978701+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"34'285","reported_seq":434,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.904142+0000","last_change":"2024-04-24T01:27:46.904142+0000","last_active":"2024-04-24T01:27:46.904142+0000","last_peered":"2024-04-24T01:27:46.904142+0000","last_clean":"2024-04-24T01:27:46.904142+0000","last_became_active":"2024-04-24T01:24:06.765335+0000","last_became_peered":"2024-04-24T01:24:06.765335+0000","last_unstale":"2024-04-24T01:27:46.904142+0000","last_undegraded":"2024-04-24T01:27:46.904142+0000","last_fullsized":"2024-04-24T01:27:46.904142+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:46.904020+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.904020+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:50.414459+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"34'2","reported_seq":28,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.135360+0000","last_change":"2024-04-24T01:28:10.135388+0000","last_active":"2024-04-24T01:28:10.135360+0000","last_peered":"2024-04-24T01:28:10.135360+0000","last_clean":"2024-04-24T01:28:10.135360+0000","last_became_active":"2024-04-24T01:24:08.772295+0000","last_became_peered":"2024-04-24T01:24:08.772295+0000","last_unstale":"2024-04-24T01:28:10.135360+0000","last_undegraded":"2024-04-24T01:28:10.135360+0000","last_fullsized":"2024-04-24T01:28:10.135360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:10.135272+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.135272+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:45.660932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.273889+0000","last_change":"2024-04-24T01:27:50.273889+0000","last_active":"2024-04-24T01:27:50.273889+0000","last_peered":"2024-04-24T01:27:50.273889+0000","last_clean":"2024-04-24T01:27:50.273889+0000","last_became_active":"2024-04-24T01:24:00.746231+0000","last_became_peered":"2024-04-24T01:24:00.746231+0000","last_unstale":"2024-04-24T01:27:50.273889+0000","last_undegraded":"2024-04-24T01:27:50.273889+0000","last_fullsized":"2024-04-24T01:27:50.273889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.273766+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.273766+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:54:42.265021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.812248+0000","last_change":"2024-04-24T01:27:56.812248+0000","last_active":"2024-04-24T01:27:56.812248+0000","last_peered":"2024-04-24T01:27:56.812248+0000","last_clean":"2024-04-24T01:27:56.812248+0000","last_became_active":"2024-04-24T01:23:58.755525+0000","last_became_peered":"2024-04-24T01:23:58.755525+0000","last_unstale":"2024-04-24T01:27:56.812248+0000","last_undegraded":"2024-04-24T01:27:56.812248+0000","last_fullsized":"2024-04-24T01:27:56.812248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.812089+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.812089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:57:46.064127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.157587+0000","last_change":"2024-04-24T01:27:28.157587+0000","last_active":"2024-04-24T01:27:28.157587+0000","last_peered":"2024-04-24T01:27:28.157587+0000","last_clean":"2024-04-24T01:27:28.157587+0000","last_became_active":"2024-04-24T01:24:02.752603+0000","last_became_peered":"2024-04-24T01:24:02.752603+0000","last_unstale":"2024-04-24T01:27:28.157587+0000","last_undegraded":"2024-04-24T01:27:28.157587+0000","last_fullsized":"2024-04-24T01:27:28.157587+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:28.157467+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.157467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:47.159396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"34'43","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.890053+0000","last_change":"2024-04-24T01:27:26.890053+0000","last_active":"2024-04-24T01:27:26.890053+0000","last_peered":"2024-04-24T01:27:26.890053+0000","last_clean":"2024-04-24T01:27:26.890053+0000","last_became_active":"2024-04-24T01:24:04.759341+0000","last_became_peered":"2024-04-24T01:24:04.759341+0000","last_unstale":"2024-04-24T01:27:26.890053+0000","last_undegraded":"2024-04-24T01:27:26.890053+0000","last_fullsized":"2024-04-24T01:27:26.890053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:26.889929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.889929+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:07:10.323651+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"34'285","reported_seq":414,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.070163+0000","last_change":"2024-04-24T01:27:24.070163+0000","last_active":"2024-04-24T01:27:24.070163+0000","last_peered":"2024-04-24T01:27:24.070163+0000","last_clean":"2024-04-24T01:27:24.070163+0000","last_became_active":"2024-04-24T01:24:06.764797+0000","last_became_peered":"2024-04-24T01:24:06.764797+0000","last_unstale":"2024-04-24T01:27:24.070163+0000","last_undegraded":"2024-04-24T01:27:24.070163+0000","last_fullsized":"2024-04-24T01:27:24.070163+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:24.069989+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.069989+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:29:46.537881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.899047+0000","last_change":"2024-04-24T01:27:53.899047+0000","last_active":"2024-04-24T01:27:53.899047+0000","last_peered":"2024-04-24T01:27:53.899047+0000","last_clean":"2024-04-24T01:27:53.899047+0000","last_became_active":"2024-04-24T01:24:00.737698+0000","last_became_peered":"2024-04-24T01:24:00.737698+0000","last_unstale":"2024-04-24T01:27:53.899047+0000","last_undegraded":"2024-04-24T01:27:53.899047+0000","last_fullsized":"2024-04-24T01:27:53.899047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.898918+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.898918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:10:49.273306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.068848+0000","last_change":"2024-04-24T01:27:53.068848+0000","last_active":"2024-04-24T01:27:53.068848+0000","last_peered":"2024-04-24T01:27:53.068848+0000","last_clean":"2024-04-24T01:27:53.068848+0000","last_became_active":"2024-04-24T01:23:58.744064+0000","last_became_peered":"2024-04-24T01:23:58.744064+0000","last_unstale":"2024-04-24T01:27:53.068848+0000","last_undegraded":"2024-04-24T01:27:53.068848+0000","last_fullsized":"2024-04-24T01:27:53.068848+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:53.068721+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.068721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:30.201730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.724506+0000","last_change":"2024-04-24T01:27:31.724506+0000","last_active":"2024-04-24T01:27:31.724506+0000","last_peered":"2024-04-24T01:27:31.724506+0000","last_clean":"2024-04-24T01:27:31.724506+0000","last_became_active":"2024-04-24T01:24:02.759885+0000","last_became_peered":"2024-04-24T01:24:02.759885+0000","last_unstale":"2024-04-24T01:27:31.724506+0000","last_undegraded":"2024-04-24T01:27:31.724506+0000","last_fullsized":"2024-04-24T01:27:31.724506+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:31.724380+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.724380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:37.609422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"34'58","reported_seq":125,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.950474+0000","last_change":"2024-04-24T01:27:30.950474+0000","last_active":"2024-04-24T01:27:30.950474+0000","last_peered":"2024-04-24T01:27:30.950474+0000","last_clean":"2024-04-24T01:27:30.950474+0000","last_became_active":"2024-04-24T01:24:04.753129+0000","last_became_peered":"2024-04-24T01:24:04.753129+0000","last_unstale":"2024-04-24T01:27:30.950474+0000","last_undegraded":"2024-04-24T01:27:30.950474+0000","last_fullsized":"2024-04-24T01:27:30.950474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'58","last_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_deep_scrub":"34'58","last_deep_scrub_stamp":"2024-04-24T01:27:30.950337+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.950337+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:02:06.885598+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":30,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.107889+0000","last_change":"2024-04-24T01:27:23.107889+0000","last_active":"2024-04-24T01:27:23.107889+0000","last_peered":"2024-04-24T01:27:23.107889+0000","last_clean":"2024-04-24T01:27:23.107889+0000","last_became_active":"2024-04-24T01:24:06.764978+0000","last_became_peered":"2024-04-24T01:24:06.764978+0000","last_unstale":"2024-04-24T01:27:23.107889+0000","last_undegraded":"2024-04-24T01:27:23.107889+0000","last_fullsized":"2024-04-24T01:27:23.107889+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.107773+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.107773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:16.379160+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"34'3","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.138383+0000","last_change":"2024-04-24T01:28:12.138383+0000","last_active":"2024-04-24T01:28:12.138383+0000","last_peered":"2024-04-24T01:28:12.138383+0000","last_clean":"2024-04-24T01:28:12.138383+0000","last_became_active":"2024-04-24T01:24:08.776312+0000","last_became_peered":"2024-04-24T01:24:08.776312+0000","last_unstale":"2024-04-24T01:28:12.138383+0000","last_undegraded":"2024-04-24T01:28:12.138383+0000","last_fullsized":"2024-04-24T01:28:12.138383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:12.138254+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.138254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:11.767955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.703790+0000","last_change":"2024-04-24T01:27:51.703790+0000","last_active":"2024-04-24T01:27:51.703790+0000","last_peered":"2024-04-24T01:27:51.703790+0000","last_clean":"2024-04-24T01:27:51.703790+0000","last_became_active":"2024-04-24T01:24:00.739117+0000","last_became_peered":"2024-04-24T01:24:00.739117+0000","last_unstale":"2024-04-24T01:27:51.703790+0000","last_undegraded":"2024-04-24T01:27:51.703790+0000","last_fullsized":"2024-04-24T01:27:51.703790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:51.703677+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.703677+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:51:59.808919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.113076+0000","last_change":"2024-04-24T01:27:49.113076+0000","last_active":"2024-04-24T01:27:49.113076+0000","last_peered":"2024-04-24T01:27:49.113076+0000","last_clean":"2024-04-24T01:27:49.113076+0000","last_became_active":"2024-04-24T01:23:58.746995+0000","last_became_peered":"2024-04-24T01:23:58.746995+0000","last_unstale":"2024-04-24T01:27:49.113076+0000","last_undegraded":"2024-04-24T01:27:49.113076+0000","last_fullsized":"2024-04-24T01:27:49.113076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:49.112893+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.112893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:16:26.748726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"34'5","reported_seq":239,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.312374+0000","last_change":"2024-04-24T01:27:40.312374+0000","last_active":"2024-04-24T01:27:40.312374+0000","last_peered":"2024-04-24T01:27:40.312374+0000","last_clean":"2024-04-24T01:27:40.312374+0000","last_became_active":"2024-04-24T01:24:02.754260+0000","last_became_peered":"2024-04-24T01:24:02.754260+0000","last_unstale":"2024-04-24T01:27:40.312374+0000","last_undegraded":"2024-04-24T01:27:40.312374+0000","last_fullsized":"2024-04-24T01:27:40.312374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:40.312210+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.312210+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:37:26.075351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"34'43","reported_seq":105,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.146630+0000","last_change":"2024-04-24T01:27:23.146630+0000","last_active":"2024-04-24T01:27:23.146630+0000","last_peered":"2024-04-24T01:27:23.146630+0000","last_clean":"2024-04-24T01:27:23.146630+0000","last_became_active":"2024-04-24T01:24:04.757088+0000","last_became_peered":"2024-04-24T01:24:04.757088+0000","last_unstale":"2024-04-24T01:27:23.146630+0000","last_undegraded":"2024-04-24T01:27:23.146630+0000","last_fullsized":"2024-04-24T01:27:23.146630+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'43","last_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_deep_scrub":"34'43","last_deep_scrub_stamp":"2024-04-24T01:27:23.146508+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.146508+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:42.897359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.041459+0000","last_change":"2024-04-24T01:27:25.041459+0000","last_active":"2024-04-24T01:27:25.041459+0000","last_peered":"2024-04-24T01:27:25.041459+0000","last_clean":"2024-04-24T01:27:25.041459+0000","last_became_active":"2024-04-24T01:24:06.769941+0000","last_became_peered":"2024-04-24T01:24:06.769941+0000","last_unstale":"2024-04-24T01:27:25.041459+0000","last_undegraded":"2024-04-24T01:27:25.041459+0000","last_fullsized":"2024-04-24T01:27:25.041459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:25.041335+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.041335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.527549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.764060+0000","last_change":"2024-04-24T01:27:45.764060+0000","last_active":"2024-04-24T01:27:45.764060+0000","last_peered":"2024-04-24T01:27:45.764060+0000","last_clean":"2024-04-24T01:27:45.764060+0000","last_became_active":"2024-04-24T01:24:08.772451+0000","last_became_peered":"2024-04-24T01:24:08.772451+0000","last_unstale":"2024-04-24T01:27:45.764060+0000","last_undegraded":"2024-04-24T01:27:45.764060+0000","last_fullsized":"2024-04-24T01:27:45.764060+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:45.763949+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.763949+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:24.155072+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"34'8","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.048365+0000","last_change":"2024-04-24T01:27:54.048365+0000","last_active":"2024-04-24T01:27:54.048365+0000","last_peered":"2024-04-24T01:27:54.048365+0000","last_clean":"2024-04-24T01:27:54.048365+0000","last_became_active":"2024-04-24T01:24:00.739981+0000","last_became_peered":"2024-04-24T01:24:00.739981+0000","last_unstale":"2024-04-24T01:27:54.048365+0000","last_undegraded":"2024-04-24T01:27:54.048365+0000","last_fullsized":"2024-04-24T01:27:54.048365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:54.048229+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.048229+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:34:31.165768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:26.961654+0000","last_change":"2024-04-24T01:28:26.961654+0000","last_active":"2024-04-24T01:28:26.961654+0000","last_peered":"2024-04-24T01:28:26.961654+0000","last_clean":"2024-04-24T01:28:26.961654+0000","last_became_active":"2024-04-24T01:23:58.764063+0000","last_became_peered":"2024-04-24T01:23:58.764063+0000","last_unstale":"2024-04-24T01:28:26.961654+0000","last_undegraded":"2024-04-24T01:28:26.961654+0000","last_fullsized":"2024-04-24T01:28:26.961654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:26.961535+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:26.961535+0000","last_clean_scrub_stamp":"2024-04-24T01:28:26.961535+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:30:55.159380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.208971+0000","last_change":"2024-04-24T01:27:35.208971+0000","last_active":"2024-04-24T01:27:35.208971+0000","last_peered":"2024-04-24T01:27:35.208971+0000","last_clean":"2024-04-24T01:27:35.208971+0000","last_became_active":"2024-04-24T01:24:02.754727+0000","last_became_peered":"2024-04-24T01:24:02.754727+0000","last_unstale":"2024-04-24T01:27:35.208971+0000","last_undegraded":"2024-04-24T01:27:35.208971+0000","last_fullsized":"2024-04-24T01:27:35.208971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:35.208809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.208809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:53.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"34'60","reported_seq":131,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.868587+0000","last_change":"2024-04-24T01:27:51.868587+0000","last_active":"2024-04-24T01:27:51.868587+0000","last_peered":"2024-04-24T01:27:51.868587+0000","last_clean":"2024-04-24T01:27:51.868587+0000","last_became_active":"2024-04-24T01:24:04.760445+0000","last_became_peered":"2024-04-24T01:24:04.760445+0000","last_unstale":"2024-04-24T01:27:51.868587+0000","last_undegraded":"2024-04-24T01:27:51.868587+0000","last_fullsized":"2024-04-24T01:27:51.868587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'60","last_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_deep_scrub":"34'60","last_deep_scrub_stamp":"2024-04-24T01:27:51.868449+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.868449+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:02.837512+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":62,"num_read_kb":51,"num_write":32,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"34'285","reported_seq":389,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.193209+0000","last_change":"2024-04-24T01:27:33.193209+0000","last_active":"2024-04-24T01:27:33.193209+0000","last_peered":"2024-04-24T01:27:33.193209+0000","last_clean":"2024-04-24T01:27:33.193209+0000","last_became_active":"2024-04-24T01:24:06.770167+0000","last_became_peered":"2024-04-24T01:24:06.770167+0000","last_unstale":"2024-04-24T01:27:33.193209+0000","last_undegraded":"2024-04-24T01:27:33.193209+0000","last_fullsized":"2024-04-24T01:27:33.193209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.193083+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.193083+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:59:14.827477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.116526+0000","last_change":"2024-04-24T01:28:16.116526+0000","last_active":"2024-04-24T01:28:16.116526+0000","last_peered":"2024-04-24T01:28:16.116526+0000","last_clean":"2024-04-24T01:28:16.116526+0000","last_became_active":"2024-04-24T01:24:08.768303+0000","last_became_peered":"2024-04-24T01:24:08.768303+0000","last_unstale":"2024-04-24T01:28:16.116526+0000","last_undegraded":"2024-04-24T01:28:16.116526+0000","last_fullsized":"2024-04-24T01:28:16.116526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.116365+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.116365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:36.662647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"34'8","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.095967+0000","last_change":"2024-04-24T01:27:46.095967+0000","last_active":"2024-04-24T01:27:46.095967+0000","last_peered":"2024-04-24T01:27:46.095967+0000","last_clean":"2024-04-24T01:27:46.095967+0000","last_became_active":"2024-04-24T01:24:00.731292+0000","last_became_peered":"2024-04-24T01:24:00.731292+0000","last_unstale":"2024-04-24T01:27:46.095967+0000","last_undegraded":"2024-04-24T01:27:46.095967+0000","last_fullsized":"2024-04-24T01:27:46.095967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:46.095813+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.095813+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:43:01.593908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.047166+0000","last_change":"2024-04-24T01:28:12.047166+0000","last_active":"2024-04-24T01:28:12.047166+0000","last_peered":"2024-04-24T01:28:12.047166+0000","last_clean":"2024-04-24T01:28:12.047166+0000","last_became_active":"2024-04-24T01:23:58.764175+0000","last_became_peered":"2024-04-24T01:23:58.764175+0000","last_unstale":"2024-04-24T01:28:12.047166+0000","last_undegraded":"2024-04-24T01:28:12.047166+0000","last_fullsized":"2024-04-24T01:28:12.047166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:12.047037+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.047037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:46:29.031559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.200442+0000","last_change":"2024-04-24T01:27:36.200442+0000","last_active":"2024-04-24T01:27:36.200442+0000","last_peered":"2024-04-24T01:27:36.200442+0000","last_clean":"2024-04-24T01:27:36.200442+0000","last_became_active":"2024-04-24T01:24:02.754486+0000","last_became_peered":"2024-04-24T01:24:02.754486+0000","last_unstale":"2024-04-24T01:27:36.200442+0000","last_undegraded":"2024-04-24T01:27:36.200442+0000","last_fullsized":"2024-04-24T01:27:36.200442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.200293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.200293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.864662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"34'79","reported_seq":165,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.888578+0000","last_change":"2024-04-24T01:27:48.888578+0000","last_active":"2024-04-24T01:27:48.888578+0000","last_peered":"2024-04-24T01:27:48.888578+0000","last_clean":"2024-04-24T01:27:48.888578+0000","last_became_active":"2024-04-24T01:24:04.761007+0000","last_became_peered":"2024-04-24T01:24:04.761007+0000","last_unstale":"2024-04-24T01:27:48.888578+0000","last_undegraded":"2024-04-24T01:27:48.888578+0000","last_fullsized":"2024-04-24T01:27:48.888578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'79","last_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_deep_scrub":"34'79","last_deep_scrub_stamp":"2024-04-24T01:27:48.888453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.888453+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:02:06.782682+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":79,"num_read_kb":68,"num_write":34,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.070118+0000","last_change":"2024-04-24T01:27:21.070118+0000","last_active":"2024-04-24T01:27:21.070118+0000","last_peered":"2024-04-24T01:27:21.070118+0000","last_clean":"2024-04-24T01:27:21.070118+0000","last_became_active":"2024-04-24T01:24:06.769315+0000","last_became_peered":"2024-04-24T01:24:06.769315+0000","last_unstale":"2024-04-24T01:27:21.070118+0000","last_undegraded":"2024-04-24T01:27:21.070118+0000","last_fullsized":"2024-04-24T01:27:21.070118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.070033+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.070033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:24.653388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"34'23","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:21.171607+0000","last_change":"2024-04-24T01:28:21.171607+0000","last_active":"2024-04-24T01:28:21.171607+0000","last_peered":"2024-04-24T01:28:21.171607+0000","last_clean":"2024-04-24T01:28:21.171607+0000","last_became_active":"2024-04-24T01:24:08.775179+0000","last_became_peered":"2024-04-24T01:24:08.775179+0000","last_unstale":"2024-04-24T01:28:21.171607+0000","last_undegraded":"2024-04-24T01:28:21.171607+0000","last_fullsized":"2024-04-24T01:28:21.171607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:28:21.171436+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:28:21.171436+0000","last_clean_scrub_stamp":"2024-04-24T01:28:21.171436+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:33:38.910435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.963948+0000","last_change":"2024-04-24T01:28:22.963948+0000","last_active":"2024-04-24T01:28:22.963948+0000","last_peered":"2024-04-24T01:28:22.963948+0000","last_clean":"2024-04-24T01:28:22.963948+0000","last_became_active":"2024-04-24T01:24:39.842086+0000","last_became_peered":"2024-04-24T01:24:39.842086+0000","last_unstale":"2024-04-24T01:28:22.963948+0000","last_undegraded":"2024-04-24T01:28:22.963948+0000","last_fullsized":"2024-04-24T01:28:22.963948+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:28:22.963758+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:28:22.963758+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.963758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:07.481942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":34,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.330094+0000","last_change":"2024-04-24T01:27:54.330094+0000","last_active":"2024-04-24T01:27:54.330094+0000","last_peered":"2024-04-24T01:27:54.330094+0000","last_clean":"2024-04-24T01:27:54.330094+0000","last_became_active":"2024-04-24T01:23:58.746768+0000","last_became_peered":"2024-04-24T01:23:58.746768+0000","last_unstale":"2024-04-24T01:27:54.330094+0000","last_undegraded":"2024-04-24T01:27:54.330094+0000","last_fullsized":"2024-04-24T01:27:54.330094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:54.329915+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.329915+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:09.474046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.022839+0000","last_change":"2024-04-24T01:27:39.022839+0000","last_active":"2024-04-24T01:27:39.022839+0000","last_peered":"2024-04-24T01:27:39.022839+0000","last_clean":"2024-04-24T01:27:39.022839+0000","last_became_active":"2024-04-24T01:24:02.750962+0000","last_became_peered":"2024-04-24T01:24:02.750962+0000","last_unstale":"2024-04-24T01:27:39.022839+0000","last_undegraded":"2024-04-24T01:27:39.022839+0000","last_fullsized":"2024-04-24T01:27:39.022839+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.022713+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.022713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:44.907755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'47","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.795265+0000","last_change":"2024-04-24T01:27:26.795265+0000","last_active":"2024-04-24T01:27:26.795265+0000","last_peered":"2024-04-24T01:27:26.795265+0000","last_clean":"2024-04-24T01:27:26.795265+0000","last_became_active":"2024-04-24T01:24:04.757682+0000","last_became_peered":"2024-04-24T01:24:04.757682+0000","last_unstale":"2024-04-24T01:27:26.795265+0000","last_undegraded":"2024-04-24T01:27:26.795265+0000","last_fullsized":"2024-04-24T01:27:26.795265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'47","last_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_deep_scrub":"34'47","last_deep_scrub_stamp":"2024-04-24T01:27:26.795151+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.795151+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:53.921283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.990277+0000","last_change":"2024-04-24T01:27:40.990277+0000","last_active":"2024-04-24T01:27:40.990277+0000","last_peered":"2024-04-24T01:27:40.990277+0000","last_clean":"2024-04-24T01:27:40.990277+0000","last_became_active":"2024-04-24T01:24:06.762095+0000","last_became_peered":"2024-04-24T01:24:06.762095+0000","last_unstale":"2024-04-24T01:27:40.990277+0000","last_undegraded":"2024-04-24T01:27:40.990277+0000","last_fullsized":"2024-04-24T01:27:40.990277+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.990117+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.990117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:52.892751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"34'12","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.974834+0000","last_change":"2024-04-24T01:28:06.974834+0000","last_active":"2024-04-24T01:28:06.974834+0000","last_peered":"2024-04-24T01:28:06.974834+0000","last_clean":"2024-04-24T01:28:06.974834+0000","last_became_active":"2024-04-24T01:24:08.772367+0000","last_became_peered":"2024-04-24T01:24:08.772367+0000","last_unstale":"2024-04-24T01:28:06.974834+0000","last_undegraded":"2024-04-24T01:28:06.974834+0000","last_fullsized":"2024-04-24T01:28:06.974834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:06.974708+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.974708+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:08.313889+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"34'8","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.077121+0000","last_change":"2024-04-24T01:28:15.077149+0000","last_active":"2024-04-24T01:28:15.077121+0000","last_peered":"2024-04-24T01:28:15.077121+0000","last_clean":"2024-04-24T01:28:15.077121+0000","last_became_active":"2024-04-24T01:24:39.799478+0000","last_became_peered":"2024-04-24T01:24:39.799478+0000","last_unstale":"2024-04-24T01:28:15.077121+0000","last_undegraded":"2024-04-24T01:28:15.077121+0000","last_fullsized":"2024-04-24T01:28:15.077121+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:28:15.077031+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.077031+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:52.551061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.011324+0000","last_change":"2024-04-24T01:28:22.011382+0000","last_active":"2024-04-24T01:28:22.011324+0000","last_peered":"2024-04-24T01:28:22.011324+0000","last_clean":"2024-04-24T01:28:22.011324+0000","last_became_active":"2024-04-24T01:23:58.756610+0000","last_became_peered":"2024-04-24T01:23:58.756610+0000","last_unstale":"2024-04-24T01:28:22.011324+0000","last_undegraded":"2024-04-24T01:28:22.011324+0000","last_fullsized":"2024-04-24T01:28:22.011324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:22.011213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:22.011213+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.011213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:24.578256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.249380+0000","last_change":"2024-04-24T01:27:38.249380+0000","last_active":"2024-04-24T01:27:38.249380+0000","last_peered":"2024-04-24T01:27:38.249380+0000","last_clean":"2024-04-24T01:27:38.249380+0000","last_became_active":"2024-04-24T01:24:02.754342+0000","last_became_peered":"2024-04-24T01:24:02.754342+0000","last_unstale":"2024-04-24T01:27:38.249380+0000","last_undegraded":"2024-04-24T01:27:38.249380+0000","last_fullsized":"2024-04-24T01:27:38.249380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.249265+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.249265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:20.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"34'45","reported_seq":104,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.930974+0000","last_change":"2024-04-24T01:27:31.930974+0000","last_active":"2024-04-24T01:27:31.930974+0000","last_peered":"2024-04-24T01:27:31.930974+0000","last_clean":"2024-04-24T01:27:31.930974+0000","last_became_active":"2024-04-24T01:24:04.752110+0000","last_became_peered":"2024-04-24T01:24:04.752110+0000","last_unstale":"2024-04-24T01:27:31.930974+0000","last_undegraded":"2024-04-24T01:27:31.930974+0000","last_fullsized":"2024-04-24T01:27:31.930974+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:31.930805+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.930805+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:58:07.030096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"34'285","reported_seq":416,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.862447+0000","last_change":"2024-04-24T01:27:25.862447+0000","last_active":"2024-04-24T01:27:25.862447+0000","last_peered":"2024-04-24T01:27:25.862447+0000","last_clean":"2024-04-24T01:27:25.862447+0000","last_became_active":"2024-04-24T01:24:06.768459+0000","last_became_peered":"2024-04-24T01:24:06.768459+0000","last_unstale":"2024-04-24T01:27:25.862447+0000","last_undegraded":"2024-04-24T01:27:25.862447+0000","last_fullsized":"2024-04-24T01:27:25.862447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.862292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.862292+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:06.513466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.291445+0000","last_change":"2024-04-24T01:27:49.291445+0000","last_active":"2024-04-24T01:27:49.291445+0000","last_peered":"2024-04-24T01:27:49.291445+0000","last_clean":"2024-04-24T01:27:49.291445+0000","last_became_active":"2024-04-24T01:24:08.768232+0000","last_became_peered":"2024-04-24T01:24:08.768232+0000","last_unstale":"2024-04-24T01:27:49.291445+0000","last_undegraded":"2024-04-24T01:27:49.291445+0000","last_fullsized":"2024-04-24T01:27:49.291445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:49.291293+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.291293+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:16:16.626192+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"34'10","reported_seq":66,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.091349+0000","last_change":"2024-04-24T01:27:58.091349+0000","last_active":"2024-04-24T01:27:58.091349+0000","last_peered":"2024-04-24T01:27:58.091349+0000","last_clean":"2024-04-24T01:27:58.091349+0000","last_became_active":"2024-04-24T01:24:00.740395+0000","last_became_peered":"2024-04-24T01:24:00.740395+0000","last_unstale":"2024-04-24T01:27:58.091349+0000","last_undegraded":"2024-04-24T01:27:58.091349+0000","last_fullsized":"2024-04-24T01:27:58.091349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:58.091198+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.091198+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:10.304456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.001582+0000","last_change":"2024-04-24T01:28:20.001609+0000","last_active":"2024-04-24T01:28:20.001582+0000","last_peered":"2024-04-24T01:28:20.001582+0000","last_clean":"2024-04-24T01:28:20.001582+0000","last_became_active":"2024-04-24T01:23:58.757690+0000","last_became_peered":"2024-04-24T01:23:58.757690+0000","last_unstale":"2024-04-24T01:28:20.001582+0000","last_undegraded":"2024-04-24T01:28:20.001582+0000","last_fullsized":"2024-04-24T01:28:20.001582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:20.001483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:20.001483+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.001483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:57:37.817459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'5","reported_seq":429,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.716690+0000","last_change":"2024-04-24T01:27:35.716690+0000","last_active":"2024-04-24T01:27:35.716690+0000","last_peered":"2024-04-24T01:27:35.716690+0000","last_clean":"2024-04-24T01:27:35.716690+0000","last_became_active":"2024-04-24T01:24:02.754879+0000","last_became_peered":"2024-04-24T01:24:02.754879+0000","last_unstale":"2024-04-24T01:27:35.716690+0000","last_undegraded":"2024-04-24T01:27:35.716690+0000","last_fullsized":"2024-04-24T01:27:35.716690+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-04-24T01:27:35.716538+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.716538+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:53:45.474001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"34'15","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.061416+0000","last_change":"2024-04-24T01:27:39.061416+0000","last_active":"2024-04-24T01:27:39.061416+0000","last_peered":"2024-04-24T01:27:39.061416+0000","last_clean":"2024-04-24T01:27:39.061416+0000","last_became_active":"2024-04-24T01:24:04.759693+0000","last_became_peered":"2024-04-24T01:24:04.759693+0000","last_unstale":"2024-04-24T01:27:39.061416+0000","last_undegraded":"2024-04-24T01:27:39.061416+0000","last_fullsized":"2024-04-24T01:27:39.061416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'15","last_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_deep_scrub":"34'15","last_deep_scrub_stamp":"2024-04-24T01:27:39.061278+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.061278+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:46:42.587769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"34'285","reported_seq":472,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.819879+0000","last_change":"2024-04-24T01:27:21.819879+0000","last_active":"2024-04-24T01:27:21.819879+0000","last_peered":"2024-04-24T01:27:21.819879+0000","last_clean":"2024-04-24T01:27:21.819879+0000","last_became_active":"2024-04-24T01:24:06.769183+0000","last_became_peered":"2024-04-24T01:24:06.769183+0000","last_unstale":"2024-04-24T01:27:21.819879+0000","last_undegraded":"2024-04-24T01:27:21.819879+0000","last_fullsized":"2024-04-24T01:27:21.819879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:21.819685+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.819685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:03:51.931578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"34'4","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.010031+0000","last_change":"2024-04-24T01:27:42.010031+0000","last_active":"2024-04-24T01:27:42.010031+0000","last_peered":"2024-04-24T01:27:42.010031+0000","last_clean":"2024-04-24T01:27:42.010031+0000","last_became_active":"2024-04-24T01:24:08.769148+0000","last_became_peered":"2024-04-24T01:24:08.769148+0000","last_unstale":"2024-04-24T01:27:42.010031+0000","last_undegraded":"2024-04-24T01:27:42.010031+0000","last_fullsized":"2024-04-24T01:27:42.010031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:42.009873+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.009873+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:39.421872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.891623+0000","last_change":"2024-04-24T01:28:01.891623+0000","last_active":"2024-04-24T01:28:01.891623+0000","last_peered":"2024-04-24T01:28:01.891623+0000","last_clean":"2024-04-24T01:28:01.891623+0000","last_became_active":"2024-04-24T01:24:00.742647+0000","last_became_peered":"2024-04-24T01:24:00.742647+0000","last_unstale":"2024-04-24T01:28:01.891623+0000","last_undegraded":"2024-04-24T01:28:01.891623+0000","last_fullsized":"2024-04-24T01:28:01.891623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:01.891503+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.891503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:24:18.375150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.053931+0000","last_change":"2024-04-24T01:28:14.053931+0000","last_active":"2024-04-24T01:28:14.053931+0000","last_peered":"2024-04-24T01:28:14.053931+0000","last_clean":"2024-04-24T01:28:14.053931+0000","last_became_active":"2024-04-24T01:23:58.757442+0000","last_became_peered":"2024-04-24T01:23:58.757442+0000","last_unstale":"2024-04-24T01:28:14.053931+0000","last_undegraded":"2024-04-24T01:28:14.053931+0000","last_fullsized":"2024-04-24T01:28:14.053931+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:14.053794+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.053794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:02:31.641010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.040427+0000","last_change":"2024-04-24T01:27:32.040427+0000","last_active":"2024-04-24T01:27:32.040427+0000","last_peered":"2024-04-24T01:27:32.040427+0000","last_clean":"2024-04-24T01:27:32.040427+0000","last_became_active":"2024-04-24T01:24:02.752895+0000","last_became_peered":"2024-04-24T01:24:02.752895+0000","last_unstale":"2024-04-24T01:27:32.040427+0000","last_undegraded":"2024-04-24T01:27:32.040427+0000","last_fullsized":"2024-04-24T01:27:32.040427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:32.040303+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.040303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:36:24.647469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"34'50","reported_seq":110,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.834021+0000","last_change":"2024-04-24T01:27:27.834021+0000","last_active":"2024-04-24T01:27:27.834021+0000","last_peered":"2024-04-24T01:27:27.834021+0000","last_clean":"2024-04-24T01:27:27.834021+0000","last_became_active":"2024-04-24T01:24:04.754604+0000","last_became_peered":"2024-04-24T01:24:04.754604+0000","last_unstale":"2024-04-24T01:27:27.834021+0000","last_undegraded":"2024-04-24T01:27:27.834021+0000","last_fullsized":"2024-04-24T01:27:27.834021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:27.833839+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.833839+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:51:49.939141+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.839921+0000","last_change":"2024-04-24T01:27:21.839921+0000","last_active":"2024-04-24T01:27:21.839921+0000","last_peered":"2024-04-24T01:27:21.839921+0000","last_clean":"2024-04-24T01:27:21.839921+0000","last_became_active":"2024-04-24T01:24:06.766740+0000","last_became_peered":"2024-04-24T01:24:06.766740+0000","last_unstale":"2024-04-24T01:27:21.839921+0000","last_undegraded":"2024-04-24T01:27:21.839921+0000","last_fullsized":"2024-04-24T01:27:21.839921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.839778+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.839778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:25.887464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.781113+0000","last_change":"2024-04-24T01:27:41.781113+0000","last_active":"2024-04-24T01:27:41.781113+0000","last_peered":"2024-04-24T01:27:41.781113+0000","last_clean":"2024-04-24T01:27:41.781113+0000","last_became_active":"2024-04-24T01:24:08.771751+0000","last_became_peered":"2024-04-24T01:24:08.771751+0000","last_unstale":"2024-04-24T01:27:41.781113+0000","last_undegraded":"2024-04-24T01:27:41.781113+0000","last_fullsized":"2024-04-24T01:27:41.781113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:41.781002+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.781002+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:01.531853+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"34'7","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.009852+0000","last_change":"2024-04-24T01:27:38.009852+0000","last_active":"2024-04-24T01:27:38.009852+0000","last_peered":"2024-04-24T01:27:38.009852+0000","last_clean":"2024-04-24T01:27:38.009852+0000","last_became_active":"2024-04-24T01:24:00.747163+0000","last_became_peered":"2024-04-24T01:24:00.747163+0000","last_unstale":"2024-04-24T01:27:38.009852+0000","last_undegraded":"2024-04-24T01:27:38.009852+0000","last_fullsized":"2024-04-24T01:27:38.009852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-04-24T01:27:38.009727+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.009727+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:13.773436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"34'119","reported_seq":214,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.840720+0000","last_change":"2024-04-24T01:28:07.840757+0000","last_active":"2024-04-24T01:28:07.840720+0000","last_peered":"2024-04-24T01:28:07.840720+0000","last_clean":"2024-04-24T01:28:07.840720+0000","last_became_active":"2024-04-24T01:23:45.964903+0000","last_became_peered":"2024-04-24T01:23:45.964903+0000","last_unstale":"2024-04-24T01:28:07.840720+0000","last_undegraded":"2024-04-24T01:28:07.840720+0000","last_fullsized":"2024-04-24T01:28:07.840720+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'119","last_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_deep_scrub":"34'119","last_deep_scrub_stamp":"2024-04-24T01:28:07.840634+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.840634+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:16:33.976498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:31.868412+0000","last_change":"2024-04-24T01:28:31.868436+0000","last_active":"2024-04-24T01:28:31.868412+0000","last_peered":"2024-04-24T01:28:31.868412+0000","last_clean":"2024-04-24T01:28:31.868412+0000","last_became_active":"2024-04-24T01:23:50.692676+0000","last_became_peered":"2024-04-24T01:23:50.692676+0000","last_unstale":"2024-04-24T01:28:31.868412+0000","last_undegraded":"2024-04-24T01:28:31.868412+0000","last_fullsized":"2024-04-24T01:28:31.868412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:31.868324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:31.868324+0000","last_clean_scrub_stamp":"2024-04-24T01:28:31.868324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:56.136612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:36.856060+0000","last_change":"2024-04-24T01:28:36.856087+0000","last_active":"2024-04-24T01:28:36.856060+0000","last_peered":"2024-04-24T01:28:36.856060+0000","last_clean":"2024-04-24T01:28:36.856060+0000","last_became_active":"2024-04-24T01:23:58.764040+0000","last_became_peered":"2024-04-24T01:23:58.764040+0000","last_unstale":"2024-04-24T01:28:36.856060+0000","last_undegraded":"2024-04-24T01:28:36.856060+0000","last_fullsized":"2024-04-24T01:28:36.856060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:36.855956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:36.855956+0000","last_clean_scrub_stamp":"2024-04-24T01:28:36.855956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:38.122105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:21.919820+0000","last_change":"2024-04-24T01:28:21.919843+0000","last_active":"2024-04-24T01:28:21.919820+0000","last_peered":"2024-04-24T01:28:21.919820+0000","last_clean":"2024-04-24T01:28:21.919820+0000","last_became_active":"2024-04-24T01:24:39.801128+0000","last_became_peered":"2024-04-24T01:24:39.801128+0000","last_unstale":"2024-04-24T01:28:21.919820+0000","last_undegraded":"2024-04-24T01:28:21.919820+0000","last_fullsized":"2024-04-24T01:28:21.919820+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:21.919728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:21.919728+0000","last_clean_scrub_stamp":"2024-04-24T01:28:21.919728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:13.218711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"34'94","reported_seq":191,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.123918+0000","last_change":"2024-04-24T01:27:27.123918+0000","last_active":"2024-04-24T01:27:27.123918+0000","last_peered":"2024-04-24T01:27:27.123918+0000","last_clean":"2024-04-24T01:27:27.123918+0000","last_became_active":"2024-04-24T01:24:04.758640+0000","last_became_peered":"2024-04-24T01:24:04.758640+0000","last_unstale":"2024-04-24T01:27:27.123918+0000","last_undegraded":"2024-04-24T01:27:27.123918+0000","last_fullsized":"2024-04-24T01:27:27.123918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'94","last_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_deep_scrub":"34'94","last_deep_scrub_stamp":"2024-04-24T01:27:27.123786+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.123786+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:21:04.256795+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":93,"num_read_kb":81,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.112111+0000","last_change":"2024-04-24T01:27:29.112111+0000","last_active":"2024-04-24T01:27:29.112111+0000","last_peered":"2024-04-24T01:27:29.112111+0000","last_clean":"2024-04-24T01:27:29.112111+0000","last_became_active":"2024-04-24T01:24:06.769924+0000","last_became_peered":"2024-04-24T01:24:06.769924+0000","last_unstale":"2024-04-24T01:27:29.112111+0000","last_undegraded":"2024-04-24T01:27:29.112111+0000","last_fullsized":"2024-04-24T01:27:29.112111+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.111929+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.111929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:02:30.720342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"34'82","reported_seq":173,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.978931+0000","last_change":"2024-04-24T01:27:37.978931+0000","last_active":"2024-04-24T01:27:37.978931+0000","last_peered":"2024-04-24T01:27:37.978931+0000","last_clean":"2024-04-24T01:27:37.978931+0000","last_became_active":"2024-04-24T01:24:08.768119+0000","last_became_peered":"2024-04-24T01:24:08.768119+0000","last_unstale":"2024-04-24T01:27:37.978931+0000","last_undegraded":"2024-04-24T01:27:37.978931+0000","last_fullsized":"2024-04-24T01:27:37.978931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'82","last_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_deep_scrub":"34'82","last_deep_scrub_stamp":"2024-04-24T01:27:37.978807+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.978807+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:55.762850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"34'4","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.938286+0000","last_change":"2024-04-24T01:27:56.938286+0000","last_active":"2024-04-24T01:27:56.938286+0000","last_peered":"2024-04-24T01:27:56.938286+0000","last_clean":"2024-04-24T01:27:56.938286+0000","last_became_active":"2024-04-24T01:24:00.735398+0000","last_became_peered":"2024-04-24T01:24:00.735398+0000","last_unstale":"2024-04-24T01:27:56.938286+0000","last_undegraded":"2024-04-24T01:27:56.938286+0000","last_fullsized":"2024-04-24T01:27:56.938286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:56.938134+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.938134+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:59.400837+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:29.892015+0000","last_change":"2024-04-24T01:28:29.892039+0000","last_active":"2024-04-24T01:28:29.892015+0000","last_peered":"2024-04-24T01:28:29.892015+0000","last_clean":"2024-04-24T01:28:29.892015+0000","last_became_active":"2024-04-24T01:23:50.689822+0000","last_became_peered":"2024-04-24T01:23:50.689822+0000","last_unstale":"2024-04-24T01:28:29.892015+0000","last_undegraded":"2024-04-24T01:28:29.892015+0000","last_fullsized":"2024-04-24T01:28:29.892015+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:29.891923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:29.891923+0000","last_clean_scrub_stamp":"2024-04-24T01:28:29.891923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:00:34.694662+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.180653+0000","last_change":"2024-04-24T01:28:06.180653+0000","last_active":"2024-04-24T01:28:06.180653+0000","last_peered":"2024-04-24T01:28:06.180653+0000","last_clean":"2024-04-24T01:28:06.180653+0000","last_became_active":"2024-04-24T01:23:58.741846+0000","last_became_peered":"2024-04-24T01:23:58.741846+0000","last_unstale":"2024-04-24T01:28:06.180653+0000","last_undegraded":"2024-04-24T01:28:06.180653+0000","last_fullsized":"2024-04-24T01:28:06.180653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.180538+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.180538+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:45.452260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.112872+0000","last_change":"2024-04-24T01:27:24.112872+0000","last_active":"2024-04-24T01:27:24.112872+0000","last_peered":"2024-04-24T01:27:24.112872+0000","last_clean":"2024-04-24T01:27:24.112872+0000","last_became_active":"2024-04-24T01:24:02.753677+0000","last_became_peered":"2024-04-24T01:24:02.753677+0000","last_unstale":"2024-04-24T01:27:24.112872+0000","last_undegraded":"2024-04-24T01:27:24.112872+0000","last_fullsized":"2024-04-24T01:27:24.112872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:24.112716+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.112716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:45.026444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"34'297","reported_seq":529,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.829636+0000","last_change":"2024-04-24T01:27:23.829636+0000","last_active":"2024-04-24T01:27:23.829636+0000","last_peered":"2024-04-24T01:27:23.829636+0000","last_clean":"2024-04-24T01:27:23.829636+0000","last_became_active":"2024-04-24T01:24:04.762423+0000","last_became_peered":"2024-04-24T01:24:04.762423+0000","last_unstale":"2024-04-24T01:27:23.829636+0000","last_undegraded":"2024-04-24T01:27:23.829636+0000","last_fullsized":"2024-04-24T01:27:23.829636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'297","last_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_deep_scrub":"34'297","last_deep_scrub_stamp":"2024-04-24T01:27:23.829451+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.829451+0000","objects_scrubbed":11,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:46:41.027361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":387,"num_read_kb":371,"num_write":44,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.953224+0000","last_change":"2024-04-24T01:27:41.953224+0000","last_active":"2024-04-24T01:27:41.953224+0000","last_peered":"2024-04-24T01:27:41.953224+0000","last_clean":"2024-04-24T01:27:41.953224+0000","last_became_active":"2024-04-24T01:24:06.759855+0000","last_became_peered":"2024-04-24T01:24:06.759855+0000","last_unstale":"2024-04-24T01:27:41.953224+0000","last_undegraded":"2024-04-24T01:27:41.953224+0000","last_fullsized":"2024-04-24T01:27:41.953224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.953108+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.953108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:10.618830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.753087+0000","last_change":"2024-04-24T01:27:49.753087+0000","last_active":"2024-04-24T01:27:49.753087+0000","last_peered":"2024-04-24T01:27:49.753087+0000","last_clean":"2024-04-24T01:27:49.753087+0000","last_became_active":"2024-04-24T01:24:08.772968+0000","last_became_peered":"2024-04-24T01:24:08.772968+0000","last_unstale":"2024-04-24T01:27:49.753087+0000","last_undegraded":"2024-04-24T01:27:49.753087+0000","last_fullsized":"2024-04-24T01:27:49.753087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:49.752922+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.752922+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:51:01.966181+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.285843+0000","last_change":"2024-04-24T01:27:47.285843+0000","last_active":"2024-04-24T01:27:47.285843+0000","last_peered":"2024-04-24T01:27:47.285843+0000","last_clean":"2024-04-24T01:27:47.285843+0000","last_became_active":"2024-04-24T01:24:00.746237+0000","last_became_peered":"2024-04-24T01:24:00.746237+0000","last_unstale":"2024-04-24T01:27:47.285843+0000","last_undegraded":"2024-04-24T01:27:47.285843+0000","last_fullsized":"2024-04-24T01:27:47.285843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:47.285734+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.285734+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:04:56.799840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.112054+0000","last_change":"2024-04-24T01:28:00.112079+0000","last_active":"2024-04-24T01:28:00.112054+0000","last_peered":"2024-04-24T01:28:00.112054+0000","last_clean":"2024-04-24T01:28:00.112054+0000","last_became_active":"2024-04-24T01:23:50.688095+0000","last_became_peered":"2024-04-24T01:23:50.688095+0000","last_unstale":"2024-04-24T01:28:00.112054+0000","last_undegraded":"2024-04-24T01:28:00.112054+0000","last_fullsized":"2024-04-24T01:28:00.112054+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.111972+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.111972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:57:11.268871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:58.234409+0000","last_change":"2024-04-24T01:27:58.234409+0000","last_active":"2024-04-24T01:27:58.234409+0000","last_peered":"2024-04-24T01:27:58.234409+0000","last_clean":"2024-04-24T01:27:58.234409+0000","last_became_active":"2024-04-24T01:23:58.742525+0000","last_became_peered":"2024-04-24T01:23:58.742525+0000","last_unstale":"2024-04-24T01:27:58.234409+0000","last_undegraded":"2024-04-24T01:27:58.234409+0000","last_fullsized":"2024-04-24T01:27:58.234409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:58.234292+0000","last_clean_scrub_stamp":"2024-04-24T01:27:58.234292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:41:31.772695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"34'4","reported_seq":233,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.917133+0000","last_change":"2024-04-24T01:27:35.917133+0000","last_active":"2024-04-24T01:27:35.917133+0000","last_peered":"2024-04-24T01:27:35.917133+0000","last_clean":"2024-04-24T01:27:35.917133+0000","last_became_active":"2024-04-24T01:24:02.750511+0000","last_became_peered":"2024-04-24T01:24:02.750511+0000","last_unstale":"2024-04-24T01:27:35.917133+0000","last_undegraded":"2024-04-24T01:27:35.917133+0000","last_fullsized":"2024-04-24T01:27:35.917133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:35.916997+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.916997+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:19:07.090816+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'23","reported_seq":101,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.905612+0000","last_change":"2024-04-24T01:27:27.905612+0000","last_active":"2024-04-24T01:27:27.905612+0000","last_peered":"2024-04-24T01:27:27.905612+0000","last_clean":"2024-04-24T01:27:27.905612+0000","last_became_active":"2024-04-24T01:24:04.756828+0000","last_became_peered":"2024-04-24T01:24:04.756828+0000","last_unstale":"2024-04-24T01:27:27.905612+0000","last_undegraded":"2024-04-24T01:27:27.905612+0000","last_fullsized":"2024-04-24T01:27:27.905612+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'23","last_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_deep_scrub":"34'23","last_deep_scrub_stamp":"2024-04-24T01:27:27.905478+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.905478+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:18:29.454916+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.318338+0000","last_change":"2024-04-24T01:27:41.318338+0000","last_active":"2024-04-24T01:27:41.318338+0000","last_peered":"2024-04-24T01:27:41.318338+0000","last_clean":"2024-04-24T01:27:41.318338+0000","last_became_active":"2024-04-24T01:24:06.770158+0000","last_became_peered":"2024-04-24T01:24:06.770158+0000","last_unstale":"2024-04-24T01:27:41.318338+0000","last_undegraded":"2024-04-24T01:27:41.318338+0000","last_fullsized":"2024-04-24T01:27:41.318338+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.318182+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.318182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:55:53.255679+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:41.797885+0000","last_change":"2024-04-24T01:28:41.797917+0000","last_active":"2024-04-24T01:28:41.797885+0000","last_peered":"2024-04-24T01:28:41.797885+0000","last_clean":"2024-04-24T01:28:41.797885+0000","last_became_active":"2024-04-24T01:24:08.775554+0000","last_became_peered":"2024-04-24T01:24:08.775554+0000","last_unstale":"2024-04-24T01:28:41.797885+0000","last_undegraded":"2024-04-24T01:28:41.797885+0000","last_fullsized":"2024-04-24T01:28:41.797885+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:41.797791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:41.797791+0000","last_clean_scrub_stamp":"2024-04-24T01:28:41.797791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:02.199698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'8","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:51.266085+0000","last_change":"2024-04-24T01:27:51.266085+0000","last_active":"2024-04-24T01:27:51.266085+0000","last_peered":"2024-04-24T01:27:51.266085+0000","last_clean":"2024-04-24T01:27:51.266085+0000","last_became_active":"2024-04-24T01:24:00.731508+0000","last_became_peered":"2024-04-24T01:24:00.731508+0000","last_unstale":"2024-04-24T01:27:51.266085+0000","last_undegraded":"2024-04-24T01:27:51.266085+0000","last_fullsized":"2024-04-24T01:27:51.266085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:51.265934+0000","last_clean_scrub_stamp":"2024-04-24T01:27:51.265934+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:09:26.486398+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:30.878943+0000","last_change":"2024-04-24T01:28:30.878968+0000","last_active":"2024-04-24T01:28:30.878943+0000","last_peered":"2024-04-24T01:28:30.878943+0000","last_clean":"2024-04-24T01:28:30.878943+0000","last_became_active":"2024-04-24T01:23:50.689876+0000","last_became_peered":"2024-04-24T01:23:50.689876+0000","last_unstale":"2024-04-24T01:28:30.878943+0000","last_undegraded":"2024-04-24T01:28:30.878943+0000","last_fullsized":"2024-04-24T01:28:30.878943+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:30.878842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:30.878842+0000","last_clean_scrub_stamp":"2024-04-24T01:28:30.878842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:04:59.394810+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.125139+0000","last_change":"2024-04-24T01:28:05.125139+0000","last_active":"2024-04-24T01:28:05.125139+0000","last_peered":"2024-04-24T01:28:05.125139+0000","last_clean":"2024-04-24T01:28:05.125139+0000","last_became_active":"2024-04-24T01:23:58.739345+0000","last_became_peered":"2024-04-24T01:23:58.739345+0000","last_unstale":"2024-04-24T01:28:05.125139+0000","last_undegraded":"2024-04-24T01:28:05.125139+0000","last_fullsized":"2024-04-24T01:28:05.125139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.125023+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.125023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:02:40.888731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:43.359505+0000","last_change":"2024-04-24T01:27:43.359505+0000","last_active":"2024-04-24T01:27:43.359505+0000","last_peered":"2024-04-24T01:27:43.359505+0000","last_clean":"2024-04-24T01:27:43.359505+0000","last_became_active":"2024-04-24T01:24:02.751183+0000","last_became_peered":"2024-04-24T01:24:02.751183+0000","last_unstale":"2024-04-24T01:27:43.359505+0000","last_undegraded":"2024-04-24T01:27:43.359505+0000","last_fullsized":"2024-04-24T01:27:43.359505+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:43.359390+0000","last_clean_scrub_stamp":"2024-04-24T01:27:43.359390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:10:55.127868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'21","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:49.923613+0000","last_change":"2024-04-24T01:27:49.923613+0000","last_active":"2024-04-24T01:27:49.923613+0000","last_peered":"2024-04-24T01:27:49.923613+0000","last_clean":"2024-04-24T01:27:49.923613+0000","last_became_active":"2024-04-24T01:24:04.759842+0000","last_became_peered":"2024-04-24T01:24:04.759842+0000","last_unstale":"2024-04-24T01:27:49.923613+0000","last_undegraded":"2024-04-24T01:27:49.923613+0000","last_fullsized":"2024-04-24T01:27:49.923613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'21","last_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_deep_scrub":"34'21","last_deep_scrub_stamp":"2024-04-24T01:27:49.923469+0000","last_clean_scrub_stamp":"2024-04-24T01:27:49.923469+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:10.601774+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.002143+0000","last_change":"2024-04-24T01:27:44.002143+0000","last_active":"2024-04-24T01:27:44.002143+0000","last_peered":"2024-04-24T01:27:44.002143+0000","last_clean":"2024-04-24T01:27:44.002143+0000","last_became_active":"2024-04-24T01:24:06.759797+0000","last_became_peered":"2024-04-24T01:24:06.759797+0000","last_unstale":"2024-04-24T01:27:44.002143+0000","last_undegraded":"2024-04-24T01:27:44.002143+0000","last_fullsized":"2024-04-24T01:27:44.002143+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:44.001993+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.001993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:46.800003+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:19.951190+0000","last_change":"2024-04-24T01:28:19.951190+0000","last_active":"2024-04-24T01:28:19.951190+0000","last_peered":"2024-04-24T01:28:19.951190+0000","last_clean":"2024-04-24T01:28:19.951190+0000","last_became_active":"2024-04-24T01:24:08.778577+0000","last_became_peered":"2024-04-24T01:24:08.778577+0000","last_unstale":"2024-04-24T01:28:19.951190+0000","last_undegraded":"2024-04-24T01:28:19.951190+0000","last_fullsized":"2024-04-24T01:28:19.951190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:19.951073+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:19.951073+0000","last_clean_scrub_stamp":"2024-04-24T01:28:19.951073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:54:29.570244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"34'8","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.764536+0000","last_change":"2024-04-24T01:27:57.764536+0000","last_active":"2024-04-24T01:27:57.764536+0000","last_peered":"2024-04-24T01:27:57.764536+0000","last_clean":"2024-04-24T01:27:57.764536+0000","last_became_active":"2024-04-24T01:24:00.741743+0000","last_became_peered":"2024-04-24T01:24:00.741743+0000","last_unstale":"2024-04-24T01:27:57.764536+0000","last_undegraded":"2024-04-24T01:27:57.764536+0000","last_fullsized":"2024-04-24T01:27:57.764536+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:57.764420+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.764420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:14:01.699221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.042782+0000","last_change":"2024-04-24T01:27:55.042782+0000","last_active":"2024-04-24T01:27:55.042782+0000","last_peered":"2024-04-24T01:27:55.042782+0000","last_clean":"2024-04-24T01:27:55.042782+0000","last_became_active":"2024-04-24T01:23:58.743253+0000","last_became_peered":"2024-04-24T01:23:58.743253+0000","last_unstale":"2024-04-24T01:27:55.042782+0000","last_undegraded":"2024-04-24T01:27:55.042782+0000","last_fullsized":"2024-04-24T01:27:55.042782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.042621+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.042621+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:01:44.687742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.174050+0000","last_change":"2024-04-24T01:28:08.174089+0000","last_active":"2024-04-24T01:28:08.174050+0000","last_peered":"2024-04-24T01:28:08.174050+0000","last_clean":"2024-04-24T01:28:08.174050+0000","last_became_active":"2024-04-24T01:23:50.690403+0000","last_became_peered":"2024-04-24T01:23:50.690403+0000","last_unstale":"2024-04-24T01:28:08.174050+0000","last_undegraded":"2024-04-24T01:28:08.174050+0000","last_fullsized":"2024-04-24T01:28:08.174050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.173899+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.173899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:41:18.830246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"34'2","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.316856+0000","last_change":"2024-04-24T01:27:44.316856+0000","last_active":"2024-04-24T01:27:44.316856+0000","last_peered":"2024-04-24T01:27:44.316856+0000","last_clean":"2024-04-24T01:27:44.316856+0000","last_became_active":"2024-04-24T01:24:02.750231+0000","last_became_peered":"2024-04-24T01:24:02.750231+0000","last_unstale":"2024-04-24T01:27:44.316856+0000","last_undegraded":"2024-04-24T01:27:44.316856+0000","last_fullsized":"2024-04-24T01:27:44.316856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:44.316675+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.316675+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:19.698338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'88","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:27.086861+0000","last_change":"2024-04-24T01:27:27.086861+0000","last_active":"2024-04-24T01:27:27.086861+0000","last_peered":"2024-04-24T01:27:27.086861+0000","last_clean":"2024-04-24T01:27:27.086861+0000","last_became_active":"2024-04-24T01:24:04.759323+0000","last_became_peered":"2024-04-24T01:24:04.759323+0000","last_unstale":"2024-04-24T01:27:27.086861+0000","last_undegraded":"2024-04-24T01:27:27.086861+0000","last_fullsized":"2024-04-24T01:27:27.086861+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'88","last_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_deep_scrub":"34'88","last_deep_scrub_stamp":"2024-04-24T01:27:27.086724+0000","last_clean_scrub_stamp":"2024-04-24T01:27:27.086724+0000","objects_scrubbed":11,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:12:32.526409+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":89,"num_read_kb":75,"num_write":42,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.902351+0000","last_change":"2024-04-24T01:27:29.902351+0000","last_active":"2024-04-24T01:27:29.902351+0000","last_peered":"2024-04-24T01:27:29.902351+0000","last_clean":"2024-04-24T01:27:29.902351+0000","last_became_active":"2024-04-24T01:24:06.768466+0000","last_became_peered":"2024-04-24T01:24:06.768466+0000","last_unstale":"2024-04-24T01:27:29.902351+0000","last_undegraded":"2024-04-24T01:27:29.902351+0000","last_fullsized":"2024-04-24T01:27:29.902351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.902169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.902169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:40:02.390606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"34'13","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.131290+0000","last_change":"2024-04-24T01:28:20.131290+0000","last_active":"2024-04-24T01:28:20.131290+0000","last_peered":"2024-04-24T01:28:20.131290+0000","last_clean":"2024-04-24T01:28:20.131290+0000","last_became_active":"2024-04-24T01:24:08.771567+0000","last_became_peered":"2024-04-24T01:24:08.771567+0000","last_unstale":"2024-04-24T01:28:20.131290+0000","last_undegraded":"2024-04-24T01:28:20.131290+0000","last_fullsized":"2024-04-24T01:28:20.131290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'13","last_scrub_stamp":"2024-04-24T01:28:20.131163+0000","last_deep_scrub":"34'13","last_deep_scrub_stamp":"2024-04-24T01:28:20.131163+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.131163+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:15:16.775973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":31,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"34'22","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.768560+0000","last_change":"2024-04-24T01:27:55.768560+0000","last_active":"2024-04-24T01:27:55.768560+0000","last_peered":"2024-04-24T01:27:55.768560+0000","last_clean":"2024-04-24T01:27:55.768560+0000","last_became_active":"2024-04-24T01:24:00.740472+0000","last_became_peered":"2024-04-24T01:24:00.740472+0000","last_unstale":"2024-04-24T01:27:55.768560+0000","last_undegraded":"2024-04-24T01:27:55.768560+0000","last_fullsized":"2024-04-24T01:27:55.768560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:55.768450+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.768450+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:38.395793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":60,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.133523+0000","last_change":"2024-04-24T01:28:13.133547+0000","last_active":"2024-04-24T01:28:13.133523+0000","last_peered":"2024-04-24T01:28:13.133523+0000","last_clean":"2024-04-24T01:28:13.133523+0000","last_became_active":"2024-04-24T01:23:58.741890+0000","last_became_peered":"2024-04-24T01:23:58.741890+0000","last_unstale":"2024-04-24T01:28:13.133523+0000","last_undegraded":"2024-04-24T01:28:13.133523+0000","last_fullsized":"2024-04-24T01:28:13.133523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.133431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.133431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:35:35.842301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:28.908528+0000","last_change":"2024-04-24T01:28:28.908552+0000","last_active":"2024-04-24T01:28:28.908528+0000","last_peered":"2024-04-24T01:28:28.908528+0000","last_clean":"2024-04-24T01:28:28.908528+0000","last_became_active":"2024-04-24T01:23:50.689851+0000","last_became_peered":"2024-04-24T01:23:50.689851+0000","last_unstale":"2024-04-24T01:28:28.908528+0000","last_undegraded":"2024-04-24T01:28:28.908528+0000","last_fullsized":"2024-04-24T01:28:28.908528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:28.908436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:28.908436+0000","last_clean_scrub_stamp":"2024-04-24T01:28:28.908436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:20:07.474910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.079211+0000","last_change":"2024-04-24T01:27:26.079211+0000","last_active":"2024-04-24T01:27:26.079211+0000","last_peered":"2024-04-24T01:27:26.079211+0000","last_clean":"2024-04-24T01:27:26.079211+0000","last_became_active":"2024-04-24T01:24:02.753525+0000","last_became_peered":"2024-04-24T01:24:02.753525+0000","last_unstale":"2024-04-24T01:27:26.079211+0000","last_undegraded":"2024-04-24T01:27:26.079211+0000","last_fullsized":"2024-04-24T01:27:26.079211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:26.079098+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.079098+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:16:40.353572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"34'30","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.825422+0000","last_change":"2024-04-24T01:27:24.825422+0000","last_active":"2024-04-24T01:27:24.825422+0000","last_peered":"2024-04-24T01:27:24.825422+0000","last_clean":"2024-04-24T01:27:24.825422+0000","last_became_active":"2024-04-24T01:24:04.761423+0000","last_became_peered":"2024-04-24T01:24:04.761423+0000","last_unstale":"2024-04-24T01:27:24.825422+0000","last_undegraded":"2024-04-24T01:27:24.825422+0000","last_fullsized":"2024-04-24T01:27:24.825422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'30","last_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_deep_scrub":"34'30","last_deep_scrub_stamp":"2024-04-24T01:27:24.825285+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.825285+0000","objects_scrubbed":8,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:34.030557+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"34'285","reported_seq":369,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.840969+0000","last_change":"2024-04-24T01:27:25.840969+0000","last_active":"2024-04-24T01:27:25.840969+0000","last_peered":"2024-04-24T01:27:25.840969+0000","last_clean":"2024-04-24T01:27:25.840969+0000","last_became_active":"2024-04-24T01:24:06.769230+0000","last_became_peered":"2024-04-24T01:24:06.769230+0000","last_unstale":"2024-04-24T01:27:25.840969+0000","last_undegraded":"2024-04-24T01:27:25.840969+0000","last_fullsized":"2024-04-24T01:27:25.840969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:25.840846+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.840846+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:46:26.499751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"34'2","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.017138+0000","last_change":"2024-04-24T01:27:59.017138+0000","last_active":"2024-04-24T01:27:59.017138+0000","last_peered":"2024-04-24T01:27:59.017138+0000","last_clean":"2024-04-24T01:27:59.017138+0000","last_became_active":"2024-04-24T01:24:08.770033+0000","last_became_peered":"2024-04-24T01:24:08.770033+0000","last_unstale":"2024-04-24T01:27:59.017138+0000","last_undegraded":"2024-04-24T01:27:59.017138+0000","last_fullsized":"2024-04-24T01:27:59.017138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.017023+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.017023+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:20.258126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.981815+0000","last_change":"2024-04-24T01:27:36.981815+0000","last_active":"2024-04-24T01:27:36.981815+0000","last_peered":"2024-04-24T01:27:36.981815+0000","last_clean":"2024-04-24T01:27:36.981815+0000","last_became_active":"2024-04-24T01:24:00.747715+0000","last_became_peered":"2024-04-24T01:24:00.747715+0000","last_unstale":"2024-04-24T01:27:36.981815+0000","last_undegraded":"2024-04-24T01:27:36.981815+0000","last_fullsized":"2024-04-24T01:27:36.981815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.981689+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.981689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:02.218699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"32'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.976878+0000","last_change":"2024-04-24T01:28:09.976878+0000","last_active":"2024-04-24T01:28:09.976878+0000","last_peered":"2024-04-24T01:28:09.976878+0000","last_clean":"2024-04-24T01:28:09.976878+0000","last_became_active":"2024-04-24T01:23:58.764149+0000","last_became_peered":"2024-04-24T01:23:58.764149+0000","last_unstale":"2024-04-24T01:28:09.976878+0000","last_undegraded":"2024-04-24T01:28:09.976878+0000","last_fullsized":"2024-04-24T01:28:09.976878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.976742+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.976742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:34:54.442355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.223313+0000","last_change":"2024-04-24T01:28:07.223313+0000","last_active":"2024-04-24T01:28:07.223313+0000","last_peered":"2024-04-24T01:28:07.223313+0000","last_clean":"2024-04-24T01:28:07.223313+0000","last_became_active":"2024-04-24T01:23:50.690338+0000","last_became_peered":"2024-04-24T01:23:50.690338+0000","last_unstale":"2024-04-24T01:28:07.223313+0000","last_undegraded":"2024-04-24T01:28:07.223313+0000","last_fullsized":"2024-04-24T01:28:07.223313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:07.223157+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.223157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:47:03.453523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:43.811968+0000","last_change":"2024-04-24T01:28:43.811991+0000","last_active":"2024-04-24T01:28:43.811968+0000","last_peered":"2024-04-24T01:28:43.811968+0000","last_clean":"2024-04-24T01:28:43.811968+0000","last_became_active":"2024-04-24T01:24:39.799092+0000","last_became_peered":"2024-04-24T01:24:39.799092+0000","last_unstale":"2024-04-24T01:28:43.811968+0000","last_undegraded":"2024-04-24T01:28:43.811968+0000","last_fullsized":"2024-04-24T01:28:43.811968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:43.811874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:43.811874+0000","last_clean_scrub_stamp":"2024-04-24T01:28:43.811874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:46:43.826340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.936683+0000","last_change":"2024-04-24T01:27:45.936683+0000","last_active":"2024-04-24T01:27:45.936683+0000","last_peered":"2024-04-24T01:27:45.936683+0000","last_clean":"2024-04-24T01:27:45.936683+0000","last_became_active":"2024-04-24T01:24:04.761187+0000","last_became_peered":"2024-04-24T01:24:04.761187+0000","last_unstale":"2024-04-24T01:27:45.936683+0000","last_undegraded":"2024-04-24T01:27:45.936683+0000","last_fullsized":"2024-04-24T01:27:45.936683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:45.936543+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.936543+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:45.566244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"34'285","reported_seq":425,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:26.031922+0000","last_change":"2024-04-24T01:27:26.031922+0000","last_active":"2024-04-24T01:27:26.031922+0000","last_peered":"2024-04-24T01:27:26.031922+0000","last_clean":"2024-04-24T01:27:26.031922+0000","last_became_active":"2024-04-24T01:24:06.764822+0000","last_became_peered":"2024-04-24T01:24:06.764822+0000","last_unstale":"2024-04-24T01:27:26.031922+0000","last_undegraded":"2024-04-24T01:27:26.031922+0000","last_fullsized":"2024-04-24T01:27:26.031922+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:26.031809+0000","last_clean_scrub_stamp":"2024-04-24T01:27:26.031809+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:17:08.282206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.899565+0000","last_change":"2024-04-24T01:28:17.899565+0000","last_active":"2024-04-24T01:28:17.899565+0000","last_peered":"2024-04-24T01:28:17.899565+0000","last_clean":"2024-04-24T01:28:17.899565+0000","last_became_active":"2024-04-24T01:24:08.778586+0000","last_became_peered":"2024-04-24T01:24:08.778586+0000","last_unstale":"2024-04-24T01:28:17.899565+0000","last_undegraded":"2024-04-24T01:28:17.899565+0000","last_fullsized":"2024-04-24T01:28:17.899565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-04-24T01:28:17.899414+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.899414+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:15:39.140517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"34'2","reported_seq":58,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.099400+0000","last_change":"2024-04-24T01:28:08.099400+0000","last_active":"2024-04-24T01:28:08.099400+0000","last_peered":"2024-04-24T01:28:08.099400+0000","last_clean":"2024-04-24T01:28:08.099400+0000","last_became_active":"2024-04-24T01:24:00.740589+0000","last_became_peered":"2024-04-24T01:24:00.740589+0000","last_unstale":"2024-04-24T01:28:08.099400+0000","last_undegraded":"2024-04-24T01:28:08.099400+0000","last_fullsized":"2024-04-24T01:28:08.099400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:08.099278+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.099278+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:59:08.168998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.836355+0000","last_change":"2024-04-24T01:28:11.836355+0000","last_active":"2024-04-24T01:28:11.836355+0000","last_peered":"2024-04-24T01:28:11.836355+0000","last_clean":"2024-04-24T01:28:11.836355+0000","last_became_active":"2024-04-24T01:23:58.751400+0000","last_became_peered":"2024-04-24T01:23:58.751400+0000","last_unstale":"2024-04-24T01:28:11.836355+0000","last_undegraded":"2024-04-24T01:28:11.836355+0000","last_fullsized":"2024-04-24T01:28:11.836355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.836242+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.836242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:31.148213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:32.826110+0000","last_change":"2024-04-24T01:28:32.826134+0000","last_active":"2024-04-24T01:28:32.826110+0000","last_peered":"2024-04-24T01:28:32.826110+0000","last_clean":"2024-04-24T01:28:32.826110+0000","last_became_active":"2024-04-24T01:23:50.777416+0000","last_became_peered":"2024-04-24T01:23:50.777416+0000","last_unstale":"2024-04-24T01:28:32.826110+0000","last_undegraded":"2024-04-24T01:28:32.826110+0000","last_fullsized":"2024-04-24T01:28:32.826110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:32.826015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:32.826015+0000","last_clean_scrub_stamp":"2024-04-24T01:28:32.826015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:57:17.800836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:21.157304+0000","last_change":"2024-04-24T01:27:21.157304+0000","last_active":"2024-04-24T01:27:21.157304+0000","last_peered":"2024-04-24T01:27:21.157304+0000","last_clean":"2024-04-24T01:27:21.157304+0000","last_became_active":"2024-04-24T01:24:02.755130+0000","last_became_peered":"2024-04-24T01:24:02.755130+0000","last_unstale":"2024-04-24T01:27:21.157304+0000","last_undegraded":"2024-04-24T01:27:21.157304+0000","last_fullsized":"2024-04-24T01:27:21.157304+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:21.157174+0000","last_clean_scrub_stamp":"2024-04-24T01:27:21.157174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:08.856778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'106","reported_seq":206,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:24.850725+0000","last_change":"2024-04-24T01:27:24.850725+0000","last_active":"2024-04-24T01:27:24.850725+0000","last_peered":"2024-04-24T01:27:24.850725+0000","last_clean":"2024-04-24T01:27:24.850725+0000","last_became_active":"2024-04-24T01:24:04.761543+0000","last_became_peered":"2024-04-24T01:24:04.761543+0000","last_unstale":"2024-04-24T01:27:24.850725+0000","last_undegraded":"2024-04-24T01:27:24.850725+0000","last_fullsized":"2024-04-24T01:27:24.850725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'106","last_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_deep_scrub":"34'106","last_deep_scrub_stamp":"2024-04-24T01:27:24.850572+0000","last_clean_scrub_stamp":"2024-04-24T01:27:24.850572+0000","objects_scrubbed":9,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:35:25.939996+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":108,"num_read_kb":111,"num_write":44,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.111936+0000","last_change":"2024-04-24T01:27:20.111936+0000","last_active":"2024-04-24T01:27:20.111936+0000","last_peered":"2024-04-24T01:27:20.111936+0000","last_clean":"2024-04-24T01:27:20.111936+0000","last_became_active":"2024-04-24T01:24:06.769335+0000","last_became_peered":"2024-04-24T01:24:06.769335+0000","last_unstale":"2024-04-24T01:27:20.111936+0000","last_undegraded":"2024-04-24T01:27:20.111936+0000","last_fullsized":"2024-04-24T01:27:20.111936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.111793+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.111793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:34:00.943524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"34'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.148836+0000","last_change":"2024-04-24T01:28:09.148836+0000","last_active":"2024-04-24T01:28:09.148836+0000","last_peered":"2024-04-24T01:28:09.148836+0000","last_clean":"2024-04-24T01:28:09.148836+0000","last_became_active":"2024-04-24T01:24:08.771116+0000","last_became_peered":"2024-04-24T01:24:08.771116+0000","last_unstale":"2024-04-24T01:28:09.148836+0000","last_undegraded":"2024-04-24T01:28:09.148836+0000","last_fullsized":"2024-04-24T01:28:09.148836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.148692+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.148692+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:13:37.814414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.170629+0000","last_change":"2024-04-24T01:28:11.170629+0000","last_active":"2024-04-24T01:28:11.170629+0000","last_peered":"2024-04-24T01:28:11.170629+0000","last_clean":"2024-04-24T01:28:11.170629+0000","last_became_active":"2024-04-24T01:24:08.772674+0000","last_became_peered":"2024-04-24T01:24:08.772674+0000","last_unstale":"2024-04-24T01:28:11.170629+0000","last_undegraded":"2024-04-24T01:28:11.170629+0000","last_fullsized":"2024-04-24T01:28:11.170629+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.170504+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.170504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:38:30.319203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"34'6","reported_seq":59,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.103068+0000","last_change":"2024-04-24T01:27:50.103068+0000","last_active":"2024-04-24T01:27:50.103068+0000","last_peered":"2024-04-24T01:27:50.103068+0000","last_clean":"2024-04-24T01:27:50.103068+0000","last_became_active":"2024-04-24T01:24:00.738063+0000","last_became_peered":"2024-04-24T01:24:00.738063+0000","last_unstale":"2024-04-24T01:27:50.103068+0000","last_undegraded":"2024-04-24T01:27:50.103068+0000","last_fullsized":"2024-04-24T01:27:50.103068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:50.102944+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.102944+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:05.909709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:23.032609+0000","last_change":"2024-04-24T01:28:23.032609+0000","last_active":"2024-04-24T01:28:23.032609+0000","last_peered":"2024-04-24T01:28:23.032609+0000","last_clean":"2024-04-24T01:28:23.032609+0000","last_became_active":"2024-04-24T01:23:58.762020+0000","last_became_peered":"2024-04-24T01:23:58.762020+0000","last_unstale":"2024-04-24T01:28:23.032609+0000","last_undegraded":"2024-04-24T01:28:23.032609+0000","last_fullsized":"2024-04-24T01:28:23.032609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:23.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:23.032499+0000","last_clean_scrub_stamp":"2024-04-24T01:28:23.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:19.871990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:38.764441+0000","last_change":"2024-04-24T01:27:38.764441+0000","last_active":"2024-04-24T01:27:38.764441+0000","last_peered":"2024-04-24T01:27:38.764441+0000","last_clean":"2024-04-24T01:27:38.764441+0000","last_became_active":"2024-04-24T01:24:02.754554+0000","last_became_peered":"2024-04-24T01:24:02.754554+0000","last_unstale":"2024-04-24T01:27:38.764441+0000","last_undegraded":"2024-04-24T01:27:38.764441+0000","last_fullsized":"2024-04-24T01:27:38.764441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:38.764324+0000","last_clean_scrub_stamp":"2024-04-24T01:27:38.764324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:42:54.262419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'48","reported_seq":111,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.087751+0000","last_change":"2024-04-24T01:27:31.087751+0000","last_active":"2024-04-24T01:27:31.087751+0000","last_peered":"2024-04-24T01:27:31.087751+0000","last_clean":"2024-04-24T01:27:31.087751+0000","last_became_active":"2024-04-24T01:24:04.758742+0000","last_became_peered":"2024-04-24T01:24:04.758742+0000","last_unstale":"2024-04-24T01:27:31.087751+0000","last_undegraded":"2024-04-24T01:27:31.087751+0000","last_fullsized":"2024-04-24T01:27:31.087751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'48","last_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_deep_scrub":"34'48","last_deep_scrub_stamp":"2024-04-24T01:27:31.087607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.087607+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:17.401970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.881559+0000","last_change":"2024-04-24T01:27:50.881559+0000","last_active":"2024-04-24T01:27:50.881559+0000","last_peered":"2024-04-24T01:27:50.881559+0000","last_clean":"2024-04-24T01:27:50.881559+0000","last_became_active":"2024-04-24T01:24:06.765630+0000","last_became_peered":"2024-04-24T01:24:06.765630+0000","last_unstale":"2024-04-24T01:27:50.881559+0000","last_undegraded":"2024-04-24T01:27:50.881559+0000","last_fullsized":"2024-04-24T01:27:50.881559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:50.881443+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.881443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:09:57.915724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:22.205265+0000","last_change":"2024-04-24T01:28:22.205292+0000","last_active":"2024-04-24T01:28:22.205265+0000","last_peered":"2024-04-24T01:28:22.205265+0000","last_clean":"2024-04-24T01:28:22.205265+0000","last_became_active":"2024-04-24T01:24:08.778269+0000","last_became_peered":"2024-04-24T01:24:08.778269+0000","last_unstale":"2024-04-24T01:28:22.205265+0000","last_undegraded":"2024-04-24T01:28:22.205265+0000","last_fullsized":"2024-04-24T01:28:22.205265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-04-24T01:28:22.205176+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-04-24T01:28:22.205176+0000","last_clean_scrub_stamp":"2024-04-24T01:28:22.205176+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:03.929937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":31,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"34'14","reported_seq":83,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.832778+0000","last_change":"2024-04-24T01:28:03.832778+0000","last_active":"2024-04-24T01:28:03.832778+0000","last_peered":"2024-04-24T01:28:03.832778+0000","last_clean":"2024-04-24T01:28:03.832778+0000","last_became_active":"2024-04-24T01:24:00.742933+0000","last_became_peered":"2024-04-24T01:24:00.742933+0000","last_unstale":"2024-04-24T01:28:03.832778+0000","last_undegraded":"2024-04-24T01:28:03.832778+0000","last_fullsized":"2024-04-24T01:28:03.832778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'14","last_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_deep_scrub":"34'14","last_deep_scrub_stamp":"2024-04-24T01:28:03.832618+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.832618+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:44:59.237815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":54,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.044241+0000","last_change":"2024-04-24T01:27:57.044241+0000","last_active":"2024-04-24T01:27:57.044241+0000","last_peered":"2024-04-24T01:27:57.044241+0000","last_clean":"2024-04-24T01:27:57.044241+0000","last_became_active":"2024-04-24T01:23:58.742169+0000","last_became_peered":"2024-04-24T01:23:58.742169+0000","last_unstale":"2024-04-24T01:27:57.044241+0000","last_undegraded":"2024-04-24T01:27:57.044241+0000","last_fullsized":"2024-04-24T01:27:57.044241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.044128+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.044128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:43.358491+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:29.142915+0000","last_change":"2024-04-24T01:27:29.142915+0000","last_active":"2024-04-24T01:27:29.142915+0000","last_peered":"2024-04-24T01:27:29.142915+0000","last_clean":"2024-04-24T01:27:29.142915+0000","last_became_active":"2024-04-24T01:24:02.752568+0000","last_became_peered":"2024-04-24T01:24:02.752568+0000","last_unstale":"2024-04-24T01:27:29.142915+0000","last_undegraded":"2024-04-24T01:27:29.142915+0000","last_fullsized":"2024-04-24T01:27:29.142915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:29.142798+0000","last_clean_scrub_stamp":"2024-04-24T01:27:29.142798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:23:45.905908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'9","reported_seq":50,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.183920+0000","last_change":"2024-04-24T01:27:34.183920+0000","last_active":"2024-04-24T01:27:34.183920+0000","last_peered":"2024-04-24T01:27:34.183920+0000","last_clean":"2024-04-24T01:27:34.183920+0000","last_became_active":"2024-04-24T01:24:04.746747+0000","last_became_peered":"2024-04-24T01:24:04.746747+0000","last_unstale":"2024-04-24T01:27:34.183920+0000","last_undegraded":"2024-04-24T01:27:34.183920+0000","last_fullsized":"2024-04-24T01:27:34.183920+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'9","last_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_deep_scrub":"34'9","last_deep_scrub_stamp":"2024-04-24T01:27:34.183806+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.183806+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:32:12.698513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:23.807924+0000","last_change":"2024-04-24T01:27:23.807924+0000","last_active":"2024-04-24T01:27:23.807924+0000","last_peered":"2024-04-24T01:27:23.807924+0000","last_clean":"2024-04-24T01:27:23.807924+0000","last_became_active":"2024-04-24T01:24:06.763385+0000","last_became_peered":"2024-04-24T01:24:06.763385+0000","last_unstale":"2024-04-24T01:27:23.807924+0000","last_undegraded":"2024-04-24T01:27:23.807924+0000","last_fullsized":"2024-04-24T01:27:23.807924+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:23.807746+0000","last_clean_scrub_stamp":"2024-04-24T01:27:23.807746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:15:16.346274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"34'4","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:18.094421+0000","last_change":"2024-04-24T01:28:18.094448+0000","last_active":"2024-04-24T01:28:18.094421+0000","last_peered":"2024-04-24T01:28:18.094421+0000","last_clean":"2024-04-24T01:28:18.094421+0000","last_became_active":"2024-04-24T01:24:08.768288+0000","last_became_peered":"2024-04-24T01:24:08.768288+0000","last_unstale":"2024-04-24T01:28:18.094421+0000","last_undegraded":"2024-04-24T01:28:18.094421+0000","last_fullsized":"2024-04-24T01:28:18.094421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:18.094335+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:18.094335+0000","last_clean_scrub_stamp":"2024-04-24T01:28:18.094335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:21.982836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"34'6","reported_seq":57,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.205539+0000","last_change":"2024-04-24T01:28:05.205539+0000","last_active":"2024-04-24T01:28:05.205539+0000","last_peered":"2024-04-24T01:28:05.205539+0000","last_clean":"2024-04-24T01:28:05.205539+0000","last_became_active":"2024-04-24T01:24:00.738039+0000","last_became_peered":"2024-04-24T01:24:00.738039+0000","last_unstale":"2024-04-24T01:28:05.205539+0000","last_undegraded":"2024-04-24T01:28:05.205539+0000","last_fullsized":"2024-04-24T01:28:05.205539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:05.205385+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.205385+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:43:24.593592+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.105447+0000","last_change":"2024-04-24T01:28:03.105447+0000","last_active":"2024-04-24T01:28:03.105447+0000","last_peered":"2024-04-24T01:28:03.105447+0000","last_clean":"2024-04-24T01:28:03.105447+0000","last_became_active":"2024-04-24T01:23:58.735578+0000","last_became_peered":"2024-04-24T01:23:58.735578+0000","last_unstale":"2024-04-24T01:28:03.105447+0000","last_undegraded":"2024-04-24T01:28:03.105447+0000","last_fullsized":"2024-04-24T01:28:03.105447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.105283+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.105283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:10:07.428544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.931202+0000","last_change":"2024-04-24T01:27:36.931202+0000","last_active":"2024-04-24T01:27:36.931202+0000","last_peered":"2024-04-24T01:27:36.931202+0000","last_clean":"2024-04-24T01:27:36.931202+0000","last_became_active":"2024-04-24T01:24:02.750361+0000","last_became_peered":"2024-04-24T01:24:02.750361+0000","last_unstale":"2024-04-24T01:27:36.931202+0000","last_undegraded":"2024-04-24T01:27:36.931202+0000","last_fullsized":"2024-04-24T01:27:36.931202+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.931078+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.931078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:33:03.648188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"34'50","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:31.196826+0000","last_change":"2024-04-24T01:27:31.196826+0000","last_active":"2024-04-24T01:27:31.196826+0000","last_peered":"2024-04-24T01:27:31.196826+0000","last_clean":"2024-04-24T01:27:31.196826+0000","last_became_active":"2024-04-24T01:24:04.755448+0000","last_became_peered":"2024-04-24T01:24:04.755448+0000","last_unstale":"2024-04-24T01:27:31.196826+0000","last_undegraded":"2024-04-24T01:27:31.196826+0000","last_fullsized":"2024-04-24T01:27:31.196826+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'50","last_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_deep_scrub":"34'50","last_deep_scrub_stamp":"2024-04-24T01:27:31.196709+0000","last_clean_scrub_stamp":"2024-04-24T01:27:31.196709+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:14:11.522611+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.807267+0000","last_change":"2024-04-24T01:27:20.807267+0000","last_active":"2024-04-24T01:27:20.807267+0000","last_peered":"2024-04-24T01:27:20.807267+0000","last_clean":"2024-04-24T01:27:20.807267+0000","last_became_active":"2024-04-24T01:24:06.768861+0000","last_became_peered":"2024-04-24T01:24:06.768861+0000","last_unstale":"2024-04-24T01:27:20.807267+0000","last_undegraded":"2024-04-24T01:27:20.807267+0000","last_fullsized":"2024-04-24T01:27:20.807267+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.807118+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.807118+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:36.350177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:39.797414+0000","last_change":"2024-04-24T01:28:39.797438+0000","last_active":"2024-04-24T01:28:39.797414+0000","last_peered":"2024-04-24T01:28:39.797414+0000","last_clean":"2024-04-24T01:28:39.797414+0000","last_became_active":"2024-04-24T01:24:08.774058+0000","last_became_peered":"2024-04-24T01:24:08.774058+0000","last_unstale":"2024-04-24T01:28:39.797414+0000","last_undegraded":"2024-04-24T01:28:39.797414+0000","last_fullsized":"2024-04-24T01:28:39.797414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:39.797323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:39.797323+0000","last_clean_scrub_stamp":"2024-04-24T01:28:39.797323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:43:32.937854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'10","reported_seq":71,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:35.969607+0000","last_change":"2024-04-24T01:27:35.969607+0000","last_active":"2024-04-24T01:27:35.969607+0000","last_peered":"2024-04-24T01:27:35.969607+0000","last_clean":"2024-04-24T01:27:35.969607+0000","last_became_active":"2024-04-24T01:24:00.747557+0000","last_became_peered":"2024-04-24T01:24:00.747557+0000","last_unstale":"2024-04-24T01:27:35.969607+0000","last_undegraded":"2024-04-24T01:27:35.969607+0000","last_fullsized":"2024-04-24T01:27:35.969607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:35.969453+0000","last_clean_scrub_stamp":"2024-04-24T01:27:35.969453+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:40.292715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.863808+0000","last_change":"2024-04-24T01:28:13.863808+0000","last_active":"2024-04-24T01:28:13.863808+0000","last_peered":"2024-04-24T01:28:13.863808+0000","last_clean":"2024-04-24T01:28:13.863808+0000","last_became_active":"2024-04-24T01:23:58.752253+0000","last_became_peered":"2024-04-24T01:23:58.752253+0000","last_unstale":"2024-04-24T01:28:13.863808+0000","last_undegraded":"2024-04-24T01:28:13.863808+0000","last_fullsized":"2024-04-24T01:28:13.863808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:13.863667+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.863667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:07:05.970240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.118393+0000","last_change":"2024-04-24T01:27:30.118393+0000","last_active":"2024-04-24T01:27:30.118393+0000","last_peered":"2024-04-24T01:27:30.118393+0000","last_clean":"2024-04-24T01:27:30.118393+0000","last_became_active":"2024-04-24T01:24:02.752959+0000","last_became_peered":"2024-04-24T01:24:02.752959+0000","last_unstale":"2024-04-24T01:27:30.118393+0000","last_undegraded":"2024-04-24T01:27:30.118393+0000","last_fullsized":"2024-04-24T01:27:30.118393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:30.118234+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.118234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:55:34.081179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"34'36","reported_seq":92,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.933125+0000","last_change":"2024-04-24T01:27:32.933125+0000","last_active":"2024-04-24T01:27:32.933125+0000","last_peered":"2024-04-24T01:27:32.933125+0000","last_clean":"2024-04-24T01:27:32.933125+0000","last_became_active":"2024-04-24T01:24:04.748894+0000","last_became_peered":"2024-04-24T01:24:04.748894+0000","last_unstale":"2024-04-24T01:27:32.933125+0000","last_undegraded":"2024-04-24T01:27:32.933125+0000","last_fullsized":"2024-04-24T01:27:32.933125+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'36","last_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_deep_scrub":"34'36","last_deep_scrub_stamp":"2024-04-24T01:27:32.933012+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.933012+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:06:06.750907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:20.831064+0000","last_change":"2024-04-24T01:27:20.831064+0000","last_active":"2024-04-24T01:27:20.831064+0000","last_peered":"2024-04-24T01:27:20.831064+0000","last_clean":"2024-04-24T01:27:20.831064+0000","last_became_active":"2024-04-24T01:24:06.764977+0000","last_became_peered":"2024-04-24T01:24:06.764977+0000","last_unstale":"2024-04-24T01:27:20.831064+0000","last_undegraded":"2024-04-24T01:27:20.831064+0000","last_fullsized":"2024-04-24T01:27:20.831064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:20.830957+0000","last_clean_scrub_stamp":"2024-04-24T01:27:20.830957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:22:31.945556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"34'10","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.917603+0000","last_change":"2024-04-24T01:27:55.917603+0000","last_active":"2024-04-24T01:27:55.917603+0000","last_peered":"2024-04-24T01:27:55.917603+0000","last_clean":"2024-04-24T01:27:55.917603+0000","last_became_active":"2024-04-24T01:24:00.735117+0000","last_became_peered":"2024-04-24T01:24:00.735117+0000","last_unstale":"2024-04-24T01:27:55.917603+0000","last_undegraded":"2024-04-24T01:27:55.917603+0000","last_fullsized":"2024-04-24T01:27:55.917603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:55.917438+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.917438+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:25:55.797725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:13.091102+0000","last_change":"2024-04-24T01:28:13.091102+0000","last_active":"2024-04-24T01:28:13.091102+0000","last_peered":"2024-04-24T01:28:13.091102+0000","last_clean":"2024-04-24T01:28:13.091102+0000","last_became_active":"2024-04-24T01:23:58.758592+0000","last_became_peered":"2024-04-24T01:23:58.758592+0000","last_unstale":"2024-04-24T01:28:13.091102+0000","last_undegraded":"2024-04-24T01:28:13.091102+0000","last_fullsized":"2024-04-24T01:28:13.091102+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:13.090980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:13.090980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:42:40.409078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.353257+0000","last_change":"2024-04-24T01:27:42.353257+0000","last_active":"2024-04-24T01:27:42.353257+0000","last_peered":"2024-04-24T01:27:42.353257+0000","last_clean":"2024-04-24T01:27:42.353257+0000","last_became_active":"2024-04-24T01:24:02.752686+0000","last_became_peered":"2024-04-24T01:24:02.752686+0000","last_unstale":"2024-04-24T01:27:42.353257+0000","last_undegraded":"2024-04-24T01:27:42.353257+0000","last_fullsized":"2024-04-24T01:27:42.353257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.353157+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.353157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:02.089872+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'70","reported_seq":149,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.233047+0000","last_change":"2024-04-24T01:27:32.233080+0000","last_active":"2024-04-24T01:27:32.233047+0000","last_peered":"2024-04-24T01:27:32.233047+0000","last_clean":"2024-04-24T01:27:32.233047+0000","last_became_active":"2024-04-24T01:24:04.754176+0000","last_became_peered":"2024-04-24T01:24:04.754176+0000","last_unstale":"2024-04-24T01:27:32.233047+0000","last_undegraded":"2024-04-24T01:27:32.233047+0000","last_fullsized":"2024-04-24T01:27:32.233047+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'70","last_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_deep_scrub":"34'70","last_deep_scrub_stamp":"2024-04-24T01:27:32.232954+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.232954+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:38:33.771403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":60,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.841600+0000","last_change":"2024-04-24T01:27:22.841624+0000","last_active":"2024-04-24T01:27:22.841600+0000","last_peered":"2024-04-24T01:27:22.841600+0000","last_clean":"2024-04-24T01:27:22.841600+0000","last_became_active":"2024-04-24T01:24:06.764746+0000","last_became_peered":"2024-04-24T01:24:06.764746+0000","last_unstale":"2024-04-24T01:27:22.841600+0000","last_undegraded":"2024-04-24T01:27:22.841600+0000","last_fullsized":"2024-04-24T01:27:22.841600+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.841514+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.841514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:42:44.014128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"34'19","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:19.132938+0000","last_change":"2024-04-24T01:28:19.132938+0000","last_active":"2024-04-24T01:28:19.132938+0000","last_peered":"2024-04-24T01:28:19.132938+0000","last_clean":"2024-04-24T01:28:19.132938+0000","last_became_active":"2024-04-24T01:24:08.768601+0000","last_became_peered":"2024-04-24T01:24:08.768601+0000","last_unstale":"2024-04-24T01:28:19.132938+0000","last_undegraded":"2024-04-24T01:28:19.132938+0000","last_fullsized":"2024-04-24T01:28:19.132938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'19","last_scrub_stamp":"2024-04-24T01:28:19.132780+0000","last_deep_scrub":"34'19","last_deep_scrub_stamp":"2024-04-24T01:28:19.132780+0000","last_clean_scrub_stamp":"2024-04-24T01:28:19.132780+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:48:36.505868+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"34'10","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.296646+0000","last_change":"2024-04-24T01:27:48.296646+0000","last_active":"2024-04-24T01:27:48.296646+0000","last_peered":"2024-04-24T01:27:48.296646+0000","last_clean":"2024-04-24T01:27:48.296646+0000","last_became_active":"2024-04-24T01:24:00.746280+0000","last_became_peered":"2024-04-24T01:24:00.746280+0000","last_unstale":"2024-04-24T01:27:48.296646+0000","last_undegraded":"2024-04-24T01:27:48.296646+0000","last_fullsized":"2024-04-24T01:27:48.296646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:48.296518+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.296518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:09.220285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.859610+0000","last_change":"2024-04-24T01:28:12.859610+0000","last_active":"2024-04-24T01:28:12.859610+0000","last_peered":"2024-04-24T01:28:12.859610+0000","last_clean":"2024-04-24T01:28:12.859610+0000","last_became_active":"2024-04-24T01:23:58.751516+0000","last_became_peered":"2024-04-24T01:23:58.751516+0000","last_unstale":"2024-04-24T01:28:12.859610+0000","last_undegraded":"2024-04-24T01:28:12.859610+0000","last_fullsized":"2024-04-24T01:28:12.859610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:12.859483+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.859483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:11:08.233871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:41.046002+0000","last_change":"2024-04-24T01:27:41.046002+0000","last_active":"2024-04-24T01:27:41.046002+0000","last_peered":"2024-04-24T01:27:41.046002+0000","last_clean":"2024-04-24T01:27:41.046002+0000","last_became_active":"2024-04-24T01:24:02.750482+0000","last_became_peered":"2024-04-24T01:24:02.750482+0000","last_unstale":"2024-04-24T01:27:41.046002+0000","last_undegraded":"2024-04-24T01:27:41.046002+0000","last_fullsized":"2024-04-24T01:27:41.046002+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:41.045887+0000","last_clean_scrub_stamp":"2024-04-24T01:27:41.045887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:25:22.914827+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"34'45","reported_seq":103,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:25.087296+0000","last_change":"2024-04-24T01:27:25.087358+0000","last_active":"2024-04-24T01:27:25.087296+0000","last_peered":"2024-04-24T01:27:25.087296+0000","last_clean":"2024-04-24T01:27:25.087296+0000","last_became_active":"2024-04-24T01:24:04.758606+0000","last_became_peered":"2024-04-24T01:24:04.758606+0000","last_unstale":"2024-04-24T01:27:25.087296+0000","last_undegraded":"2024-04-24T01:27:25.087296+0000","last_fullsized":"2024-04-24T01:27:25.087296+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'45","last_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_deep_scrub":"34'45","last_deep_scrub_stamp":"2024-04-24T01:27:25.087202+0000","last_clean_scrub_stamp":"2024-04-24T01:27:25.087202+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:18.223546+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.735703+0000","last_change":"2024-04-24T01:27:33.735761+0000","last_active":"2024-04-24T01:27:33.735703+0000","last_peered":"2024-04-24T01:27:33.735703+0000","last_clean":"2024-04-24T01:27:33.735703+0000","last_became_active":"2024-04-24T01:24:06.771505+0000","last_became_peered":"2024-04-24T01:24:06.771505+0000","last_unstale":"2024-04-24T01:27:33.735703+0000","last_undegraded":"2024-04-24T01:27:33.735703+0000","last_fullsized":"2024-04-24T01:27:33.735703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.735599+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.735599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:44.989596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.044679+0000","last_change":"2024-04-24T01:28:03.044679+0000","last_active":"2024-04-24T01:28:03.044679+0000","last_peered":"2024-04-24T01:28:03.044679+0000","last_clean":"2024-04-24T01:28:03.044679+0000","last_became_active":"2024-04-24T01:24:08.771519+0000","last_became_peered":"2024-04-24T01:24:08.771519+0000","last_unstale":"2024-04-24T01:28:03.044679+0000","last_undegraded":"2024-04-24T01:28:03.044679+0000","last_fullsized":"2024-04-24T01:28:03.044679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:03.044539+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.044539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:54.343523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.973256+0000","last_change":"2024-04-24T01:27:33.973301+0000","last_active":"2024-04-24T01:27:33.973256+0000","last_peered":"2024-04-24T01:27:33.973256+0000","last_clean":"2024-04-24T01:27:33.973256+0000","last_became_active":"2024-04-24T01:24:00.747972+0000","last_became_peered":"2024-04-24T01:24:00.747972+0000","last_unstale":"2024-04-24T01:27:33.973256+0000","last_undegraded":"2024-04-24T01:27:33.973256+0000","last_fullsized":"2024-04-24T01:27:33.973256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:33.973155+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.973155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:28.429349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.825748+0000","last_change":"2024-04-24T01:28:09.825748+0000","last_active":"2024-04-24T01:28:09.825748+0000","last_peered":"2024-04-24T01:28:09.825748+0000","last_clean":"2024-04-24T01:28:09.825748+0000","last_became_active":"2024-04-24T01:23:58.751724+0000","last_became_peered":"2024-04-24T01:23:58.751724+0000","last_unstale":"2024-04-24T01:28:09.825748+0000","last_undegraded":"2024-04-24T01:28:09.825748+0000","last_fullsized":"2024-04-24T01:28:09.825748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:09.825585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.825585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:16.859867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.059784+0000","last_change":"2024-04-24T01:27:40.059810+0000","last_active":"2024-04-24T01:27:40.059784+0000","last_peered":"2024-04-24T01:27:40.059784+0000","last_clean":"2024-04-24T01:27:40.059784+0000","last_became_active":"2024-04-24T01:24:02.750797+0000","last_became_peered":"2024-04-24T01:24:02.750797+0000","last_unstale":"2024-04-24T01:27:40.059784+0000","last_undegraded":"2024-04-24T01:27:40.059784+0000","last_fullsized":"2024-04-24T01:27:40.059784+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:40.059684+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.059684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:45:04.176354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"34'46","reported_seq":109,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:28.098384+0000","last_change":"2024-04-24T01:27:28.098384+0000","last_active":"2024-04-24T01:27:28.098384+0000","last_peered":"2024-04-24T01:27:28.098384+0000","last_clean":"2024-04-24T01:27:28.098384+0000","last_became_active":"2024-04-24T01:24:04.758904+0000","last_became_peered":"2024-04-24T01:24:04.758904+0000","last_unstale":"2024-04-24T01:27:28.098384+0000","last_undegraded":"2024-04-24T01:27:28.098384+0000","last_fullsized":"2024-04-24T01:27:28.098384+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'46","last_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_deep_scrub":"34'46","last_deep_scrub_stamp":"2024-04-24T01:27:28.098205+0000","last_clean_scrub_stamp":"2024-04-24T01:27:28.098205+0000","objects_scrubbed":6,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:13.672642+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":47,"num_read_kb":39,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:22.091423+0000","last_change":"2024-04-24T01:27:22.091423+0000","last_active":"2024-04-24T01:27:22.091423+0000","last_peered":"2024-04-24T01:27:22.091423+0000","last_clean":"2024-04-24T01:27:22.091423+0000","last_became_active":"2024-04-24T01:24:06.766745+0000","last_became_peered":"2024-04-24T01:24:06.766745+0000","last_unstale":"2024-04-24T01:27:22.091423+0000","last_undegraded":"2024-04-24T01:27:22.091423+0000","last_fullsized":"2024-04-24T01:27:22.091423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:22.091312+0000","last_clean_scrub_stamp":"2024-04-24T01:27:22.091312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:04:42.457212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"34'3","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:38.803638+0000","last_change":"2024-04-24T01:28:38.803638+0000","last_active":"2024-04-24T01:28:38.803638+0000","last_peered":"2024-04-24T01:28:38.803638+0000","last_clean":"2024-04-24T01:28:38.803638+0000","last_became_active":"2024-04-24T01:24:08.773457+0000","last_became_peered":"2024-04-24T01:24:08.773457+0000","last_unstale":"2024-04-24T01:28:38.803638+0000","last_undegraded":"2024-04-24T01:28:38.803638+0000","last_fullsized":"2024-04-24T01:28:38.803638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:38.803505+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:38.803505+0000","last_clean_scrub_stamp":"2024-04-24T01:28:38.803505+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:21:01.570836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"34'4","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:55.329918+0000","last_change":"2024-04-24T01:27:55.329959+0000","last_active":"2024-04-24T01:27:55.329918+0000","last_peered":"2024-04-24T01:27:55.329918+0000","last_clean":"2024-04-24T01:27:55.329918+0000","last_became_active":"2024-04-24T01:24:00.731680+0000","last_became_peered":"2024-04-24T01:24:00.731680+0000","last_unstale":"2024-04-24T01:27:55.329918+0000","last_undegraded":"2024-04-24T01:27:55.329918+0000","last_fullsized":"2024-04-24T01:27:55.329918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:27:55.329792+0000","last_clean_scrub_stamp":"2024-04-24T01:27:55.329792+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:04:03.792768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:17.960427+0000","last_change":"2024-04-24T01:28:17.960427+0000","last_active":"2024-04-24T01:28:17.960427+0000","last_peered":"2024-04-24T01:28:17.960427+0000","last_clean":"2024-04-24T01:28:17.960427+0000","last_became_active":"2024-04-24T01:23:58.757644+0000","last_became_peered":"2024-04-24T01:23:58.757644+0000","last_unstale":"2024-04-24T01:28:17.960427+0000","last_undegraded":"2024-04-24T01:28:17.960427+0000","last_fullsized":"2024-04-24T01:28:17.960427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:17.960318+0000","last_clean_scrub_stamp":"2024-04-24T01:28:17.960318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:51:16.440099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:39.749135+0000","last_change":"2024-04-24T01:27:39.749158+0000","last_active":"2024-04-24T01:27:39.749135+0000","last_peered":"2024-04-24T01:27:39.749135+0000","last_clean":"2024-04-24T01:27:39.749135+0000","last_became_active":"2024-04-24T01:24:02.752868+0000","last_became_peered":"2024-04-24T01:24:02.752868+0000","last_unstale":"2024-04-24T01:27:39.749135+0000","last_undegraded":"2024-04-24T01:27:39.749135+0000","last_fullsized":"2024-04-24T01:27:39.749135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:39.749046+0000","last_clean_scrub_stamp":"2024-04-24T01:27:39.749046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:27.448650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'22","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.983586+0000","last_change":"2024-04-24T01:27:34.983586+0000","last_active":"2024-04-24T01:27:34.983586+0000","last_peered":"2024-04-24T01:27:34.983586+0000","last_clean":"2024-04-24T01:27:34.983586+0000","last_became_active":"2024-04-24T01:24:04.758919+0000","last_became_peered":"2024-04-24T01:24:04.758919+0000","last_unstale":"2024-04-24T01:27:34.983586+0000","last_undegraded":"2024-04-24T01:27:34.983586+0000","last_fullsized":"2024-04-24T01:27:34.983586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'22","last_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_deep_scrub":"34'22","last_deep_scrub_stamp":"2024-04-24T01:27:34.983448+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.983448+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:01.670877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"34'285","reported_seq":388,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:33.929176+0000","last_change":"2024-04-24T01:27:33.929176+0000","last_active":"2024-04-24T01:27:33.929176+0000","last_peered":"2024-04-24T01:27:33.929176+0000","last_clean":"2024-04-24T01:27:33.929176+0000","last_became_active":"2024-04-24T01:24:06.769669+0000","last_became_peered":"2024-04-24T01:24:06.769669+0000","last_unstale":"2024-04-24T01:27:33.929176+0000","last_undegraded":"2024-04-24T01:27:33.929176+0000","last_fullsized":"2024-04-24T01:27:33.929176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'285","last_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_deep_scrub":"34'285","last_deep_scrub_stamp":"2024-04-24T01:27:33.929072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:33.929072+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:18.783745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.001570+0000","last_change":"2024-04-24T01:28:11.001570+0000","last_active":"2024-04-24T01:28:11.001570+0000","last_peered":"2024-04-24T01:28:11.001570+0000","last_clean":"2024-04-24T01:28:11.001570+0000","last_became_active":"2024-04-24T01:24:08.772707+0000","last_became_peered":"2024-04-24T01:24:08.772707+0000","last_unstale":"2024-04-24T01:28:11.001570+0000","last_undegraded":"2024-04-24T01:28:11.001570+0000","last_fullsized":"2024-04-24T01:28:11.001570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.001466+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.001466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:24.425690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"34'16","reported_seq":84,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.079919+0000","last_change":"2024-04-24T01:27:48.079950+0000","last_active":"2024-04-24T01:27:48.079919+0000","last_peered":"2024-04-24T01:27:48.079919+0000","last_clean":"2024-04-24T01:27:48.079919+0000","last_became_active":"2024-04-24T01:24:00.731836+0000","last_became_peered":"2024-04-24T01:24:00.731836+0000","last_unstale":"2024-04-24T01:27:48.079919+0000","last_undegraded":"2024-04-24T01:27:48.079919+0000","last_fullsized":"2024-04-24T01:27:48.079919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'16","last_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_deep_scrub":"34'16","last_deep_scrub_stamp":"2024-04-24T01:27:48.079833+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.079833+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:52:03.610383+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":60,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.861517+0000","last_change":"2024-04-24T01:28:04.861517+0000","last_active":"2024-04-24T01:28:04.861517+0000","last_peered":"2024-04-24T01:28:04.861517+0000","last_clean":"2024-04-24T01:28:04.861517+0000","last_became_active":"2024-04-24T01:23:58.751997+0000","last_became_peered":"2024-04-24T01:23:58.751997+0000","last_unstale":"2024-04-24T01:28:04.861517+0000","last_undegraded":"2024-04-24T01:28:04.861517+0000","last_fullsized":"2024-04-24T01:28:04.861517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:04.861352+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.861352+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:53:45.266160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:36.756543+0000","last_change":"2024-04-24T01:27:36.756588+0000","last_active":"2024-04-24T01:27:36.756543+0000","last_peered":"2024-04-24T01:27:36.756543+0000","last_clean":"2024-04-24T01:27:36.756543+0000","last_became_active":"2024-04-24T01:24:02.755127+0000","last_became_peered":"2024-04-24T01:24:02.755127+0000","last_unstale":"2024-04-24T01:27:36.756543+0000","last_undegraded":"2024-04-24T01:27:36.756543+0000","last_fullsized":"2024-04-24T01:27:36.756543+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:36.756455+0000","last_clean_scrub_stamp":"2024-04-24T01:27:36.756455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:22.449180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"34'75","reported_seq":158,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.761800+0000","last_change":"2024-04-24T01:27:30.761800+0000","last_active":"2024-04-24T01:27:30.761800+0000","last_peered":"2024-04-24T01:27:30.761800+0000","last_clean":"2024-04-24T01:27:30.761800+0000","last_became_active":"2024-04-24T01:24:04.753518+0000","last_became_peered":"2024-04-24T01:24:04.753518+0000","last_unstale":"2024-04-24T01:27:30.761800+0000","last_undegraded":"2024-04-24T01:27:30.761800+0000","last_fullsized":"2024-04-24T01:27:30.761800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'75","last_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_deep_scrub":"34'75","last_deep_scrub_stamp":"2024-04-24T01:27:30.761661+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.761661+0000","objects_scrubbed":11,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:34:48.545704+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":80,"num_read_kb":67,"num_write":44,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.337095+0000","last_change":"2024-04-24T01:27:45.337095+0000","last_active":"2024-04-24T01:27:45.337095+0000","last_peered":"2024-04-24T01:27:45.337095+0000","last_clean":"2024-04-24T01:27:45.337095+0000","last_became_active":"2024-04-24T01:24:06.770303+0000","last_became_peered":"2024-04-24T01:24:06.770303+0000","last_unstale":"2024-04-24T01:27:45.337095+0000","last_undegraded":"2024-04-24T01:27:45.337095+0000","last_fullsized":"2024-04-24T01:27:45.337095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:45.336963+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.336963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:02:37.290165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.739935+0000","last_change":"2024-04-24T01:27:37.739935+0000","last_active":"2024-04-24T01:27:37.739935+0000","last_peered":"2024-04-24T01:27:37.739935+0000","last_clean":"2024-04-24T01:27:37.739935+0000","last_became_active":"2024-04-24T01:24:08.768847+0000","last_became_peered":"2024-04-24T01:24:08.768847+0000","last_unstale":"2024-04-24T01:27:37.739935+0000","last_undegraded":"2024-04-24T01:27:37.739935+0000","last_fullsized":"2024-04-24T01:27:37.739935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.739820+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.739820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:34.597803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"34'10","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:45.075139+0000","last_change":"2024-04-24T01:27:45.075163+0000","last_active":"2024-04-24T01:27:45.075139+0000","last_peered":"2024-04-24T01:27:45.075139+0000","last_clean":"2024-04-24T01:27:45.075139+0000","last_became_active":"2024-04-24T01:24:00.729421+0000","last_became_peered":"2024-04-24T01:24:00.729421+0000","last_unstale":"2024-04-24T01:27:45.075139+0000","last_undegraded":"2024-04-24T01:27:45.075139+0000","last_fullsized":"2024-04-24T01:27:45.075139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:45.075019+0000","last_clean_scrub_stamp":"2024-04-24T01:27:45.075019+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:24:51.367822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"34'3","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:24.976757+0000","last_change":"2024-04-24T01:28:24.976757+0000","last_active":"2024-04-24T01:28:24.976757+0000","last_peered":"2024-04-24T01:28:24.976757+0000","last_clean":"2024-04-24T01:28:24.976757+0000","last_became_active":"2024-04-24T01:23:58.762856+0000","last_became_peered":"2024-04-24T01:23:58.762856+0000","last_unstale":"2024-04-24T01:28:24.976757+0000","last_undegraded":"2024-04-24T01:28:24.976757+0000","last_fullsized":"2024-04-24T01:28:24.976757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:28:24.976622+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:28:24.976622+0000","last_clean_scrub_stamp":"2024-04-24T01:28:24.976622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:36:28.031723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.913584+0000","last_change":"2024-04-24T01:27:34.913612+0000","last_active":"2024-04-24T01:27:34.913584+0000","last_peered":"2024-04-24T01:27:34.913584+0000","last_clean":"2024-04-24T01:27:34.913584+0000","last_became_active":"2024-04-24T01:24:02.753074+0000","last_became_peered":"2024-04-24T01:24:02.753074+0000","last_unstale":"2024-04-24T01:27:34.913584+0000","last_undegraded":"2024-04-24T01:27:34.913584+0000","last_fullsized":"2024-04-24T01:27:34.913584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.913487+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.913487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:18.229615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"34'44","reported_seq":106,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:30.156369+0000","last_change":"2024-04-24T01:27:30.156369+0000","last_active":"2024-04-24T01:27:30.156369+0000","last_peered":"2024-04-24T01:27:30.156369+0000","last_clean":"2024-04-24T01:27:30.156369+0000","last_became_active":"2024-04-24T01:24:04.758869+0000","last_became_peered":"2024-04-24T01:24:04.758869+0000","last_unstale":"2024-04-24T01:27:30.156369+0000","last_undegraded":"2024-04-24T01:27:30.156369+0000","last_fullsized":"2024-04-24T01:27:30.156369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'44","last_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_deep_scrub":"34'44","last_deep_scrub_stamp":"2024-04-24T01:27:30.156230+0000","last_clean_scrub_stamp":"2024-04-24T01:27:30.156230+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:22:37.955468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":37,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.987190+0000","last_change":"2024-04-24T01:27:42.987190+0000","last_active":"2024-04-24T01:27:42.987190+0000","last_peered":"2024-04-24T01:27:42.987190+0000","last_clean":"2024-04-24T01:27:42.987190+0000","last_became_active":"2024-04-24T01:24:06.765608+0000","last_became_peered":"2024-04-24T01:24:06.765608+0000","last_unstale":"2024-04-24T01:27:42.987190+0000","last_undegraded":"2024-04-24T01:27:42.987190+0000","last_fullsized":"2024-04-24T01:27:42.987190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:42.987041+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.987041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:18.512702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:42.845852+0000","last_change":"2024-04-24T01:28:42.845852+0000","last_active":"2024-04-24T01:28:42.845852+0000","last_peered":"2024-04-24T01:28:42.845852+0000","last_clean":"2024-04-24T01:28:42.845852+0000","last_became_active":"2024-04-24T01:24:08.776378+0000","last_became_peered":"2024-04-24T01:24:08.776378+0000","last_unstale":"2024-04-24T01:28:42.845852+0000","last_undegraded":"2024-04-24T01:28:42.845852+0000","last_fullsized":"2024-04-24T01:28:42.845852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:42.845732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:42.845732+0000","last_clean_scrub_stamp":"2024-04-24T01:28:42.845732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:44.271718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"34'12","reported_seq":65,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.994109+0000","last_change":"2024-04-24T01:28:05.994109+0000","last_active":"2024-04-24T01:28:05.994109+0000","last_peered":"2024-04-24T01:28:05.994109+0000","last_clean":"2024-04-24T01:28:05.994109+0000","last_became_active":"2024-04-24T01:24:00.730015+0000","last_became_peered":"2024-04-24T01:24:00.730015+0000","last_unstale":"2024-04-24T01:28:05.994109+0000","last_undegraded":"2024-04-24T01:28:05.994109+0000","last_fullsized":"2024-04-24T01:28:05.994109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:28:05.993947+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.993947+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:59:25.685425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:04.244737+0000","last_change":"2024-04-24T01:28:04.244763+0000","last_active":"2024-04-24T01:28:04.244737+0000","last_peered":"2024-04-24T01:28:04.244737+0000","last_clean":"2024-04-24T01:28:04.244737+0000","last_became_active":"2024-04-24T01:23:58.742465+0000","last_became_peered":"2024-04-24T01:23:58.742465+0000","last_unstale":"2024-04-24T01:28:04.244737+0000","last_undegraded":"2024-04-24T01:28:04.244737+0000","last_fullsized":"2024-04-24T01:28:04.244737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:04.244647+0000","last_clean_scrub_stamp":"2024-04-24T01:28:04.244647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:25.006383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:34.755417+0000","last_change":"2024-04-24T01:27:34.755417+0000","last_active":"2024-04-24T01:27:34.755417+0000","last_peered":"2024-04-24T01:27:34.755417+0000","last_clean":"2024-04-24T01:27:34.755417+0000","last_became_active":"2024-04-24T01:24:02.756609+0000","last_became_peered":"2024-04-24T01:24:02.756609+0000","last_unstale":"2024-04-24T01:27:34.755417+0000","last_undegraded":"2024-04-24T01:27:34.755417+0000","last_fullsized":"2024-04-24T01:27:34.755417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:34.755296+0000","last_clean_scrub_stamp":"2024-04-24T01:27:34.755296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:32.167294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"34'38","reported_seq":97,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.873513+0000","last_change":"2024-04-24T01:27:47.873544+0000","last_active":"2024-04-24T01:27:47.873513+0000","last_peered":"2024-04-24T01:27:47.873513+0000","last_clean":"2024-04-24T01:27:47.873513+0000","last_became_active":"2024-04-24T01:24:04.760424+0000","last_became_peered":"2024-04-24T01:24:04.760424+0000","last_unstale":"2024-04-24T01:27:47.873513+0000","last_undegraded":"2024-04-24T01:27:47.873513+0000","last_fullsized":"2024-04-24T01:27:47.873513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'38","last_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_deep_scrub":"34'38","last_deep_scrub_stamp":"2024-04-24T01:27:47.873413+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.873413+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:12:47.188719+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":33,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.891422+0000","last_change":"2024-04-24T01:27:54.891469+0000","last_active":"2024-04-24T01:27:54.891422+0000","last_peered":"2024-04-24T01:27:54.891422+0000","last_clean":"2024-04-24T01:27:54.891422+0000","last_became_active":"2024-04-24T01:24:06.769956+0000","last_became_peered":"2024-04-24T01:24:06.769956+0000","last_unstale":"2024-04-24T01:27:54.891422+0000","last_undegraded":"2024-04-24T01:27:54.891422+0000","last_fullsized":"2024-04-24T01:27:54.891422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:54.891327+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.891327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:46.997900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"34'6","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:37.823684+0000","last_change":"2024-04-24T01:28:37.823684+0000","last_active":"2024-04-24T01:28:37.823684+0000","last_peered":"2024-04-24T01:28:37.823684+0000","last_clean":"2024-04-24T01:28:37.823684+0000","last_became_active":"2024-04-24T01:24:08.773426+0000","last_became_peered":"2024-04-24T01:24:08.773426+0000","last_unstale":"2024-04-24T01:28:37.823684+0000","last_undegraded":"2024-04-24T01:28:37.823684+0000","last_fullsized":"2024-04-24T01:28:37.823684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:37.823558+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:37.823558+0000","last_clean_scrub_stamp":"2024-04-24T01:28:37.823558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:49:15.900101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"34'6","reported_seq":73,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.065481+0000","last_change":"2024-04-24T01:27:44.065481+0000","last_active":"2024-04-24T01:27:44.065481+0000","last_peered":"2024-04-24T01:27:44.065481+0000","last_clean":"2024-04-24T01:27:44.065481+0000","last_became_active":"2024-04-24T01:24:00.730354+0000","last_became_peered":"2024-04-24T01:24:00.730354+0000","last_unstale":"2024-04-24T01:27:44.065481+0000","last_undegraded":"2024-04-24T01:27:44.065481+0000","last_fullsized":"2024-04-24T01:27:44.065481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:44.065351+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.065351+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:42:23.725424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:02.876743+0000","last_change":"2024-04-24T01:28:02.876743+0000","last_active":"2024-04-24T01:28:02.876743+0000","last_peered":"2024-04-24T01:28:02.876743+0000","last_clean":"2024-04-24T01:28:02.876743+0000","last_became_active":"2024-04-24T01:23:58.753023+0000","last_became_peered":"2024-04-24T01:23:58.753023+0000","last_unstale":"2024-04-24T01:28:02.876743+0000","last_undegraded":"2024-04-24T01:28:02.876743+0000","last_fullsized":"2024-04-24T01:28:02.876743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:02.876585+0000","last_clean_scrub_stamp":"2024-04-24T01:28:02.876585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:36:05.674595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"34'3","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:32.719516+0000","last_change":"2024-04-24T01:27:32.719516+0000","last_active":"2024-04-24T01:27:32.719516+0000","last_peered":"2024-04-24T01:27:32.719516+0000","last_clean":"2024-04-24T01:27:32.719516+0000","last_became_active":"2024-04-24T01:24:02.757772+0000","last_became_peered":"2024-04-24T01:24:02.757772+0000","last_unstale":"2024-04-24T01:27:32.719516+0000","last_undegraded":"2024-04-24T01:27:32.719516+0000","last_fullsized":"2024-04-24T01:27:32.719516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-04-24T01:27:32.719397+0000","last_clean_scrub_stamp":"2024-04-24T01:27:32.719397+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:26:10.815530+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'54","reported_seq":123,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:44.973007+0000","last_change":"2024-04-24T01:27:44.973079+0000","last_active":"2024-04-24T01:27:44.973007+0000","last_peered":"2024-04-24T01:27:44.973007+0000","last_clean":"2024-04-24T01:27:44.973007+0000","last_became_active":"2024-04-24T01:24:04.761329+0000","last_became_peered":"2024-04-24T01:24:04.761329+0000","last_unstale":"2024-04-24T01:27:44.973007+0000","last_undegraded":"2024-04-24T01:27:44.973007+0000","last_fullsized":"2024-04-24T01:27:44.973007+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'54","last_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_deep_scrub":"34'54","last_deep_scrub_stamp":"2024-04-24T01:27:44.972905+0000","last_clean_scrub_stamp":"2024-04-24T01:27:44.972905+0000","objects_scrubbed":7,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:58:52.372440+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":32,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:37.200708+0000","last_change":"2024-04-24T01:27:37.200734+0000","last_active":"2024-04-24T01:27:37.200708+0000","last_peered":"2024-04-24T01:27:37.200708+0000","last_clean":"2024-04-24T01:27:37.200708+0000","last_became_active":"2024-04-24T01:24:06.769868+0000","last_became_peered":"2024-04-24T01:24:06.769868+0000","last_unstale":"2024-04-24T01:27:37.200708+0000","last_undegraded":"2024-04-24T01:27:37.200708+0000","last_fullsized":"2024-04-24T01:27:37.200708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:37.200577+0000","last_clean_scrub_stamp":"2024-04-24T01:27:37.200577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:58:30.452220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"34'4","reported_seq":32,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:40.772052+0000","last_change":"2024-04-24T01:28:40.772052+0000","last_active":"2024-04-24T01:28:40.772052+0000","last_peered":"2024-04-24T01:28:40.772052+0000","last_clean":"2024-04-24T01:28:40.772052+0000","last_became_active":"2024-04-24T01:24:08.774419+0000","last_became_peered":"2024-04-24T01:24:08.774419+0000","last_unstale":"2024-04-24T01:28:40.772052+0000","last_undegraded":"2024-04-24T01:28:40.772052+0000","last_fullsized":"2024-04-24T01:28:40.772052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:40.771931+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:40.771931+0000","last_clean_scrub_stamp":"2024-04-24T01:28:40.771931+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:24:47.076601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"34'6","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:15.821958+0000","last_change":"2024-04-24T01:28:15.821958+0000","last_active":"2024-04-24T01:28:15.821958+0000","last_peered":"2024-04-24T01:28:15.821958+0000","last_clean":"2024-04-24T01:28:15.821958+0000","last_became_active":"2024-04-24T01:24:00.742461+0000","last_became_peered":"2024-04-24T01:24:00.742461+0000","last_unstale":"2024-04-24T01:28:15.821958+0000","last_undegraded":"2024-04-24T01:28:15.821958+0000","last_fullsized":"2024-04-24T01:28:15.821958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:15.821799+0000","last_clean_scrub_stamp":"2024-04-24T01:28:15.821799+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:38:18.284502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:47.098736+0000","last_change":"2024-04-24T01:27:47.098736+0000","last_active":"2024-04-24T01:27:47.098736+0000","last_peered":"2024-04-24T01:27:47.098736+0000","last_clean":"2024-04-24T01:27:47.098736+0000","last_became_active":"2024-04-24T01:23:58.746521+0000","last_became_peered":"2024-04-24T01:23:58.746521+0000","last_unstale":"2024-04-24T01:27:47.098736+0000","last_undegraded":"2024-04-24T01:27:47.098736+0000","last_fullsized":"2024-04-24T01:27:47.098736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:47.098613+0000","last_clean_scrub_stamp":"2024-04-24T01:27:47.098613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:18:08.549533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.326589+0000","last_change":"2024-04-24T01:27:53.326589+0000","last_active":"2024-04-24T01:27:53.326589+0000","last_peered":"2024-04-24T01:27:53.326589+0000","last_clean":"2024-04-24T01:27:53.326589+0000","last_became_active":"2024-04-24T01:24:00.731763+0000","last_became_peered":"2024-04-24T01:24:00.731763+0000","last_unstale":"2024-04-24T01:27:53.326589+0000","last_undegraded":"2024-04-24T01:27:53.326589+0000","last_fullsized":"2024-04-24T01:27:53.326589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:53.326480+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.326480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:27:56.533113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":51,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:09.154672+0000","last_change":"2024-04-24T01:28:09.154672+0000","last_active":"2024-04-24T01:28:09.154672+0000","last_peered":"2024-04-24T01:28:09.154672+0000","last_clean":"2024-04-24T01:28:09.154672+0000","last_became_active":"2024-04-24T01:23:58.734575+0000","last_became_peered":"2024-04-24T01:23:58.734575+0000","last_unstale":"2024-04-24T01:28:09.154672+0000","last_undegraded":"2024-04-24T01:28:09.154672+0000","last_fullsized":"2024-04-24T01:28:09.154672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:09.154557+0000","last_clean_scrub_stamp":"2024-04-24T01:28:09.154557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:38.451216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:07.943548+0000","last_change":"2024-04-24T01:28:07.943548+0000","last_active":"2024-04-24T01:28:07.943548+0000","last_peered":"2024-04-24T01:28:07.943548+0000","last_clean":"2024-04-24T01:28:07.943548+0000","last_became_active":"2024-04-24T01:24:00.729432+0000","last_became_peered":"2024-04-24T01:24:00.729432+0000","last_unstale":"2024-04-24T01:28:07.943548+0000","last_undegraded":"2024-04-24T01:28:07.943548+0000","last_fullsized":"2024-04-24T01:28:07.943548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:07.943435+0000","last_clean_scrub_stamp":"2024-04-24T01:28:07.943435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:27.515070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.003080+0000","last_change":"2024-04-24T01:28:16.003105+0000","last_active":"2024-04-24T01:28:16.003080+0000","last_peered":"2024-04-24T01:28:16.003080+0000","last_clean":"2024-04-24T01:28:16.003080+0000","last_became_active":"2024-04-24T01:23:58.756405+0000","last_became_peered":"2024-04-24T01:23:58.756405+0000","last_unstale":"2024-04-24T01:28:16.003080+0000","last_undegraded":"2024-04-24T01:28:16.003080+0000","last_fullsized":"2024-04-24T01:28:16.003080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.002980+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.002980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:31.898663+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:57.270216+0000","last_change":"2024-04-24T01:27:57.270216+0000","last_active":"2024-04-24T01:27:57.270216+0000","last_peered":"2024-04-24T01:27:57.270216+0000","last_clean":"2024-04-24T01:27:57.270216+0000","last_became_active":"2024-04-24T01:24:00.732047+0000","last_became_peered":"2024-04-24T01:24:00.732047+0000","last_unstale":"2024-04-24T01:27:57.270216+0000","last_undegraded":"2024-04-24T01:27:57.270216+0000","last_fullsized":"2024-04-24T01:27:57.270216+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:57.270099+0000","last_clean_scrub_stamp":"2024-04-24T01:27:57.270099+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:29:32.213542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:56.302374+0000","last_change":"2024-04-24T01:27:56.302374+0000","last_active":"2024-04-24T01:27:56.302374+0000","last_peered":"2024-04-24T01:27:56.302374+0000","last_clean":"2024-04-24T01:27:56.302374+0000","last_became_active":"2024-04-24T01:23:58.746580+0000","last_became_peered":"2024-04-24T01:23:58.746580+0000","last_unstale":"2024-04-24T01:27:56.302374+0000","last_undegraded":"2024-04-24T01:27:56.302374+0000","last_fullsized":"2024-04-24T01:27:56.302374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:27:56.302255+0000","last_clean_scrub_stamp":"2024-04-24T01:27:56.302255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:55.783843+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"34'4","reported_seq":53,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.195571+0000","last_change":"2024-04-24T01:28:01.195571+0000","last_active":"2024-04-24T01:28:01.195571+0000","last_peered":"2024-04-24T01:28:01.195571+0000","last_clean":"2024-04-24T01:28:01.195571+0000","last_became_active":"2024-04-24T01:24:00.735253+0000","last_became_peered":"2024-04-24T01:24:00.735253+0000","last_unstale":"2024-04-24T01:28:01.195571+0000","last_undegraded":"2024-04-24T01:28:01.195571+0000","last_fullsized":"2024-04-24T01:28:01.195571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.195431+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.195431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:09.529251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:11.140087+0000","last_change":"2024-04-24T01:28:11.140087+0000","last_active":"2024-04-24T01:28:11.140087+0000","last_peered":"2024-04-24T01:28:11.140087+0000","last_clean":"2024-04-24T01:28:11.140087+0000","last_became_active":"2024-04-24T01:23:58.741916+0000","last_became_peered":"2024-04-24T01:23:58.741916+0000","last_unstale":"2024-04-24T01:28:11.140087+0000","last_undegraded":"2024-04-24T01:28:11.140087+0000","last_fullsized":"2024-04-24T01:28:11.140087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:11.139969+0000","last_clean_scrub_stamp":"2024-04-24T01:28:11.139969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:56:09.603168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"34'10","reported_seq":79,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.819728+0000","last_change":"2024-04-24T01:27:59.819728+0000","last_active":"2024-04-24T01:27:59.819728+0000","last_peered":"2024-04-24T01:27:59.819728+0000","last_clean":"2024-04-24T01:27:59.819728+0000","last_became_active":"2024-04-24T01:24:00.742097+0000","last_became_peered":"2024-04-24T01:24:00.742097+0000","last_unstale":"2024-04-24T01:27:59.819728+0000","last_undegraded":"2024-04-24T01:27:59.819728+0000","last_fullsized":"2024-04-24T01:27:59.819728+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:59.819607+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.819607+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:11.722240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.856063+0000","last_change":"2024-04-24T01:28:06.856063+0000","last_active":"2024-04-24T01:28:06.856063+0000","last_peered":"2024-04-24T01:28:06.856063+0000","last_clean":"2024-04-24T01:28:06.856063+0000","last_became_active":"2024-04-24T01:23:58.752407+0000","last_became_peered":"2024-04-24T01:23:58.752407+0000","last_unstale":"2024-04-24T01:28:06.856063+0000","last_undegraded":"2024-04-24T01:28:06.856063+0000","last_fullsized":"2024-04-24T01:28:06.856063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:06.855938+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.855938+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:17:44.329967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"34'2","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:59.195318+0000","last_change":"2024-04-24T01:27:59.195318+0000","last_active":"2024-04-24T01:27:59.195318+0000","last_peered":"2024-04-24T01:27:59.195318+0000","last_clean":"2024-04-24T01:27:59.195318+0000","last_became_active":"2024-04-24T01:24:00.733530+0000","last_became_peered":"2024-04-24T01:24:00.733530+0000","last_unstale":"2024-04-24T01:27:59.195318+0000","last_undegraded":"2024-04-24T01:27:59.195318+0000","last_fullsized":"2024-04-24T01:27:59.195318+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:27:59.195149+0000","last_clean_scrub_stamp":"2024-04-24T01:27:59.195149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:03:51.074457+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"34'4","reported_seq":55,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:01.122928+0000","last_change":"2024-04-24T01:28:01.122928+0000","last_active":"2024-04-24T01:28:01.122928+0000","last_peered":"2024-04-24T01:28:01.122928+0000","last_clean":"2024-04-24T01:28:01.122928+0000","last_became_active":"2024-04-24T01:23:58.734424+0000","last_became_peered":"2024-04-24T01:23:58.734424+0000","last_unstale":"2024-04-24T01:28:01.122928+0000","last_undegraded":"2024-04-24T01:28:01.122928+0000","last_fullsized":"2024-04-24T01:28:01.122928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:01.122753+0000","last_clean_scrub_stamp":"2024-04-24T01:28:01.122753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:31:56.927600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:48.790317+0000","last_change":"2024-04-24T01:27:48.790317+0000","last_active":"2024-04-24T01:27:48.790317+0000","last_peered":"2024-04-24T01:27:48.790317+0000","last_clean":"2024-04-24T01:27:48.790317+0000","last_became_active":"2024-04-24T01:24:00.739665+0000","last_became_peered":"2024-04-24T01:24:00.739665+0000","last_unstale":"2024-04-24T01:27:48.790317+0000","last_undegraded":"2024-04-24T01:27:48.790317+0000","last_fullsized":"2024-04-24T01:27:48.790317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:48.790131+0000","last_clean_scrub_stamp":"2024-04-24T01:27:48.790131+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:50:15.310685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"34'4","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:10.150980+0000","last_change":"2024-04-24T01:28:10.150980+0000","last_active":"2024-04-24T01:28:10.150980+0000","last_peered":"2024-04-24T01:28:10.150980+0000","last_clean":"2024-04-24T01:28:10.150980+0000","last_became_active":"2024-04-24T01:23:58.741918+0000","last_became_peered":"2024-04-24T01:23:58.741918+0000","last_unstale":"2024-04-24T01:28:10.150980+0000","last_undegraded":"2024-04-24T01:28:10.150980+0000","last_fullsized":"2024-04-24T01:28:10.150980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:10.150848+0000","last_clean_scrub_stamp":"2024-04-24T01:28:10.150848+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:42:35.075645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"34'8","reported_seq":63,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:42.824684+0000","last_change":"2024-04-24T01:27:42.824684+0000","last_active":"2024-04-24T01:27:42.824684+0000","last_peered":"2024-04-24T01:27:42.824684+0000","last_clean":"2024-04-24T01:27:42.824684+0000","last_became_active":"2024-04-24T01:24:00.745126+0000","last_became_peered":"2024-04-24T01:24:00.745126+0000","last_unstale":"2024-04-24T01:27:42.824684+0000","last_undegraded":"2024-04-24T01:27:42.824684+0000","last_fullsized":"2024-04-24T01:27:42.824684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:42.824525+0000","last_clean_scrub_stamp":"2024-04-24T01:27:42.824525+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:56:03.738253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:24.013981+0000","last_change":"2024-04-24T01:28:24.014012+0000","last_active":"2024-04-24T01:28:24.013981+0000","last_peered":"2024-04-24T01:28:24.013981+0000","last_clean":"2024-04-24T01:28:24.013981+0000","last_became_active":"2024-04-24T01:23:58.756926+0000","last_became_peered":"2024-04-24T01:23:58.756926+0000","last_unstale":"2024-04-24T01:28:24.013981+0000","last_undegraded":"2024-04-24T01:28:24.013981+0000","last_fullsized":"2024-04-24T01:28:24.013981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:24.013883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:24.013883+0000","last_clean_scrub_stamp":"2024-04-24T01:28:24.013883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:51:35.371838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"34'10","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.013289+0000","last_change":"2024-04-24T01:27:40.013289+0000","last_active":"2024-04-24T01:27:40.013289+0000","last_peered":"2024-04-24T01:27:40.013289+0000","last_clean":"2024-04-24T01:27:40.013289+0000","last_became_active":"2024-04-24T01:24:00.738206+0000","last_became_peered":"2024-04-24T01:24:00.738206+0000","last_unstale":"2024-04-24T01:27:40.013289+0000","last_undegraded":"2024-04-24T01:27:40.013289+0000","last_fullsized":"2024-04-24T01:27:40.013289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:40.013169+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.013169+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:07:21.080960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"34'4","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:12.109769+0000","last_change":"2024-04-24T01:28:12.109769+0000","last_active":"2024-04-24T01:28:12.109769+0000","last_peered":"2024-04-24T01:28:12.109769+0000","last_clean":"2024-04-24T01:28:12.109769+0000","last_became_active":"2024-04-24T01:23:58.741812+0000","last_became_peered":"2024-04-24T01:23:58.741812+0000","last_unstale":"2024-04-24T01:28:12.109769+0000","last_undegraded":"2024-04-24T01:28:12.109769+0000","last_fullsized":"2024-04-24T01:28:12.109769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-04-24T01:28:12.109616+0000","last_clean_scrub_stamp":"2024-04-24T01:28:12.109616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:11:48.990071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"34'2","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:03.238648+0000","last_change":"2024-04-24T01:28:03.238648+0000","last_active":"2024-04-24T01:28:03.238648+0000","last_peered":"2024-04-24T01:28:03.238648+0000","last_clean":"2024-04-24T01:28:03.238648+0000","last_became_active":"2024-04-24T01:24:00.737692+0000","last_became_peered":"2024-04-24T01:24:00.737692+0000","last_unstale":"2024-04-24T01:28:03.238648+0000","last_undegraded":"2024-04-24T01:28:03.238648+0000","last_fullsized":"2024-04-24T01:28:03.238648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:03.238536+0000","last_clean_scrub_stamp":"2024-04-24T01:28:03.238536+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:37:17.676354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"34'2","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.851711+0000","last_change":"2024-04-24T01:28:00.851711+0000","last_active":"2024-04-24T01:28:00.851711+0000","last_peered":"2024-04-24T01:28:00.851711+0000","last_clean":"2024-04-24T01:28:00.851711+0000","last_became_active":"2024-04-24T01:23:58.754429+0000","last_became_peered":"2024-04-24T01:23:58.754429+0000","last_unstale":"2024-04-24T01:28:00.851711+0000","last_undegraded":"2024-04-24T01:28:00.851711+0000","last_fullsized":"2024-04-24T01:28:00.851711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:00.851583+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.851583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:32.414278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"34'6","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:54.721998+0000","last_change":"2024-04-24T01:27:54.721998+0000","last_active":"2024-04-24T01:27:54.721998+0000","last_peered":"2024-04-24T01:27:54.721998+0000","last_clean":"2024-04-24T01:27:54.721998+0000","last_became_active":"2024-04-24T01:24:00.738838+0000","last_became_peered":"2024-04-24T01:24:00.738838+0000","last_unstale":"2024-04-24T01:27:54.721998+0000","last_undegraded":"2024-04-24T01:27:54.721998+0000","last_fullsized":"2024-04-24T01:27:54.721998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:54.721886+0000","last_clean_scrub_stamp":"2024-04-24T01:27:54.721886+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:31:21.542465+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.829238+0000","last_change":"2024-04-24T01:28:08.829238+0000","last_active":"2024-04-24T01:28:08.829238+0000","last_peered":"2024-04-24T01:28:08.829238+0000","last_clean":"2024-04-24T01:28:08.829238+0000","last_became_active":"2024-04-24T01:23:58.751418+0000","last_became_peered":"2024-04-24T01:23:58.751418+0000","last_unstale":"2024-04-24T01:28:08.829238+0000","last_undegraded":"2024-04-24T01:28:08.829238+0000","last_fullsized":"2024-04-24T01:28:08.829238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.829110+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.829110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:56:29.507416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"34'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:05.859558+0000","last_change":"2024-04-24T01:28:05.859558+0000","last_active":"2024-04-24T01:28:05.859558+0000","last_peered":"2024-04-24T01:28:05.859558+0000","last_clean":"2024-04-24T01:28:05.859558+0000","last_became_active":"2024-04-24T01:24:00.742460+0000","last_became_peered":"2024-04-24T01:24:00.742460+0000","last_unstale":"2024-04-24T01:28:05.859558+0000","last_undegraded":"2024-04-24T01:28:05.859558+0000","last_fullsized":"2024-04-24T01:28:05.859558+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-04-24T01:28:05.859401+0000","last_clean_scrub_stamp":"2024-04-24T01:28:05.859401+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:24:16.646001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:16.995244+0000","last_change":"2024-04-24T01:28:16.995244+0000","last_active":"2024-04-24T01:28:16.995244+0000","last_peered":"2024-04-24T01:28:16.995244+0000","last_clean":"2024-04-24T01:28:16.995244+0000","last_became_active":"2024-04-24T01:23:58.760634+0000","last_became_peered":"2024-04-24T01:23:58.760634+0000","last_unstale":"2024-04-24T01:28:16.995244+0000","last_undegraded":"2024-04-24T01:28:16.995244+0000","last_fullsized":"2024-04-24T01:28:16.995244+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:16.995125+0000","last_clean_scrub_stamp":"2024-04-24T01:28:16.995125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:06.512760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"34'8","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:40.742337+0000","last_change":"2024-04-24T01:27:40.742337+0000","last_active":"2024-04-24T01:27:40.742337+0000","last_peered":"2024-04-24T01:27:40.742337+0000","last_clean":"2024-04-24T01:27:40.742337+0000","last_became_active":"2024-04-24T01:24:00.745024+0000","last_became_peered":"2024-04-24T01:24:00.745024+0000","last_unstale":"2024-04-24T01:27:40.742337+0000","last_undegraded":"2024-04-24T01:27:40.742337+0000","last_fullsized":"2024-04-24T01:27:40.742337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'8","last_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_deep_scrub":"34'8","last_deep_scrub_stamp":"2024-04-24T01:27:40.742220+0000","last_clean_scrub_stamp":"2024-04-24T01:27:40.742220+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:06:29.319272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:20.989162+0000","last_change":"2024-04-24T01:28:20.989162+0000","last_active":"2024-04-24T01:28:20.989162+0000","last_peered":"2024-04-24T01:28:20.989162+0000","last_clean":"2024-04-24T01:28:20.989162+0000","last_became_active":"2024-04-24T01:23:58.761688+0000","last_became_peered":"2024-04-24T01:23:58.761688+0000","last_unstale":"2024-04-24T01:28:20.989162+0000","last_undegraded":"2024-04-24T01:28:20.989162+0000","last_fullsized":"2024-04-24T01:28:20.989162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:20.989006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:20.989006+0000","last_clean_scrub_stamp":"2024-04-24T01:28:20.989006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:05:51.498610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"34'6","reported_seq":34,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:14.099525+0000","last_change":"2024-04-24T01:28:14.099552+0000","last_active":"2024-04-24T01:28:14.099525+0000","last_peered":"2024-04-24T01:28:14.099525+0000","last_clean":"2024-04-24T01:28:14.099525+0000","last_became_active":"2024-04-24T01:24:39.798391+0000","last_became_peered":"2024-04-24T01:24:39.798391+0000","last_unstale":"2024-04-24T01:28:14.099525+0000","last_undegraded":"2024-04-24T01:28:14.099525+0000","last_fullsized":"2024-04-24T01:28:14.099525+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:28:14.099430+0000","last_clean_scrub_stamp":"2024-04-24T01:28:14.099430+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T12:38:48.960432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:06.112328+0000","last_change":"2024-04-24T01:28:06.112328+0000","last_active":"2024-04-24T01:28:06.112328+0000","last_peered":"2024-04-24T01:28:06.112328+0000","last_clean":"2024-04-24T01:28:06.112328+0000","last_became_active":"2024-04-24T01:23:58.739422+0000","last_became_peered":"2024-04-24T01:23:58.739422+0000","last_unstale":"2024-04-24T01:28:06.112328+0000","last_undegraded":"2024-04-24T01:28:06.112328+0000","last_fullsized":"2024-04-24T01:28:06.112328+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:06.112211+0000","last_clean_scrub_stamp":"2024-04-24T01:28:06.112211+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:47:09.638702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"34'12","reported_seq":67,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:53.768193+0000","last_change":"2024-04-24T01:27:53.768193+0000","last_active":"2024-04-24T01:27:53.768193+0000","last_peered":"2024-04-24T01:27:53.768193+0000","last_clean":"2024-04-24T01:27:53.768193+0000","last_became_active":"2024-04-24T01:24:00.739291+0000","last_became_peered":"2024-04-24T01:24:00.739291+0000","last_unstale":"2024-04-24T01:27:53.768193+0000","last_undegraded":"2024-04-24T01:27:53.768193+0000","last_fullsized":"2024-04-24T01:27:53.768193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'12","last_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_deep_scrub":"34'12","last_deep_scrub_stamp":"2024-04-24T01:27:53.768072+0000","last_clean_scrub_stamp":"2024-04-24T01:27:53.768072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:21:20.455501+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:08.993658+0000","last_change":"2024-04-24T01:28:08.993658+0000","last_active":"2024-04-24T01:28:08.993658+0000","last_peered":"2024-04-24T01:28:08.993658+0000","last_clean":"2024-04-24T01:28:08.993658+0000","last_became_active":"2024-04-24T01:23:58.764801+0000","last_became_peered":"2024-04-24T01:23:58.764801+0000","last_unstale":"2024-04-24T01:28:08.993658+0000","last_undegraded":"2024-04-24T01:28:08.993658+0000","last_fullsized":"2024-04-24T01:28:08.993658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:08.993523+0000","last_clean_scrub_stamp":"2024-04-24T01:28:08.993523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:24:50.996413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:35.896301+0000","last_change":"2024-04-24T01:28:35.896301+0000","last_active":"2024-04-24T01:28:35.896301+0000","last_peered":"2024-04-24T01:28:35.896301+0000","last_clean":"2024-04-24T01:28:35.896301+0000","last_became_active":"2024-04-24T01:23:58.756175+0000","last_became_peered":"2024-04-24T01:23:58.756175+0000","last_unstale":"2024-04-24T01:28:35.896301+0000","last_undegraded":"2024-04-24T01:28:35.896301+0000","last_fullsized":"2024-04-24T01:28:35.896301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:35.896182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:35.896182+0000","last_clean_scrub_stamp":"2024-04-24T01:28:35.896182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:31:58.630325+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"34'6","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:46.290325+0000","last_change":"2024-04-24T01:27:46.290325+0000","last_active":"2024-04-24T01:27:46.290325+0000","last_peered":"2024-04-24T01:27:46.290325+0000","last_clean":"2024-04-24T01:27:46.290325+0000","last_became_active":"2024-04-24T01:24:00.746627+0000","last_became_peered":"2024-04-24T01:24:00.746627+0000","last_unstale":"2024-04-24T01:27:46.290325+0000","last_undegraded":"2024-04-24T01:27:46.290325+0000","last_fullsized":"2024-04-24T01:27:46.290325+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-04-24T01:27:46.290152+0000","last_clean_scrub_stamp":"2024-04-24T01:27:46.290152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:15:57.436026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:28:00.151375+0000","last_change":"2024-04-24T01:28:00.151375+0000","last_active":"2024-04-24T01:28:00.151375+0000","last_peered":"2024-04-24T01:28:00.151375+0000","last_clean":"2024-04-24T01:28:00.151375+0000","last_became_active":"2024-04-24T01:23:58.743246+0000","last_became_peered":"2024-04-24T01:23:58.743246+0000","last_unstale":"2024-04-24T01:28:00.151375+0000","last_undegraded":"2024-04-24T01:28:00.151375+0000","last_fullsized":"2024-04-24T01:28:00.151375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:28:00.151264+0000","last_clean_scrub_stamp":"2024-04-24T01:28:00.151264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:06:54.349626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"34'10","reported_seq":78,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-04-24T01:27:50.704477+0000","last_change":"2024-04-24T01:27:50.704477+0000","last_active":"2024-04-24T01:27:50.704477+0000","last_peered":"2024-04-24T01:27:50.704477+0000","last_clean":"2024-04-24T01:27:50.704477+0000","last_became_active":"2024-04-24T01:24:00.742877+0000","last_became_peered":"2024-04-24T01:24:00.742877+0000","last_unstale":"2024-04-24T01:27:50.704477+0000","last_undegraded":"2024-04-24T01:27:50.704477+0000","last_fullsized":"2024-04-24T01:27:50.704477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'10","last_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_deep_scrub":"34'10","last_deep_scrub_stamp":"2024-04-24T01:27:50.704360+0000","last_clean_scrub_stamp":"2024-04-24T01:27:50.704360+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:31.185382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":215,"num_object_clones":0,"num_object_copies":430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":215,"num_whiteouts":0,"num_read":1889,"num_read_kb":1654,"num_write":791,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1755,"ondisk_log_size":1755,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1598,"num_read_kb":1488,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39960,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331880,"statfs":{"total":96636764160,"available":96595845120,"internally_reserved":0,"allocated":475136,"data_stored":149748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640324,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40484,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331356,"statfs":{"total":96636764160,"available":96595308544,"internally_reserved":0,"allocated":1011712,"data_stored":738694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640322,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40504,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331336,"statfs":{"total":96636764160,"available":96595288064,"internally_reserved":0,"allocated":1032192,"data_stored":739182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44100,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327740,"statfs":{"total":96636764160,"available":96591605760,"internally_reserved":0,"allocated":454656,"data_stored":150586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:29:03.240 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a3a91c640 1 Processor -- start 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a3a91c640 1 -- start start 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a3a91c640 1 --2- >> v2:172.21.15.142:3300/0 conn(0x7f5a3412db90 0x7f5a3412ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a3a91c640 1 -- --> v1:172.21.15.142:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a34070350 con 0x7f5a3406d690 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a3a91c640 1 -- --> v2:172.21.15.142:3300/0 -- mon_getmap magic: 0 -- 0x7f5a34070020 con 0x7f5a3412db90 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a33fff640 1 --1- >> v1:172.21.15.142:6789/0 conn(0x7f5a3406d690 0x7f5a3406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.142:6789/0 says I am v1:172.21.15.142:43986/0 (socket says 172.21.15.142:43986) 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a33fff640 1 -- 172.21.15.142:0/4187979072 learned_addr learned my addr 172.21.15.142:0/4187979072 (peer_addr_for_me v1:172.21.15.142:0/0) 2024-04-24T01:29:03.365 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a337fe640 1 --2- 172.21.15.142:0/4187979072 >> v2:172.21.15.142:3300/0 conn(0x7f5a3412db90 0x7f5a3412ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a32ffd640 1 -- 172.21.15.142:0/4187979072 <== mon.0 v1:172.21.15.142:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2696410889 0 0) 0x7f5a34070350 con 0x7f5a3406d690 2024-04-24T01:29:03.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.364+0000 7f5a32ffd640 1 -- 172.21.15.142:0/4187979072 --> v1:172.21.15.142:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a1c003520 con 0x7f5a3406d690 2024-04-24T01:29:03.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a337fe640 1 -- 172.21.15.142:0/4187979072 >> v1:172.21.15.142:6789/0 conn(0x7f5a3406d690 legacy=0x7f5a3406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.366 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a337fe640 1 -- 172.21.15.142:0/4187979072 --> v2:172.21.15.142:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3406f0c0 con 0x7f5a3412db90 2024-04-24T01:29:03.368 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a337fe640 1 --2- 172.21.15.142:0/4187979072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3412db90 0x7f5a3412ff80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009750 tx=0x7f5a2802c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c97216299c7bbc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a32ffd640 1 -- 172.21.15.142:0/4187979072 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a28035070 con 0x7f5a3412db90 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a32ffd640 1 -- 172.21.15.142:0/4187979072 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a28031740 con 0x7f5a3412db90 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.365+0000 7f5a32ffd640 1 -- 172.21.15.142:0/4187979072 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a28031a40 con 0x7f5a3412db90 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4187979072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3412db90 msgr2=0x7f5a3412ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4187979072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3412db90 0x7f5a3412ff80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009750 tx=0x7f5a2802c950 comp rx=0 tx=0).stop 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4187979072 shutdown_connections 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4187979072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3412db90 0x7f5a3412ff80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4187979072 >> 172.21.15.142:0/4187979072 conn(0x7f5a34099680 msgr2=0x7f5a34099a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4187979072 shutdown_connections 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.366+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4187979072 wait complete. 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a3a91c640 1 Processor -- start 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a3a91c640 1 -- start start 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a3a91c640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a3a91c640 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34071600 con 0x7f5a3406d690 2024-04-24T01:29:03.369 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a33fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a33fff640 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48774/0 (socket says 172.21.15.142:48774) 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.367+0000 7f5a33fff640 1 -- 172.21.15.142:0/4294481283 learned_addr learned my addr 172.21.15.142:0/4294481283 (peer_addr_for_me v2:172.21.15.142:0/0) 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a33fff640 1 -- 172.21.15.142:0/4294481283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3408f9b0 con 0x7f5a3406d690 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a33fff640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5a24001eb0 tx=0x7f5a2400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24015070 con 0x7f5a3406d690 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a24005c10 con 0x7f5a3406d690 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a34090720 con 0x7f5a3406d690 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24007070 con 0x7f5a3406d690 2024-04-24T01:29:03.370 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.368+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3408e100 con 0x7f5a3406d690 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.369+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5a24018070 con 0x7f5a3406d690 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.369+0000 7f5a30ff9640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.369+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6336+0+0 (secure 0 0 0) 0x7f5a2404dba0 con 0x7f5a3406d690 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.369+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a3408f510 con 0x7f5a3406d690 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.369+0000 7f5a337fe640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:29:03.371 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.370+0000 7f5a337fe640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 0x7f5a2003a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5a28037000 tx=0x7f5a28008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:29:03.374 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.373+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+184950 (secure 0 0 0) 0x7f5a24010c60 con 0x7f5a3406d690 2024-04-24T01:29:03.544 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.544+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f5a34062da0 con 0x7f5a3406d690 2024-04-24T01:29:03.549 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.549+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f5a24007210 con 0x7f5a3406d690 2024-04-24T01:29:03.550 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.549+0000 7f5a30ff9640 1 -- 172.21.15.142:0/4294481283 <== mon.0 v2:172.21.15.142:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5a2400c660 con 0x7f5a3406d690 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 msgr2=0x7f5a2003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 0x7f5a2003a520 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5a28037000 tx=0x7f5a28008030 comp rx=0 tx=0).stop 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 msgr2=0x7f5a3408dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5a24001eb0 tx=0x7f5a2400eaf0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 shutdown_connections 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.169:6824/3871964860,v1:172.21.15.169:6825/3871964860] conn(0x7f5a20038060 0x7f5a2003a520 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 --2- 172.21.15.142:0/4294481283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5a3406d690 0x7f5a3408dbc0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 >> 172.21.15.142:0/4294481283 conn(0x7f5a34099680 msgr2=0x7f5a340705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 shutdown_connections 2024-04-24T01:29:03.552 INFO:teuthology.orchestra.run.smithi142.stderr:2024-04-24T01:29:03.551+0000 7f5a3a91c640 1 -- 172.21.15.142:0/4294481283 wait complete. 2024-04-24T01:29:03.562 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T01:29:03.562 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T01:29:03.563 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T01:29:03.563 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.598 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T01:29:03.598 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T01:29:03.598 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.632 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T01:29:03.632 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T01:29:03.632 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.704 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T01:29:03.704 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T01:29:03.704 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.776 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T01:29:03.776 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T01:29:03.777 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T01:29:03.777 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.846 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T01:29:03.847 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T01:29:03.847 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T01:29:03.847 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T01:29:03.857 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T01:29:03.858 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T01:29:03.858 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-04-24T01:29:03.923 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T01:29:03.923 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T01:29:04.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:29:04.074 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T01:29:04.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:29:04.264 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T01:29:04.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:29:04.359 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T01:29:04.408 INFO:tasks.ceph:Archiving mon data... 2024-04-24T01:29:04.410 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/data/mon.a.tgz 2024-04-24T01:29:04.410 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2024-04-24T01:29:04.425 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.iYLsHqaSKU 2024-04-24T01:29:04.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.iYLsHqaSKU 2024-04-24T01:29:04.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.iYLsHqaSKU 2024-04-24T01:29:04.677 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.iYLsHqaSKU is 271KB 2024-04-24T01:29:04.770 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.iYLsHqaSKU 2024-04-24T01:29:04.784 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T01:29:04.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T01:29:04.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T01:29:04.902 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T01:29:04.919 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T01:29:04.919 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T01:29:04.920 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi142/crash 2024-04-24T01:29:04.921 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T01:29:04.965 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi169/crash 2024-04-24T01:29:04.966 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T01:29:05.011 INFO:tasks.ceph:Compressing logs... 2024-04-24T01:29:05.011 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T01:29:05.014 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30151.log 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30529.log 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30421.log 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30529.log: gzip -5 --verbose -- 86.1% /var/log/ceph/ceph-client.admin.30109.log 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30151.log.gz 2024-04-24T01:29:05.052 INFO:teuthology.orchestra.run.smithi142.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30529.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29927.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30109.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30421.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31549.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.29927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31213.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31549.log: gzip -5 86.2% --verbose -- /var/log/ceph/ceph-client.admin.31339.log -- replaced with /var/log/ceph/ceph-client.admin.29927.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31549.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31003.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31213.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31339.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31339.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28221.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31003.log.gz 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26344.log 2024-04-24T01:29:05.053 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28062.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28221.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.tmp-client.admin.26344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31129.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26344.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30781.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.28062.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31129.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 86.0% 85.7% -- replaced with /var/log/ceph/ceph.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31129.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29983.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30781.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30835.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.29983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T01:29:05.054 INFO:teuthology.orchestra.run.smithi142.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29983.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30589.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30835.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30067.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30589.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30589.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31507.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30067.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30588.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31507.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31507.log.gz/var/log/ceph/ceph-client.admin.30588.log: 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30697.log 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30588.log.gz 2024-04-24T01:29:05.055 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:gzip/var/log/ceph/ceph-client.admin.30697.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31381.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31465.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30697.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30252.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31381.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30025.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31465.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30253.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30252.log: /var/log/ceph/ceph-client.admin.30025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31423.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30252.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30025.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30250.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30253.log.gz 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30877.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31423.log: /var/log/ceph/ceph-client.admin.30250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28180.log 2024-04-24T01:29:05.056 INFO:teuthology.orchestra.run.smithi142.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31423.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30877.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30250.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29870.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30877.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30420.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.28180.log: /var/log/ceph/ceph-client.admin.29870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31297.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.28180.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.29870.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30919.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30420.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30419.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31297.log: /var/log/ceph/ceph-client.admin.30919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31045.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31297.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30919.log.gz/var/log/ceph/ceph-client.admin.30419.log: 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30587.log 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30419.log.gz 2024-04-24T01:29:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31171.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31045.log: /var/log/ceph/ceph-client.admin.30587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30418.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31045.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30587.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31171.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30418.log: /var/log/ceph/ceph-client.admin.31255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31589.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30418.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.30251.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30961.log 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ceph-client.admin.31589.log: /var/log/ceph/ceph-client.admin.30961.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31589.log.gz 2024-04-24T01:29:05.058 INFO:teuthology.orchestra.run.smithi142.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.30961.log.gz 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55761.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64836.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87191.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.55761.log: /var/log/ceph/ceph-client.0.64836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34404.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.87191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93241.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55761.log.gz 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34364.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34404.log.gz 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44871.log 2024-04-24T01:29:05.109 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.64836.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.93241.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87191.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35802.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.44871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95108.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.35802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71491.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.95108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37012.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.93241.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.71491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67861.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.44871.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.37012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74516.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5%/var/log/ceph/ceph-client.0.67861.log: -- replaced with /var/log/ceph/ceph-client.0.35802.log.gz 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39426.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.74516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64231.log 2024-04-24T01:29:05.110 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71491.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.39426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30014.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37012.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.64231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56366.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.0.95108.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.30014.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.74516.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.30014.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92031.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.56366.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39426.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62416.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.92031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46081.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.62416.log: gzip -5 91.3% -- replaced with /var/log/ceph/ceph-client.0.64231.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30054.log 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.67861.log.gz 2024-04-24T01:29:05.111 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.46081.log: gzip -5 --verbose 91.1% -- /var/log/ceph/ceph-client.admin.30094.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.56366.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.30054.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92031.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52131.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30054.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.62416.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.30094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34284.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.52131.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.30094.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59391.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.46081.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44266.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.34284.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65441.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.59391.log: /var/log/ceph/ceph-client.0.44266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43661.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52131.log.gz 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.65441.log: /var/log/ceph/ceph-client.0.94451.log 2024-04-24T01:29:05.112 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.43661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48501.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.59391.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.94451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78751.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.48501.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44266.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.78751.log: gzip -5 91.8% -- replaced with /var/log/ceph/ceph-client.0.65441.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose 91.3% -- replaced with /var/log/ceph/ceph-client.0.43661.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: -- /var/log/ceph/ceph-client.0.58181.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82381.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94451.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.58181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70281.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48501.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.82381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38222.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.78751.log.gz 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.70281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81171.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.38222.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-24T01:29:05.113 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.81171.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80566.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.58181.log.gz 90.5% -- replaced with /var/log/ceph/ceph-client.0.38222.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.70281.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72701.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip/var/log/ceph/ceph-client.0.80566.log: -5 --verbose -- /var/log/ceph/ceph-client.0.61206.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5%/var/log/ceph/ceph-client.0.72701.log: -- replaced with /var/log/ceph/ceph-client.0.82381.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1%gzip -- replaced with /var/log/ceph/ceph-client.0.81171.log.gz -5 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.0.87796.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79961.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.61206.log: /var/log/ceph/ceph-client.0.87796.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.79961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66046.log 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72701.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.80566.log.gz 2024-04-24T01:29:05.114 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61206.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.87796.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.66046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60601.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69071.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.60601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40636.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.69071.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.79961.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.66046.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70886.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.40636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59996.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60601.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.70886.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.69071.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50316.log 91.2% -- replaced with /var/log/ceph/ceph-client.0.40636.log.gz 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.59996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63626.log 2024-04-24T01:29:05.115 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.50316.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.63626.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.59996.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.70886.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50316.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40031.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84789.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63626.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.40031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35197.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.84789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57576.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.84789.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.35197.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40031.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35197.log.gz 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88401.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.57576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76936.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.88401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37617.log 2024-04-24T01:29:05.116 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.76936.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57576.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68466.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.88401.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76936.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.37617.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.37617.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46686.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.68466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58786.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.46686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75726.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.58786.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46686.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68466.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.54551.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.75726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78146.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.58786.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.54551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41241.log 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.78146.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75726.log.gz 2024-04-24T01:29:05.117 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 91.5% --verbose -- /var/log/ceph/ceph-client.0.81776.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.54551.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.41241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84190.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.81776.log: 91.3% 91.2% -- replaced with /var/log/ceph/ceph-client.0.78146.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.41241.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.81776.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82986.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.84190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85987.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.82986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75121.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.84190.log.gz/var/log/ceph/ceph-client.0.85987.log: 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72096.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.75121.log: 91.3% 90.5% -- replaced with /var/log/ceph/ceph-client.0.85987.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.82986.log.gz 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90216.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.72096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92636.log 2024-04-24T01:29:05.118 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.75121.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.90216.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72096.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77541.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.92636.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90216.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34324.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.77541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38821.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34324.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92636.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.34324.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73911.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77541.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49711.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.38821.log: /var/log/ceph/ceph-client.0.73911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73306.log 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.49711.log: 91.7% 91.7% -- replaced with /var/log/ceph/ceph-client.0.38821.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr: -- replaced with /var/log/ceph/ceph-client.0.73911.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.49711.log.gz 2024-04-24T01:29:05.119 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43056.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41846.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.73306.log: /var/log/ceph/ceph-client.0.43056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29974.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.41846.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43056.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73306.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.41846.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66651.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.29974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49106.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29974.log.gz/var/log/ceph/ceph-client.0.66651.log: 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55156.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63021.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.49106.log: /var/log/ceph/ceph-client.0.55156.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66651.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.49106.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 91.6% -- replaced with /var/log/ceph/ceph-client.0.55156.log.gz 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr: --verbose -- /var/log/ceph/ceph-client.0.36407.log 2024-04-24T01:29:05.120 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.63021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52736.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.36407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91426.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.52736.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63021.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69676.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36407.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.91426.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52736.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83591.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.69676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34244.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.91426.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.83591.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.83591.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.69676.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50921.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.34244.log: gzip -5 --verbose -- 85.9% -- replaced with /var/log/ceph/ceph-client.admin.34244.log.gz 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr: /var/log/ceph/ceph-client.0.79356.log 2024-04-24T01:29:05.121 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.50921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89611.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.79356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89006.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.89611.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50921.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.79356.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.89611.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47291.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86586.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.89006.log: /var/log/ceph/ceph-client.0.47291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42451.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.86586.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47291.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89006.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47896.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.86586.log.gz 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90821.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.42451.log: /var/log/ceph/ceph-client.0.47896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53341.log 2024-04-24T01:29:05.122 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.90821.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42451.log.gz 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.47896.log.gz 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93846.log 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90821.log.gz 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61811.log 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.53341.log: /var/log/ceph/ceph-client.0.93846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45476.log 2024-04-24T01:29:05.123 INFO:teuthology.orchestra.run.smithi169.stderr: 92.2%/var/log/ceph/ceph-client.0.61811.log: -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.61811.log.gz 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.93846.log.gz 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.53341.log.gz 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56971.log 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.45476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53946.log 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.56971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76331.log 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.53946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67256.log 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.76331.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45476.log.gz 2024-04-24T01:29:05.127 INFO:teuthology.orchestra.run.smithi169.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.56971.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.53946.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76331.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51526.log 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.67256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85388.log 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.0.51526.log: /var/log/ceph/ceph-client.0.85388.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85388.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.51526.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67256.log.gz 2024-04-24T01:29:05.128 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T01:29:05.214 INFO:teuthology.orchestra.run.smithi142.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T01:29:06.005 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T01:29:06.044 INFO:teuthology.orchestra.run.smithi142.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T01:29:06.046 INFO:teuthology.orchestra.run.smithi142.stderr: 2024-04-24T01:29:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:real 0m1.021s 2024-04-24T01:29:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:user 0m1.158s 2024-04-24T01:29:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m0.077s 2024-04-24T01:29:06.140 INFO:teuthology.orchestra.run.smithi169.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T01:29:06.144 INFO:teuthology.orchestra.run.smithi169.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T01:29:06.146 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-24T01:29:06.146 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m1.116s 2024-04-24T01:29:06.146 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m3.293s 2024-04-24T01:29:06.146 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.203s 2024-04-24T01:29:06.146 INFO:tasks.ceph:Archiving logs... 2024-04-24T01:29:06.146 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi142/log 2024-04-24T01:29:06.147 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T01:29:06.385 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi169/log 2024-04-24T01:29:06.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T01:29:06.970 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T01:29:06.980 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T01:29:06.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T01:29:06.983 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T01:29:07.055 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T01:29:07.064 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T01:29:07.064 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:29:07.067 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:29:07.079 INFO:teuthology.orchestra.run.smithi142.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:29:07.080 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:^- hv01.front.sepia.ceph.com 2 6 377 44 +1626us[+1626us] +/- 571ms 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 44 -440us[ -425us] +/- 79ms 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 +572us[ +572us] +/- 91ms 2024-04-24T01:29:07.083 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:^- hv01.front.sepia.ceph.com 2 6 377 44 +1584us[+1611us] +/- 571ms 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv02.front.sepia.ceph.com 3 6 377 41 -466us[ -439us] +/- 79ms 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +534us[ +560us] +/- 91ms 2024-04-24T01:29:07.085 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:29:07.085 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T01:29:07.094 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T01:29:07.095 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T01:29:07.103 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T01:29:07.182 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T01:29:07.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:29:07.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:29:07.264 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:29:07.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:29:07.291 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T01:29:07.300 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T01:29:07.308 INFO:teuthology.task.internal:Duration was 710.174244 seconds 2024-04-24T01:29:07.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T01:29:07.317 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T01:29:07.317 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T01:29:07.319 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T01:29:07.353 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:29:07.367 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:29:07.691 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T01:29:07.691 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2024-04-24T01:29:07.691 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T01:29:07.751 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-04-24T01:29:07.751 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T01:29:07.784 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T01:29:07.784 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T01:29:07.793 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T01:29:07.848 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T01:29:07.848 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T01:29:07.857 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T01:29:07.981 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T01:29:07.993 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T01:29:07.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T01:29:08.016 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T01:29:08.040 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T01:29:08.052 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:29:08.059 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:29:08.079 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2024-04-24T01:29:08.102 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-04-24T01:29:08.140 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:29:08.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:29:08.164 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T01:29:08.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:29:08.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T01:29:08.204 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T01:29:08.204 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi142 2024-04-24T01:29:08.205 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T01:29:08.236 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:40:02-rgw-squid-distro-default-smithi/7670589/remote/smithi169 2024-04-24T01:29:08.236 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T01:29:08.267 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T01:29:08.267 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T01:29:08.273 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T01:29:08.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T01:29:08.328 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T01:29:08.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T01:29:08.338 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T01:29:08.338 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T01:29:08.341 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T01:29:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 01:29 /home/ubuntu/cephtest 2024-04-24T01:29:08.371 INFO:teuthology.orchestra.run.smithi169.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 01:29 /home/ubuntu/cephtest 2024-04-24T01:29:08.372 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T01:29:08.382 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T01:29:08.404 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 710.1742436885834 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-24T01:29:08.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T01:29:08.481 INFO:teuthology.run:pass